Análise de fatores associados ao desempenho dos participantes do ENEM 2018 utilizando o sparklyr

Abstract

The National High School Exam (ENEM) was created in 1988 with the purpose of evaluating the performance of high school graduates. The ENEM has become the largest Brazilian national exam using innovations in the registration process, in which it enabled a growing demand for registrations and the attendance of new test sites with realization throughout Brazil. This paper seeks to present the factors associated with the performance of all participants in ENEM 2018 through multiple correspondence analysis, presenting new ways to apply these methods together with the Spark framework. The database consists of 137 variables distributed in different aspects, such as educational aspects and socioeconomic factors of those enrolled. By preprocessing the data, using the Spark framework and the spaklyr package in R, control characteristics of the participant, school, tests and socioeconomic questionnaire were selected. The use of Spark Apache was necessary in the data preprocessing (Big Data) step. Correspondence analysis is one of the multivariate statistical techniques used for the study of categorical data that makes it possible to graphically evaluate the associations of these variables. The results of the descriptive and exploratory analysis of the data show that the participants from the states of the South and Southeast regions presented better scores compared to the participants from other states and regions. There is a contrast in education and consequently in the performance of participants in states that are farther from the economic center of Brazil. The results found in the analysis of multiple correspondence indicate that there is an association between the control variables of the participant, school, socioeconomic questionnaire and performance in objective and discursive tests. This relationship between socioeconomic aspects and the performance of enem 2018 participants is a situation that evidences a social, economic and cultural inequality that Brazil still faces and that influences other aspects, one of which is education.