Estimation of the Proportion of Underachieving Students in Compulsory Secondary Education in Spain: An Application of the Rasch Model

There are very few studies in Spain that treat underachievement rigorously, and those that do are typically related to gifted students. The present study examined the proportion of underachieving students using the Rasch measurement model. A sample of 643 first-year high school students (mean age = 12.09; SD = 0.47) from 8 schools in the province of Alicante (Spain) completed the Battery of Differential and General Skills (Badyg), and these students' General Points Average (GPAs) were recovered by teachers. Dichotomous and Partial credit Rasch models were performed. After adjusting the measurement instruments, the individual underachievement index provided a total sample of 181 underachieving students, or 28.14% of the total sample across the ability levels. This study confirms that the Rasch measurement model can accurately estimate the construct validity of both the intelligence test and the academic grades for the calculation of underachieving students. Furthermore, the present study constitutes a pioneer framework for the estimation of the prevalence of underachievement in Spain.

Introduction

The concept of underachievement has been widely studied in the educational field in the last 50 years, showing a clear impact in high education studies and in professional careers (Conklin, 1940; Shaw and McCuen, 1960; Gurman, 1970; Delisle and Berger, 1990; Rimm, 1997; Smith, 2005; McCoach and Del Siegle, 2011). In the scientific literature, there is a general agreement that underachievement is the discrepancy between what can be expected and what is actually achieved (Phillipson, 2008). However, it is important to note that there is not a unique and accepted definition, due to conceptual problems mainly related to the arbitrary operationalization of the discrepancy between ability and achievement (Ziegler et al., 2012). This fact has resulted in a diversification of studies that can include from students with emotional and behavior disorders (Lane et al., 2002) to students with learning disabilities (Fletcher et al., 2005).

Including or not these kind of diversifications, the consequences of being underachieving could imply insufficient support (Ziegler et al., 2012), low academic self-perceptions (Matthews and McBee, 2007) or low goal-valuation (McCoach and Siegle, 2003; Baslanti and McCoach, 2006), among other negative processes (McCall et al., 2000).

In Spain, the percentage of school failure or dropout (those students who leave the educational system) during the course of 2012–2013 was 23.5% (Eurostat, 2014), which is double of the percentage in the European Union, 11.9% for the same period. Some communities in Spain even reached 29.8 %. This considerable percentage of students that leads to school failure could be related to underachievement.

The estimation of the percentage of underachieving students can vary, depending on some aspects such as the operational underachievement definition or the socio-cultural context of students involved. For example, Rimm (1987) made an estimation of 50% of students with low achievement and high potential in Elementary Secondary Education, whereas Colangelo et al. (2004) made a lower estimate of 10% in a sample of high school students. In China, Phillipson (2008) calculated an empirical percentage of underachieving students that moved from 10% in the 50–59 capacity percentile bands (measured by a frequency distribution of the difference between ability and potential), to 32% in the higher 95 percentile bands in Primary Education. In Secondary Education, the percentage of underachieving students reached 53% in those whose capacity was in the higher bands. This implies that, with increasing capacity, the percentage of underachieving students is considerably higher, and this is more visible in Secondary Education.

There are hardly any studies in Spain that treat underachievement rigorously, and they are usually related to gifted students. One of the most important studies was developed in Madrid by García-Alcañiz (1991), where the percentage of gifted students with school failure was 30%, similar to normal population. Jiménez and Álvarez's (1997) confirmed the same percentage of students with high IQ and low achievement during the first school years. Broc (2010) treated underachievement in the context of school failure and absenteeism, and formulated a theoretical model regarding the reasons for low academic achievement in students with high potential levels.

With respect to the operational definition of underachievement, the discrepancy between the potential ability and the academic achievement is, in some cases, restricted to gifted students, as happens frequently in the United States (Reis and McCoach, 2000; Siegle et al., 2006), whereas the studies from China are opened to all of the ability ranges (Phillipson, 2008, 2010). The second perspective could suppose a more adequate and individualized response to all students.

From a methodological perspective, some questions have been raised about the adequacy of different identification methods proposed in the studies. Traditionally, there have been three statistical methods: the absolute split method, the simple difference method and the regression method (Plewis, 1991; Lau and Chan, 2001). According to Phillipson (2008), leaving aside arguments against the arbitrary use of cut-scores such as top 25% and standard deviations of 1, all three methods are highly dependent on sample parameters such as the means and standard deviations. This assertion implies that the use of statistical parameters such as the means and standard deviations would be inaccurate whether we want to evaluate individual comparisons.

The more recent method is based on the application of the Rasch model (Phillipson and Tse, 2007; Phillipson, 2008). This method is most well-known among item response theories (Rasch, 1960/1980; Wright and Stone, 1979), representing the variability of a construct based on the calibration of ordinal data from a shared measurement scale. The Rasch model establishes that the difficulty of the items and the ability of the subjects can be measured on the same scale and that the likelihood that a subject responds correctly to an item is based on the difference between the ability of the subject and the difficulty of the item. Both measures (ability and difficulty) are estimated using logit units because the scale used by the model is logarithmic. Using the same measurement scale establishes homogenous intervals, which means that the same difference between the difficulty parameter of an item and the ability of a subject involves the same probability of success along the entire scale (Preece, 2010).

While many statistical models try to fit the model to the data, the opposite occurs in the Rasch measurement model. That is, the data must fit the model to be accepted (Bond and Fox, 2001), as the model provides detailed information about the interaction between persons and items. This adjustment can be conducted using residual measures, i.e., the difference between a subject's response to a given item and the expected response calculated by the model. The adjustment measures can be standardized for a particular item or subject in two ways (Bond and Fox, 2007). On one side is Outfit, which is the root mean square of the residuals, divided by the degrees of freedom. This measure can be interpreted as an overall measure that expresses whether the answers given to a particular item will fit the model. On the other side is Infit, a measure that eliminates the extreme scores that influence the Outfit by using the residuals of individuals whose ability levels are in the closest range to a particular item.

Statistical Infit and Outfit are calculated based on root mean squares, depending on the statistical value of Pearson's chi-squared divided by the degrees of freedom, thus forming a scale with values that can range from 0 to infinity. Values below 1 indicate a higher than expected fit of the model, while values greater than 1 indicate a poor fit of the model. If we have an Infit value of 1.40, then we can assert that there is 40% more data variability compared to the model's prediction. An Outfit of 0.80 indicates that 20% less data variability is observed with respect to the model's prediction.

Phillipson (2008) performed the calculation of Chinese underachieving in mathematics by scaling the responses to both the Raven Progressive Matrices (RPM) and the Hong Kong Attainment Test (HKAT). The main purpose of this study is to develop a psychometric model for the detection of underachievement, based on the use of academic grades under the construct comparability approach (Coe, 2008). In this sense, we propose a calculation of general underachievement by scaling the responses to both the Battery of Differential and General Skills (Badyg) and General Points Average (GPAs).

In Spain, the educational evaluation processes undertaken by teachers in schools are based on conducting non-standardized written tests and the assessment of attitudinal variables, (e. g., quality of the participation in the proposed activities) observed in the classroom. Thus, the application of the evaluation criteria leads to a total grade for each of the courses which the student is enrolled. Therefore, the use of academic grades are quite important, as schools continue to evaluate skills through other traditional methods and/or measurement instruments, such as written exams, oral exams, group work, etc., that are based on the evaluation criteria of regional regulations.

On the other hand, there are a significant number of studies on academic performance that have used the results of studies at the international level, such as the Trends in International Mathematics and Science Study (TIMSS) and especially the Program for International Student Assessment (PISA) by using standardized tests (Ruiz de Miguel, 2009; Calero et al., 2010; Ferrera et al., 2012). However, these tests do not evaluate curricular content but instead mastery and the understanding of problems and concepts, in addition to the ability to adapt to different situation. As such they are conceptually different from the evaluative approach in use in schools (Anagnostopoulou et al., 2013; Cordero et al., 2013). At this point, although academic grades and test performance have to be seen as complementary (Marrero and Espino, 1988), it is possible (especially in Spain) that academic grades emerge as the most valid values of a student's current level of achievement because they evaluate academic contents within a classroom environment (Marzano, 2000; McCoach and Del Siegle, 2011).

The analyses of the conceptual and methodological processes in comparing school grades have been studied extensively in the last quarter of the twentieth century, especially in the United Kingdom (Forrest and Vickerman, 1982; Fitz-Gibbon et al., 1994; Goldstein and Cresswell, 1996; Goldstein and Thomas, 1996). Furthermore, in most recent years, a new conceptualization of the term comparison has emerged, named the construct comparability approach (Coe, 2008). This model indicates that when comparing any two elements, they must have something in common to serve as the basis for this comparison. Just as two tests can be compared based on their measurements using the same scale (Muñiz, 1997), in the context of comparing academic grades, we can only compare those that measure a shared construct, which in our case is academic performance. Therefore, the premise of this approach would be as follows (Coe, 2008): Two grades from two students are comparable if the performance of both students, which corresponds to the same level of the latent construct that they share, leads to the same grade.

According to this postulate, the difficulty of a course will correspond to a specific level established in the latent variable. A course will be more difficult than another to the extent that a higher level of performance or ability is needed to achieve the same grade. If the latent construct is changed, this relationship may easily be the inverse (Coe, 2010).

The measurement of comparability would be based on using the grades from the courses as a measurement to validate the construct, which implies that they must provide good levels of content representativeness, good internal consistency, and appropriate levels of correlation between the variables that comprise the different courses. If, in studies on academic performance or other research topics, the mean grades of the courses are used to obtain the academic performance variable, then it is essential to use statistical tools to confirm their fit from the measurement standpoint.

As noted above, at this level of analysis we start with considering each of the courses as a test with specific items, with the range of grades from 1 to 10, which implies various degrees or categories of success. The partial credit model (Wright and Masters, 1982) enables an analysis of the difficulty of achieving a specific score for each of the courses separately, following the Rasch methodology with polytomous data. Moreover, Rasch models for dichotomous data, such as the Badyg, are based on items that are scored as either correct or incorrect.

At this point, it becomes necessary to test the extent to which students can be identified as underachieving and non-underachieving by using measures in the same metric scale. Therefore, the present study will describe an estimation of the proportion of underachieving Spanish students in the first course of compulsory secondary education. Rasch measurement method will ensure an estimation of the construct validity of both the intelligence test and the academic grades.

Methods

Participants

Random cluster sampling was used, using the school as the sampling unit, taking into account geographical areas of the province of Alicante. A total of 8 schools in the province of Alicante were included; 2 schools were private, while the rest were public. A total of 643 students in the first year of Compulsory Secondary Education (Educación Secundaria Obligatoria—E.S.O.) participated in the study. Twenty nine students (4.31%) were excluded from the final sample due to having an insufficient command of the language, because they had special educational needs, or because they did not have parental consent. Fifty one percent of the students were male, and 49% were female, with an average age of 12.09 years and a standard deviation of 0.47. Five hundred twenty three participants (81.4%) were enrolled in a public school, while 120 (18.6%) were enrolled in a private school. Overall student in each class in each school took part in the study. Because of the racial and ethnic homogeneity of the country, the majority of children were Caucasian (98%). Childhood socioeconomic status (SES) was indexed according to parental occupation. There was a wide range of socioeconomic status with a predominance of middle class children. This classification was based on the level of incomes and the level of studies of the families. The regional education counselors determined SES through a questionnaire registered with the responses of the students. The variable used were: parents' professions, professional situation and level of studies, number of books at home, cultural and sporting activities, and availability of technological means at home.

Chi-square test was used to determine whether there were differences between the gender of the sample (51.2% boys and 48.8% girls) and the gender of the national student population (51.3% boys and 48.7% girls), supporting the absence of gender differences between sample and population (χ² = 0.29, df = 1, p > 0.05).

In the sample, the percentage of students who assist to public schools (81.4%) was slightly higher than the percentage who assist to private schools (18.6%) in the population, which was 76 and 24% respectively (χ² = 4.1, df = 1, p > 0.01); although there were no differences in the private/public school ratio (χ² = 2.67, df = 1, p > 0.05).

So, in general terms, the sample studies was representative of the national general population of first grade Compulsory Secondary Education students.

Measures

For the analysis of academic performance, numerical GPAs from 9 mandatory courses, which the faculty provided at the end of the school year, were considered. The courses recorded were Spanish Language and Literature, Natural Sciences, Valencian Language, Social Sciences, Mathematics, English, Technology, Art Education, and Physical Education. Student scores showed high reliability, with a Cronbach's alpha of 0.93. Students' scholar ability was estimated using the Battery of Differential and General Skills (Yuste et al., 2005) or Badyg. This Spanish battery measures the capacities and academic abilities of students. There are six subscales: Analogies (A), Series (S), Matrices (M), Complete (C), Problems (P), and Figures fit (E). Each subscale is measured with 32 items with five response options and only one option is correct, producing a total of 192 items. For this study, Cronbach's alpha values for each subscale were 0.83, 0.89, 0.79, 0.83, 0.77, and 0.87 respectively. Furthermore, a general intelligence quotient (IQ) could be obtained based on the punctuations from the distinct differential skills. The Cronbach's alpha of the total IQ was 0.83.

Procedure

Prior to data collection, the necessary permission was requested from the educational administration and school boards of the various schools. After obtaining these permissions, the parents or legal guardians of the students had to provide the corresponding informed consent. Data collection was performed in the schools themselves during the second trimester of the school year and during normal school hours. The data were collected by collaborating researchers previously trained in the standards and guidelines for data collection.

Data Analysis

For this study, punctuations from Badyg and school grades were analyzed using Winsteps version 3.81 statistical software (Linacre, 2011), whose estimates were based on the joint maximum likelihood (Bond, 2003; Linacre, 2012).

From the maximum likelihood procedure, it is possible to obtain a value for the difficulty of a certain item that best explains the pattern of recorded performance. Similarly, one can obtain a value for the ability of each individual depending on the pattern of the indices of difficulty. This process is repeated continuously using the most recent estimates of skill and difficulty until the estimate converges.

Once fit indices from both measures have been observed, the Rasch model allows for the testing of the hypothesis that two tests measure the same underlying construct (Bond and Fox, 2001, 2007). This comparison is tested by elaborating a scatter plot of students' Rasch responses to both tests and to observe whether the points lie between 95% confidence bands (Phillipson, 2008). Those points outside the 95% confidence bands indicate that the achievement level is not what is expected.

Results

Taking into account that school grades do not constitute a validated test, a deeper analysis of the fit of the courses has been conducted, based on the inter-subject comparability approach (Tasmanian Qualification Authority, 2006, 2007; Coe, 2008; Korobko et al., 2008). Table 1 shows the courses analyzed, the indices of fit, and the item-scale correlation. The statistics for fit are very important when deciding whether the items follow the proposed Rasch model. However, the interpretation of these cases is often complex due to the absence of unanimity in setting minimum thresholds (Smith et al., 1998). In our case, we used an approximate range of 0.8–1.2 for Infit and Outfit (Bond and Fox, 2007, pp. 243), in addition to the observation of each of the item characteristic curves (ICCs). Table 1 shows a lack of fit in a number of courses (Spanish Language and Literature, Natural Sciences, Valencian Language, and Physical Education), which assumes a lack of fit for the subjects' pattern of responses with respect to the model. Furthermore, in the ICCs of most of these items, the highest response probabilities are exceeded by adjacent categories, especially the lowest categories. The latter also have a fairly low number of subjects. Therefore, this situation implies that the pattern of responses does not adequately fit the model and that the reconversion of the performance categories for all courses may be appropriate.

TABLE 1

Table 1. Statistics of fit for the courses in the first and second grades in ESO.

Based on the qualitative scores of Spanish schools, recoding was performed using the following values: 1 for categories 1, 2, 3, and 4 (“poor”); 2 for categories 5 and 6 (“sufficient” and “good”); 3 for categories 7 and 8 (“notable”); and 4 for categories 9 and 10 (“outstanding”).

The new calibration of the courses provided a good fit for the data (Table 2), except for physical education (Infit = 1.43; Outfit = 1.52). The analysis of Differential Item Functioning (DIF) estimated the distribution of the difficulty parameter in the sample of boys and girls. The results show that the course Visual Arts Education is easier for girls and that the difference is statistically significant (Mantel χ² = 23.518; p = 0.000). The differences found in Valencian Language, mathematics, social sciences, and natural sciences were not statistically significant, with p > 0.001. Therefore, both Physical Education and Visual Arts Education were eliminated to estimate the new model.

TABLE 2

Table 2. Indices of fit for first year of ESO with recoded values.

For the analysis of unidimensionality, a principal component analysis of the residual scores was conducted (Linacre, 1998). The results showed a principal factor that was able to explain 69.3% of the variance of the latent trait, with a wide difference between the weight of the first factor and the next (Eigenvalue = 1.4), which favors the unidimensionality of the model.

Although not shown, each of the Badyg blocks was analyzed separately. The item analyses for the Badyg demonstrate that all items except for items 1M, 11M, 7M, 2E, 13E, 29E, 2P, 8P, and 29S have an Infit Mean SQ between 0.80 and 1.20, indicating that the majority of items fitted the model satisfactorily. As regards person fit, the majority of Infit and Outfit Mean SQ values of persons are within values of 1.3. Approximately 95% of students fit the Rasch model (Bond and Fox, 2001, pp. 176–177; Phillipson and Tse, 2007).

Table 3 shows the summary of the item and person estimates for the Badyg and school grades. For the Badyg, the mean logit of the items is 0.00, and the majority of the items are within a SD of 1.22. The reliability of the estimate, similar to Cronbach's alpha, is 0.99, which indicates that Badyg is a useful test. Infit and Outfit Mean have values close to 1, demonstrating that the data fits the Rasch model very well. The mean person ability estimate has a value of −4.44 (SD = 0.75), meaning that these students find the Badyg more difficult, as expected. The reliability of the estimate has a strong value of 0.95, and the values of Infit and Outfit Mean are close to 1.

TABLE 3

Table 3. Summary of item and person estimates from Badyg and school grades.

For the School grades, the mean (and SD) logit for items is 0.00 (0.27), showing that grades are not widespread in the interval scale. The reliability of the estimate is very high, with a value of 0.99. Infit and Outfit Mean (and SD) have values close to 1, which implies a good fit of the data. The mean (and SD) of the person estimate from the school grades are (1.05 and 1.33). In this case, students find the majority of the courses easy.

After adjusting the school grade scores and Badyg scores to be aligned with mean 0 and SD 1, the scatterplot of person logit school grades scores and person logit Badyg scores was produced (Figure 1), using the 95% confidence bands (Bond and Fox, 2001, p. 57). Points within the bands include students with normal achievement. Points below the lower band represent students whose school grades are significantly lower than expected by their Badyg score. Finally, points above the upper band represent students whose school grades are significantly higher than expected by their Badyg score.

FIGURE 1

Figure 1. Person logit school grades scores and person logit Badyg scores, with 9.5% confidence bands.

The individual underachievement index, based on the significant differences between GPA and Badyg, provides the exact number of underachieving students, 181 or 28.14% of the total sample of 643 students across the ability levels. From the total of underachieving students, 29 were enrolled in private school (16.02%), whereas 152 students were enrolled in public school (83.98%). The analysis of the differences between these percentages of underachieving students identified in public and private schools showed that these differences were statistically significant (χ² = 17.13, df = 1, p = 0.00). With respect to gender differences between underachieving and non-underachieving students, these was also statistically significant (χ² = 6.24, df = 1, p = 0.012). A higher percentage of boys (33.4%) was detected as underachieving in comparison with girls (24.4%), whereas the opposite occurs in the non-underachievement group (66.6% boys and 75.6 girls).

Discussion

The present study describes an estimation of the proportion of underachieving Spanish students in the first course of compulsory secondary education. In light of the results, we may assert that the proportion of underachieving students found in the sample with the Rasch method is relatively high, with a value of 181, or 28.14% of the total sample. Moreover, important gender differences are observed between non-underachieving and underachieving students with the total sample. A higher proportion of boys are identified as underachieving in comparison with girls. These results with the Rasch method is consistent with previous results using other methods of measuring underachievement (Gibbs et al., 2008).

This percentage is similar to those found previously in Spain. Jiménez and Álvarez's (1997) confirmed the presence of students with high IQ and low achievement since the first school years, showing a percentage of 30%. It seems that the percentage of Spanish underachieving students is relatively higher than in other countries. Colangelo et al. (2004) considered that the percentage of underachieving students in the United States is near 10%. In China, Phillipson (2008) found close to 12% of underachieving students in a large sample in the normal capacity band. The use of the Rasch method in our study estimates more students as underachieving's, in comparison with the traditional methods employed by Lau and Chan (2001). This fact could be related to that this model does not establish an arbitrary cut-off for the selection, and use a logarithmic scale in where both measures are fitted and adjusted.

With respect to the high number of underachieving students, it is important to consider the contextual factors in the present study. Firstly, it seems that underachievement changes from more general to more subject-specific areas at the end of elementary school (McCall et al., 2000). Secondly, some evidence from the United States highlights the importance of the change to secondary education (Eccles and Roeser, 2011). In this sense, it is possible that this level of underachieving is affected by this transition of Primary to Secondary Education, given that the sample employed corresponds to the first year of the Compulsory Secondary Education. The start of the Secondary Education constitutes a new educational stage in Spain with some important changes, such as the change of school. This implies that this transition is normally related to a difficult process in our educational context (Pérez and Castejón, 2008) as happens in other educational systems (Eccles and Roeser, 2011). It is possible that underachievement declines as students adjust to this transition, which can be analyzed in future studies by including students from higher levels of Secondary Education.

Some points must be addressed in the present study, as they can affect the levels of detection of underachievement. First, we referred to a global underachievement instead of an underachievement index in a specific area, which implies a major probability of obtaining a higher number of underachieving students. Second, and according to previous studies (Phillipson and Tse, 2007), the number of underachieving students can vary depending on the method employed. In the present study, the Rasch method is used as enhanced objective and non-sample dependent measures when comparing the degree of agreement between two tests (Bond and Fox, 2007). Therefore, it is possible to know the lack of concordance between these two tests (Phillipson, 2008), in this case Badyg and GPA, when exploring the underachievement patterns at the individual level.

The analysis of GPA through the partial credit model confirmed the possibility of comparison, based on the construct comparability approach (Newton, 2005; Coe, 2008). It was necessary to reduce the number of categories for all courses and eliminate the Physical Education course to obtain adequate levels of fit (Wright and Masters, 1981; Wright, 1984; Wright et al., 1994) and the Arts and Visual Education course because it had a significant DIF. The courses analyzed together aim at measuring overall academic performance, showing optimal values of factor loadings in the principal component analysis, and confirming the unidimensionality of the construct. As shown, the partial credit model performs a calculation of the difficulty indices for each course that allow us to know the ability level required by the subject to achieve a certain grade. This model has been widely used in education because it is a highly effective analysis tool (Bond, 2003).

For a more objective measure of the courses, it would be advisable to reduce the number of grades for evaluation, especially in the lowest categories. In the present study, we found that in all high schools analyzed, the grades 1, 2, and 3 are assigned to a very low proportion in all courses. In addition, a wider range of grades leads to a more heterogeneous distribution of evaluation criteria than the standards indicate. In this regard, schools in countries such as the United Kingdom use small grade ranges (Department for Education, 2013).

In addition, some limitations may need to be addressed in the future. Firstly, existence of cultural factors must be added in future studies (Reis and McCoach, 2000). Statistical differences have been detected in the number of underachieving students attending private school with those who attend the public school. Therefore, it is necessary to develop studies in Spain that are focused on estimating the percentages of underachieving students with a larger sample and in our socio-cultural context. Furthermore, it would be interesting to compare different identification methods in order to obtain more reliable percentages of underachieving students. Secondly, it would be necessary to employ achievement tests in future studies in order to contrast the quality of the use of grades in Spanish schools when detecting underachieving, and more specifically, in public and private schools.

Another important point is that this study focuses on students of all intelligence levels, not only on gifted students. Therefore, the heterogeneity level could be higher (Reis and McCoach, 2000; Siegle and McCoach, 2005; Phillipson and Tse, 2007). Different aspects such as educational level, gender, and other individual aspects can introduce characteristic patterns associated with different subpopulations. In future studies, it is necessary to employ methodological processes that can detect this heterogeneity (Madigson and Vermunt, 2002; Lubke and Munthén, 2005) and to establish whether underachievings' subgroups exist across the ability levels. In this line, Reis and McCoach (2000) describe six different types of underachievings: Anxious Underachievings, Wheeler-dealer Underachievings, Coasting Underachievings, Defiant Underachievings, Identity Search Underachievings, and Sad or Depressed Underachievings. In more recent studies, Snyder and Linnenbrink-García (2013) propose that there are multiple developmental trajectories in underachievement, and Ritchotte et al. (2014) find two types of underachieving students: students having less positive attitudes toward their self-efficacy, the meaningfulness of tasks, their school environment and their self-regulation skills, and on the other hand students having more positive attitudes toward these constructs.

The present study constitutes a pioneer analysis for the estimation of the prevalence of underachievement in Spain. These results could be useful to educational orientation and the instructional interventions performed by teachers, as they have already done in other countries (McCall et al., 2000). In these situations, once the Rasch method provides individual detections of underachievement, the education professionals could help the student value his/her academic goals and learning strategies (Chan, 1999; McCoach and Siegle, 2003; Obergriesser and Stoeger, 2015), get self-regulated strategies (Reis and Greene, 2014), develop positive attitudes toward school and teachers, and adequate and enhance self-concept. Furthermore, to obtain a deeper educational treatment, it is necessary to introduce differential variables among groups (underachieving, normal-achieving and overachieving), such as learning strategies, self-concept, parent involvement and social acceptance among peers, apart from motivational and attitudinal variables. Baker et al. (1998) suggest that, especially in adolescents, the confluence of all of these variables is what explained most of the underachievement.

Author Contributions

AV Theoretical review of the topic. Rasch Analysis of the measures. Differential item functioning of each test. RG Theoretical review of the topic. Review of the references. PM Theoretical review of the topic. JC Quantitative methods. Analysis of the sample. Reliability of the instruments.

Funding

The present work was supported by the Spanish Ministry of Economy and Competitiveness (Award number: EDU2012-32156) and the Vice Chancellor for Research of the University of Alicante (Award number: GRE11-15). The corresponding author is funded by the Spanish Ministry of Economy and Competitiveness (Reference of the grant: BES-2013-064331).

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

References

Anagnostopoulou, K., Hatzinikita, V., Christidou, V., and Dimopoulos, K. (2013). PISA test ítems and school-based examination in Greece: exploring the relationship between global and local assessment discourses. Int. J. Sci. Educ. 35, 636–662. doi: 10.1080/09500693.2011.604801

CrossRef Full Text | Google Scholar

Baker, J., Bridger, R., and Evans, K. (1998). Models of underachievement among gifted preadolescents: the role of personal, family, and school factors. Gifted Child Q. 42, 5–15. doi: 10.1177/001698629804200102

CrossRef Full Text | Google Scholar

Baslanti, U., and McCoach, D. B. (2006). Gifted underachievers and factors affecting underachievement. Roeper Rev. 28, 210–215. doi: 10.1080/02783190609554366

CrossRef Full Text

Bond, T. (2003). Validity and assessment: a rasch measurement perspective. Metodología de las Ciencias del Comportamiento 5, 179–194.

Google Scholar

Bond, T., and Fox, C. M. (2007). Applying the Rasch Model: Fundamental Measurement in the Human Sciences. New York, NY: Psychology Press.

Google Scholar

Bond, T. G., and Fox, C. M. (2001). Applying the Rasch Model: Fundamental Measurement in the Human Science. Mahwah, NJ: Erlbaum Associates.

Google Scholar

Broc, M. A. (2010). Un estudio de Meta-Análisis Sobre las Causas del Absentismo Escolar y Propuestas de Prevención e Intervención Para la Educación Primaria y Secundaria Obligatoria. Memoria de Investigació [A Meta-Analysis About the Causes of School Absenteeism and Intervention Proposals for Primary and Secondary Education. Research Report]. Zaragoza: Departamento de Educación, Cultura y Deporte del Gobierno de Aragón.

Calero, J., Choi, Á., and Waisgrais, S. (2010). Determinantes del riesgo de fracaso escolar en españa: Una aproximación a través de un análisis logístico multinivel aplicado a PISA. [Determinants for the risk of school failure in Spain: an approach using a multilevel logistic analysis applied to PISA.] Rev. Educ. 225–256.

Google Scholar

Chan, D. (1999). Reversing underachievement: can we tap unfulfilled talents in Hong Kong? Educ. Res. J. 14, 177–190.

Google Scholar

Coe, R. (2008). Comparability of GCSE examinations in different subjects: an application of the Rasch model. Oxford Rev. Educ. 34, 609–636. doi: 10.1080/03054980801970312

CrossRef Full Text | Google Scholar

Coe, R. (2010). Understanding comparability of examination standards. Res. Papers Educ. 25, 271–284. doi: 10.1080/02671522.2010.498143

CrossRef Full Text | Google Scholar

Colangelo, N., Kerr, B., Christensen, P., and Maxey, J. (2004). “A comparison of gifted underachievers and gifted high achievers,” in Social/Emotional Issues, Underachievement, and Counseling of Gifted and Talented Students, ed S. Moon (Thousand Oaks, CA: Corwin Press), 119–132.

Conklin, A. M. (1940). Failure of Highly Intelligence Pupils: A Study of their Behavior. New York, NY: Teachers College, Columbia University.

Cordero, J. M., Crespo, E., and Pedraja, F. (2013). Rendimiento educativo y determinantes según PISA: una revisión de la literatura en España [Educational performance and determinants according to PISA: a review of literatura in Spain]. Rev. Educ. 362, 273–297. doi: 10.4438/1988-592X-RE-2011-362-161

CrossRef Full Text | Google Scholar

Delisle, J. R., and Berger, S. L. (1990). Underachieving gifted students. (ERIC Document Reproduction Service No. ED 321483). Retrieved from http://www.kidsource.com/kidsource/content/underachieving_gifted.html

Department for Education (2013). National Curriculum and Assessment: Information for Schools. Curriculum and Qualifications and Schools, Colleges and Children's Services. Government of the UK. Available online at: https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/358070/NC_assessment_quals_factsheet_Sept_update.pdf

Eccles, J. S., and Roeser, R. W. (2011). Schools as developmental context during adolescence. J. Res. Adol. 21, 225–241. doi: 10.1111/j.1532-7795.2010.00725.x

CrossRef Full Text | Google Scholar

Eurostat (2014). Being Young in Europe Today. Available online at: http://ec.europa.eu/eurostat/statistics-explained/index.php/Being_young_in_Europe_today_-_education

Ferrera, J. M. C., López, C. M., and Rodríguez, R. S. (2012). Análisis de los condicionantes del rendimiento educativo de los alumnos españoles en PISA 2009 mediante técnicas multinivel. [Analysis of the constraints of educational performance of Spanish students in PISA 2009 using multilevel techniques]. Presupuesto Gasto Público 67, 71–96.

Fitz-Gibbon, C. T., Vincent, L., and Britain, G. (1994). Candidates' Performance in Public Examinations in Mathematics and Science. London: School Curriculum and Assessment Authority.

Google Scholar

Fletcher, J. M., Denton, C., and Francis, D. J. (2005). Validity of alternative approaches for the identification of learning desabilities: operationalizing unexpected underachievement. J. Learn. Disabil. 38, 545–552. doi: 10.1177/00222194050380061101

PubMed Abstract | CrossRef Full Text | Google Scholar

Forrest, G. M., and Vickerman, C. (1982). Standards in GCE: Subject Pairs Comparisons, 1972-80, Occasional Publication 39. Manchester: Joint Matriculation Board.

García-Alcañiz, E. (1991). Diferencias Intelectuales y de Rendimiento Académico Entre Chicos-Chicas Bien Dotados y la Media [Intellectual and Achievement Differences Among Gifted Boys-Girls and the Average Population]. Madrid: I Congreso Internacional de Psicología y Educación.

Gibbs, S. J., Fergusson, D. M., and Hornwood, L. J. (2008). Gender differences in educational achievement to age 25. Aus. J. Educ. 52, 63–80. doi: 10.1177/000494410805200105

CrossRef Full Text

Goldstein, H., and Cresswell, M. (1996). The comparability of different subjects in public examinations: a theoretical and practical critique. Oxford Rev. Educ. 22, 435–442. doi: 10.1080/0305498960220404

CrossRef Full Text | Google Scholar

Goldstein, H., and Thomas, S. (1996). Using examination results as indicators of school and college performance. J. R. Stat. Soc. A 159, 149–163. doi: 10.2307/2983475

CrossRef Full Text | Google Scholar

Gurman, A. S. (1970). The role of the family in underachievement. J. Sch. Psychol. 8, 48–53. doi: 10.1016/0022-4405(70)90055-5

CrossRef Full Text | Google Scholar

Jiménez, C., and Álvarez, B. (1997). Alumnos de alta capacidad y rendimiento escolar insatisfactorio [High ability students and insatisfactory academic achievement]. Rev. Educ. 313, 279–295.

Korobko, O. B., Glas, C. A. W., Bosker, R. J., and Luyten, J. W. (2008). Comparing the difficulty of examination subjects with item response theory. J. Educ. Meas. 45, 139–157. doi: 10.1111/j.1745-3984.2007.00057.x

CrossRef Full Text | Google Scholar

Lane, K. L., Greshman, F. M., and O'shaughnessy, T. E. (2002). Serving students with or at-risk for emotional and behavior disorders: future challenges. Educ. Treat. Child. 25, 507.

PubMed Abstract | Google Scholar

Lau, K., and Chan, D. W. (2001). Identification of underachievers in Hong Kong: do different methods select different underachievers? Educ. Stud. 27, 187–200. doi: 10.1080/03055690120050419

CrossRef Full Text | Google Scholar

Linacre, J. (2011). WINSTEPS Rasch Measurement Computer Program [Computer Software]. Chicago, IL: Winsteps.

Linacre, J. (2012). A User's Guide to WINSTEPS & MINSTEP Rasch-Model Computer Programs. Program Manual 3.74.0. 2012. Available online at: http://www.winsteps.com/winman

Linacre, J. M. (1998). Structure in rasch residuals: why principal component analysis? Rasch Meas. Trans. 12, 636.

Lubke, G., and Munthén, B. (2005). Investigating population heterogeneity with Factor Mixture Models. Psychol. Methods 10, 21–39. doi: 10.1037/1082-989X.10.1.21

PubMed Abstract | CrossRef Full Text | Google Scholar

Madigson, J., and Vermunt, J. K. (2002). Latent class models for clustering: a comparison with K-means. Can. J. Mark. 20, 37–44.

Marrero, H., and Espino, M. (1988). Evaluación comparative del poder predictor de las aptitudes sobre notas escolares y pruebas objetivas [Comparative evaluation of the predictive power of skills on school grades and objective tests]. Rev. Educ. 287, 97–112.

Google Scholar

Marzano, R. J. (2000). Transforming Classroom Grading. Alexandria: The Association for Supervision and Curriculum Development.

Google Scholar

Matthews, M. S., and McBee, M. T. (2007). School factors and the underachievement of gifted students in a talent search summer program. Gifted Child Q. 51, 167–181. doi: 10.1177/0016986207299473

CrossRef Full Text | Google Scholar

McCall, R. B., Beach, S. R., and Lau, S. (2000). The nature and correlates of underachievement among elementary schoolchildren in Hong Kong. Child Dev. 71, 785–801. doi: 10.1111/1467-8624.00185

PubMed Abstract | CrossRef Full Text | Google Scholar

McCoach, B. D., and Del Siegle, D. (2011). “Underachievers,” in Encyclopedia of Adolescence, ed R. J. Levesque (New York, NY: Springer Science & Business Media), 3025–3032.

Google Scholar

McCoach, D. B., and Siegle, D. (2003). The structure and function of academic self-concept in gifted and general education samples. Roeper Rev. 25, 61–65. doi: 10.1080/02783190309554200

CrossRef Full Text | Google Scholar

Muñiz, J. (1997). Introducción a la Teoría de Respuesta a los Ítems. [Introduction to the Item Response Theory] Madrid: Pirámide.

Newton, P. E. (2005). Examination standards and the limits of linking. Assess. Educ. 12, 105–123. doi: 10.1080/09695940500143795

CrossRef Full Text | Google Scholar

Obergriesser, S., and Stoeger, H. (2015). The role of emotions, motivation, and learning behavior in underachievement and results of an intervention. High Abil. Stud. 26, 167–190. doi: 10.1080/13598139.2015.1043003

CrossRef Full Text | Google Scholar

Pérez, A. M., and Castejón, J. L. (2008). “Changes in cognitive-motivational factors resulting from the process of school transition,” in Handbook of Instructional Resources and their Applications in the Classroom, eds A. Valle, J. C. Núñez, R. G. Cabanach, J. A. González-Pienda, and S. Rodríguez (New York, NY: Nova Science Publishers), 223–237.

Phillipson, S. (2008). The optimal achievement model and underachievement in Hong Kong: an application of the Rasch model. Psychol. Sci. Q. 50, 147–172.

Google Scholar

Phillipson, S. (2010). Modelling parental role in academic achievement: comparing high-ability to low- and average-ability students. Tal. Dev. Excell. 2, 83–103.

Phillipson, S. N., and Tse, A. K. (2007). Discovering patterns of achievement in Hong Kong students: an application of the Rasch measurement model. High Ability Stud. 18, 173–190. doi: 10.1080/13598130701709640

CrossRef Full Text | Google Scholar

Plewis, I. (1991). Underachievement: a case of conceptual confusion. Br. Educ. Res. J. 17, 377–385. doi: 10.1080/0141192910170407

CrossRef Full Text | Google Scholar

Preece, P. (2010). Equal-interval measurement: the foundation of quantitative educational research. Res. Papers Educ. 17, 363–372. doi: 10.1080/0267152022000031397

CrossRef Full Text | Google Scholar

Rasch, G. (1960/1980). Probabilistic Models for Intelligence Attainment Test, Expanded Edn. Chicago: University of Chicago Press.

Reis, S. M., and Greene, M. J. (2014). Using Self-Regulated Learning to Reverse Underachievement in Talented Students. Available online at: http://www.gifted.uconn.edu/general/faculty/reis/Self-Regulated_Learning_Reverse_Underachievement.html

Reis, S. M., and McCoach, D. B. (2000). The underachievement of gifted students: what do we know and where do we go? Gifted Child Q. 44, 158–170. doi: 10.1177/001698620004400302

CrossRef Full Text | Google Scholar

Ritchotte, J. A., Matthews, M. S., and Flowers, C. P. (2014). The validity of the achievement-orientation model for gifted middle school students. Expl. Study Gifted Child. Q. 58, 183–198. doi: 10.1177/0016986214534890

CrossRef Full Text | Google Scholar

Rimm, S. B. (1987). Why bright children underachieve: the pressures they feel. Gifted Child Today 10, 30–36.

Google Scholar

Rimm, S. B. (1997). An underachievement epidemic. Educ. Leadersh. 54, 18–22.

Google Scholar

Ruiz de Miguel, C. (2009). Las escuelas eficaces: un estudio multinivel de factores explicativos del rendimiento escolar en el área de matemáticas. [Effective schools: a multilevel study of explanatory factors of school performance in the area of mathematics.]. Rev. Educ. 348, 355–376.

Google Scholar

Shaw, M. C., and McCuen, J. T. (1960). The reaction to frustration of bright high school underachievers. Calif. J. Educ. Res. 11, 120–125.

Google Scholar

Siegle, D., and McCoach, D. B. (2005). Motivating Gifted Students. Waco, TX: Prufrock Press.

Siegle, D., Reis, S. M., McCoach, D. B., Mann, R. L., Greene, M., and Schreiber, F. (2006). “A study to increase academic achievement among gifted underachievers,” in Poster presented at the 2006 Institute of Education Sciences Research Conference (Washington, DC).

Smith, E. (2005). Analyzing Underachievement in Schools. London: Continuum International Publication Group.

Smith, R. M., Schumacker, R. E., and Bush, M. J. (1998). Using item mean squares to evaluate fit to the Rasch model. J. Outcome Meas. 2, 66–78.

PubMed Abstract | Google Scholar

Snyder, K. E., and Linnenbrink-García, L. (2013). A developmental, person-centered approach to exploring multiple motivational pathways in gifted underachievement. Educ. Psychol. 48, 209–228. doi: 10.1080/00461520.2013.835597

CrossRef Full Text | Google Scholar

Tasmanian Qualification Authority (2006). An Introduction to Rasch Modelling and the TCE. Available online at: http://www.tqa.tas.gov.au/4DCGI/_WWW_doc/003675/RND01/Rasch_intro.pdf (Accessed 20 May 2014)

Tasmanian Qualification Authority (2007). How the Scaled Awards are Calculated and Used to Determine the Tertiary Entrance Score. Available online at: http://www.tqa.tas.gov.au/0477 (Accessed 20 May 2014).

Wright, B. D. (1984). Despair and hope for educational measurement. Contem. Educ. Rev. 3, 281–288.

Wright, B. D., Linacre, J. M., Gustafson, J., and Martin-Lof, P. (1994). Reasonable mean-square fit values. Rasch Meas. Trans. 8, 370.

Wright, B. D., and Masters, G. N. (1981). The Measurement of Knowledge and Attitude (Research Memorandum No. 30). Chicago, IL: MESA Psychometric Laboratory.

Wright, B. D., and Masters, G. N. (1982). Rating Scale Analysis Rasch Measurement. Chicago, IL: MESA Press.

Google Scholar

Wright, B. D., and Stone, M. H. (1979). Best Test Design. Chicago, IL: MESA Press.

Google Scholar

Yuste, C., Martínez, R., and Galve, J. L. (2005). Batería de Aptitudes Diferenciales y Generales. Badyg [Battery of Differential and General Skills. Badyg]. Madrid: CEPE.

Ziegler, A., Ziegler, A., and Stoeger, H. (2012). Shortcomings of the IQ-Based construct of underachievement. Roeper Rev. 34, 123–132. doi: 10.1080/02783193.2012.660726

CrossRef Full Text | Google Scholar