Part of this article's content has been mentioned in:
On the use of pseudoword reading as estimate of premorbid intelligence in brain injured, psychopathological, or cognitively impaired patients
Rocio Del Pino
Javier Peña
Naroa Ibarretxe-Bilbao
David J. Schretlen
Natalia Ojeda2*- 1Neurodegenerative Diseases Group, BioCruces Health Research Institute, Barakaldo, Spain
- 2Department of Methods and Experimental Psychology, University of Deusto, Bilbao, Spain
- 3Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, United States
The Word Accentuation Test (WAT, Spanish adaptation of the NART) and the Pseudo-Words (PW) Reading subtest from the Battery for Reading Processes Assessment-Revised (PROLEC-R) are measures to estimate premorbid IQ. This study aims to develop demographically calibrated norms for these premorbid measures in a representative sample of the adult Spanish population in terms of age, education, and sex. A sample of 700 healthy participants from 18 to 86 years old completed the WAT and the PW Reading subtest. The effect of age, years of formal education, and sex on WAT total score, PW total score, and time to complete the PW task (PW time) were analyzed. Percentiles and scalar scores were obtained for each raw score according to nine age ranges and individual education levels. The results indicated a significant effect of age and education on the premorbid performance assessed, with no significant effect of sex. Age and education explained from 1.9 to 33.2% of the variance in premorbid IQ variables. Older participants with fewer years of education obtained worse premorbid IQ estimates. This premorbid IQ estimation decline started in the 56–65 age range for WAT total score and PW time, whereas it started in the 71–75 age range for PW total score. This study reports the first demographic-calibrated norms for WAT and PW Reading subtest for Spanish-speaking population. Even though the influence of age and years of education on premorbid IQ measures was confirmed, the PW Reading subtest showed to be more resistant to decline in elderly population than the WAT.
Introduction
The neuropsychological performance assessment requires knowledge of the previous intellectual level of the person being assessed (Lezak, 2004; Alves et al., 2013). The detection of neuropsychological deficits rests upon the comparison of an individual’s current cognitive functioning with an estimate of his/her premorbid IQ (Crawford, 1992; Law and O’Carroll, 1998; McGurn et al., 2004). Estimation of premorbid function is becoming increasingly recognized as a crucial component of neuropsychological assessment in both research and clinical practice due to its relevance in the diagnosis and rehabilitation process (Law and O’Carroll, 1998; Lowe and Rogers, 2011; Vakil, 2012). It helps clinicians and researchers to accurately diagnose the level of cognitive decline in different pathologies such as schizophrenia (Gomar et al., 2011; Khandaker et al., 2011), traumatic brain injury (Freeman et al., 2001; Kesler et al., 2003), dementia (Law and O’Carroll, 1998; McFarlane et al., 2006; Hessler et al., 2013), or normal aging (Sierra et al., 2010; Lowe and Rogers, 2011). However, there is a lack of normative data on premorbid IQ measures, specifically for Spanish population. Thus, neuropsychologists have to use normative data from other populations, mainly from the Unites States or South America. Nevertheless, several studies showed that age, education, language, and culture have a significant impact on neuropsychological performance (Ardila, 2007; del Pino et al., 2015).
Regarding premorbid IQ instruments, the most common approaches for estimating premorbid IQ are: (a) demographic-based regression equations (Barona et al., 1984); (b) cognitive instruments that measure reading ability (i.e., the National Adult Reading Test-NART, Nelson, 1982), or assessing patterns of performance (i.e., the Vocabulary subtest from Wechsler Adult Intelligence Scale-Revised: WAIS-R, Wechsler, 1981); and (c) the combination of demographic-based regression equations with cognitive instruments such as reading tests (Crawford et al., 1989a).
Demographic-based regression equations which include demographic variables (i.e., age, level of formal education, or social class) are known to be related to scores on intelligence tests, and could yield information on an individual’s premorbid level of intellectual functioning (Barona et al., 1984; Crawford, 1992; Bright et al., 2002). This method uses demographic data in a multiple regression equation to determine the index of premorbid IQ (Eppinger et al., 1987; Crawford et al., 1989b). One of the most widely used is the Barona index (Barona et al., 1984) which is a demographically based regression equation to estimate premorbid IQ using the WAIS-R (Wechsler, 1981). This formula displays adequate predictive validity in estimating WAIS-R Full Scale IQ (FSIQ) for individuals in the borderline and average intelligence ranges (Barona et al., 1984). Nonetheless, the Barona index may provide significant under- or overestimates in cases where premorbid IQ is above 120 or below 69 (Barona et al., 1984; Franzen et al., 1997; Griffin et al., 2002).
Another effective procedure for estimating premorbid ability relies upon cognitive instruments which measure an over learned skill such as reading or assess patterns of performance (Nelson and McKenna, 1975; Del Ser et al., 1997; Russell et al., 2000; Contador et al., 2015). Several authors have criticized the use of performance tests, such as the vocabulary subtest from the WAIS-R, to estimate the premorbid IQ; because vocabulary is known to decline with aging and is sensitive to brain damage, specifically in the neuroanatomical basis of language (Martin and Fedio, 1983; Del Ser et al., 1997; Sierra et al., 2010; Hebben et al., 2011; de Oliveira et al., 2014). However, reading ability becomes, with practice, an automatic ability that is highly resistant to cognitive impairment (Del Ser et al., 1997; Russell et al., 2000; Khandaker et al., 2011; Harman-Smith et al., 2013; Hessler et al., 2013). Hence, instruments based on reading irregular words (i.e., NART) (Nelson, 1982) or based on pseudo-words (PW) (i.e., Spot-the-Word test) (Baddeley et al., 1993) are used to estimate premorbid IQ.
More recent approaches employ multiple regression equations to predict cognitive performance using both demographic variables and cognitive instruments as predictors (Griffin et al., 2002; Harnett et al., 2004; Ball et al., 2007; Sierra Sanjurjo et al., 2015). For example, the Oklahoma Premorbid Intelligence Estimation (OPIE) estimates premorbid IQ by combining demographic variables (age, education, occupation, and race) with current performance on the WAIS-R (Vocabulary and Picture Completion subtests) (Scott et al., 1997; Griffin et al., 2002). The OPIE showed a wider range of premorbid IQ scores in which no systematic under- or over-estimation was performed compared to other available techniques (Griffin et al., 2002). However, several authors reported incremental accuracy when the NART or an oral reading test is combined with demographic information instead of using the WAIS-R; which makes this last procedure the most appropriate one (Crawford et al., 1990; Griffin et al., 2002; Harnett et al., 2004; Lezak, 2004; Ball et al., 2007; Sierra Sanjurjo et al., 2015). Therefore, it seems to be important to have normative data of oral reading test to estimate accurately the premorbid IQ.
The most popular reading test to estimate premorbid IQ is the NART which was created for English speakers. It was adapted to different languages, but it seems impossible to build a Spanish model due to the peculiarities of the language since every Spanish word is read in a regular way. English is an opaque language, with highly irregular rules for pronunciation while Spanish is a transparent language in which any written word or non-word can be read aloud generating the sounds from letters. Although Spanish accentuation is quite regular, the words that do not follow accentuation rules must be ortho-graphically stressed. However, there are exceptions; and in order to read correctly the words, the reader needs to see the written accentuation mark or have previous knowledge of the correct accentuation of the word when this mark is not present. As a result, Del Ser et al. (1997) designed the Word Accentuation Test (WAT), the Spanish adaptation of the NART, to estimate the premorbid IQ in dementia (Del Ser et al., 1997). This adaptation is based on the prosodic accentuation of infrequent Spanish words and its use has been expanded to measure premorbid functioning in patients with schizophrenia (Gomar et al., 2011), cognitive impairment and dysexecutive syndrome (Sierra et al., 2010), as well as healthy people without cognitive impairment (Sierra et al., 2010; Contador et al., 2015). Nevertheless, there is currently no normative data available for this instrument. Concerning reading PW tests, the Spot-the-Word test (Baddeley et al., 1993) was proposed as an adequate instrument to assess premorbid IQ in older adults with normal aging as well as in patients with dementia (Friedman et al., 1992; Patterson et al., 1994; McFarlane et al., 2006). However, to our knowledge, there is no Spanish version of this test. A similar test is available for the Spanish population as part of a wider battery for assessing reading processes (PROLEC-R) (Cuetos et al., 2007). Nonetheless, it was initially created for children and no norms are available for adults.
Within this framework, in order to obtain accurate and calibrated norms for potential Spanish premorbid IQ instruments, this study seeks to normalize and standardize the WAT and the PW Reading subtest from PROLEC-R in the Spanish adult population. Moreover, we also aim to analyze the relationship between these two premorbid IQ measures to explore their potential equivalency or specific characterization in the healthy population. It is expected to provide alternative methods to accurately estimate premorbid IQ which could enrich clinicians’ and researchers’ decisions based on the specifications of the population they work with.
Materials and Methods
Participants
Participants were recruited by “word of mouth” from eight different geographical locations in Spain. The final sample size was seven hundred healthy participants (age ranged from 18 to 86 years old) who were selected by taking into account the sociodemographic characteristics of the Spanish population (National Institute of Statistics [NIS], 2012) data. Inclusion criteria were as follow: (1) healthy subjects, without previous history of physical or mental illness that significantly compromises the individual’s intellectual or cognitive functioning; (2) age ranging from 18 to 90 years old; (3) Spanish mother tongue or bilingual; (4) Spanish population representative of different age ranges and educational levels (National Institute of Statistics [NIS], 2012); (5) voluntary participation; (6) signed informed consent; and (7) ≥score of 26 in the Telephone Interview for Cognitive Status (TICS) (Brandt et al., 1988). Exclusion criteria were: (1) medical history of physical or mental illness that affect their cognitive performance; (2) severe cognitive impairment; or (3) sensory limitations (visual or auditory) which cannot be adequately compensated by corrections (glasses or hearing aids).
The project was approved by the Ethics Committee at the University of Deusto, Bilbao, Spain. All subjects were volunteers and provided written informed consent prior to their participation in the study, in accordance with the Declaration of Helsinki.
Measures
The WAT assesses Spanish speakers’ premorbid IQ by reading the correct pronunciation of 30 low frequency Spanish words whose accents have been removed (González Montalvo, 1991; Del Ser et al., 1997). In this test examinees must demonstrate their knowledge of the correct accentuation of each word. Spanish words can be classified into one of four groups depending on the position of their stress. When last syllable is stressed, the word belongs to the “aguda” category. “Aguda” words need written accent when they end in a vowel or the consonants “-n” or “-s.” If the stress falls on the second to last syllable, it is classified as a “llana.” “Llanas” form the majority of the Spanish lexicon and most of them end in a vowel or the consonants “-n” or “-s.” Written accent is carried only by those “llanas” ending in a consonant different from “-n” or “-s” preceded by a vowel or ending in any two consecutive consonants. If the stress is placed on the third last or the fourth to last syllable, they are categorized as “esdrújulas” or “sobresdrújulas,” respectively. In either of the last two categories, the stressed syllable must have written accent. This knowledge cannot be inferred unless they have been previously exposed to the word. This experience is routinely acquired through education and language experience. The Spanish instructions are presented in the Supplementary Material (Supplementary Figure 1). The person is asked to read each word aloud. The words are printed on white paper in bold black capital letters (see Supplementary Figure 2). The total score is the number of words correctly read (from 0 to 30). The test is administered individually and takes 2–3 min.
The PW Reading subtest from the PROLEC-R (Cuetos et al., 2007) assesses the sub-lexical processes (phonological path) and reading fluency. The person is asked to read aloud each PW as quickly as possible. Time to complete the task and accuracy of reading PW are recorded and scored. Stimuli include 40 non-existent words (PW). Like the WAT, the total score is the number of words correctly read (from 0 to 40) and the test takes 3–4 min.
Data Analysis
Data were analyzed using the Statistical Package for the Social Science (SPSS), version 20. Sociodemographic and cognitive variables were analyzed with a Student’s t-test and a chi-squared test was used for categorical variables.
The relationship between the cognitive performance in each of the measures included (WAT total score, PW total score, and time to complete the task in PW) and the sociodemographic characteristics such as age, education, and sex were analyzed by linear regression. Coefficients of correlation (r) and determination (r2) of raw scores were determined.
Age was codified in nine ranges (18–25, 26–35, 36–45, 46–55, 56–65, 66–70, 71–75, 76–80, 81–86). The differences in cognitive performance according to these age ranges were analyzed by one-way ANOVA and post hoc Tukey’s HSD test was also analyzed.
The normative data and the standardization for the WAT total score, PW total score, and time to complete the task in PW were obtained. The normative procedure carried out was the following: (1) To ensure a normal distribution, the raw scores were assigned their corresponding percentiles (Pc) by the frequency distribution and Pc were transformed into scalar scores (SS) (from 2 to 18) for each age range (Ivnik et al., 1992; Peña-Casanova et al., 2009, 2012; Testa et al., 2009; Smerbeck et al., 2012; del Pino et al., 2015); (2) This transformation of raw scores to SS adjusted by age (SSa) produced a normalized distribution; and (3) Multiple linear regressions were analyzed in order to create the final normative data adjusted by years of education. The following equation was used (Peña-Casanova et al., 2009, 2012; del Pino et al., 2015):
Results
The sociodemographic characteristics of the total sample are shown in Table 1. The sample was composed of 305 males (mean age = 45.5, SD = 18.0; mean years of education = 13.1, SD = 5.1) and 395 females (mean age = 44.6, SD = 17.9; mean years of education = 12.7, SD = 4.8). No significant differences were found for age or years of formal education between males and females (age: t = 0.61; p = 0.54; years of education: t = 0.86; p = 0.39). However, there were statistical differences in employment status (χ2 = 48.68; p < 0.001) and in professional/working class (χ2 = 27.34; p < 0.001) in the total sample assessed. 50.4% of the sample were working at the time of the assessment; 27.3% of the sample were classified as high technical in the professional/working class while 30.7% of the sample were unskilled.
TABLE 1
TABLE 1. Sociodemographic characteristics of the sample.
The mean and standard deviations of the premorbid performance in the sample was 24.1 (SD = 4.9) for WAT total score, 36.9 (SD = 3.8) for PW total score, and 49.0 (SD = 23.2) seconds to complete the PW task. The measures were highly correlated with one another. The WAT total score correlated positively with the PW total score (r = 0.50; p < 0.001) and negatively with time in PW (r = −0.55; p < 0.001). Those results suggested that both measures (WAT and PW) evaluate similar constructs. Hence, a composite variable of WAT and PW, named premorbid intelligence (PI) composite score, was created in order to analyze the relationship between the sociodemographic characteristics and this construct. Coefficients of correlation (r) and determination (r2) are shown in Table 2. There was a significant effect of age and years of education on performance in WAT total score, in PW total score, in PW time, and in PI composite score. Nevertheless, sex was not significant. The percentage of variance explained by age and education ranged from 1.9 to 9.2% and 20.5 to 33.2%, respectively.
TABLE 2
TABLE 2. Correlation analysis between WAT total score, PW total score, time to complete the task in PW (subtest from PROLEC-R), PI composite score and demographic characteristics.
As shown in Figures 1, 2, the premorbid performance is presented graphically according to nine age ranges for the WAT total score [F(8,691) = 20.7; p < 0.001], the PW total score [F(8,688) = 22.1; p < 0.001], and time to complete the task in PW [F(8,688) = 49.2; p < 0.001]. A general pattern is observed in all the variables analyzed by post hoc Tukey’s HSD test; older people obtained worse cognitive performance than young people. Specifically, the performance started to decline in the 56–65 age range for WAT total score (p < 0.001) and time to complete the task in PW (p < 0.001), while the PW total score declined after 71 years of age (p < 0.001).
FIGURE 1
FIGURE 1. Cognitive performance of the WAT total score by age ranges.
FIGURE 2
FIGURE 2. Cognitive performance of the PW Reading subtest (total scores) and time to complete the PW task in seconds by age ranges.
Tables 3, 4 display the first step to obtain the SS adjusted by age (SSa) and the Pc of their corresponding raw scores. The second step to obtain the normalized SS (SSn), adjusted by age and years of education for the WAT total score, PW total score and time to complete the task in PW is shown in Tables 5, 6. These two tables show the years of education in the upper right and the SSa and the Pc obtained in the previous tables (see Tables 3, 4 according to the age of the participant) are in the two left columns. As an example, the interpretation procedure for a 46 year-old participant with 8 years of education that obtained a score of 26 in the WAT is the following: Step 1, Table 3 shows his/her corresponding SSa and Pc (SSa = 10; Pc = 44–56); Step 2, check Table 5 in order to obtain SSn. Years of education (8 years) appears in the upper right and the SSa and the Pc obtained previously (SSa = 10; Pc = 44–56) are now up to a SSn of 12 and a Pc of 69–79. As a result, his/her actual SSn is above the mean.
TABLE 3
TABLE 3. Scalar scores, percentiles and raw scores for the entire sample and according to age ranges (from 18 to 55 years old).
TABLE 4
TABLE 4. Scalar scores, percentiles and raw scores according to age ranges (from 56 to 86 years old).
TABLE 5
TABLE 5. Scalar scores normalized from WAT total score adjusted by age and education.
TABLE 6
TABLE 6. Scalar scores normalized from PW total scores and time to complete the PW task adjusted by age and education.
Discussion
This study provides the first demographically calibrated norms for two premorbid IQ measures with a representative sample of the Spanish population (National Institute of Statistics [NIS], 2012). The normative data for the WAT and the PW Reading subtest from the PROLEC-R are presented according to nine age ranges and individual levels of formal education.
Our results showed that demographic variables such as age and years of formal education have an impact on the premorbid performance (Del Ser et al., 1997; Harnett et al., 2004; Testa et al., 2009; Schretlen et al., 2009; Lowe and Rogers, 2011). In our study, education was a better predictor of these premorbid measures than age. Indeed, years of education explained 33.2% of the variance in the premorbid composite variable (WAT and PW total score), while age only explained 9.0% of variance in the WAT total score. Similarly, Lowe and Rogers (2011) found that the American version of the NART correlated significantly with education, but not with age. In fact, according to the cognitive reserve hypothesis, some authors found that highly educated individuals may also continue to benefit from cognitive reserve even after the diagnosis of dementia, showing slower decline in some areas of cognition (Stern et al., 1994; Le Carret et al., 2005).
This study supported the hypothesis that combining demographic variables with reading ability tests provides higher reliable estimates of premorbid IQ (Crawford et al., 1990; Ball et al., 2007; Mathias et al., 2007; Schretlen et al., 2009). Demographic variables are predictors of cognitive performance, and therefore influence the diagnosis of cognitive impairment (Graves et al., 1999; Lezak, 2004). As the results showed, those participants who had completed more years of education had a higher level of premorbid functioning (Lowe and Rogers, 2011), however, premorbid IQ decreased with aging. Reading performance decreased in the 56–65 age range in WAT while the performance in PW started declining in the 71–75 age range. This pointed out that the PW Reading subtest was less influenced by aging than WAT. This indicates that the PW Reading subtest seems to be more resistant to decline with aging, and consequently, it could be a better measure to estimate premorbid IQ in elderly people (Friedman et al., 1992; Patterson et al., 1994). This could be explained by the sub-lexical pathway since PW reading requires the sub-lexical pathway which is more basic than the lexical pathway, and therefore more resistant to decline (Cuetos et al., 2007). In accordance with our results, Patterson et al. (1994) found that reading PW estimates the premorbid IQ more accurately than reading infrequent words. Their results showed larger differences between healthy controls and patients with Alzheimer’s Disease for words read correctly on the NART than in the non-word reading test (PW).
This study might have a direct impact on the clinical field as the normative data provide clinicians and researchers the possibility to estimate the premorbid IQ of patients more accurately, thus making more precise diagnosis. This could reduce the misdiagnosis of neurodegenerative diseases or mild cognitive impairment in elderly people. Furthermore, this study highlights the need that each country should create and follow their own demographically adapted norms taking into account their cultural aspects. According to several authors, United States norms are clearly not appropriate for every country since culture, ethnicity, education, and language among others, influence neuropsychological performance (Buré-Reyes et al., 2013; Ojeda et al., 2014). Hence, norms derived from other cultures are not appropriate to make individual-level diagnoses. Moreover, these findings also emphasize the relevance of calibrating performance according to intraindividual demographics in each country.
Despite the significant contribution to the clinical and scientific field, reporting normative data with a large representative sample of Spanish population, this study has several limitations. One common limitation to all normative studies is that normative data are limited to the characteristics of those tested (Mitrushina, 2005; Peña-Casanova et al., 2009; del Pino et al., 2015). However, this study tried to assess a wide variety of adult Spanish people with all kind of possible sociodemographic characteristics (National Institute of Statistics [NIS], 2012). Even though a very careful procedure was followed in the stratification and recruitment process, it was not possible to perform it by regions in Spain. Consequently, the population from the Basque Country region was overrepresented. For future studies, it would be interesting to include the representative percentage of people from different areas around Spain according to the NIS data and to increase the number of elderly people in the sample. Including illiterate people in the sample could be another limitation. Education was not compulsory in Spain until the General Education Act was passed in 1970. Compulsory education was from 6 to 14 years of age, but it was extended to the age of 16 in 1994. Accordingly, illiteracy is not common in Spain. Nonetheless, people with only 2 or 3 years of education were also included in the study.
Conclusion
In conclusion, this study reports the first normative data for the WAT and PW Reading subtest from PROLEC-R adapted by age and years of formal education of the Spanish population in order to estimate accurately premorbid IQ. Additionally, to our knowledge, this is the first study that uses the PW Reading subtest for adults. Future research is planned to estimate the validity of these two measures estimating premorbid IQ among the clinical population.
Author Contributions
All authors listed have made substantial, direct and intellectual contributions to the work, and approved it for publication. NO and DS came up with the idea for this project. NO, JP, and RP contributed to the project and managed all steps of the research process. RP performed the data collection, data entry, data analysis, and manuscript writing. The co-authors contributed equally to this research in the areas of research design, and revision of the manuscript writing.
Funding
This work was supported by the Department of Health of the Basque Government (2011111102), Basic and Applied Research of the Basque Government (PI_2014_1_43), the Federation of Associations of Spanish Neuropsychology (FANPSE), and University of Deusto.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors thank Soledad Vela (Care Centre for Elderly People from Ibi-CEAM), Belen Sanchís (Sejaa Centre, Psychology, Pedagogy, and Nutrition), Natividad Pardo (Neurology Centre, Neurodem), Ana Aznar (Acquired brain damage Foundation, Ateneo), and Leticia López (Vitoria) for their contribution and support to the Normacog Project.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2018.01950/full#supplementary-material
FIGURE S1 | Instructions and correction of the WAT in Spanish for the rater’s use.
FIGURE S2 | Stimulus sheet of the WAT.
References
Alves, L., Simoes, M. R., Martins, C., Freitas, S., and Santana, I. (2013). Premorbid IQ influence on screening tests’ scores in healthy patients and patients with cognitive impairment. J. Geriatr. Psychiatry Neurol. 26, 117–126. doi: 10.1177/0891988713484194
Ardila, A. (2007). “The impact of culture on neuropsychological test performance,” in International Handbook of Cross-Cultural Neuropsychology, eds B. P. Uzzell, M. Ponton and A. Ardila (Mahwah, NJ: Lawrence Erlbaum Associates), 23–44.
Baddeley, A., Emslie, H., and Nimmo-Smith, I. (1993). The spot-the-word test: a robust estimate of verbal intelligence based on lexical decision. Br. J. Clin. Psychol. 32, 55–65. doi: 10.1111/j.2044-8260.1993.tb01027.x
Ball, J., Hart, R. P., Stutts, M. L., Turf, E., and Barth, J. T. (2007). Comparative utility of barona formulae, WTAR demographic algorithms, and WRAT-3 reading for estimating premorbid ability in a diverse research sample. Clin. Neuropsychol. 21, 422–433. doi: 10.1080/13854040600582577
Barona, A., Reynolds, C. R., and Chastain, R. (1984). A demographically based index of premorbid intelligence for the WAIS—R. J. Consult. Clin. Psychol. 52, 885–887. doi: 10.1037/0022-006X.52.5.885
Brandt, J., Spencer, M., and Folstein, M. (1988). The telephone interview for cognitive status. Cogn. Behav. Neurol 1, 111–118.
Bright, P., Jaldow, E., and Kopelman, M. D. (2002). The national adult reading test as a measure of premorbid intelligence: a comparison with estimates derived from demographic variables. J. Int. Neuropsychol. Soc. 8, 847–854. doi: 10.1017/S1355617702860131
Buré-Reyes, A., Hidalgo-Ruzzante, N., Vilar-López, R., Gontier, J., Sánchez, L., Pérez-García, M., et al. (2013). Neuropsychological test performance of spanish speakers: is performance different across different spanish-speaking subgroups? J. Clin. Exp. Neuropsychol. 35, 404–412. doi: 10.1080/13803395.2013.778232
Contador, I., Bermejo-Pareja, F., Del Ser, T., and Benito-León, J. (2015). Effects of education and word reading on cognitive scores in a community-based sample of spanish elders with diverse socioeconomic status. J. Clin. Exp. Neuropsychol. 37, 92–101. doi: 10.1080/13803395.2014.989819
Crawford, J. R. (1992). “Current and premorbid intelligence measures in neuropsychological assessment,” In A Handbook of Neuropsychological Assessment, eds J. R. Crawford, W. McKinlay and D. M. Parker (Hillsdale, NJ: Lawrence Erlbaum Associates, Inc.) pp. 21–49.
Crawford, J. R., Nelson, H., Blackmore, L., Cochrane, R., and Allan, K. (1990). Estimating premorbid intelligence by combining the NART and demographic variables: an examination of the NART standardisation sample and supplementary equations. Pers. Individ. Differ. 11, 1153–1157. doi: 10.1016/0191-8869(90)90028-P
Crawford, J. R., Stewart, L., Cochrane, R., Parker, D., and Besson, J. (1989a). Construct validity of the national adult reading test: a factor analytic study. Pers. Individ. Differ. 10, 585–587. doi: 10.1016/0191-8869(89)90043-3
Crawford, J. R., Stewart, L., Parker, D., Besson, J., and Cochrane, R. (1989b). Estimation of premorbid intelligence: combining psychometric and demographic approaches improves predictive accuracy. Pers. Individ. Differ. 10, 793–796. doi: 10.1016/0191-8869(89)90126-8
Cuetos, F., Rodríguez, B., Ruano, E., and Arribas, D. (2007). PROLEC-R. Batería De Evaluación De Los Procesos Lectores, Revisada. Madrid: TEA Ediciones España.
de Oliveira, M. O., Nitrini, R., Yassuda, M. S., and Brucki, S. M. (2014). Vocabulary is an appropriate measure of premorbid intelligence in a sample with heterogeneous educational level in brazil. Behav. Neurol. 2014:875960. doi: 10.1155/2014/875960
del Pino, R., Peña, J., Schretlen, D. J., Ibarretxe-Bilbao, N., and Ojeda, N. (2015). Multisite study for norming and standardizing neuropsychological instruments in healthy people from spanish population: methods and characteristics of normacog project. Rev. Neurol. 61, 57–65.
Del Ser, T., González-Montalvo, J., Martìnez-Espinosa, S., Delgado-Villapalos, C., and Bermejo, F. (1997). Estimation of premorbid intelligence in spanish people with the word accentuation test and its application to the diagnosis of dementia. Brain Cogn. 33, 343–356. doi: 10.1006/brcg.1997.0877
Eppinger, M. G., Craig, P. L., Adams, R. L., and Parsons, O. A. (1987). The WAIS—R index for estimating premorbid intelligence: cross-validation and clinical utility. J. Consult. Clin. Psychol. 55, 86–90. doi: 10.1037//0022-006X.55.1.86
Franzen, M. D., Burgess, E., and Smith-Seemiller, L. (1997). Methods of estimating premorbid functioning. Arch. Clin. Neuropsychol. 12, 711–738. doi: 10.1016/S0887-6177(97)00046-2
Freeman, J., Godfrey, H. P., Harris, J. K., and Partridge, F. M. (2001). Utility of a demographic equation in detecting impaired NART performance after TBI. Br. J. Clin. Psychol. 40, 221–224. doi: 10.1348/014466501163562
Friedman, R. B., Ferguson, S., Robinson, S., and Sunderland, T. (1992). Dissociation of mechanisms of reading in alzheimer’s disease. Brain Lang. 43, 400–413. doi: 10.1016/0093-934X(92)90109-R
Gomar, J., Ortiz-Gil, J., McKenna, P., Salvador, R., Sans-Sansa, B., Sarró, S., et al. (2011). Validation of the word accentuation test (TAP) as a means of estimating premorbid IQ in spanish speakers. Schizophr. Res. 128, 175–176. doi: 10.1016/j.schres.2010.11.016
González Montalvo, J. I. (1991). Creación y validación de un test de lectura para el diagnóstico del deterioro mental en el anciano. Doctoral dissertation, Complutense University of Madrid, Madrid.
Graves, R. E., Carswell, L. M., and Snow, W. G. (1999). An evaluation of the sensitivity of premorbid IQ estimators for detecting cognitive decline. Psychol. Assess. 11, 29–38. doi: 10.1037/1040-3590.11.1.29
Griffin, S. L., Mindt, M. R., Rankin, E. J., Ritchie, A. J., and Scott, J. G. (2002). Estimating premorbid intelligence: comparison of traditional and contemporary methods across the intelligence continuum. Arch. Clin. Neuropsychol. 17, 497–507. doi: 10.1016/S0887-6177(01)00136-6
Harman-Smith, Y. E., Mathias, J. L., Bowden, S. C., Rosenfeld, J. V., and Bigler, E. D. (2013). Wechsler adult intelligence scale–third edition profiles and their relationship to self-reported outcome following traumatic brain injury. J. Clin. Exp. Neuropsychol. 35, 785–798. doi: 10.1080/13803395.2013.824554
Harnett, M. A., Godfrey, H. P., and Knight, R. G. (2004). Regression equations for predicting premorbid performance on executive test measures by persons with traumatic brain injuries. N. Z. J. Psychol. 33:78.
Hebben, N., Milberg, W., Espinosa, G. M. V., and Fuentes, S. V. (2011). Fundamentos Para La Evaluación Neuropsicológica. Mexico, MX: Manual Moderno.
Hessler, J., Jahn, T., Kurz, A., and Bickel, H. (2013). The MWT-B as an estimator of premorbid intelligence in MCI and dementia. Z. Neuropsychol. 24, 129–136. doi: 10.1024/1016-264X/a000099
Ivnik, R. J., Malec, J. F., Smith, G. E., Tangalos, E. G., Petersen, R. C., Kokmen, E., et al. (1992). Mayo’s older americans normative studies: WAIS-R norms for ages 56 to 97. Clin. Neuropsychol. 6, 1–30. doi: 10.1080/13854049208401877
Kesler, S. R., Adams, H. F., Blasey, C. M., and Bigler, E. D. (2003). Premorbid intellectual functioning, education, and brain size in traumatic brain injury: an investigation of the cognitive reserve hypothesis. Appl. Neuropsychol. 10, 153–162. doi: 10.1207/S15324826AN1003_04
Khandaker, G. M., Barnett, J. H., White, I. R., and Jones, P. B. (2011). A quantitative meta-analysis of population-based studies of premorbid intelligence and schizophrenia. Schizophr. Res. 132, 220–227. doi: 10.1016/j.schres.2011.06.017
Law, R., and O’Carroll, R. E. (1998). A comparison of three measures of estimating premorbid intellectual level in dementia of the alzheimer type. Int. J. Geriatr. Psychiatry 13, 727–730. doi: 10.1002/(SICI)1099-1166(1998100)13:103.0.CO;2-2
Le Carret, N., Auriacombe, S., Letenneur, L., Bergua, V., Dartigues, J., and Fabrigoule, C. (2005). Influence of education on the pattern of cognitive deterioration in AD patients: the cognitive reserve hypothesis. Brain Cogn. 57, 120–126. doi: 10.1016/j.bandc.2004.08.031
Lowe, D. A., and Rogers, S. A. (2011). Estimating premorbid intelligence among older adults: the utility of the AMNART. J. Aging Res. 2011:428132. doi: 10.4061/2011/428132
Martin, A., and Fedio, P. (1983). Word production and comprehension in alzheimer’s disease: the breakdown of semantic knowledge. Brain Lang. 19, 124–141. doi: 10.1016/0093-934X(83)90059-7
Mathias, J. L., Bowden, S. C., and Barrett-Woodbridge, M. (2007). Accuracy of the wechsler test of adult reading (WTAR) and national adult reading test (NART) when estimating IQ in a healthy australian sample. Aust. Psychol. 42, 49–56. doi: 10.1080/00050060600827599
McFarlane, J., Welch, J., and Rodgers, J. (2006). Severity of alzheimer’s disease and effect on premorbid measures of intelligence. Br. J. Clin. Psychol. 45, 453–464. doi: 10.1348/014466505X71245
McGurn, B., Starr, J. M., Topfer, J. A., Pattie, A., Whiteman, M. C., Lemmon, H. A., et al. (2004). Pronunciation of irregular words is preserved in dementia, validating premorbid IQ estimation. Neurology 62, 1184–1186. doi: 10.1212/01.WNL.0000103169.80910.8B
Mitrushina, M. (2005). Handbook of Normative Data for Neuropsychological Assessment. New York, NY: Oxford University Press.
National Institute of Statistics [NIS] (2012). Population Census by Age and Sex. Madrid: National Institute of Statistics.
Nelson, H. E., and McKenna, P. (1975). The use of current reading ability in the assessment of dementia. Br. J. Soc. Clin. Psychol. 14, 259–267. doi: 10.1111/j.2044-8260.1975.tb00178.x
Ojeda, N., Aretouli, E., Peña, J., and Schretlen, D. J. (2014). Age differences in cognitive performance: a study of cultural differences in historical context. J. Neuropsychol. 10, 104–115. doi: 10.1111/jnp.12059
Patterson, K. E., Graham, N., and Hodges, J. R. (1994). Reading in dementia of the alzheimer type: a preserved ability? Neuropsychology 8, 395–407. doi: 10.1037/0894-4105.8.3.395
Peña-Casanova, J., Blesa, R., Aguilar, M., Gramunt-Fombuena, N., Gomez-Anson, B., Oliva, R., et al. (2009). Spanish multicenter normative studies (neuronorma project): methods and sample characteristics. Arch. Clin. Neuropsychol. 24, 307–319. doi: 10.1093/arclin/acp027
Peña-Casanova, J., Casals-Coll, M., Quintana, M., Sánchez-Benavides, G., Rognoni, T., Calvo, L., et al. (2012). Spanish normative studies in a young adult population (neuronorma young adults project): methods and characteristics of the sample. Neurología 27, 253–260. doi: 10.1016/j.nrl.2011.12.019
Russell, A. J., Munro, J., Jones, P., Hayward, P., Hemsley, D., and Murray, R. (2000). The national adult reading test as a measure of premorbid IQ in schizophrenia. Br. J. Clin. Psychol. 39, 297–305. doi: 10.1348/014466500163301
Schretlen, D. J., Winicki, J., Meyer, S., Testa, S., Pearlson, G., and Gordon, B. (2009). Development, psychometric properties, and validity of the hopkins adult reading test (HART). Clin. Neuropsychol. 23, 926–943. doi: 10.1080/13854040802603684
Scott, J. G., Krull, K. R., Williamson, D. J., Adams, R. L., and Iverson, G. L. (1997). Oklahoma premorbid intelligence estimation (OPIE): utilization in clinical samples. Clin. Neuropsychol. 11, 146–154. doi: 10.1080/13854049708407043
Sierra, N., Torralva, T., Roca, M., Manes, F., and Burin, D. I. (2010). Estimación de la inteligencia premórbida en deterioro cognitivo leve y moderado, y déficit ejecutivo. Neuropsicol. Latinoamericana 2, 25–32.
Sierra Sanjurjo, N., Montanes, P., Sierra Matamoros, F. A., and Burin, D. (2015). Estimating intelligence in spanish: regression equations with the word accentuation test and demographic variables in latin america. Appl. Neuropsychol. Adult 22, 252–261. doi: 10.1080/23279095.2014.918543
Smerbeck, A., Parrish, J., Yeh, E., Weinstock-Guttman, B., Hoogs, M., Serafin, D., et al. (2012). Regression-based norms improve the sensitivity of the national MS society consensus neuropsychological battery for pediatric multiple sclerosis (NBPMS). Clin. Neuropsychol. 26, 985–1002. doi: 10.1080/13854046.2012.704074
Stern, Y., Gurland, B., Tatemichi, T. K., Tang, M. X., Wilder, D., and Mayeux, R. (1994). Influence of education and occupation on the incidence of alzheimer’s disease. JAMA 271, 1004–1010. doi: 10.1001/jama.1994.03510370056032
Testa, S., Winicki, J. M., Pearlson, G. D., Gordon, B., and Schretlen, D. J. (2009). Accounting for estimated IQ in neuropsychological test performance with regression-based techniques. J. Int. Neuropsychol. Soc. 15, 1012–1022. doi: 10.1017/S1355617709990713
Vakil, E. (2012). Neuropsychological assessment: principles, rationale, and challenges. J. Clin. Exp. Neuropsychol. 34, 135–150. doi: 10.1080/13803395.2011.623121
Keywords: normative data, premorbid intelligence, premorbid IQ, pseudo-words, WAT
Citation: Del Pino R, Peña J, Ibarretxe-Bilbao N, Schretlen DJ and Ojeda N (2018) Demographically Calibrated Norms for Two Premorbid Intelligence Measures: The Word Accentuation Test and Pseudo-Words Reading Subtest. Front. Psychol. 9:1950. doi: 10.3389/fpsyg.2018.01950
Received: 20 May 2018; Accepted: 21 September 2018;
Published: 11 October 2018.
Edited by:
Timothy L. Hubbard, Arizona State University, United StatesReviewed by:
Tomiki Sumiyoshi, National Center of Neurology and Psychiatry, JapanVictoria Anne McGowan, University of Leicester, United Kingdom
Copyright © 2018 Del Pino, Peña, Ibarretxe-Bilbao, Schretlen and Ojeda. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Natalia Ojeda, bm9qZWRhQGRldXN0by5lcw==