Memory Alteration Test to Detect Amnestic Mild Cognitive Impairment and Early Alzheimer’s Dementia in Population with Low Educational Level

Background/Aims: Short tests to early detection of the cognitive impairment are necessary in primary care setting, particularly in populations with low educational level. The aim of this study was to assess the performance of Memory Alteration Test (M@T) to discriminate controls, patients with amnestic Mild Cognitive Impairment (aMCI) and patients with early Alzheimer’s Dementia (AD) in a sample of individuals with low level of education.

Methods: Cross-sectional study to assess the performance of the M@T (study test), compared to the neuropsychological evaluation (gold standard test) scores in 247 elderly subjects with low education level from Lima-Peru. The cognitive evaluation included three sequential stages: (1) screening (to detect cases with cognitive impairment); (2) nosological diagnosis (to determinate specific disease); and (3) classification (to differentiate disease subtypes). The subjects with negative results for all stages were considered as cognitively normal (controls). The test performance was assessed by means of area under the receiver operating characteristic (ROC) curve. We calculated validity measures (sensitivity, specificity and correctly classified percentage), the internal consistency (Cronbach’s alpha coefficient), and concurrent validity (Pearson’s ratio coefficient between the M@T and Clinical Dementia Rating (CDR) scores).

Results: The Cronbach’s alpha coefficient was 0.79 and Pearson’s ratio coefficient was 0.79 (p < 0.01). The AUC of M@T to discriminate between early AD and aMCI was 99.60% (sensitivity = 100.00%, specificity = 97.53% and correctly classified = 98.41%) and to discriminate between aMCI and controls was 99.56% (sensitivity = 99.17%, specificity = 91.11%, and correctly classified = 96.99%).

Conclusions: The M@T is a short test with a good performance to discriminate controls, aMCI and early AD in individuals with low level of education from urban settings.

Introduction

Mild cognitive impairment (MCI) is a well recognized risk factor for Alzheimer’s disease (AD), and for the predemential phase of this and other dementias (Albert et al., 2011; Li et al., 2011; Cooper et al., 2015). The need for research aimed to AD early diagnosis have been highlighted in several studies directed towards the prevention and control of the worldwide progression of the disease (Richard et al., 2012; Barnett et al., 2013). Thus, it is necessary to have brief and reliable instruments to early diagnosis in primary care settings (Custodio et al., 2017).

Globally, there is a generalized low detection of dementia in the community. This is a real challenge in Latin America (LA; Lang et al., 2017), where previous studies showed that the majority of medical doctors perceive that their practices for diagnosis and treatment of dementia are inadequate, underscoring that this deficiency is higher in general practitioners than in specialists (Olavarria et al., 2015). In addition, other challenge in LA countries is the lack of validated and standardized instruments to assess cognition and functionality in indigenous populations, in rural areas, with a language other than Spanish, or with low levels of education (Maestre, 2012; Parra, 2014).

Various instruments have been developed to detect dementia (Folstein et al., 1975; Mattis, 1976; Roth et al., 1986), but there is not still gold standard short test. The Mini-Mental State Examination (MMSE), the most widely used short test, is especially inadequate in less-educated populations (Rosselli et al., 2000; Scazufca et al., 2009) because its low validity and diagnostic accuracy in this populations (Lonie et al., 2009; Mitchell, 2009; Carnero-Pardo et al., 2011b). Other short tests include task that require reading and writing abilities or involve the use of pencil and paper, which affects its use in populations with a low educational level (Carnero-Pardo et al., 2011a).

In Peru, several short tests have been validated in urban samples from Lima, including the clock drawing test (CDT)—Mano’s version (Custodio et al., 2011), the Addenbrooke’s cognitive examination (ACE; Custodio et al., 2011), the memory alteration test (M@T; Custodio et al., 2014), the INECO frontal screening (IFS; Custodio et al., 2016b) and the Peruvian version of the Eurotest (Oscanoa et al., 2016). However, neither of these tests were validated in LA low-educated populations (Paddick et al., 2017).

The M@T is a short cognitive test to detect dementia, able to discriminate between controls, patients with amnestic MCI (aMCI), and patients with early AD (Rami et al., 2007, 2010; Custodio et al., 2014; Ozer et al., 2016). It has been reported the utility of M@T in patients with low level of education (Sousa et al., 2015), however, validation studies of short cognitive tests for detecting aMCI and AD in population with low-level education are scarce (Paddick et al., 2017). Thus, the aim of the present study is to assess the validity of M@T to discriminate between controls, patients with aMCI and patients with early AD in a sample of individuals with low level of education.

Materials and Methods

Design of the Study

Diagnostic test cross-sectional study to evaluate the performance of the M@T (study test), compared to the neuropsychological evaluation (gold standard test).

The Study Test

The M@T is a valid screening test that assess the temporal orientation and different types of memory (episodic, textual and semantic) and discriminates between healthy elderly subjects, patients with aMCI and patients with early AD. This is a cognitive test with high internal consistency and validity, short application (5–10 min), easy to perform and to interpret, developed in Spain (Rami et al., 2007) and validated in Peru (Custodio et al., 2014). Its results are mildly influenced by educational level, thereby the cutoff points are 36/37 and 37/38 for subjects with <8 years and ≥8 years of education, respectively (Carnero-Pardo et al., 2011a).

This test is totally oral and do not require reading or writing skills or the use of pencil and paper, allowing the evaluation of very low educated subjects. All the questions of M@T have a single correct answers, and covering five domains: temporal orientation (5), short term memory (10), semantic memory (15), free recall (10) and facilitated recall (10). Thus, the maximum score of this test is 50 points.

The Gold Standard Test

The neuropsychological assessment is the detailed evaluation of the cognitive functions, by means of a neuropsychological battery adapted to Peruvian population. The battery included the following tests: Rey Auditory Verbal Learning Test (RAVLT; Rey, 1941), Logical Memory—Subtest of Wechsler Memory Scale Revised (Wechsler, 1997), Trail Making Test A and B (Partington and Leiter, 1949), Rey-Osterrieth Complex Figure Test (ROCF; Rey, 1941), Boston Naming Test (Kaplan et al., 1983), Wisconsin Card Sorting Test (WCST; Nelson, 1976), Letter-Number and Digit Span, subtests of Wechsler Adult Intelligent Scale III (Wechsler, 1997).

Following the order of the tests mentioned above, the neuropsychological battery has the main purpose to explore cognitive skills such as verbal memory and verbal learning through retention and evocation of verbal stimuli, immediate recall and delayed recall of stories, scanning and visuomotor tracking, divided attention, cognitive flexibility, visual memory and visuospatial construction skill. Also it appraises language skills like naming ability and word retrieval, executive functioning like forming concepts, conceptual flexibility as well attentional control, working memory and span of immediate verbal recall.

The decision criterion is two standard deviations below the mean in order to establish deficit in the cognitive domain assessed. These values were collected from the original articles for each selected test. Throughout the study, the neuropsychologists were blinded to results of M@T.

Population and Sample

The study was carried out in elderly care home centers of two districts of Lima (four from “Carabayllo” and two from “Cercado de Lima”) between March and September of 2015. We included subjects older than 60 years, Spanish speakers with low educational level (<4 years of completed formal education), excluding those with any condition that might cause cognitive impairment non-related to neurodegenerative etiology (history of substances addiction or abuse, depression, hypothyroidism, vitamin B12 deficiency, chronic hepatopathy or nephropathy, neuroinfections by HIV or syphilis, severe brain injury, sub-dural hematoma, cerebrovascular illness, vascular dementia suggestion (Hachinski Ischemic Score >4), etc.) or that could affect their performance to realize the cognitive tests (auditory, visual or other physical deficits).

Additionally, we excluded to patients that consumed any of following drugs: opioid analgesics, decongestants, anti-spasmodics, anti-cholinergics, anti-depressants, antiarrhythmics, antipsychotics, anti-emetics, anxiolytics and valproate.

Procedures

We requested the list of regular users (i.e., assistance frequency >3 times/week) of the elderly care home centers. By means of simple random sampling (table of random numbers), the potential participants were selected until completing a quota of half of available population (sample size = 0.5 N), consented to participate, and provided information necessary to assess compliance with eligibility criteria. The evaluation of cognitive impairment was performed in three successive stages: (1) screening (to detect cases with cognitive impairment); (2) nosological diagnosis (to determinate specific disease that is the cause of cognitive impairment); and (3) final classification (to differentiate disease subtypes).

In the screening phase, an integral clinical evaluation was performed, including measurement of anthropometry and blood pressure, application of Pfeffer Functional Activities Questionnaire (PFAQ) and cognitive screening tests (MMSE and CDT). If any cognitive test was positive for impairment, it was repeated by a different evaluator. The confirmed cases were considered as patients with cognitive impairment (PCI). According to educational level, the cutoff score used was 23 for subjects with 4 years of education, 21 for subjects with 1–3 years of education, and 18 for subjects with less than 1 year of education (Custodio and Lira, 2014). The MMSE and CDT was applied to study subjects, and PFAQ was applied to their caregivers/accompanist.

In the second stage, the PCIs were assessed using blood tests (hemogram, glucose, electrolytes, transaminases, rapid plasma reagin (RPR), urea, creatinine, vitamin B12, folic acid, free T3 and T4, and ultra-sensitive TSH), images studies (brain tomography and/or magnetic resonance imaging), and Beck Depression Inventory II (BDI-II) for discarding non-neurodegenerative causes of cognitive impairment. We applied the DSM-IV (American Psychiatric Association, 2000) criteria to diagnosis dementia, and the Clinical Dementia Rating (CDR; Hughes et al., 1982) for staging dementia. The CDR was applied to both study subjects and caregivers/accompanist.

Finally, in the third stage, we performed the neuropsychological evaluation of patients with MCI or dementia to typify its subtype. We applied the criteria of Petersen (Petersen et al., 1999) and NINCDS-ADRDA (McKhann et al., 1984) to classify as aMCI or AD, respectively. The doubtful cases (regarding typification) were resolved by researchers consensus.

The subjects with negative results in all tests for cognitive assessment were considered as cognitively normal (controls). The M@T was applied to study subjects in first stage and the evaluators were blinded to the results of this psychometric. The results of M@T were not used as part of the neuropsychological battery for diagnosis. The team of evaluators of the second and third phases (expert neurologists and neuropsichologists) was different from the team of the first phase (students of medicine and psychology supervised by expert neurologists).

Statistical Methods

The corresponding descriptive statistics were performed. The analysis was performed comparing the cognitive groups (controls, aMCI and AD) by pairs. For this purpose we applied T tests (for quantitative variables) and Chi Square (for categorical variables). We assessed the internal consistency (Cronbach’s alpha coefficient) and the concurrent validity (Pearson’s ratio coefficient between the M@T and CDR scores).

We performed a logistic regression (logit) for each pair of study groups (early AD/aMCI, aMCI/control, and early AD/control), using a model of two variables: final diagnosis as dependent variable and test as independent variable. We applied postestimation analysis to compute area under receiver operating characteristics (ROC) curve and graph ROC curve, and calculate validity measures (sensitivity, specificity and positive and negative predictive values).

Additionally, we calculated the diagnostic accuracy (percentage of correctly classified individuals) for M@T, MMSE and CDT. The maximum values of this measure were the standard for the cut-off scores selection of sensitivity, specificity and predictive values. Finally, we compared the AUC of this tests using the method of Hanley and McNeil. The tests were performed at 95% confidence using the STATA software (version 12.0).

Ethical Aspects

This study was carried out in accordance with the recommendations of the Council for International Organizations and Medical Sciences (CIOMS). A written informed consent was obtained from all participants or their carers in accordance with the Declaration of Helsinki. The protocol was approved by the Ethics Committee of the Universidad de San Martin de Porres.

Results

Flow of Participants

The first stage started with 346 participants, but 41 were missed (14 due to withdrawal of informed consent, 21 due to difficulty in attending scheduled appointments and six due to caregiver or evaluator illness). In the second stage, 22 of 305 participants were missed (seven due to difficulty in attending scheduled appointments, four for lack of blood tests results and 11 for lack of brain tomography).

Finally, 283 participants completed the third stage. However, 36 participants were not included in the present analysis because they were classified as non-amnesic MCI (16), vascular dementia (6), Frontotemporal dementia (4), dementia associated with Parkinson’s disease (2) and other unspecified dementias (8).

Data of Participants

Statistical analysis of the sociodemographic data, MMSE scores and M@T scores were performed according to the comparison groups. In patients with AD, compared to those with aMCI, age was significantly higher and test scores (MMSE, CDT and M@T) were significantly lower. On the other hand, in the patients with aMCI the age was significantly higher and the M@T and CDT scores were significantly lower, compared to control subjects (Table 1). The M@T and CDT scores showed a differential distribution according to the comparison group, behaving as a trend (Figure 1). The results of the neuropsychological assessment are detailed in Table 2.

TABLE 1

Table 1. Demographic characteristics and cognitive test scores in 247 low-level education individuals from Lima-Peru, according to definitive diagnosis.

FIGURE 1

Figure 1. Score in Memory Alteration Test (M@T) in 247 low-level education individuals from Lima-Peru, according to definitive diagnosis. AD, Alzheimer’s dementia; aMCI, amnestic mild cognitive impairment.

TABLE 2

Table 2. Results of the neuropsychological assessment in 247 low-level education individuals from Lima-Peru, according to definitive diagnosis.

Psychometric Properties of M@T

Internal consistency (Cronbach’s alpha coefficient: 0.79) and concurrent validity (r = 0.79; p < 0.01) were good. In relation to the M@T cutoff, a score of 26 allows to discriminate between early AD and aMCI (sensitivity = 100.00% and specificity = 97.53%), with an accuracy of 98.41%. Similarly, a score of 35 allows discriminating between aMCI and controls (sensitivity = 99.17% and specificity = 91.11%), with an accuracy of 96.99% (Table 3).

TABLE 3

Table 3. Cut-off points and diagnostic performance of M@T and MMSE to discriminate between AD, aMCI.

The performance of the M@T to discriminate between early AD and aMCI was 0.9960 (Figure 2) and to discriminate between aMCI and controls was 0.9956 (Figure 3). The discriminatory performance of M@T was significantly higher than the MMSE (p = 0.000) for all combinations of analyzed group pairs. Furthermore, the performance of M@T was significantly higher than CDT to discriminate between patients with aMCI from controls (Table 3). Additionally, we performed an analysis for assessing if the score M@T is statistically associated with clinical diagnosis (early AD or aMCI; Supplementary Table S1).

FIGURE 2

Figure 2. Receiver operating characteristics (ROC) curve of M@T, MMSE and CDT to discriminate between patients with aMCI and controls in 166 low-level education individuals from Lima-Peru. MMSE, Mini Mental State of Examination; CDT, Clock Drawing Test—Mano’s version; M@T, Memory Alteration Test.

FIGURE 3

Figure 3. ROC curve of M@T, MMSE and CDT to discriminate between patients with aMCI and early AD in 126 low-level education individuals from Lima-Peru. MMSE, Mini Mental State of Examination; CDT, Clock Drawing Test—Mano’s version; M@T, Memory Alteration Test.

Discussion

Implications

This study shows a good performance of M@T to discriminate between early AD and aMCI in subjects with less than 4 years of education. These results are similar to those previously obtained with a sample of 6.5 years of average education (AUC: 0.9986; Custodio et al., 2014) and slightly higher than those obtained in a Spanish sample with 8 years of average education (AUC: 0.9300; Rami et al., 2007).

Similarly, we found a good performance to discriminate between patients with aMCI and controls (AUC: 0.9956), which was slightly lower than that reported previously (AUC: 0.9986; Custodio et al., 2014), but also higher than that obtained in a Spanish sample (AUC: 0.932; Rami et al., 2007). Our research has also shown a good correlation coefficient between M@T and MMSE, which suggests convergent validity. This is a finding similar to that previously obtained with the Portuguese version of the M@T (Sousa et al., 2015).

Additionally, we found that the performance of M@T is higher than MMSE and CDT for discriminating both AD vs. aMCI and aMCI vs. controls. This findings can be explained because M@T evaluates episodic and semantic memory, which have their biological substrate in the hippocampus, the medial temporal lobe and temporal neocortex, areas that are early affected in AD (Rami et al., 2007). In contrast, the MMSE evaluates orientation, language, praxia and general aspects of memory and the CDT evaluates planning, visuospatial and constructive functions. Thus, MMSE is not able to discriminate between AD and aMCI (Tombaugh and McIntyre, 1992; Wind et al., 1997; Rami et al., 2009), and CDT is more appropriate to detect advanced stages of AD (Custodio et al., 2016a).

According to recent UNESCO data, 16% of adults have emerged from education systems without basic literacy skills, which is a major problem in the regions of Sub-Saharan Africa and South Asia, where more than 1/3 of adults are illiterate. Around the world, at least 20 countries have adult literacy rates less than 60% and 43 countries have adult literacy rates less than 75% (UNESCO Institute for Statistics, 2016). Thus, this population constitutes an important group and their needs emerge as public health focus. In this context, valid diagnostic tests for its use in people with low educational level are required.

There are evidence about the demographic influences (e.g., age, gender, education, and residence rural/urban) on the performance of several cognitive tests (Freitas et al., 2015; Li et al., 2016; Xie et al., 2016). Particularly, the education is a key factor since dementia is under-recognized among people with low education levels (Xie et al., 2016). Thereby the international norms of MMSE, the most broadly used cognitive screening instrument, consider different optimal cut-off points depending of educational level to improve screening precision for cognitive impairment (Moraes et al., 2010; Kim et al., 2012; Freitas et al., 2015; Li et al., 2016; Xie et al., 2016). Regarding previous results in Peruvian subjects with at least 6 years of education (Custodio et al., 2014), our data showed that performance with M@T is affected by education and cut-off points should be adjusted.

Additionally, previous studies have shown that non-specialist physicians have difficulties in effectively identifying aMCI and early AD. Thus, it is necessary to develop clinically useful, non-invasive and/or cost-effective, screening tools (Connolly et al., 2011), which must be applicable in primary care centers (Laske et al., 2015)^. In Peru, M@T has been shown to be a reliable test with high precision to discriminate between early AD, aMCI and normal cognition in samples of low educational level (Custodio et al., 2014) and, according to the results of this study, in samples with very low educational level. There are evidence suggesting a progression between various clinical states, beginning with MCI and, after a period of up to 5 years, evolving to dementia in its various sequential stages of severity (De Meyer et al., 2010; Derby et al., 2013). Our results show that, in fact, the average age is higher among patients with AD compared to patients with aMCI and, in turn, they are older than the control subjects.

In addition to age, another important sociodemographic variable is the sex. Several population-based studies have shown nearly two-thirds of individuals diagnosed with AD are females (Dal Forno et al., 2005). In this sense, the sociodemographic profile of the patients included in this study is consistent with that previously reported in the world literature.

In our sample, MMSE and CDT showed a suboptimal performance for discriminating between aMCI and healthy controls. This findings contrasts with previous studies, which found an AUC values higher than 0.80 and 0.70 with the use of MMSE and CDT, respectively (Cacho et al., 2010; Kato et al., 2013). However, a brazilian study showed a low performance of these tests (0.63 and 0.59, respectively; Ladeira et al., 2009). Similarly, other study in high educated sample showed same results (0.70 and 0.61, respectively; Rubínová et al., 2014). Thus, the discrepancy in these topic could be explained for the differences in educational level of participants and, potentially, other regional features.

Limitations

We have not included rural populations or with native language other than Spanish. Consequently, the results of this study may not be applicable to these population subgroups. The comparison groups were statistically different for the age, a potential confounding variable. However, we performed a secondary sub-analysis for checking that the performance of the logistic regression model is not affected by the age.

Conclusion

The psychometric properties of M@T allow its application in subjects with less than 4 years of primary education in urban settings. Cut-off points should be corrected for educational level and, according our data, values of 35 and 26 are useful for distinguishing patients with aMCI and early AD, respectively, in patients with low level of education. However, M@T should not be used in isolation to define dementia, since it measures memory impairment (episodic and semantic) and orientation well, but no other types of cognitive impairment nor functionality. Therefore, the simultaneous use of brief functional tests to compensate for this deficiency is required.

Recommendations

Recent studies in European populations have evaluated the ability of M@T to discriminate between aMCI and subjective memory complaints (SMC), showing an optimal performance in subjects with medium (Rami et al., 2010) and low educational level (Sousa et al., 2015). Our study did not incorporate this study group. However, we consider that future research should do so because SMC has been reported as a predictor of cognitive decline and AD (Mendonça et al., 2016).

Additionally, the future studies should include population with a broad variability of educational level and higher sample size. Thus, multivariate models could be applied to assess the factors that is statistically associated with clinical diagnosis, which includes the years of education.

The M@T constitutes a brief, non-invasive and reliable cognitive test, which could be applicable for non-specialist physicians to support the discrimination between aMCI and early AD in primary care centers.

Author Contributions

NC performed the conception of the study. NC, DL, RM and EH-P designed the study. NC, DL, RM, SC-S, JC-A and LV-L collected the data. NC and EH-P analyzed and interpreted the data of the work. EH-P and NC drafted the first draft of the article. All authors critically revised the manuscript and approved the version to be published.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Supplementary Material

The Supplementary Material for this article can be found online at: http://journal.frontiersin.org/article/10.3389/fnagi.2017.00278/full#supplementary-material

References

Albert, M. S., DeKosky, S. T., Dickson, D., Dubois, B., Feldman, H. H., Fox, N. C., et al. (2011). The diagnosis of mild cognitive impairment due to Alzheimer’s disease: recommendations from the national institute on aging-Alzheimer’s association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 7, 270–279. doi: 10.1016/j.jalz.2011.03.008

PubMed Abstract | CrossRef Full Text | Google Scholar

American Psychiatric Association. (2000). Diagnostic and Statistical Manual of Mental Disorders, Fourth Edition: DSM-IV-TR^®. Washington, DC: American Psychiatric Association.

Barnett, J. H., Hachinski, V., and Blackwell, A. D. (2013). Cognitive health begins at conception: addressing dementia as a lifelong and preventable condition. BMC Med. 11:246. doi: 10.1186/1741-7015-11-246

PubMed Abstract | CrossRef Full Text | Google Scholar

Cacho, J., Benito-León, J., García-García, R., Fernández-Calvo, B., Vicente-Villardón, J. L., and Mitchell, A. J. (2010). Does the combination of the MMSE and clock drawing test (mini-clock) improve the detection of mild Alzheimer’s disease and mild cognitive impairment? J. Alzheimers Dis. 22, 889–896. doi: 10.3233/JAD-2010-101182

PubMed Abstract | CrossRef Full Text | Google Scholar

Carnero-Pardo, C., Espejo-Martínez, B., López-Alcalde, S., Espinosa-García, M., Sáez-Zea, C., Hernández-Torres, E., et al. (2011a). Diagnostic accuracy, effectiveness and cost for cognitive impairment and dementia screening of three short cognitive tests applicable to illiterates. PLoS One 6:e27069. doi: 10.1371/journal.pone.0027069

PubMed Abstract | CrossRef Full Text | Google Scholar

Carnero-Pardo, C., Espejo-Martinez, B., Lopez-Alcalde, S., Espinosa-Garcia, M., Saez-Zea, C., Vilchez-Carrillo, R., et al. (2011b). Effectiveness and costs of phototest in dementia and cognitive impairment screening. BMC Neurol. 11:92. doi: 10.1186/1471-2377-11-92

PubMed Abstract | CrossRef Full Text | Google Scholar

Connolly, A., Gaehl, E., Martin, H., Morris, J., and Purandare, N. (2011). Underdiagnosis of dementia in primary care: variations in the observed prevalence and comparisons to the expected prevalence. Aging Ment. Health 15, 978–984. doi: 10.1080/13607863.2011.596805

PubMed Abstract | CrossRef Full Text | Google Scholar

Cooper, C., Sommerlad, A., Lyketsos, C. G., and Livingston, G. (2015). Modifiable predictors of dementia in mild cognitive impairment: a systematic review and meta-analysis. Am. J. Psychiatry 172, 323–334. doi: 10.1176/appi.ajp.2014.14070878

PubMed Abstract | CrossRef Full Text | Google Scholar

Custodio, N., Alva-Diaz, C., Becerra-Becerra, Y., Montesinos, R., Lira, D., Herrera-Pérez, E., et al. (2016a). Rendimiento en pruebas cognitivas breves, de adultos mayores con demencia en estadios avanzados, residentes de una comunidad urbana de Lima, Perú. Rev. Peru. Med. Exp. Salud Pública 33, 662–669. doi: 10.17843/rpmesp.2016.334.2549

PubMed Abstract | CrossRef Full Text | Google Scholar

Custodio, N., Herrera-Perez, E., Lira, D., Roca, M., Manes, F., Báez, S., et al. (2016b). Evaluation of the INECO frontal screening and the frontal assessment battery in peruvian patients with Alzheimer’s disease and behavioral variant Frontotemporal dementia. eNeurologicalSci 5, 25–29. doi: 10.1016/j.ensci.2016.11.001

CrossRef Full Text | Google Scholar

Custodio, N., García, A., Montesinos, R., Lira, D., and Bendezú, L. (2011). Validation of the clock drawing test—Manos’ version—as a screening test for detection of dementia in older persons of Lima, Peru. Rev. Peru. Med. Exp. Salud Publica 28, 29–34. doi: 10.1590/S1726-46342011000100005

PubMed Abstract | CrossRef Full Text | Google Scholar

Custodio, N., and Lira, D. (2014). Adaptación peruana del minimental state examination (MMSE). An. Fac. Med. 75:69. doi: 10.15381/anales.v75i1.6951

CrossRef Full Text | Google Scholar

Custodio, N., Lira, D., Herrera-Perez, E., Nuñez Del Prado, L., Parodi, J., Guevara-Silva, E., et al. (2014). The memory alteration test discriminates between cognitively healthy status, mild cognitive impairment and Alzheimer’s disease. Dement. Geriatr. Cogn. Dis. Extra 4, 314–321. doi: 10.1159/000365280

PubMed Abstract | CrossRef Full Text | Google Scholar

Custodio, N., Wheelock, A., Thumala, D., and Slachevsky, A. (2017). Dementia in latin america: epidemiological evidence and implications for public policy. Front. Aging Neurosci. 9:221. doi: 10.3389/fnagi.2017.00221

PubMed Abstract | CrossRef Full Text | Google Scholar

Dal Forno, G., Palermo, M. T., Donohue, J. E., Karagiozis, H., Zonderman, A. B., and Kawas, C. H. (2005). Depressive symptoms, sex, and risk for Alzheimer’s disease. Ann. Neurol. 57, 381–387. doi: 10.1002/ana.20405

PubMed Abstract | CrossRef Full Text | Google Scholar

De Meyer, G., Shapiro, F., Vanderstichele, H., Vanmechelen, E., Engelborghs, S., De Deyn, P. P., et al. (2010). Diagnosis-independent Alzheimer disease biomarker signature in cognitively normal elderly people. Arch. Neurol. 67, 949–956. doi: 10.1001/archneurol.2010.179

PubMed Abstract | CrossRef Full Text | Google Scholar

Derby, C. A., Burns, L. C., Wang, C., Katz, M. J., Zimmerman, M. E., L’italien, G., et al. (2013). Screening for predementia AD: time-dependent operating characteristics of episodic memory tests. Neurology 80, 1307–1314. doi: 10.1212/WNL.0b013e31828ab2c9

PubMed Abstract | CrossRef Full Text | Google Scholar

Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198. doi: 10.1016/0022-3956(75)90026-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Freitas, S., Simões, M. R., Alves, L., and Santana, I. (2015). The relevance of sociodemographic and health variables on MMSE normative data. Appl. Neuropsychol. Adult 22, 311–319. doi: 10.1080/23279095.2014.926455

PubMed Abstract | CrossRef Full Text | Google Scholar

Hughes, C. P., Berg, L., Danziger, W. L., Coben, L. A., and Martin, R. (1982). A new clinical scale for the staging of dementia. Br. J. Psychiatry 140, 566–572. doi: 10.1192/bjp.140.6.566

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaplan, E., Goodglass, H., and Weintraub, S. (1983). The Boston Naming Test. 2nd Edn. Philadelphia, PA: Lea & Febiger.

Kato, Y., Narumoto, J., Matsuoka, T., Okamura, A., Koumi, H., Kishikawa, Y., et al. (2013). Diagnostic performance of a combination of Mini-mental state examination and clock drawing test in detecting Alzheimer’s disease. Neuropsychiatr. Dis. Treat. 9, 581–586. doi: 10.2147/NDT.S42209

PubMed Abstract | CrossRef Full Text | Google Scholar

Kim, J. L., Park, J. H., Kim, B. J., Kim, M. D., Kim, S.-K., Chi, Y. K., et al. (2012). Interactive influences of demographics on the mini-mental state examination (MMSE) and the demographics-adjusted norms for MMSE in elderly Koreans. Int. Psychogeriatr. 24, 642–650. doi: 10.1017/s1041610211002456

PubMed Abstract | CrossRef Full Text | Google Scholar

Ladeira, R. B., Diniz, B. S., Nunes, P. V., and Forlenza, O. V. (2009). Combining cognitive screening tests for the evaluation of mild cognitive impairment in the elderly. Clinics 64, 967–973. doi: 10.1590/s1807-59322009001000006

PubMed Abstract | CrossRef Full Text | Google Scholar

Lang, L., Clifford, A., Wei, L., Zhang, D., Leung, D., Augustine, G., et al. (2017). Prevalence and determinants of undetected dementia in the community: a systematic literature review and a meta-analysis. BMJ Open 7:e011146. doi: 10.1136/bmjopen-2016-011146

PubMed Abstract | CrossRef Full Text | Google Scholar

Laske, C., Sohrabi, H. R., Frost, S. M., López-de-Ipiña, K., Garrard, P., Buscema, M., et al. (2015). Innovative diagnostic tools for early detection of Alzheimer’s disease. Alzheimers Dement. 11, 561–578. doi: 10.1016/j.jalz.2014.06.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, H., Jia, J., and Yang, Z. (2016). Mini-mental state examination in elderly chinese: a population-based normative study. J. Alzheimers Dis. 53, 487–496. doi: 10.3233/jad-160119

PubMed Abstract | CrossRef Full Text | Google Scholar

Li, J., Wang, Y. J., Zhang, M., Xu, Z. Q., Gao, C. Y., Fang, C. Q., et al. (2011). Vascular risk factors promote conversion from mild cognitive impairment to Alzheimer disease. Neurology 76, 1485–1491. doi: 10.1212/WNL.0b013e318217e7a4

PubMed Abstract | CrossRef Full Text | Google Scholar

Lonie, J. A., Tierney, K. M., and Ebmeier, K. P. (2009). Screening for mild cognitive impairment: a systematic review. Int. J. Geriatr. Psychiatry 24, 902–915. doi: 10.1002/gps.2208

PubMed Abstract | CrossRef Full Text | Google Scholar

Maestre, G. E. (2012). Assessing dementia in resource-poor regions. Curr. Neurol. Neurosci. Rep. 12, 511–519. doi: 10.1007/s11910-012-0300-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Mattis, S. (1976). Mental status examination for organic mental syndrome in the elderly patient. Geriatr. Psychiatry 11:e121.

Google Scholar

McKhann, G., Drachman, D., Folstein, M., Katzman, R., Price, D., and Stadlan, E. M. (1984). Clinical diagnosis of Alzheimer’s disease: report of the NINCDS-ADRDA work group under the auspices of department of health and human services task force on Alzheimer’s disease. Neurology 34, 939–944. doi: 10.1212/wnl.34.7.939

PubMed Abstract | CrossRef Full Text | Google Scholar

Mendonça, M. D., Alves, L., and Bugalho, P. (2016). From subjective cognitive complaints to dementia: who is at risk? A systematic review. Am. J. Alzheimers Dis. Other Demen. 31, 105–114. doi: 10.1177/1533317515592331

PubMed Abstract | CrossRef Full Text | Google Scholar

Mitchell, A. J. (2009). A meta-analysis of the accuracy of the mini-mental state examination in the detection of dementia and mild cognitive impairment. J. Psychiatr. Res. 43, 411–431. doi: 10.1016/j.jpsychires.2008.04.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Moraes, C., Pinto, J. A., Lopes, M. A., Litvoc, J., and Bottino, C. M. C. (2010). Impact of sociodemographic and health variables on mini-mental state examination in a community-based sample of older people. Eur. Arch. Psychiatry Clin. Neurosci. 260, 535–542. doi: 10.1007/s00406-010-0104-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Nelson, H. E. (1976). A modified card sorting test sensitive to frontal lobe defects. Cortex 12, 313–324. doi: 10.1016/s0010-9452(76)80035-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Olavarria, L., Mardones, C., Delgado, C., and Slachevsky, A. (2015). Chilean health professionals perception of knowledge about dementia. J. Neurol. Sci. 357:e134. doi: 10.1016/j.jns.2015.08.429

CrossRef Full Text | Google Scholar

Oscanoa, T. J., Cieza, E., Parodi, J. F., and Paredes, N. (2016). Evaluación de la prueba de la moneda peruana en el tamizaje de trastorno cognitivo en adultos mayores. Rev. Peru. Med. Exp. Salud Publica 33, 67–73. doi: 10.17843/rpmesp.2016.331.2009

PubMed Abstract | CrossRef Full Text | Google Scholar

Ozer, S., Noonan, K., Burke, M., Young, J., Barber, S., Forster, A., et al. (2016). The validity of the memory alteration test and the test your memory test for community-based identification of amnestic mild cognitive impairment. Alzheimers Dement. 12, 987–995. doi: 10.1016/j.jalz.2016.03.014

PubMed Abstract | CrossRef Full Text | Google Scholar

Paddick, S.-M., Gray, W. K., McGuire, J., Richardson, J., Dotchin, C., and Walker, R. W. (2017). Cognitive screening tools for identification of dementia in illiterate and low-educated older adults, a systematic review and meta-analysis. Int. Psychogeriatr. 29, 897–929. doi: 10.1017/s1041610216001976

PubMed Abstract | CrossRef Full Text | Google Scholar

Parra, M. A. (2014). Overcoming barriers in cognitive assessment of Alzheimer’s disease. Dement. Neuropsychol. 8, 95–98. doi: 10.1590/s1980-57642014dn82000002

CrossRef Full Text | Google Scholar

Partington, J. E., and Leiter, R. G. (1949). Partington’s pathways test. Psychol. Serv. Cent. J. 1, 9–20.

Petersen, R. C., Smith, G. E., Waring, S. C., Ivnik, R. J., Tangalos, E. G., and Kokmen, E. (1999). Mild cognitive impairment: clinical characterization and outcome. Arch. Neurol. 56, 303–308. doi: 10.1001/archneur.56.3.303

PubMed Abstract | CrossRef Full Text | Google Scholar

Rami, L., Bosch, B., Sanchez-Valle, R., and Molinuevo, J. L. (2010). The memory alteration test (M@T) discriminates between subjective memory complaints, mild cognitive impairment and Alzheimer’s disease. Arch. Gerontol. Geriatr. 50, 171–174. doi: 10.1016/j.archger.2009.03.005

PubMed Abstract | CrossRef Full Text | Google Scholar

Rami, L., Bosch, B., Valls-Pedret, C., Caprile, C., Sánchez-Valle Díaz, R., and Molinuevo, J. L. (2009). Discriminatory validity and association of the mini-mental test (MMSE) and the memory alteration test (M@T) with a neuropsychological battery in patients with amnestic mild cognitive impairment and Alzheimer’s disease. Rev. Neurol. 49, 169–174.

PubMed Abstract | Google Scholar

Rami, L., Molinuevo, J. L., Sanchez-Valle, R., Bosch, B., and Villar, A. (2007). Screening for amnestic mild cognitive impairment and early Alzheimer’s disease with M@T (Memory Alteration Test) in the primary care population. Int. J. Geriatr. Psychiatry 22, 294–304. doi: 10.1002/gps.1672

PubMed Abstract | CrossRef Full Text | Google Scholar

Rey, A. (1941). L’examen psychologique dans les cas d’encéphalopathie traumatique (Les problems). Arch. Psychol. 28, 286–340.

Google Scholar

Richard, E., Andrieu, S., Solomon, A., Mangialasche, F., Ahtiluoto, S., Moll van Charante, E. P., et al. (2012). Methodological challenges in designing dementia prevention trials—The European Dementia Prevention Initiative (EDPI). J. Neurol. Sci. 322, 64–70. doi: 10.1016/j.jns.2012.06.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosselli, D., Ardila, A., Pradilla, G., Morillo, L., Bautista, L., Rey, O., et al. (2000). The mini-mental state examination as a selected diagnostic test for dementia: a Colombian population study. GENECO. Rev. Neurol. 30, 428–432.

PubMed Abstract | Google Scholar

Roth, M., Tym, E., Mountjoy, C. Q., Huppert, F. A., Hendrie, H., Verma, S., et al. (1986). CAMDEX. A standardised instrument for the diagnosis of mental disorder in the elderly with special reference to the early detection of dementia. Br. J. Psychiatry 149, 698–709. doi: 10.1192/bjp.149.6.698

PubMed Abstract | CrossRef Full Text | Google Scholar

Rubínová, E., Nikolai, T., Marková, H., Siffelová, K., Laczó, J., Hort, J., et al. (2014). Clock drawing test and the diagnosis of amnestic mild cognitive impairment: can more detailed scoring systems do the work? J. Clin. Exp. Neuropsychol. 36, 1076–1083. doi: 10.1080/13803395.2014.977233

PubMed Abstract | CrossRef Full Text | Google Scholar

Scazufca, M., Almeida, O. P., Vallada, H. P., Tasse, W. A., and Menezes, P. R. (2009). Limitations of the mini-mental state examination for screening dementia in a community with low socioeconomic status: results from the Sao Paulo Ageing & Health Study. Eur. Arch. Psychiatry Clin. Neurosci. 259, 8–15. doi: 10.1007/s00406-008-0827-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Sousa, M., Pereira, A., Costa, R., and Rami, L. (2015). Initial phase of adaptation of memory alteration test (M@T) in a portuguese sample. Arch. Gerontol. Geriatr. 61, 103–108. doi: 10.1016/j.archger.2015.03.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Tombaugh, T. N., and McIntyre, N. J. (1992). The mini-mental state examination: a comprehensive review. J. Am. Geriatr. Soc. 40, 922–935. doi: 10.1111/j.1532-5415.1992.tb01992.x

PubMed Abstract | CrossRef Full Text | Google Scholar

UNESCO Institute for Statistics. (2016). 50th anniversary of international literacy day: literacy rates are on the rise but millions remain illiterate. Available online at: http://uis.unesco.org/sites/default/files/documents/fs38-50th-anniversary-of-international-literacy-day-literacy-rates-are-on-the-rise-but-millions-remain-illiterate-2016-en.pdf [Accessed February 26, 2017].

Wechsler, D. (1997). WAIS-III: Wechsler Adult Intelligence Scale. 3rd Edn. San Antonio, TX: Psychological Corporation.

Wind, A. W., Schellevis, F. G., Van Staveren, G., Scholten, R. P., Jonker, C., and Van Eijk, J. T. (1997). Limitations of the mini-mental state examination in diagnosing dementia in general practice. Int. J. Geriatr. Psychiatry 12, 101–108. doi: 10.1002/(SICI)1099-1166(199701)12:1<101::AID-GPS469>3.0.CO;2-R

PubMed Abstract | CrossRef Full Text | Google Scholar

Xie, H., Zhang, C., Wang, Y., Huang, S., Cui, W., Yang, W., et al. (2016). Distinct patterns of cognitive aging modified by education level and gender among adults with limited or no formal education: a normative study of the mini-mental state examination. J. Alzheimers Dis. 49, 961–969. doi: 10.3233/jad-143066

PubMed Abstract | CrossRef Full Text | Google Scholar