The Chinese Translation Study of the Cognitive Reserve Index Questionnaire

Purpose: The purpose of this study was to perform the translation and adaption of the Cognitive Reserve Index questionnaire into Chinese and assess the reliability of the Chinese version.

Materials and Methods: The Chinese version of the Cognitive Reserve Index questionnaire was created from a standard forward-backward translation. A total of 371 volunteers, aged between 20 and 89 years, participated in this survey. Participants were divided into three age-groups (Young, Middle-aged, and Elderly), and subgroup differences were examined by independent samples t-tests, ANOVA analysis as well as post-hoc analysis. Pearson correlation analysis was applied to test the association between the total scores and each subscore (CRI-Education, CRI-WorkingActivity, and CRI-LeisureTime). The internal consistency and test-retest reliability of the Cognitive Reserve Index questionnaire were assessed. The test-retest reliability was measured among 40 participants with a 2-week interval using intraclass correlation coefficient.

Results: Strong correlations were observed between the total scores and each subscore (CRI-Education, CRI-WorkingActivity, and CRI-LeisureTime: r = 0.65, 0.79, and 0.70, respectively). In contrast, it was found low to moderate correlations among three subscores. The internal consistency was acceptable (Cronbach's alpha coefficient = 0.68). The intraclass correlation coefficient for total scores of the Chinese version of the Cognitive Reserve Index questionnaire was 0.87 (95% CI 0.74–0.93).

Conclusion: The Chinese version of the Cognitive Reserve Index questionnaire was a potentially reliable and practical tool for evaluating cognitive reserve accumulated through a person's life span.

Introduction

Cognitive reserve is a hypothetical construct that has received growing attention in current studies (Stern, 2002). Unlike a static or passive model of brain reserve, cognitive reserve refers to the cumulative flexibility (i.e., adaptability, efficiency, and capacity) of cognitive processes generated by participating in a variety of mentally stimulating activities throughout a person's lifetime, which enables to explain differences in susceptibility of cognitive abilities or daily function to brain aging, pathology or insult (Stern et al., 2020). The cognitive reserve hypothesis holds that greater cognitive reserve can better withstand or even attenuate the effects of age-related changes and pathological damages on cognitive status through compensatory strategies and brain network, whereas a more rapid course of cognitive decline might be notable once the amount of healthy or functional neurons drops to a certain threshold (Stern et al., 2019). In 2013, Kivipelto et al. proposed the protection/risk model of cognitive impairment and suggested that protective factors (such as education level, physical exercise, cognitively stimulating activities, and social interaction), mainly through the mechanism of increasing cognitive reserve, could buffer the impact of risk factors (such as advanced age, hypertension, diabetes, and depression) on cognitive impairment (Kivipelto et al., 2018). Some studies have supported that high life span cognitive reserve was associated with better cognitive performance, and later onset of clinical manifestations in diseases, such as Alzheimer's disease (Xu et al., 2020), Parkinson's disease (Hindle et al., 2014), stroke (Umarova et al., 2019; Shin et al., 2020), traumatic brain injuries (Fraser et al., 2019), bipolar disorder (Hinrichs et al., 2017), and multiple sclerosis (Lopez-Soley et al., 2020).

Although many researchers accept the concept of cognitive reserve, the lack of precise quantified measures limits the epidemiological studies of cognitive reserve. A growing number of studies have attempted to estimate cognitive reserve by using single or various combinations of the following proxies, such as education, occupational attainment, engagement in cognitively demanding activities, and premorbid intelligence (Nucci et al., 2012; Cheng, 2016; Stern et al., 2019). Nucci et al. (2012) designed and standardized the Cognitive Reserve Index questionnaire (CRIq) to evaluate a person's cognitive reserve, which consists of three parts, namely, education, working activity, and participation in leisure activities. The CRIq assesses the frequency and the time spent in these cognitively demanding activities over the individual's lifetime. To date, the CRIq has been available in more than 15 different languages including Italian, English, French, German, Spanish, Portuguese, Greek, and Turkish at http://cri.psy.unipd.it, and it has also been used to assess cognitive reserve in diverse populations, such as healthy adults as well as patients with liver cirrhosis, Parkinson's disease, multiple sclerosis, subjective cognitive impairment, mild cognitive impairment, and Alzheimer's diseases (Kartschmit et al., 2019; Garba et al., 2020). However, the lack of a Chinese version of CRIq (C-CRIq) limits its potential use among Chinese populations. Therefore, this study aimed to translate CRIq into Chinese and test its reliability.

Materials and Methods

Instruments

The CRIq encompasses some demographic data (date and place of birth, gender, place of residence, marital status, etc.), and other three dimensions, namely, education (2 items), working activity (1 item), and leisure time (17 items), each of which calculate the frequency and the number of years of these items. Finally, the CRIq yields a total score, called the Cognitive Reserve Index (CRI), which is a measure of CR. The higher the CRI, the higher the CR. Additionally, each dimension returns a subscore, namely, CRI-Education, CRI-WorkingActivity, and CRI-LeisureTime. The CRI-Education section includes formal years of education as well as occupational courses or vocational training. The CRI-WorkingActivity section includes the level and total years of adulthood professions. Notably, five different levels of working activities are available, namely, low-skilled manual work, skilled manual work, skilled non-manual or technical work, professional occupation, and highly intellectual occupation. The CRI-LeisureTime section includes a variety of enrichment activities performed during spare time, such as reading newspapers or magazines, visiting a museum, and exercising. The instructions, administration, and automatic calculation form for CRIq are available at http://cri.psy.unipd.it. The total CRIq scores are divided into five grades, namely, low (<70), medium-low (70–84), medium (85–114), medium-high (115–130), and high (>130). In the original study, the inter-item correlation was reported as good (Cronbach's alpha coefficient = 0.73).

Translation

After obtaining authorization for translation and use of CRIq from the original author, Dr. Massimo Nucci, a standard forward-backward translation approach was followed (Beaton et al., 2000). First, CRIq was independently translated from English into Mandarin Chinese by two authors (Cao and Zhang) of our study, and the discrepancies were discussed with a third researcher (Yu) until reaching a consensus. Second, this version was back-translated into English by two bilingual postgraduate students, who majored in translation and interpreting and were not familiar with the original questionnaire. Third, the professional researchers compared and verified that the C-CRIq was compatible with the original one in semantic and idiomatic terms. Finally, 30 volunteers were interviewed to administer the C-CRIq, and the results suggested that they had a fluent understanding of each item with no suggestions provided in the pre-final version stage. The C-CRIq is shown in Supplementary Material.

Participants and Data Collection

A convenience sample of non-clinical volunteers was recruited from two cities (Beijing, Tianjin) in northern China and one Province (Jiangsu) in southern China from August 2021 to December 2021. Eligible subjects for the study comprised adults aged 18 years and older who could communicate in Chinese. Participants with a history of neurological or psychological disorder were excluded. The trained investigators (graduate nursing students) delivered the C-CRIq to volunteers face-to-face. The CRIq is not anonymous. However, if a participant refused to register his/her name, a fictitious name was generated. Of all the samples, 40 participants who agreed to register their names and telephone numbers were selected for a second round of testing C-CRIq 2 weeks later. After checking that there were no missing items, the completed questionnaires were retrieved on site. The survey process ensured informed consent, voluntary participation, and information confidentiality (Cebi and Kulce, 2021).

Statistical Analysis

Data were expressed as mean with standard deviation (SD) for continuous or number and percentage for categorical data. Subgroup differences were tested with independent sample t-tests, One-way analysis of variance (ANOVA) as well as post-hoc analysis. A Pearson correlation analysis was applied to examine the relationship between the total and the subscores of C-CRIq. The Pearson's r correlation coefficients for all values were interpreted as follows: weak correlation (<0.3), moderate correlation (0.3–0.5), and strong correlation (>0.5; Cohen, 1988). The internal consistency reliability was assessed using Cronbach's alpha coefficient, and a value of ≥0.6 was considered to indicate adequate internal consistency (Pedroso and Gubert, 2021). The test-retest reliability was analyzed by intraclass correlation coefficient (ICC), which was calculated by the correlation between the first and second completion of C-CRIq. The test-retest reliability was stratified by ICC as follows: excellent (>0.80); good (0.60–0.80); moderate (0.40–0.60); and poor (<0.40) (Shrout and Fleiss, 1979). SPSS 24.0 was adopted for statistical analyses of all data. The statistical significance level was considered at p < 0.05.

Ethical Approval

The study was approved by the Institutional Review Board (IRB) of Peking University (Approval No. IRB00001052-21125).

Results

A total of 371 participants were included in our study (196 women, 52.8%). Their age ranged from 20 to 88 years (mean age: 52.3 ± 17.2, women: 47.3 ± 17.1, and men: 57.8 ± 15.5). All participants were classified into three age-groups according to the original work: Young, from 18 to 44 years (n = 140, 33.3 ± 5.6); Middle-aged, from 45 to 69 years (n = 160, 58.5 ± 7.1); and Elderly, from 70 to 88 years (n = 71, 75.6 ± 4.6). Their mean number of years of education was 12.5 ± 4.3 years (Young: 15.9 ± 3.4, Middle-aged: 11.2 ± 2.9, and Elderly: 8.9 ± 4.1; women: 13.3 ± 4.6 and men: 11.6 ± 3.9). ANOVA analyses revealed that the number of education years was significantly different between the age-groups (F = 114.607, p < 0.001), and post-hoc analysis showed that all binary group comparisons were significant (p < 0.01 for all). Women showed a higher level of education than men (t = −3.931, p < 0.001). The general demographics of the participants are presented in Table 1.

TABLE 1

Table 1. Demographic characteristics of the participants.

As for CRI-WorkingActivity, a total of 399 working activities were performed. Among 371 participants, 16 samples were unemployed or not yet employed, whereas 44 samples had two or three different levels of working activities throughout their life span. Low-skilled manual work was the most frequently reported activity (44.1%), followed by skilled manual work, skilled non-manual work, and professional occupation (22.7, 13.5, and 12.8%, respectively). Only 3.1% of the samples had a highly intellectual occupation. The frequencies of different levels of working activities across gender and age-groups are shown in Table 2. Regarding the leisure time activities, “grandchildren or elderly caring” (73.0%), “learning new technology” (67.1%), and “housework activities” (66.6%) were among the most frequently recorded activities. The least activities included participation in exhibitions, concerts or conferences, going to movies, and voluntary work (~6%).

TABLE 2

Table 2. Frequencies of levels of working activity categories according to gender and age-groups.

The number and frequency distribution of CRI levels according to gender and age-groups are shown in Table 3. According to the distribution of CRI levels, 68.7% of participants (n = 255) were found to have a medium level of CRI, and 26.4% (n = 113) of participants had low-medium CRI. On the contrary, only 1.1% (n = 4), 2.7% (n = 10), and 1.1% (n = 4) of participants were found to have low, medium-high, and high CRI, respectively.

TABLE 3

Table 3. The number and frequency distribution of CRI levels according to gender and age-groups.

The mean total CRI scores and the subscores across gender and age-groups are presented in Table 4 and Figure 1. For total CRI scores, age was the only significant factor [Young: 95.2 ± 7.0, Middle-aged: 90.2 ± 11.6, Elderly: 85.1 ± 12.0, F_{(2, 368)} = 26.649, p < 0.001]. A post-hoc analysis indicated a significant difference in total CRI scores across the three age-groups (p < 0.01 for both). For the CRI-Education subscores, no significant difference was found in gender (t = −1.001, p = 0.317) and age-groups [F_{(2, 368)} = 2.367, p = 0.097]. For CRI-WorkingActivity subscores, age was the only significant factor [Young: 98.2 ± 6.5, Middle-aged: 95.3 ± 12.5, Elderly: 93.7 ± 15.9; F_{(2, 368)} = 5.240; p = 0.006]. The post-hoc analyses showed Young had higher CRI-WorkingActivity scores compared to the Middle-aged group (p = 0.031), whereas Young and Elderly groups as well as Middle-aged and Elderly groups did not reach significance. For CRI-LeisureTime subscores, women exceeded men (women: 85.7 ± 9.0, men: 81.7 ± 12.8, t = −3.462, p = 0.001) and the three age-groups were also significant [Young: 89.7 ± 6.6, Middle-aged: 83.0 ± 11.6, Elderly: 74.1 ± 9.6; F_{(2, 368)} = 81.958; p < 0.001]. A post-hoc analysis also showed a significant difference in CRI-LeisureTime scores across the three age-groups, with significantly higher scores in the Young group and the Middle-aged group than in the Elderly group (p < 0.001 for both).

TABLE 4

Table 4. The mean and standard deviation of CRI scores for gender and age-groups.

FIGURE 1

Figure 1. Bar plots of total CRI scores (A) and subscores across gender and age-groups (B–D).

The findings detected that the total CRI scores had a strong correlation with three subscores: r = 0.65, 0.79, and 0.70 for CRI-Education, CRI-WorkingActivity, and CRI-LeisureTime, respectively. In contrast, it was observed low-to-moderate correlations among three subscores: r = 0.43 for CRI-Education and CRI-WorkingActivity, r = 0.20 for CRI-Education and CRI-LeisureTime, and r = 0.33 for CRI-WorkingActivity and CRI-LeisureTime. The Cronbach's alpha coefficient of the C-CRIq was 0.68. ICC for total CRI scores was 0.87 (95% CI: 0.74–0.93, n = 40).

Discussion

The aim of this study was to translate the CRIq into Chinese and test the reliability of C-CRIq. All the questionnaires, instructions, and calculation forms were properly translated to the Chinese language, according to the original study.

In the literature, the concept of cognitive reserve stemmed from observed discrepancies between brain pathology and clinical manifestation and was a relatively novel concept (Stern, 2012). Due to the uncertainty about the exact nature of reserve, cognitive reserve was considered a latent variable, which can be inferred through its indicators (Stern et al., 2019). Since CRIq considered multiple proxies and gave standardized scores taking individuals' age into account, it has been widely used as a tool to evaluate cognitive reserve capacity. The results of this study also demonstrated that C-CRIq could be used as a practical and efficient tool for measuring cognitive reserve in Chinese samples. Consistent with previous studies (Nucci et al., 2012; Maiovis et al., 2016; Ozakbas et al., 2021), the total CRI scores were strongly correlated with three subscores, indicating each proxy's significant contribution to the total CRI. In addition, our inter-subscores correlations were low to moderate, reflecting the distinct information of each proxy. Our results indicated that the Cronbach's alpha coefficient of C-CRIq was 0.68, slightly lower than that of the original study (Cronbach's alpha coefficient = 0.73) (Nucci et al., 2012), but the internal consistency was acceptable. Likewise, the test-retest reliability of the C-CRIq was slightly lower than a very recent Turkey study (ICC = 0.95) (Ozakbas et al., 2021), but it also achieved a good stability and consistency (ICC = 0.87). The potential reason might be that CRIq, especially the CRI-LeisureTime section, was required to record the frequency and years of past activities, whereas the average age of the participants in our study was older (52.3 ± 17.2) than that of the Turkish study (39.5 ± 14.0), which may have resulted in a slight offset.

Mean total CRI score and subscores were similar across genders, except that women had existed higher scores than men in CRI-LeisureTime, possibly due to the fact that several items (e.g., housework, grandchildren, or elderly care) pertained specifically to women (Nucci et al., 2012). Indeed, housework activities (66.6%) and grandchildren or elderly care (73.0%) were the most frequently reported leisure activities in our study. Age significantly affected total CRI scores and subscores of CRI-WorkingActivity and CRI-LeisureTime. As predicted, the elderly group had the lowest total CRI scores and the two subscores. These findings may be explained by the fact that the elderly people in Chinese relatively have fewer years of education, as revealed in our study, and, in turn, less complex occupational lives (63.5% were in low-skilled manual work). In addition, the presence of physical health problems might be a factor in reducing their social activities. Contrary to an original study (Nucci et al., 2012), it was the Young group, not the Middle-aged group, that had the highest total CRI scores and subscores of CRI-WorkingActivity and CRI-LeisureTime. This might be explained that the Young group in our study had more complex work than the Middle-aged group, and only 9.2% of participants in the Young group in this study were unemployed, which was much lower than 24% in the original study.

According to the protection/risk model of cognitive impairment, increased cognitive reserve, which was resulted from protective factors, could buffer cognitive decline (Kivipelto et al., 2018). Current evidence indicated that higher cognitive reserve was prone to reduce the risk of symptoms onset of mild cognitive impairment by about 50% (Soldan et al., 2020). However, it was of great concern that only 2.7% (n = 10) and 1.1% (n = 4) of participants were found to have medium-high and high cognitive reserves in our study. Considering the potential benefit to individuals of cognitive reserve, it is therefore crucial to quantify individuals' cognitive reserve through CRIq and to take targeted preventive measures in advance. Notably, while CRIq existed in more than 15 different language versions of CRIq, adaptations of the original questionnaire with full English coverage were only available in Turkey, Greece, and the United States (Kartschmit et al., 2019; Garba et al., 2020). Meanwhile, it remained unclear whether and how these proxies of CRIq were fundamental to cognitive reserve as a construct (Stern et al., 2019). Future research needs to further test the relationship between the construct and its indicators.

Our study had several limitations. One of the major limitations was the nature of the sample. Despite aiming to achieve sample diversity, most participants in this study were from big cities. Therefore, future studies should include samples with relatively heterogeneous cultural and socioeconomic backgrounds and a more equal distribution among gender and age-groups to make the samples better representative of the Chinese population. Furthermore, the relatively small sample size could be listed as another limitation of this study, although it was somewhat comparable to the sample size of previous studies. Therefore, further research should include more participants.

Taken together, C-CRIq was easy to implement and exhibited acceptable internal consistency and satisfactory test-retest reliability in the context of Chinese society. The C-CRIq was easy to apply to different age-groups and the automatic calculation of the scores was quite time-saving, and it is considered a practical tool to be used.

Conclusion

This study provided the translation and adaptation processing of the first Chinese tool to measure cognitive reserve. The current findings indicated that the C-CRIq was a reliable and time-saving tool for evaluating cognitive reserve. Chinese researchers can use the C-CRIq to quantitatively measure cognitive reserve and explore targeted rehabilitation measures for those with low cognitive reserve as early as possible, so as to reduce the risk of cognitive decline.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics Statement

The studies involving human participants were reviewed and approved by the Institutional Review Board (IRB) of Peking University. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

TC and SZ: resources, investigation, methodology, formal analysis, and writing—original draft. MY: methodology and writing—review and editing. XZ: investigation, methodology, and writing—original draft. QW: project administration, methodology, and writing—review and editing. All authors contributed to the article and approved the submittedversion.

Funding

This study was supported by the National Key R&D Program of China (Grant No. 2020YFC2008804).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors would like to thank Dr. Massimo Nucci et al. for giving us permission to adapt the Cognitive Reserve Index questionnaire into the Chinese language and for their valuable advice during the adaptation process and also like to thank all volunteers who participated in this study.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.948740/full#supplementary-material

References

Beaton, D. E., Bombardier, C., Guillemin, F., and Ferraz, M. B. (2000). Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25, 3186–3191. doi: 10.1097/00007632-200012150-00014

PubMed Abstract | CrossRef Full Text | Google Scholar

Cebi, M., and Kulce, S. N. (2021). The Turkish translation study of the cognitive reserve index questionnaire (CRIq). Appl. Neuropsychol. Adult. doi: 10.1080/23279095.2021.1896519. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Cheng, S. (2016). Cognitive reserve and the prevention of dementia: the role of physical and cognitive activities. Curr. Psychiatry Rep. 18, 85. doi: 10.1007/s11920-016-0721-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Cohen, J. (1988). Statistical Power Analysis for the Behavioural Sciences, 2nd edn. Hillsdale, NJ: Lawrence ErlbaumAssociates.

Google Scholar

Fraser, E. E., Downing, M. G., Biernacki, K., McKenzie, D. P., and Ponsford, J. L. (2019). Cognitive reserve and age predict cognitive recovery after mild to severe traumatic brain injury. J. Neurotrauma 36, 2753–2761. doi: 10.1089/neu.2019.6430

PubMed Abstract | CrossRef Full Text | Google Scholar

Garba, A. E., Grossberg, G. T., Enard, K. R., Jano, F. J., Roberts, E. N., Marx, C. A., et al. (2020). Testing the cognitive reserve index questionnaire in an Alzheimer's disease population. J. Alzheimers Dis. Rep. 4, 513–524. doi: 10.3233/ADR-200244

PubMed Abstract | CrossRef Full Text | Google Scholar

Hindle, J. V., Martyr, A., and Clare, L. (2014). Cognitive reserve in Parkinson's disease: a systematic review and meta-analysis. Parkinsonism Relat. Disord. 20, 1–7. doi: 10.1016/j.parkreldis.2013.08.010

PubMed Abstract | CrossRef Full Text | Google Scholar

Hinrichs, K. H., Easter, R. E., Angers, K., Pester, B., Lai, Z., Marshall, D. F., et al. (2017). Influence of cognitive reserve on neuropsychological functioning in bipolar disorder: findings from a 5-year longitudinal study. Bipolar. Disord. 19, 50–59. doi: 10.1111/bdi.12470

PubMed Abstract | CrossRef Full Text | Google Scholar

Kartschmit, N., Mikolajczyk, R., Schubert, T., and Lacruz, M. E. (2019). Measuring cognitive reserve (CR)—a systematic review of measurement properties of CR questionnaires for the adult population. PLoS ONE 14, e219851. doi: 10.1371/journal.pone.0219851

PubMed Abstract | CrossRef Full Text | Google Scholar

Kivipelto, M., Mangialasche, F., and Ngandu, T. (2018). Lifestyle interventions to prevent cognitive impairment, dementia and Alzheimer disease. Nat. Rev. Neurol. 14, 653–666. doi: 10.1038/s41582-018-0070-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Lopez-Soley, E., Solana, E., Martínez-Heras, E., Andorra, M., Radua, J., Prats-Uribe, A., et al. (2020). Impact of cognitive reserve and structural connectivity on cognitive performance in multiple sclerosis. Front. Neurol. 11, 581700. doi: 10.3389/fneur.2020.581700

PubMed Abstract | CrossRef Full Text | Google Scholar

Maiovis, P., Ioannidis, P., Nucci, M., Gotzamani-Psarrakou, A., and Karacostas, D. (2016). Adaptation of the cognitive reserve index questionnaire (CRIq) for the Greek population. Neurol. Sci. 37, 633–636. doi: 10.1007/s10072-015-2457-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Nucci, M., Mapelli, D., and Mondini, S. (2012). Cognitive reserve index questionnaire (CRIq): a new instrument for measuring cognitive reserve. Aging Clin. Exp. Res. 24, 218–226. doi: 10.1037/t53917-000

PubMed Abstract | CrossRef Full Text | Google Scholar

Ozakbas, S., Yigit, P., Akyuz, Z., Sagici, O., Abasiyanik, Z., Ozdogar, A. T., et al. (2021). Validity and reliability of “cognitive reserve index questionnaire” for the Turkish population. Mult. Scler. Relat. Disord. 50, 102817. doi: 10.1016/j.msard.2021.102817

PubMed Abstract | CrossRef Full Text | Google Scholar

Pedroso, J., and Gubert, M. B. (2021). Cross-cultural adaptation and validation of the Infant feeding style questionnaire in Brazil. PLoS ONE. 16, e0257991. doi: 10.1371/journal.pone.0257991

PubMed Abstract | CrossRef Full Text | Google Scholar

Shin, M., Sohn, M. K., Lee, J., Kim, D. Y., Lee, S., Shin, Y., et al. (2020). Effect of cognitive reserve on risk of cognitive impairment and recovery after stroke. Stroke 51, 99–107. doi: 10.1161/STROKEAHA.119.026829

PubMed Abstract | CrossRef Full Text | Google Scholar

Shrout, P. E., and Fleiss, J. L. (1979). Intraclass correlations: uses in assessing rater reliability. Psychol. Bull. 86, 420–428. doi: 10.1037/0033-2909.86.2.420

PubMed Abstract | CrossRef Full Text | Google Scholar

Soldan, A., Pettigrew, C., and Albert, M. (2020). Cognitive reserve from the perspective of preclinical Alzheimer disease. Clin. Geriatr. Med. 36, 247–263. doi: 10.1016/j.cger.2019.11.006

PubMed Abstract | CrossRef Full Text | Google Scholar

Stern, Y. (2002). What is cognitive reserve? Theory and research application of the reserve concept. J. Int. Neuropsychol. Soc. 8, 448–460. doi: 10.1017/S1355617702813248

PubMed Abstract | CrossRef Full Text | Google Scholar

Stern, Y. (2012). Cognitive reserve in ageing and Alzheimer's disease. Lancet Neurol. 11, 1006–1012. doi: 10.1016/S1474-4422(12)70191-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Stern, Y., Arenaza-Urquijo, E. M., Bartrés-Faz, D., Belleville, S., Cantilon, M., Chetelat, G., et al. (2020). Whitepaper: defining and investigating cognitive reserve, brain reserve, and brain maintenance. Alzheimers Dement. 16, 1305–1311. doi: 10.1016/j.jalz.2018.07.219

PubMed Abstract | CrossRef Full Text | Google Scholar

Stern, Y., Barnes, C. A., Grady, C., Jones, R. N., and Raz, N. (2019). Brain reserve, cognitive reserve, compensation, and maintenance: operationalization, validity, and mechanisms of cognitive resilience. Neurobiol. Aging 83, 124–129. doi: 10.1016/j.neurobiolaging.2019.03.022

PubMed Abstract | CrossRef Full Text | Google Scholar

Umarova, R. M., Sperber, C., Kaller, C. P., Schmidt, C. S. M., Urbach, H., Klöppel, S., et al. (2019). Cognitive reserve impacts on disability and cognitive deficits in acute stroke. J. Neurol. 266, 2495–2504. doi: 10.1007/s00415-019-09442-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Xu, H., Yang, R., Dintica, C., Qi, X., Song, R., Bennett, D. A., et al. (2020). Association of lifespan cognitive reserve indicator with the risk of mild cognitive impairment and its progression to dementia. Alzheimers Dement. 16, 873–882. doi: 10.1002/alz.12085

PubMed Abstract | CrossRef Full Text | Google Scholar