- 1Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Vrije Universiteit Amsterdam, Amsterdam UMC, Amsterdam, Netherlands
- 2Division of Clinical Geriatrics, Center for Alzheimer Research, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
- 3Department of General Practice and Medicine for Older Persons, Amsterdam Public Health Research Institute, Amsterdam University Medical Center, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
- 4Department of Epidemiology and Biostatistics, Amsterdam UMC, Amsterdam, Netherlands
- 5Faculty of Behavioural and Movement Sciences, Clinical Developmental Psychology, Clinical Neuropsychology, Vrije Universiteit Amsterdam, Amsterdam, Netherlands
Introduction: Impaired awareness in dementia caused by Alzheimer’s disease and related disorders made study partner-report the preferred method of measuring interference in “instrumental activities of daily living” (IADL). However, with a shifting focus toward earlier disease stages and prevention, the question arises whether self-report might be equally or even more appropriate. The aim of this study was to investigate how participant- and study partner-report IADL perform in a community-based volunteer population without dementia and which factors relate to differences between participant- and study partner-report.
Methods: Participants (N = 3,288; 18–97 years, 70.4% females) and their study partners (N = 1,213; 18–88 years, 45.8% females) were recruited from the Dutch Brain Research Registry. IADL were measured using the Amsterdam IADL Questionnaire. The concordance between participant- and study partner-reported IADL difficulties was examined using intraclass correlation coefficient (ICC). Multinomial logistic regressions were used to investigate which demographic, cognitive, and psychosocial factors related to participant and study partner differences, by looking at the over- and underreport of IADL difficulties by the participant, relative to their study partner.
Results: Most A-IADL-Q scores represented no difficulties for both participants (87.9%) and study partners (89.4%). The concordance between participants and study partners was moderate (ICC = 0.55, 95% confidence interval [CI] = [0.51, 0.59]); 24.5% (N = 297) of participants overreported their IADL difficulties compared with study partners, and 17.8% (N = 216) underreported difficulties. The presence of depressive symptoms (odds ratio [OR] = 1.31, 95% CI = [1.12, 1.54]), as well as memory complaints (OR = 2.45, 95% CI = [1.80, 3.34]), increased the odds of participants overreporting their IADL difficulties. Higher IADL ratings decreased the odds of participant underreport (OR = 0.71, 95% CI = [0.67, 0.74]).
Conclusion: In this sample of community-based volunteers, most participants and study partners reported no major IADL difficulties. Differences between participant and study partner were, however, quite prevalent, with subjective factors indicative of increased report of IADL difficulties by the participant in particular. These findings suggest that self- and study partner-report measures may not be interchangeable, and that the level of awareness needs to be considered, even in cognitively healthy individuals.
Introduction
As the research field of Alzheimer’s disease (AD) shifts its attention to earlier stages of the disease, clinically meaningful outcome measures that show early changes are becoming increasingly important (Edgar et al., 2019). One such outcome measure is the concept of “instrumental activities of daily living” (IADL), which refers to cognitively complex everyday activities (Lawton and Brody, 1969). Previous studies have shown that study partners report a decline in IADL in preclinical AD, even before cognitive problems can be detected by the standard cognitive testing (Sperling et al., 2011; Marshall et al., 2012, 2017; Zoller et al., 2014). Due to impairments in awareness in persons with dementia (Hanseeuw et al., 2020), (I)ADL functioning has traditionally been assessed using study partner-report questionnaires (Loewenstein et al., 2001; Howorth and Saper, 2003; Wadley et al., 2003; Desai et al., 2004; Farias et al., 2005; Graham et al., 2005; Sikkes et al., 2009; Hackett et al., 2020).
However, it has been suggested that study partner-report may be biased, by factors such as depression, anxiety, and caregiver burden (Zanetti et al., 1999; Arguelles et al., 2001; Ready et al., 2004). With a shift toward studying cognitively normal or “at-risk” individuals, one might assume that participants are able to reliably reflect on their own level of functioning, as they are thought to have accurate or potentially heightened awareness of their functional and cognitive abilities, as reflected in the concept of subjective cognitive decline (SCD) (Steward et al., 2019; Hanseeuw et al., 2020). In such populations, participant-report may therefore be a more appropriate and direct assessment method (DeBettignies et al., 1990; Zanetti et al., 1999; Arguelles et al., 2001).
When investigating participant- and study partner-report, a few findings stand out. First, several studies have found that there is no perfect concordance between participants and study partners, even in cognitively normal populations (Farias et al., 2005; Okonkwo et al., 2008; Marshall et al., 2020). Factors such as participant education, depression, and anxiety, as well as the nature of the relationship and the frequency and intensity of contact between participants and study partners, may affect how either party reports impairments, leading to discordance where one may report more or fewer impairments than the other. Second, studies investigating the interplay of these factors in cognitively normal populations are scarce. Furthermore, findings are difficult to compare between studies, due to differences in IADL measurements and in the definition and operationalization of concordance and discordance.
The Amsterdam IADL Questionnaire (A-IADL-Q) was developed as a study partner-rated questionnaire and has been extensively validated in memory clinic and community-based international aging populations (Sikkes et al., 2012, 2013a,b; Koster et al., 2015; Jutten et al., 2017; Facal et al., 2018; Villeneuve et al., 2019; Bruderer-Hofstetter et al., 2020; Dubbelman et al., 2020a). It is not yet known how the participant-report version of the A-IADL-Q performs and how it relates to study partner-report. The aim of this study was to investigate how the participant- and study partner-reported versions of the A-IADL-Q perform in a community-based population, without dementia, and what factors relate to differences between participant- and study partner-reported IADL functioning.
Materials and Methods
Participant Selection and Study Design
Participants were selected through the Dutch Brain Research Registry (Hersenonderzoek.nl), which is an online platform for people interested in cognition and brain-related research (Zwan et al., 2021). All eligible registrants were invited by email to participate in the study. The only inclusion criterion was participants being 18 years or older. Those who self-reported to have received a dementia-related diagnosis (i.e., dementia or mild cognitive impairment [MCI]) were excluded.
Data collection started in August 2018 and ended in December 2018. The study was approved by the medical ethical committee of the VU University Medical Center. The participants provided consent via Hersenonderzoek.nl. Since study partners were not recruited through Hersenonderzoek.nl, they provided consent prior to completing the online IADL questionnaire.
Measures
Amsterdam Instrumental Activities of Daily Living Questionnaire
The main outcome measure was the A-IADL-Q. The A-IADL-Q was developed as a study partner-report instrument aimed at measuring problems in cognitively complex everyday functioning (Sikkes et al., 2012). For the current study, we adapted the study partner-report version to a participant-report version. Both versions consist of the same 30 items, covering a broad range of cognitive IADL. Each item assesses difficulty performing an activity due to cognitive problems, such as problems with memory, attention, or executive functioning. Item responses were rated on a five-point Likert scale, ranging from “no difficulty in performing this activity” (0) to “no longer able to perform this activity” (4). The total score is calculated using item response theory (IRT), assuming a single underlying construct (Reise and Waller, 2009), that is, IADL functioning, ranging from disability to ability. Total scores range from 20 to 70 and were reversed so that higher scores reflect better IADL functioning. A cutoff value for dementia was previously placed at 51.4 (Sikkes et al., 2013b), while scores above 60 were considered to indicate no IADL difficulties (Dubbelman et al., 2020b). The study partner-report version of the A-IADL-Q has undergone extensive validation, showing a good content and construct validity, high internal consistency, high test-retest reliability, good responsiveness to change and ablity to measure IADL across cultures and languages (Sikkes et al., 2013a,b; Koster et al., 2015; Jutten et al., 2017; Dubbelman et al., 2020a). The study partner version of the A-IADL-Q also includes questions about the type of relation to the participant and cohabitation. Study partners were classified as spouses, children, siblings, or “other.” Study partners in the “other” category included friends, coworkers, or other family members.
Other Measures
Cognitive functioning was assessed using the Cognitive Online Self-Test Amsterdam (COST-A), an online cognitive self-test developed and validated by Van Mierlo et al. (2017). The COST-A included 10 tasks, namely, orientation, digit-sequence learning, immediate word recall, two trail-making tasks (i.e., connecting numbered dots and alternately connecting lettered and numbered dots), delayed word recall, delayed word recognition, immediate recall of word pairs, recognition of word pairs, and semantic comprehension. Performance on each of the tasks was standardized and averaged into a Z-score to represent overall cognitive functioning, where higher scores indicate better cognition. Visser et al. (2021) provided a more detailed description of the COST-A.
In addition, a single yes/no question (“Do you have memory complaints?”) assessed subjective memory complaints. Depressive symptoms were assessed with the five-item short form of the Geriatric Depression Scale (GDS5) (Hoyl et al., 1999) with higher scores indicating more depressive symptoms. The education level was classified as low-medium (up to high school) and high education (college degree).
Defining Awareness of Instrumental Activities of Daily Living Functioning
In line with other studies, we defined concordance based on the discrepancy between participant- and study partner-report (Hanseeuw et al., 2020). Based on a previously determined clinically meaningful difference over time of 2.4 points, we categorized concordance into three groups, (Dubbelman et al., 2020) namely, (1) concordance between dyads, (2) discordance between dyads with the participant “overreporting” difficulties (i.e., scoring ≥ 2.4 points lower than their study partner), and (3) discordance between dyads with the participant “underreporting” difficulties (i.e., scoring ≥ 2.4 points higher than their study partner).
Statistical Analyses
Demographic differences between study partners and participants were tested using independent t-tests or chi-square tests. The frequency of IADL difficulties among cognitively normal participants and their study partners was determined. Then, in separate linear regression analyses, A-IADL-Q scores of both raters were associated with age, education, objective cognitive functioning, subjective cognitive functioning, and depressive symptoms.
The intraclass correlation coefficient (ICC) was computed to examine the absolute agreement between participant and study partner ratings. According to the criteria suggested by Koo et al., an ICC < 0.5 shows poor agreement, an ICC of 0.5–0.75 shows moderate, and an ICC > 0.75 shows good agreement (Koo and Li, 2016).
Using stepwise multinomial logistic regression models with backward selection, we investigated which factors related to concordance and discordance between dyads. The variables included the following parameters of participants: education level, sex, age, COST-A scores, memory complaints, GDS5 total score, study partner-reported IADL functioning, the type of relationship, cohabitation (yes/no), and the absolute age difference between dyads. For this analysis, COST-A scores were dichotomized into normal (more than -1.5 SD) and low (less than or equal to −1.5 SD) cognitive functioning. All analyses were performed using R version 4.0.3 software (R Core Team, 2020).
Results
Of the 11,060 eligible registrants, 4,817 individuals (44%) were interested in participation and received study instructions. After receiving instructions, 3,288 (68%) individuals completed the participant-reported A-IADL-Q. On average, participants were 61.0 ± 12.1 years old and the majority of them were women (i.e., 2,315; 70.4%). Approximately, half the participants experienced memory complaints. Table 1 displays all participant and study partner characteristics. Participant and study partner characteristics stratified by age groups are shown in Supplementary Material.
For 1,213 participants (36.9% of complete sample), the A-IADL-Q was also completed by a study partner (participant and study partner pairs will be referred to as “dyads”). Participants who were part of a dyad were 62.5 ± 11.1 years old, and the majority of them were women (i.e., 828; 68.3%). They were older (p < 0.001) and more often men (p = 0.046) than participants who were not part of a dyad. Within dyads, the participants were older (p < 0.001) and more likely to be women (p < 0.001) than study partners.
Instrumental Activities of Daily Living Difficulties in a Cognitively Normal Population
Figure 1 shows the distribution of participant- and study partner-reported A-IADL-Q scores. Among dyads, the participant-reported A-IADL-Q scores (65.9 ± 4.8) did not differ from the study partner-reported A-IADL-Q scores (66.1 ± 4.6; p = 0.186). Virtually all participants (3,232/3,288; 98.3%) and study partners (1,195/1,213; 98.5%) reported A-IADL-Q scores above a previously established cutoff for dementia (total score of 51.4). Moreover, the vast majority of both participant-reported (87.9%) and study partner-reported (89.4%) total scores were higher than 60, indicating no difficulties.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/761932/fnagi-13-761932-HTML-r2/image_m/fnagi-13-761932-g001.jpg)
Figure 1. A-IADL-Q total score distribution among all participants (left panel, N = 3,288) and among dyads (right panel, N = 1,213, participants are denoted in green and study partners are denoted in purple).
Then, we examined IADL difficulties at an item level. Half of all participants (i.e., 1,750/3,288, 53.2%) and study partners (i.e., 722/1,213, 59.5%) reported no difficulties in any activity. Those who reported difficulties mostly did so in only one activity (i.e., 35.2% of participants and 35.8% of study partners). Figure 2 shows the percentage of participants and study partners who reported difficulties for each IADL activity. Most frequently reported IADL difficulties for both participants and study partners were working (i.e., 26.9 and 19.9%, respectively), household duties (i.e., 22.2 and 16.5%, respectively), and making minor repairs at home (i.e., 16.4 and 12.7%, respectively).
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/761932/fnagi-13-761932-HTML-r2/image_m/fnagi-13-761932-g002.jpg)
Figure 2. Stacked bar chart showing the percentage of participants (denoted in shades of green) and study partners (denoted in shades of purple) who reported difficulties (N = 1,213). The dark shades represent difficulty with the activity: “no longer able to perform this activity” (4), “much more difficulty” (3), “more difficulty” (2), and “slightly more difficulty” (1). The lightest shade represents “no difficulty in performing this activity” (0). Displaying data from dyads only.
Table 2 shows the associations between age, education level, cognitive complaints, COST-A, GDS, and participant- and study partner-reported IADL performance. Higher age was associated with lower A-IADL-Q scores, and higher education was associated with better A-IADL-Q scores, but associations were weak. For example, with every 10 years increase in age, A-IADL-Q participant- and study partner-reported scores decreased with 1.2 and 1.8 points, respectively. Both participant- and study partner-reported A-IADL-Q scores were more highly associated with COST-A scores, memory complaints, and GDS. Higher COST-A scores, indicating better cognitive functioning, were associated with better IADL functioning, whereas a higher GDS, indicating more depressive symptoms, and presence of memory complaints were associated with worse IADL functioning. Associations with age, education, and COST-A scores were comparable for participant- and study partner-report, whereas associations with GDS and memory complaints were more strongly associated with participant-reported IADL scores.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/761932/fnagi-13-761932-HTML-r2/image_m/fnagi-13-761932-t002.jpg)
Table 2. Linear regressions to investigate associations with participant- and study partner-reported IADL performance.
Concordance and Discordance Between Dyads
There was a moderate agreement between participant- and study partner-reported IADL functioning (ICC = 0.55, 95% CI = [0.51, 0.59], p < 0.001; see Supplementary Table 1). Of all 1,213 dyads, 700 (57.7%) were in concordance. Two hundred sixteen participants (17.8%) underreported difficulties, compared with their study partners, and 297 participants (24.5%) overreported IADL difficulties, compared to their study partners. Compared with concordant dyads, participants with memory complaints (odds ratio [OR] = 2.44, 95% CI = [1.80, 3.32], p < 0.001) and with a higher GDS (OR = 1.31, 95% CI = [1.12, 1.53], p = 0.001) were more likely to overreport IADL difficulties (see Table 3). Participant underreport was less likely when there were fewer IADL difficulties (OR = 0.71, 95% CI = [0.67, 0.74], p < 0.001). Thus, concordance was more likely when the participant did not experience memory complaints, when they had lower GDS scores, and when IADL performance was higher. Education, age, gender, and COST-A scores of participants were not related to concordance between dyads.
![www.frontiersin.org](https://www.frontiersin.org/files/Articles/761932/fnagi-13-761932-HTML-r2/image_m/fnagi-13-761932-t003.jpg)
Table 3. Multivariable multinomial logistic regression models comparing study partners reporting more IADL difficulties than participant (N = 216) and participant reporting more IADL difficulties than study partner (N = 297), compared with agreement between the participant and study partner (N = 700).
Discussion
In this study, we showed that the majority of IADL scores fell within the range of normal IADL functioning in this community-based population, but that discordance among dyads was quite prevalent. A small proportion reported subtle IADL difficulties, which was associated with older age, lower education, worse cognitive performance, presence of self-reported memory complaints, and more depressive symptoms of participants, for both participant- and study partner-report. A moderate agreement between participant- and study partner-reported IADL was found with discordance between dyads being more likely when the participant reported memory complaints, and had depressive symptoms and lower IADL performance.
While the large majority of participant- and study partner-reported IADL functioning fell within the range of normal IADL functioning, approximately a tenth of both participants and study partners scored below the previously established cutoff for normal IADL functioning (Dubbelman et al., 2020b). This prevalence of impaired IADL is comparable to other population-based studies (Ostbye et al., 1997; Pudaric et al., 2003; Crimmins et al., 2011; Scheel-Hincke et al., 2020). For example, Scheel-Hincke et al. (2020) reported a prevalence of impaired IADL of 12 to 20% in Western Europe, with impaired IADL defined as presence of any difficulties. Another population-based study by Pudaric et al. (2003) reported a prevalence of impaired IADL (inability to carry out shopping, cooking, or housework) of 6 to 11%. Despite this comparable prevalence of abnormal IADL functioning, it is important to note that approximately half of our population reported more subtle difficulties. If we applied the definition of Scheel-Hincke et al. (2020), the prevalence of impaired IADL in our study would be approximately 50%, which is substantially higher than the prevalence that they reported. There are two potential explanations for this difference: first, we included more activities, and second, and more importantly, we included more cognitively complex activities than other studies. This is illustrated by the fact that most problems were reported in working, household duties, and making repairs, which are especially cognitively complex (Jutten et al., 2017). These activities were not included in other IADL scales. For example, a population-based study that assessed five IADL items (Chan et al., 2012) reported most problems for shopping. In our population, problems with shopping were fourth most prevalent. We found a higher proportion of difficulties for more complex activities, supporting the notion that including more complex activities enabled detection of more fine-grained difficulties in IADL functioning.
With regard to potential sources of bias in the report of IADL functioning, we found low associations between both study partner- and participant-reported IADL functioning and age and education. This finding is supported by previous validation studies for the study partner version of the A-IADL-Q (Sikkes et al., 2013a; Jutten et al., 2017; Dubbelman et al., 2020a). Participant- and study partner-report were similarly associated with objective cognitive performance, but participant-reported IADL functioning was more strongly related to depressive symptoms, as well as subjective cognitive performance (i.e., presence of self-reported memory complaints). Consistent with recent literature suggesting that study partners are better able to assess the functioning of participants than the participant themselves (Howland et al., 2017), our findings might imply that study partner-report is less biased than participant-report by participant-related subjective factors.
Our findings demonstrated only a moderate concordance between dyads. While the distributions of study partner- and participant-reported IADL scores were largely similar, we found a moderate ICC and a high proportion of discordance (either over- or underreport). Other studies have also shown discordance in cognitively normal participants and, specifically, participant overreport (Ostbye et al., 1997; Farias et al., 2005; Okonkwo et al., 2008; Pol et al., 2011). For example, a study by Okonkwo et al. (2008) showed slight discordance between participant- and study partner-report of specific finance-related IADL. The proportion of discordance that we found in our study is substantially higher, which is probably due to differences in IADL measures, definitions of concordance, and population differences. As opposed to Okonkwo et al. (2008), who calculated concordance based on an individual item, we determined concordance based on a more global measure of IADL with a wider range of activities. We calculated concordance based on a clinically meaningful difference in total scores. Another potential explanation may be that, even though we used a population-based sample, we did not screen for cognitive impairment. As such, it is possible that there were participants who had subtle cognitive impairment but did not meet criteria for MCI or dementia. Thus, while the proportion of discordance is difficult to compare with other studies, the fact that other studies also reported discordance suggests that participant- and study partner-report might not be interchangeable.
The potential limited interchangeability is further supported by our results, which indicate that concordance is influenced by self-reported memory complaints and depressive symptoms. Participants with memory complaints reported more difficulties, compared with their study partners. Participant overreport of memory complaints has previously been described as a heightened awareness (Hanseeuw et al., 2020), which is thought to characterize early stages of AD and related disorders (Jessen et al., 2014; Slot et al., 2019; Hanseeuw et al., 2020). Following this theory, a subgroup of our study sample may have a heightened functional awareness. This idea is further supported by our finding that a large proportion of our sample had memory complaints, which may indicate a heightened memory awareness. While no other studies have investigated the effect of subjective cognitive functioning on the concordance of functional impairment, several studies (Weinberger et al., 1992; Ostbye et al., 1997; Albert et al., 1999; Tabert et al., 2002; Farias et al., 2005; Okonkwo et al., 2008; Pol et al., 2011) related objective cognitive functioning to concordance. These studies show that patients with poorer global cognition are more likely to underreport IADL difficulties. We did not find a significant association between concordance and objective cognition within our healthy volunteer population. This could be due to the fact that our population is presumably cognitively healthy, and lowered awareness may not occur until cognitive problems start to develop (Starkstein et al., 2006; Hanseeuw et al., 2020). Although not significant, in this population, lower cognitive performance seems to be related to reduced odds for participant underreport. This might suggest that the subtle cognitive problems of these individuals do not interfere with their disease insight, but rather, that they increase their awareness. Furthermore, participants with depressive symptoms were more likely to overreport, and less likely to underreport, IADL difficulties. This was also reported in studies in MCI and dementia that showed a greater chance of discordance when participants had depressive symptoms (Magaziner et al., 1996; Okonkwo et al., 2008). This is in line with the idea that negative self-perception in patients with depressive symptoms causes exaggeration of deficits (Lahr et al., 2007), as has also been shown by Okonkwo et al. (2008), who reported that underestimation of financial abilities was related to higher depressive symptoms. Thus, memory complaints and depressive symptoms both influence the report of IADL difficulties of participants and need to be taken into consideration when using participant-reported IADL measures.
The findings discussed earlier may have important implications for study design decisions and should be considered carefully when considering the use of a participant-reported IADL instrument. Although a concordance of 60% might seem low, the majority of both participant- and study partner-reported difficulties fell within the category of “no difficulties.” This crude overlap indicates that participant-report IADL can be useful in cognitively normal populations in cross-sectional studies. However, when a deterioration of cognitive functioning and subsequently everyday functioning is to be expected, study partner-report might provide a more reliable indication of change in IADL functioning. The combination of participant- and study partner-report can be used to establish awareness, which is informative since it has been shown to predict future disease progression (Nosheny et al., 2019, 2020) and greater discordance seems to be related to a greater risk of Alzheimer pathology (Tabert et al., 2002; Hanseeuw et al., 2020). The combination of participant- and study partner-report might also be valuable as they seem to reflect different perspectives. This is reflected in the current study as participant-report seems to be more influenced by subjective factors than the study partner-report. The different perspectives were also implied in an article by Amariglio et al. (2021) who showed that distinct IADL items were related to amyloid pathology for participants and study partners. Thus, participant self-report can be used in cognitively normal populations but should ideally be supplemented by study partner-report, not only when considering the cognitive decline of participants in longitudinal studies but also to gain multiple perspectives and insight into the awareness of participants.
Some limitations should be considered when interpreting our findings. For the lack of an objective IADL measure, we cannot ascertain whether participants indeed overreport their difficulties or whether participants actually have IADL difficulties that the study partner does not yet notice. In contrast, a heightened participant awareness may also reflect lowered study partner awareness. This caveat notwithstanding, the absence of an association between participant overreport and objective cognitive functioning could indicate that participant overreport is more strongly influenced by subjective than objective factors. It should also be noted that objective cognition and IADL performance cannot be completely separated, as IADL performance is dependent on cognition. This may introduce some level of circularity into the analyses. However, the association between our objective cognitive measure and the A-IADL-Q scores was only moderate. Furthermore, as the study partner-report is generally considered a gold standard in dementia research and clinical practice (Sikkes and De Rotrou, 2014), we used it as such in the current study. Another limitation is the selective nature of the volunteer registry, which consists mostly of highly educated and highly motivated individuals. This may limit generalizability to the general population. We did not include factors such as caregiver burden, personality traits, or more detailed information on the amount of contact between the participant and the study partner. Future studies should consider assessing these factors to obtain more detailed insight into the accuracy of assessments and possible biases. Furthermore, follow-up studies are needed to determine the pivot point until which the participant is still able to reliably evaluate their own level of daily functioning.
An important strength of this study is the large sample of cognitively healthy volunteers, representing a large range of ages, from early adulthood to late life. We included detailed information about the level of IADL difficulties from both self- and study partner-report in a cognitively healthy population, providing valuable new insights into the occurrence of more subtle IADL difficulties. While the clinically meaningful cutoff was determined for decline and not for differences between respondents, a strength of this clinically meaningful cutoff to distinguish concordance from discordance is that we believed that discordance actually represented an important, non-negligible difference in IADL report.
Conclusion
Our findings show a moderate concordance between participants and study partners in reporting IADL difficulties, with subjective factors influencing the level of concordance. These findings suggest caution in using self- and study partner-report measures interchangeably, even in cognitively healthy community-based samples. Our results suggest that participant report might be more related to subjective factors and that study partner-report is less associated with these factors, possibly reflecting differing perspectives.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by the VU University Medical Center. The participants provided their written informed consent to participate in this study.
Author Contributions
SS, WF, HH, MV, and MZ: conception or design of the work. MZ, EN, LV, and MV: data collection. MV, MD, SS, WF, and HH: data analysis and interpretation. SS, MD, MV, and LV: drafting the manuscript. All authors provided critical revision of the article and final approval of the version to be published.
Funding
LV was supported by a fellowship grant received from Alzheimer Nederland (WE.15-2019-05) and recipient of ABOARD, which is a public-private partnership receiving funding from ZonMW (#73305095007) and Health Holland, Topsector Life Sciences & Health (PPP-allowance; #LSHM20106). All funding is paid to the institution. WF has received funding from NWO, EU-FP7, EU-JPND, Alzheimer Nederland, CardioVascularOnderzoek Nederland, stichting Dioraphte, Gieskes-Strijbis fund, stichting Equilibrio, Pasman stichting, Biogen MA Inc., Boehringer Ingelheim, Life-MI, AVID, Roche BV, Fujifilm, and Combinostics. WF holds the Pasman chair, has performed contract research for Biogen MA Inc., and Boehringer Ingelheim, is a consultant to Oxford Health Policy Forum CIC, Roche, and Biogen MA Inc., and has been an invited speaker at Boehringer Ingelheim, Biogen MA Inc., Danone, Eisai, and WebMD Neurology (Medscape). All funding is paid to her institution. PS has acquired grant support (for the institution; Alzheimer Center Amsterdam) from GE Healthcare, Danone Research, Piramal, and MERCK. In the past 2 years, he has received consultancy/speaker fees (paid to the institution) from Lilly, GE Healthcare, Novartis, Sanofi, Nutricia, Probiodrug, Biogen, Roche, Avraham, and EIP Pharma. SS has received funding from Health Holland, Topsector Life Sciences & Health (Grant Nos. LSHM19051 and LSHM20084), and ZonMW (Grant Nos. #7330502051 and #73305095008) and has received consultancy fees from Biogen, Lundbeck, Boehringer, and Toyama and license fees for use of Amsterdam IADL Questionnaire from Green Valley, VtV Therapeutics, Alzheon, Vivoryon, Roche, Neuroscience, Janssen, Medavante, and Genentech. All funds are paid to her institution. The other authors have no relevant disclosures.
Conflict of Interest
The authors declare that this study received funding from Stichting Stoffels-Hornstra. The funder was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
The authors thank the participants and their study partners for their time and participation in this study. The participant recruitment was accomplished through Hersenonderzoek.nl, a Dutch online registry that facilitates participant recruitment for neuroscience studies (www.hersenonderzoek.nl).
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnagi.2021.761932/full#supplementary-material
References
Albert, S. M., Michaels, K., Padilla, M., Pelton, G., Bell, K., Marder, K., et al. (1999). Functional significance of mild cognitive impairment in elderly patients without a dementia diagnosis. Am. J. Geriatr. Psychiatry 7, 213–220. doi: 10.1097/00019442-199908000-00005
Amariglio, R. E., Sikkes, S. A. M., Marshall, G. A., Buckley, R. F., Gatchel, J. R., Johnson, K. A., et al. (2021). Item-level investigation of participant and study partner report on the cognitive function index from the A4 study screening data. J. Prev. Alzheimers Dis. 8, 257–262. doi: 10.14283/jpad.2021.8
Arguelles, S., Loewenstein, D. A., Eisdorfer, C., and Arguelles, T. (2001). Caregivers’ judgments of the functional abilities of the Alzheimer’s disease patient: impact of caregivers’ depression and perceived burden. J. Geriatr. Psychiatry Neurol. 14, 91–98. doi: 10.1177/089198870101400209
Bruderer-Hofstetter, M., Dubbelman, M. A., Meichtry, A., Koehn, F., Munzer, T., Jutten, R. J., et al. (2020). Cross-cultural adaptation and validation of the Amsterdam Instrumental Activities of Daily Living questionnaire short version German for Switzerland. Health Qual. Life Outcomes 18:323. doi: 10.1186/s12955-020-01576-w
Chan, K. S., Kasper, J. D., Brandt, J., and Pezzin, L. E. (2012). Measurement equivalence in ADL and IADL difficulty across international surveys of aging: findings from the HRS, SHARE, and ELSA. J. Gerontol. B Psychol. Sci. Soc. Sci. 67, 121–132. doi: 10.1093/geronb/gbr133
Crimmins, E. M., Kim, J. K., and Sole-Auro, A. (2011). Gender differences in health: results from SHARE, ELSA and HRS. Eur. J. Public Health 21, 81–91. doi: 10.1093/eurpub/ckq022
DeBettignies, B. H., Mahurin, R. K., and Pirozzolo, F. J. (1990). Insight for impairment in independent living skills in Alzheimer’s disease and multi-infarct dementia. J. Clin. Exp. Neuropsychol. 12, 355–363. doi: 10.1080/01688639008400980
Desai, A. K., Grossberg, G. T., and Sheth, D. N. (2004). Activities of daily living in patients with dementia: clinical relevance, methods of assessment and effects of treatment. CNS Drugs 18, 853–875. doi: 10.2165/00023210-200418130-00003
Dubbelman, M. A., Verrijp, M., Facal, D., Sanchez-Benavides, G., Brown, L. J. E., van der Flier, W. M., et al. (2020a). The influence of diversity on the measurement of functional impairment: an international validation of the Amsterdam IADL Questionnaire in eight countries. Alzheimers Dement. (Amst). 12:e12021. doi: 10.1002/dad2.12021
Dubbelman, M. A., Verrijp, M., Jutten, R. J., Terwee, C. B., Visser, L. N. C., Van der Flier, W. M., et al. (2020) “OC39: detecting meaningful change in everyday functioning: a mixed-methods approach to establish clinical meaninguflnes of changes on the Amsterdam IADL Questionnaire,” in Symposia – Oral Communications – Late Breaking News. J. Prev. Alzheimers Dis., vol. 7, 2–54. doi: 10.14283/jpad.2020.54
Dubbelman, M. A., Verrijp, M., Visser, L. N. C., Terwee, C. B., van Der Flier, W., Scheltens, P., et al. (2020b). A mixed-methods approach to establish clinically meaningful categories of impairment in instrumental activities of daily living. Alzheimers Dement. 16:e045693.
Edgar, C. J., Vradenburg, G., and Hassenstab, J. (2019). The 2018 Revised FDA Guidance for early Alzheimer’s disease: establishing the meaningfulness of treatment effects. J. Prev. Alzheimers. Dis. 6, 223–227. doi: 10.14283/jpad.2019.30
Facal, D., Carabias, M. A. R., Pereiro, A. X., Lojo-Seoane, C., Campos-Magdaleno, M., Jutten, R. J., et al. (2018). Assessing everyday activities across the dementia spectrum with the Amsterdam IADL Questionnaire. Curr. Alzheimer Res. 15, 1261–1266. doi: 10.2174/1567205015666180925113411
Farias, S. T., Mungas, D., and Jagust, W. (2005). Degree of discrepancy between self and other-reported everyday functioning by cognitive status: dementia, mild cognitive impairment, and healthy elders. Int. J. Geriatr. Psychiatry 20, 827–834. doi: 10.1002/gps.1367
Graham, D. P., Kunik, M. E., Doody, R., and Snow, A. L. (2005). Self-reported awareness of performance in dementia. Brain Res. Cogn. Brain Res. 25, 144–152. doi: 10.1016/j.cogbrainres.2005.05.001
Hackett, K., Mis, R., Drabick, D. A. G., and Giovannetti, T. (2020). Informant reporting in mild cognitive impairment: sources of discrepancy on the functional activities questionnaire. J. Int. Neuropsychol. Soc. 26, 503–514. doi: 10.1017/S1355617719001449
Hanseeuw, B. J., Scott, M. R., Sikkes, S. A. M., Properzi, M., Gatchel, J. R., Salmon, E., et al. (2020). Evolution of anosognosia in alzheimer’s disease and its relationship to amyloid. Ann. Neurol. 87, 267–280. doi: 10.1002/ana.25649
Howland, M., Allan, K. C., Carlton, C. E., Tatsuoka, C., Smyth, K. A., and Sajatovic, M. (2017). Patient-rated versus proxy-rated cognitive and functional measures in older adults. Patient Relat. Outcome Meas. 8, 33–42. doi: 10.2147/PROM.S126919
Howorth, P., and Saper, J. (2003). The dimensions of insight in people with dementia. Aging Ment. Health 7, 113–122. doi: 10.1080/1360786031000072286
Hoyl, M. T., Alessi, C. A., Harker, J. O., Josephson, K. R., Pietruszka, F. M., Koelfgen, M., et al. (1999). Development and testing of a five-item version of the Geriatric Depression Scale. J. Am. Geriatr. Soc. 47, 873–878. doi: 10.1111/j.1532-5415.1999.tb03848.x
Jessen, F., Amariglio, R. E., Van Boxtel, M., Breteler, M. M. B., Ceccaldi, M., Chételat, G., et al. (2014). A conceptual framework for research on subjective cognitive decline in preclinical Alzheimer’s disease. Alzheimers Dement. 10, 844–852. doi: 10.1016/j.jalz.2014.01.001
Jutten, R. J., Peeters, C. F. W., Leijdesdorff, S. M. J., Visser, P. J., Maier, A. B., Terwee, C. B., et al. (2017). Detecting functional decline from normal aging to dementia: development and validation of a short version of the Amsterdam IADL Questionnaire. Alzheimers Dement. (Amst). 8, 26–35. doi: 10.1016/j.dadm.2017.03.002
Koo, T. K., and Li, M. Y. (2016). A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J. Chiropr. Med. 15, 155–163.
Koster, N., Knol, D. L., Uitdehaag, B. M., Scheltens, P., and Sikkes, S. A. M. (2015). The sensitivity to change over time of the Amsterdam IADL Questionnaire((c)). Alzheimers Dement. 11, 1231–1240. doi: 10.1016/j.jalz.2014.10.006
Lahr, D., Beblo, T., and Hartje, W. (2007). Cognitive performance and subjective complaints before and after remission of major depression. Cogn. Neuropsychiatry 12, 25–45. doi: 10.1080/13546800600714791
Lawton, M. P., and Brody, E. M. (1969). Assessment of older people: self-maintaining and instrumental activities of daily living. Gerontologist 9, 179–186. doi: 10.1093/geront/9.3_part_1.179
Loewenstein, D. A., Arguelles, S., Bravo, M., Freeman, R. Q., Arguelles, T., Acevedo, A., et al. (2001). Caregivers’ judgments of the functional abilities of the Alzheimer’s disease patient: a comparison of proxy reports and objective measures. J. Gerontol. B Psychol. Sci. Soc. Sci. 56, 78–84. doi: 10.1093/geronb/56.2.p78
Magaziner, J., Bassett, S. S., Hebel, J. R., and Gruber-Baldini, A. (1996). Use of proxies to measure health and functional status in epidemiologic studies of community-dwelling women aged 65 years and older. Am. J. Epidemiol. 143, 283–292. doi: 10.1093/oxfordjournals.aje.a008740
Marshall, G. A., Aghjayan, S. L., Dekhtyar, M., Locascio, J. J., Jethwani, K., Amariglio, R. E., et al. (2017). Activities of daily living measured by the Harvard Automated Phone Task track with cognitive decline over time in non-demented elderly. J. Prev. Alzheimers Dis. 4, 81–86. doi: 10.14283/jpad.2017.10
Marshall, G. A., Amariglio, R. E., Sperling, R. A., and Rentz, D. M. (2012). Activities of daily living: where do they fit in the diagnosis of Alzheimer’s disease? Neurodegener. Dis. Manag. 2, 483–491. doi: 10.2217/nmt.12.55
Marshall, G. A., Sikkes, S. A. M., Amariglio, R. E., Gatchel, J. R., Rentz, D. M., Johnson, K. A., et al. (2020). Instrumental activities of daily living, amyloid, and cognition in cognitively normal older adults screening for the A4 Study. Alzheimers Dement. (Amst). 12:e12118. doi: 10.1002/dad2.12118
Nosheny, R. L., Camacho, M. R., Jin, C., Neuhaus, J., Truran, D., Flenniken, D., et al. (2020). Validation of online functional measures in cognitively impaired older adults. Alzheimers Dement. 16, 1426–1437. doi: 10.1002/alz.12138
Nosheny, R. L., Jin, C., Neuhaus, J., Insel, P. S., Mackin, R. S., Weiner, M. W., et al. (2019). Study partner-reported decline identifies cognitive decline and dementia risk. Ann. Clin. Transl. Neurol. 6, 2448–2459. doi: 10.1002/acn3.50938
Okonkwo, O. C., Wadley, V. G., Griffith, H. R., Belue, K., Lanza, S., Zamrini, E. Y., et al. (2008). Awareness of deficits in financial abilities in patients with mild cognitive impairment: going beyond self-informant discrepancy. Am. J. Geriatr. Psychiatry 16, 650–659. doi: 10.1097/JGP.0b013e31817e8a9d
Ostbye, T., Tyas, S., McDowell, I., and Koval, J. (1997). Reported activities of daily living: agreement between elderly subjects with and without dementia and their caregivers. Age Ageing 26, 99–106. doi: 10.1093/ageing/26.2.99
Pol, M. C., Buurman, B. M., de Vos, R., and de Rooij, S. E. (2011). Patient and proxy rating agreements on activities of daily living and the instrumental activities of daily living of acutely hospitalized older adults. J. Am. Geriatr. Soc. 59, 1554–1556. doi: 10.1111/j.1532-5415.2011.03514.x
Pudaric, S., Sundquist, J., and Johansson, S.-E. (2003). Country of birth, instrumental activities of daily living, self-rated health and mortality: a Swedish population-based survey of people aged 55–74. Soc. Sci. Med. 56, 2493–2503. doi: 10.1016/s0277-9536(02)00284-8
R Core Team (2020). R: A Language And Environment For Statistical Computing. 2 Edn. Vienna: R Foundation for Statistical Computing.
Ready, R. E., Ott, B. R., and Grace, J. (2004). Validity of informant reports about AD and MCI patients’ memory. Alzheimer Dis. Assoc. Dis. 18, 11–16. doi: 10.1097/00002093-200401000-00003
Reise, S. P., and Waller, N. G. (2009). Item response theory and clinical measurement. Annu. Rev. Clin. Psychol. 5, 27–48.
Scheel-Hincke, L. L., Moller, S., Lindahl-Jacobsen, R., Jeune, B., and Ahrenfeldt, L. J. (2020). Cross-national comparison of sex differences in ADL and IADL in Europe: findings from SHARE. Eur. J. Ageing 17, 69–79. doi: 10.1007/s10433-019-00524-y
Sikkes, S. A. M., de Lange-de Klerk, E. S., Pijnenburg, Y. A. L., Gillissen, F., Romkes, R., Knol, D. L., et al. (2012). A new informant-based questionnaire for instrumental activities of daily living in dementia. Alzheimers Dement. 8, 536–543. doi: 10.1016/j.jalz.2011.08.006
Sikkes, S. A. M., de Lange-de Klerk, E. S., Pijnenburg, Y. A. L., Scheltens, P., and Uitdehaag, B. M. (2009). A systematic review of Instrumental Activities of Daily Living scales in dementia: room for improvement. J. Neurol. Neurosurg. Psychiatry 80, 7–12. doi: 10.1136/jnnp.2008.155838
Sikkes, S. A. M., and De Rotrou, J. (2014). A qualitative review of instrumental activities of daily living in dementia: what’s cooking? Neurodegener. Dis. Manag. 4, 393–400. doi: 10.2217/nmt.14.24
Sikkes, S. A. M., Knol, D. L., Pijnenburg, Y. A. L., de Lange-de Klerk, E. S., Uitdehaag, B. M., and Scheltens, P. (2013a). Validation of the Amsterdam IADL Questionnaire(c), a new tool to measure instrumental activities of daily living in dementia. Neuroepidemiology 41, 35–41. doi: 10.1159/000346277
Sikkes, S. A. M., Pijnenburg, Y. A. L., Knol, D. L., de Lange-de Klerk, E. S., Scheltens, P., and Uitdehaag, B. M. (2013b). Assessment of instrumental activities of daily living in dementia: diagnostic value of the Amsterdam Instrumental Activities of Daily Living Questionnaire. J. Geriatr. Psychiatry Neurol. 26, 244–250. doi: 10.1177/0891988713509139
Slot, R. E. R., Sikkes, S. A. M., Berkhof, J., Brodaty, H., Buckley, R., Cavedo, E., et al. (2019). Subjective cognitive decline and rates of incident Alzheimer’s disease and non-Alzheimer’s disease dementia. Alzheimers Dement. 15, 465–476. doi: 10.1016/j.jalz.2018.10.003
Sperling, R. A., Aisen, P. S., Beckett, L. A., Bennett, D. A., Craft, S., Fagan, A. M., et al. (2011). Toward defining the preclinical stages of Alzheimer’s disease: recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimers Dement. 7, 280–292. doi: 10.1016/j.jalz.2011.03.003
Starkstein, S. E., Jorge, R., Mizrahi, R., and Robinson, R. G. (2006). A diagnostic formulation for anosognosia in Alzheimer’s disease. J. Neurol. Neurosurg. Psychiatry 77, 719–725. doi: 10.1136/jnnp.2005.085373
Steward, K. A., Kennedy, R., Erus, G., Nasrallah, I. M., and Wadley, V. G. (2019). Poor awareness of IADL deficits is associated with reduced regional brain volume in older adults with cognitive impairment. Neuropsychologia 129, 372–378. doi: 10.1016/j.neuropsychologia.2019.04.023
Tabert, M. H., Albert, S. M., Borukhova-Milov, L., Camacho, Y., Pelton, G., Liu, X., et al. (2002). Functional deficits in patients with mild cognitive impairment: prediction of AD. Neurology 58, 758–764. doi: 10.1212/wnl.58.5.758
Van Mierlo, L. D., Wouters, H., Sikkes, S. A. M., Van der Flier, W. M., Prins, N. D., Bremer, J. A. E., et al. (2017). Screening for mild cognitive impairment and dementia with automated, anonymous online and telephone cognitive self-tests. J. Alzheimers Dis. 56, 249–259. doi: 10.3233/JAD-160566
Villeneuve, S. C., Houot, M., Cacciamani, F., Verrijp, M., Dubois, B., Sikkes, S., et al. (2019). Latent class analysis identifies functional decline with Amsterdam IADL in preclinical Alzheimer’s disease. Alzheimers Dement. (N Y). 5, 553–562. doi: 10.1016/j.trci.2019.08.009
Visser, L. N. C., Dubbelman, M. A., Verrijp, M., Wanders, L., Pelt, S., Zwan, M. D., et al. (2021). The Cognitive Online Self-Test Amsterdam (COST-A): establishing norm scores in a community-dwelling population. Alzheimers Dement. (Amst). 13:e12234. doi: 10.1002/dad2.12234
Wadley, V. G., Harrell, L. E., and Marson, D. C. (2003). Self- and informant report of financial abilities in patients with Alzheimer’s disease: reliable and valid? J. Am. Geriatr. Soc. 51, 1621–1626. doi: 10.1046/j.1532-5415.2003.51514.x
Weinberger, M., Samsa, G. P., Schmader, K., Greenberg, S. M., Carr, D. B., and Wildman, D. S. (1992). Comparing proxy and patients’ perceptions of patients’ functional status: results from an outpatient geriatric clinic. J. Am. Geriatr. Soc. 40, 585–588. doi: 10.1111/j.1532-5415.1992.tb02107.x
Zanetti, O., Geroldi, C., Frisoni, G. B., Bianchetti, A., and Trabucchi, M. (1999). Contrasting results between caregiver’s report and direct assessment of activities of daily living in patients affected by mild and very mild dementia: the contribution of the caregiver’s personal characteristics. J. Am. Geriatr. Soc. 47, 196–202. doi: 10.1111/j.1532-5415.1999.tb04578.x
Zoller, A. S., Gaal, I. M., Royer, C. A., Locascio, J. J., Amariglio, R. E., Blacker, D., et al. (2014). SIST-M-IR activities of daily living items that best discriminate clinically normal elderly from those with mild cognitive impairment. Curr. Alzheimer Res. 11, 785–791. doi: 10.2174/156720501108140910122220
Keywords: instrumental activities of daily living, aging, preclinical, awareness, Alzheimer’s disease, dementia, self report measures, study partner-reported outcomes
Citation: Verrijp M, Dubbelman MA, Visser LNC, Jutten RJ, Nijhuis EW, Zwan MD, van Hout HPJ, Scheltens P, van der Flier WM and Sikkes SAM (2022) Everyday Functioning in a Community-Based Volunteer Population: Differences Between Participant- and Study Partner-Report. Front. Aging Neurosci. 13:761932. doi: 10.3389/fnagi.2021.761932
Received: 20 August 2021; Accepted: 16 November 2021;
Published: 05 January 2022.
Edited by:
Stéphane Epelbaum, Hôpital Universitaire la Pitié-Salpêtrière, FranceReviewed by:
Nikki-Anne Wilson, Neuroscience Research Australia, AustraliaCarol Persad, University of Michigan, United States
Arturo Pereiro, University of Santiago de Compostela, Spain
Copyright © 2022 Verrijp, Dubbelman, Visser, Jutten, Nijhuis, Zwan, van Hout, Scheltens, van der Flier and Sikkes. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sietske A. M. Sikkes, s.sikkes@amsterdamumc.nl
†These authors have contributed equally to this work and share first authorship