Mood Disturbances Across the Continuum of Care Based on Self-Report and Clinician Rated Measures in the interRAI Suite of Assessment Instruments

Background: Mood disturbance is a pervasive problem affecting persons of all ages in the general population and the subset of those receiving services from different health care providers. interRAI assessment instruments comprise an integrated health information system providing a common approach to comprehensive assessment of the strengths, preferences and needs of persons with complex needs across the continuum of care.

Objective: Our objective was to create new mood scales for use with the full suite of interRAI assessments including a composite version with both clinician-rated and self-reported items as well as a self-report only version.

Methods: We completed a cross-sectional analysis of 511,641 interRAI assessments of Canadian adults aged 18+ in community mental health, home care, community support services, nursing homes, palliative care, acute hospital, and general population surveys to develop, test, and refine new measures of mood disturbance that combined clinician and self-rated items. We examined validity and internal consistency across diverse care settings and populations.

Results: The composite scale combining both clinician and self-report ratings and the self-report only variant showed different distributions across populations and settings with most severe signs of disturbed mood in community mental health settings and lowest severity in the general population prior to the COVID-19 pandemic. The self-report and composite measures were strongly correlated with each other but differed most in populations with high rates of missing values for self-report due to cognitive impairment (e.g., nursing homes). Evidence of reliability was strong across care settings, as was convergent validity with respect to depression/mood disorder diagnoses, sleep disturbance, and self-harm indicators. In a general population survey, the correlation of the self-reported mood scale with Kessler-10 was 0.73.

Conclusions: The new interRAI mood scales provide reliable and valid mental health measures that can be applied across diverse populations and care settings. Incorporating a person-centered approach to assessment, the composite scale considers the person's perspective and clinician views to provide a sensitive and robust measure that considers mood disturbances related to dysphoria, anxiety, and anhedonia.

Introduction

Mood disturbances, including symptoms associated with anxiety and depression, have been increasing in prevalence in the population (1–3), and this has been exacerbated greatly due to lockdowns, social isolation, economic and health-related concerns during the COVID-19 pandemic (4–6). Problems of mood may be transitory, but they affect persons of all ages, gender, social class, and cultures. They are experienced worldwide, can begin in early stages of life (7–14), and can persist throughout the life course (15–18). Although there are important biomedical factors that can affect mood, a broad array of psychosocial and environmental factors can also trigger, worsen, or prolong these symptoms to become more persistent problems related to depression (15, 19).

As a consequence, mood disturbance is a pervasive problem affecting the general population as well as the subset of persons utilizing health care services. Indeed, health service providers in community and facility-based settings encounter persons with mood disturbance that can complicate the provision of health services (16, 20–23). Mood disturbance is a health problem that must be addressed for its own sake; however, it also warrants attention because it can also interfere with adherence to treatment regimens (24–26), recognition and response to symptoms (27, 28), and it increases resource intensity after adjusting for other clinical factors (29–31). Problems with mood may often be transient; however, they should be attended to with early interventions when the risk of transition to a more permanent form of mood disorder is evident.

The relative success of health care organizations in managing and alleviating problems related to mood is considered to be sufficiently important to justify its use as an outcome based indicator of quality of care in mental health (32) and non-mental health settings (33–39). For example, the Canadian Institute for Health Information publicly reports a risk-adjusted quality indicator for worsened depressive mood in long-term care facilities on a national basis (www.yourhealthsystem.cihi.ca).

The interRAI suite of clinical assessment instruments is used internationally as a comprehensive, integrative health information system providing a common clinical language for evaluating the strengths, preferences, and needs of persons of all ages across the continuum of care (40–48). These instruments include a variety of measures of mood that can be used as standalone items or in summary scales. The most widely used mood measure from this suite is the Depression Rating Scale (DRS) (16, 49–53), which is an additive scale based on the frequency of occurrence of seven items (e.g., tearfulness, repetitive anxious complaints) with scores ranging from 0 to 14. Cross-sector studies of the reliability of the DRS have shown it to have acceptable internal consistency based on Cronbach's alpha scores of 0.70 or more (54–56) as well as strong inter-rater reliability based on weighted kappa values in excess of 0.60 (41, 57).

Although the DRS has been in widespread use for over two decades, there are some important limitations that warrant efforts to develop an alternative mood measure that could be employed across health settings over the life course. For example, the tripartite model of depression and anxiety (58, 59) suggests that it is important to consider indicators of dysphoria, anxiety, and anhedonia. However, the DRS includes only indicators of the first two factors, despite the relevance of anhedonia (60), and longitudinal studies have shown that items on social withdrawal provide additional predictive value for future depression diagnoses after adjusting for the DRS (61). A further criticism has been related to the modest correlation between the clinician-rated DRS with self-reported measures like the Geriatric Depression Scale (GDS) (62). Koehler et al. showed that the DRS and GDS were both related to depression diagnoses in long-term care settings (62) yet, they were relatively uncorrelated with each other. This limited correlation suggests that clinician-rated and self-reported measures address important, but different aspects of mood. Clinicians may be insensitive to certain aspects of mood that self-report measures may pick up. In addition, practical and economic considerations may preclude the use of clinician-only rated systems for screening of the general population. For example, some low resource nations do not have sufficient mental health human resources to respond to the clinical needs of all persons with severe mental health issues (63, 64) let alone to have health professionals to do broad-based population screening. There is also growing interest in the use of self-report measures for patient reported outcome measurement (65, 66). On the other hand, self-report measures may also cause under-detection due to cultural biases (67, 68) or non-response due to cognitive impairment or communication difficulties (62). Hence, there could be important advantages to an assessment strategy that combines the use of clinician-rated and self-reported measures of mood that are consistent between populations, health and social service settings, and geographic regions, in a manner that permits longitudinal monitoring of mental health outcomes. Such measures could be used for person-level and organizational-level applications including care planning, need identification, outcome evaluation, measurement-based care, and risk adjustment.

The DRS was first created as a clinician-rated scale with interRAI's original nursing home assessment (50) and then validated for use with assessments for other settings as they became available (51–54). However, with the advent of interRAI's new integrated suite of instruments, a set of three self-reported measures of dysphoria, anxiety, and anhedonia was introduced. Our objective was to create alternative mood scales for use with all interRAI assessments including a composite version with both clinician-rated and self-reported items as well as a self-report only version. Testing was also done to ensure that the clinician-rated items could function as a scale in legacy instruments that predate the new suite (e.g., RAI-MDS 2.0; RAI-MH); however, our focus here is on the newer instruments since they will be the only standard to be adopted internationally in any new implementations of interRAI systems.

Methods

We completed a cross-sectional analysis of 511,641 interRAI assessments of Canadian adults age 18 years or more in community mental health, home care, community support services, nursing homes, palliative care, acute hospital, and general population surveys to develop, test, and refine new measures of mood that combined clinician and self-rated items. We examined convergent validity, criterion validity, and internal consistency across a continuum of care settings serving diverse populations. Although interRAI data are available for over 30 other countries, we chose to focus on Canadian data only to avoid country level effects and as such we defer analyses of those international data for future testing. Our emphasis here was on multiple care sectors within one nation with awareness that cross-national testing will be an important next step.

Samples

This study includes stratified analyses of large samples of individuals with highly diverse demographic backgrounds and heterogeneity in health status across multiple care settings, age groups and life stages. The data for our study samples came from three types of implementations of interRAI systems First, we sampled from diverse settings where there was mandated routine clinical use in the full population of service recipients: home care¹ (using interRAI Home Care (69), community support services [using interRAI Community Health Assessment (56)], palliative home care [using interRAI Palliative Care (70–72)], and nursing homes [using interRAI Long Term Care Facility (73, 74)]. Most of these data are from the province of Ontario; however, that province still uses an older version of the nursing home instrument² (75, 76) that excludes self-report items so data from the province of New Brunswick based on the newer interRAI LTCF assessment were used instead. Second, pilot or regional implementations of interRAI systems were done for community mental health services [using interRAI Community Mental Health (44)], wellness checks in home care [using the interRAI Check-Up Self-report version (77, 78)], and emergency department screening [using the interRAI Emergency Department Contact Assessment (79)] of older adults in acute hospitals. The third type of implementation was research-only use of interRAI self-report items in telephone and on-line surveys of the general population.

Table 1 provides an overview of the seven main study populations used in our analyses. In every setting we used only the most recent observation for each person assessed, so the within-sector samples all represent unique individuals. There is a possibility that some persons were assessed at different times in different settings (e.g., home care and nursing homes), but we did not have identifiers that could be used to link records between sectors. Therefore, although there were up to half a million individuals included in this analysis, the actual number will be somewhat less than that because of some persons receiving care in two or more settings during the study period.

TABLE 1

Table 1. Sample characteristics.

The community mental health sample was of 7,256 adults receiving those services in the Niagara and Chatham Kent regions of Ontario between 2015 and 2019. Most of this sample was comprised of young and middle-aged adults with only 11.0% being aged 65 years or more. About half were male and about one-third were married³. As people within this sample were accessing community-based mental health services, it is not surprising that more than half had a mood disorder diagnosis present when assessed. Less than 5 percent had moderate or worse cognitive impairment based on a score of three or more on the Cognitive Performance Scale (80, 81), which is substantially lower than would be evident in care settings for frail older adults (e.g., home care, nursing homes).

Adult home care clients comprised the largest study sub-population with 352,161 unique Ontarians receiving long-stay home care services between 2018 and 2021. These services predominantly target older adults, so most of the sample was over 65 (85.7%), most were female, and one-third were married. About one quarter had an existing depression diagnosis, and about one quarter had moderate or worse cognitive impairment.

The community support service sub-population included 28,302 Ontarians receiving community services, representing a lighter care population than is typically seen in home care. The most recent data available were for the 2016–2017 period. This population has a similar age distribution as seen in the long-stay home care population, but somewhat more females, fewer married individuals, lower rates of depression diagnoses, and notably lower rates of moderate or worse cognitive impairment.

A second long-stay home care population sample was comprised of 4,930 clients captured during 2020–2021. This sample, who normally would have received the interRAI HC assessment as part of routine care, were screened with the interRAI Check Up self-report instrument (and not the interRAI HC instrument) due to practical restrictions that prevented in-person visits during the start of the COVID-19 pandemic. As shown in Table 1, this sub-population was comparable to the interRAI HC assessed population in age, marital status, and gender but they had lower rates of cognitive impairment.

The nursing home sample was the only sample to be fully gathered outside of Ontario, since New Brunswick was the only Canadian province to have fully adopted the interRAI LTCF at the start of our study. The sub-population of 8,237 unique individuals were assessed between 2016 and 2020 and they had the highest proportion of persons aged 85 years or more. Two thirds were female and about one quarter were married. Diagnosed depression was evident at a rate comparable to the Ontario home care sample; however, this population also had the highest rates of moderate or worse cognitive impairment.

The palliative care sample was comprised of 106,759 unique Ontarians receiving community based palliative care through the provincial home care program between 2011 and 2021. This sub-population was younger than the home care population; however, about three quarters were aged 65 years or more. Unlike the home care population, the majority were married and only about 40 percent were female. Depression diagnoses were not available, but moderate or worse cognitive impairment affected only about 11 percent of this sub-population.

The emergency department sample of 1,432 individuals was obtained from a pilot implementation of the interRAI ED-CA in a study of screening for potential frailty among older adults in emergency departments in Ontario and Quebec done between 2017 and 2018. The study sample was constrained to older adults with about half being aged 85 years or more. Marital status, depression diagnoses, and CPS scores are not tracked in the ED-CA.

Two community samples of the general population were obtained from research projects done before and during the COVID-19 pandemic. One study included 642 respondents to a telephone survey in the Waterloo Region only that was done in 2011. Participants were selected using random-digit dialing of the general population. A second study done in partnership with Mental Health Research Canada used an on-line survey of a polling company's pre-existing participant pool, and it included 1,921 respondents from across Canada in February 2021, which corresponded to the third wave of COVID-19 in Canada. Both samples are comprised mainly of young and middle-aged adults with comparable percentages who were female. As with the palliative sample, the majority of those in the on-line survey were married (not available for the 2011 survey). Of particular note is the high rate of depression diagnoses reported in the 2021 community survey with rates exceeded only by the community mental health sample (question was not asked in the 2011 survey).

Measures

Five of the interRAI assessments used in this research (CMH, HC, CHA, LTCF, PC) are comprehensive assessments completed by trained health professionals (mainly nurses) at different points during the episode of care (40, 43). Typically, this occurs at admission/intake and then on a structured reassessment cycle that varies by sector (e.g., 3 months in long-term care and 6 months in home care or community mental health). In addition, periodic reassessments may occur on an unscheduled basis if there is a recognized clinically significant change (improvement or worsening) that is persistent and requires a change to the care plan. All of these instruments have multiple applications for diverse audiences including care planning, outcome measurement, quality monitoring, and resource allocation (32, 43, 44, 82).

The interRAI ED-CA is a clinician-led screening-level assessment that is done with older adults in emergency departments. It is not intended to support the full care planning process; however, it includes several measures that can be used to inform clinical management in the emergency department (79, 83, 84).

For the clinician-led assessment and screening instruments, the assessor employs evidence from all sources of information to determine the most appropriate response for a given item based on their best judgement. This includes direct observation of and interviews with the person, discussion with key informants (e.g., family members when appropriate), information provided by staff and professional communications, and review of the chart. Clinicians are provided with standardized item definitions, inclusion/exclusion criteria, illustrative examples, observational timeframes, and coding guidelines as part of the standard training approach for interRAI assessments (85, 86). Most items on the clinician-led assessments are based on clinical judgement; however, there is a subset of items that are self-report only with standardized narrative structures for the items and response sets. The cross-sector reliability and validity of these instruments have been reported elsewhere (41, 54, 57). The composite measure of mood that we developed is based on a combination of clinician-rated and self-reported items included in these assessment systems; however, we also developed a self-report only variant that can be used as a standalone scale. In addition, we created a clinician-only variant that can be used for backward compatibility with legacy instruments (results for clinician-only version not reported here but are available on request).

The Check-Up Self-report version and the survey questions used for the general populations are based on self-report items that have fixed, standardized questions and responses. The CU-SR can be self-administered or be done with a lay survey interviewer, but the interviewer does not require clinical credentials. The responses are strictly based on the person's self-report without clinical judgement being applied by the interviewer. Previous research has reported in the reliability and validity of the CU-SR in community-based research (77, 78).

Analyses

Scale Construction

Figure 1 provides a schematic representation of coding rules for three variants of mood scales that can be derived from the new interRAI suite of assessments. The Composite Mood Scale (CMS) is based on four clinician-rated and three self-rated items dealing with dysphoria, anxiety, and anhedonia. All indicators use a 3-day lookback period and have the following four level response values: 0-not present; 1-not exhibited, but present recently; 2-exhibited in 1–2 of last 3 days; 3-exhibited daily (wording varies slightly for self-report items). The clinician-rated items include one item for dysphoria (presence of sad, pained, or worried facial expressions), one item for anxiety (repetitive non-health-related anxious complaints), and two items for anhedonia (social withdrawal and loss of interest⁴). The self-report items include one for dysphoria (feeling sad, depressed, or hopeless), one for anxiety (feeling anxious, restless, or uneasy) and one for anhedonia (lost interest in things normally enjoy). The self-rated items allow for a non-response category, but that option is not permitted for the assessor rating. Therefore, missing values should only be an issue with the self-rated items.

FIGURE 1

Figure 1. Schematic representation of coding rules for three variants of Mood scale.

We chose to do this to maximize sensitivity of detection of mood disturbance. In creating the composite scale, a variety of coding options were considered to test whether collapsing certain response values (e.g., combining infrequently present and not present values) would improve scale performance and we explored alternative rules for use of self-report vs. clinician ratings. There was no improvement in performance when response value ranges were collapsed. The potential loss of sensitivity was a greater concern, so we left all response values unmodified. For the two clinician rated items on anhedonia, the highest of the two values was used to specify the clinician observation for that indicator. After considering alternative substitution or additive models, we chose to code the composite scale first based on the person's self-report. If the self-report item was missing (e.g., unwilling or unable to respond) it was substituted with the clinician-rated item for the indicator. Next, if the clinician rating indicated greater frequency of a symptom being present, the clinician rating replaced the self-report. Once the value of each composite item was specified for the three indicators, their scores were summed to create a score with values of 0–9. All alternative coding options were examined with respect to their ability to predict outcomes of interest; however, this approach provided the best overall performance (results available on request).

The Self-reported Mood Scale (SMS) simply sums the scores for the three self-report items. A missing value was permitted for one of the three values and compensated for by assigning the rounded value of the mean of the other two items to the third missing item. As with the composite scale, the self-reported scale values ranged from 0 to 9 with higher scores indicating greater mood disturbance.

Validity

There were three main approaches used to establish validity of the composite and self-reported mood scales. First, we used the CMH data to identify which variant of these scales best predicted presence of two types of indicators of convergent validity: (a) a provisional diagnosis of a mood disorder, indicating clinical designation of the problem meeting diagnostic criteria; (b) self-harm indicators, as non-diagnostic markers of presence of a severe problem. The variant that performed best in those comparisons was examined for its relationship to a depression diagnosis in all other data sets where that diagnosis was available.

Second, we examined evidence of convergent validity by comparing mean scale scores (and 95% confidence limits) against sleep disturbance and depression/mood disorder diagnoses across care settings. The other assessments do not include self-harm indicators; however, a measure of difficulty sleeping is widely available in the interRAI suite and it is known to be associated with mood disturbance (3, 87). The diagnosis items for depression or mood disorder in clinician-rated assessments are based on the clinician's confirmation (using all sources of information available) of the presence of a formal diagnosis made by a physician.

The third approach for the self-reported scale only was to establish convergent validity against the Kessler-10 Psychological Distress Scale (K-10) in the on-line community sample only (K-10 was not available in other data sets). The K-10 measures non-specific psychological stress (rather than a measure of mood disorders) that considers anxiety and depressive symptoms experienced in the last 4 weeks. The K10 is commonly used mental health in population health surveys, including in the World Health Organization World Mental Health Initiative surveys (88), as well as in Australia (89), New Zealand (90), and Canada (91).

Reliability

Inter-rater reliability of the clinician-rated items has been reported for the interRAI suite of assessments elsewhere [2, 17] and is not relevant to self-reported items. We did not examine test-retest reliability, but previous multinational work with the interRAI LTCF reported average test-retest reliability of all items with weighted kappas between 0.75 and 0.92 (74). Therefore, our focus was on testing internal consistency based on Cronbach's alpha values for the composite and self-report versions of the scales in all settings.

Results

Table 2 provides the distributional characteristics, scale reliabilities, correlations between scales, and rates of missing values for the composite and self-report versions of the mood scale across care settings. For both versions of the scale, the highest severity ratings were evident in the community mental health sample. Among the clinical settings, the least severe ratings for both scales were evident in the community support service sample assessed with the interRAI CHA. The only setting where the self-report and composite scales resulted in different rank orders of severity for the sector was in the interRAI LTCF sample. Those able to self-report had scores comparable to the CHA sample; however, when the composite version was used to include ratings for persons with missing data on the self-report items, the mean severity score was second highest after community mental health.

TABLE 2

Table 2. Mood scale variant means (SD), medians (Q1–Q3), internal consistency, scale correlations, and missing rates by setting.

For the settings where only self-report measures were available (i.e., interRAI Check-Up, telephone and on-line surveys), the severity of mood disturbance was second highest among clinical settings in the emergency department. However, a more striking finding is the substantial difference across the estimates for the general population at two points in time. Mean survey ratings in 2011 compared with during the third wave of the COVID-19 pandemic were very different (1.1 vs. 3.5, respectively).

The Cronbach's alpha values for 12 of the 14 possible scores were above 0.70 with seven instances of scores of 0.78 or more. The only instances where values fell below 0.70 were with self-report in home care (0.64) and the 2011 telephone survey (0.65).

The two variants of the scale are highly correlated with each other where both variants were available. That is to be expected given that self-report items are common to both variants. The main uses of the composite scale are to compensate for missing self-report data and to increase sensitivity by using higher scores from clinicians in cases of disagreement. Therefore, it is not surprisingly, that they are less correlated (r = 0.77) in the interRAI LTCF where missing values for the self-report items are most prevalent (about 44% of residents compared with 25% of emergency department patients and 4% of community support clients).

Table 3 shows the unadjusted odds ratios (and 95% CL) for the relationship between scores on the composite and self-reported mood scales against the presence of a physician's diagnosis of mood disorder or depression. For most settings, the odds ratio of such a diagnosis being present increased by about 1.3 for each 1-point increment on the scale. For context, persons with a maximum score of 9 on the scale would have a 12-times greater odds of a physician's mood disorder/depression diagnosis than those in the reference group with a score of 0. The c statistic values ranged between 0.67 and 0.75 with strongest values in the community mental health sample, which is in the range of the conventional 0.7 threshold for a good model (92). The exception was in the interRAI LTCF sample where both scales had weaker performance.

TABLE 3

Table 3. Unadjusted odd ratios (95% CL) for depression or mood disorder diagnosis present, by mood scale variant and setting.

Table 4 provides evidence of convergent validity of the two mood scales against mood disorder diagnosis and indicators of self-harm in the community mental health sample. This context is informative because there is greater mental health expertise available and there is greater variance in mental health indicators including higher rates of severe symptoms. We also used these analyses to specify appropriate cut-points for the scales should clinicians wish to use threshold values to inform decision-making. For all four indicators of self-harm and for the mood disorder diagnosis, each increment in the scale had comparable odds ratios (values ranged between 1.23 and 1.35) and c statistics (values ranged between 0.68 and 0.75). Using mood disorder as a marker for an initial cut-point after the baseline 0 value, suggests that appropriate scores would be 4 or more for the composite scale and 3 or more for the self-reported scale. The more severe threshold based on self-harm indicators would be values of 7 for the composite scale and 6 for the self-report version. For example, persons with a score of 7 on the CMS have over 8-times greater odds of having a suicide plan present compared with those with scores of 0.

TABLE 4

Table 4. Unadjusted odds ratios (95% CL) and optimal scale cut-points based on various mental health markers by mood scale variant in community mental health sample only (n = 7,256).

Figure 2 shows the mood scale distributions across settings using the abovementioned cut-off values. There was within-group heterogeneity in these scale scores, but the most severe ratings were found in the community mental health sample. One exception was the on-line general population survey during COVID-19 where the severity scores for the self-report scale were the highest for all settings. Also, as noted earlier, the prevalence of signs of mood disturbance of differing severity varies most greatly in LTCF where those in the self-report and composite scale subsamples differ most substantially. In that setting, the composite mood scale demonstrates substantially higher rates of mood disturbance than does the self-reported variant.

FIGURE 2

Figure 2. Distribution of mood scale variants by care setting and scale variant. Colors reflects similar levels of mood disturbance for each scale based on cut-points reported in Table 4. Horizontal lines within the stacked bars reflects single point increments in the scale value within each settings. The specific scale values (and text labels) in the stacked bars are: green (none)−0 for both self-report and composite version; orange (mild)−1–2 for self-report and 1–3 for composite; gray (moderate)−3–4 for self-report and 4–6 for composite; and red (severe)−5+ for self-report and 6+ for composite version.

Table 5 shows the relationships of the two scale variants with difficulty sleeping and depression/mood disorder diagnoses across settings based on mean scale scores and 95% CL. For both scales and in all settings, higher frequency of sleep difficulties was associated with significantly higher mean scores in the mood scales. The same was also true for the presence of depression/mood disorder diagnoses. Again, the COVID-19 community sample demonstrated highest scores on these scales for both those with and without depression diagnoses present.

TABLE 5

Table 5. Evidence of convergent validity of mood scale variants with depression or mood disorder diagnosis present.

Finally, Figure 3 shows the relationship between the K-10 and the SMS. Increments in the SMS are significantly associated with higher K-10 scores and the correlation between the two scales is 0.73. This value is comparable to the value of 0.70 reported elsewhere for brief measures like the PHQ-2 and K-6 (93). Butterworth and colleagues suggest that a K-10 score of 30 or more indicates “very high risk of psychological distress” (1). Persons with the suggested SMS with values of 6 (the cut-off suggest by self-harm indicators in the community mental health sample) and 7 have mean (95% CL) K-10 scores of 28.2 (27.3–29.3) and 30.6 (29.4–31.8), respectively. Put differently, the percentage of persons with K-10 scores increased consistently with each increment of the SMS ranging from 1% of those with a score of 0–85% of those with a score of 9 on the SMS (see Figure 2).

FIGURE 3

Figure 3. Association between self-reported mood-scale-self-report and Kessler-10 in general-population survey.

Discussion

With the transition to the new suite of interRAI assessment instruments (40) the composite and self-reported mood scales can be adopted as an alternative to the previous standard of the Depression Rating Scale (DRS). While the DRS will remain useful for historical trend analyses, these mood scales have several advantages over the DRS. First, with the inclusion of self-report measures they more directly includes the person's perspective than measures that rely on clinician-only assessments. Second, it is designed to be more sensitive than the DRS by using two types different of measures (clinician-rating and self-report) to better capture indications of mood disturbance. This should help in reducing the rate of under-detection of problems with mood. Third, the addition of anhedonia measures fills an important gap in the content validity of the DRS. Although the mood scale deals with a possibly transitory state in mood, having indicators related to anhedonia provides additional evidence relevant to broader aspects of depression if the indicators of mood disturbance persist over time. Fourth, our analyses provide more robust evidence for clinical cut-points in the mood scales than has been available for the DRS. Fifth, the availability of alternative forms of the scale allows for comparability of measures across diverse clinical settings where self-report or clinician-rated only measures may not be possible or desirable. This also gives the opportunity to compare results from the two perspectives separately when the clinician or self-report scales are considered on their own.

Our analyses provide clear evidence of reliability and validity for these scales to be used as a common standard with various adult age groups across settings in the continuum of care. The scales can effectively employ both the person's perspective and clinician ratings in a manner that allow it to be used for comparisons in settings where factors like cognitive impairment may be important barriers to those that rely on self-report alone. The results shown in Table 2 illustrated why having the option of clinician ratings available is essential for settings like home care, nursing homes, and palliative care where item non-response for self-ratings can be substantial. On the other hand, the 3-item self-report scale poses minimal burden while demonstrating solid measurement properties across settings and populations.

The results variations in indicators of mood disturbance across care settings were consistent with what one would expect based on the populations served in those settings. However, it was also interesting to note the stark differences in scale scores in the general population samples prior to and during the COVID-19 pandemic. This shows that the mood scale variants are sensitive to contextual variables and major external events.

One observation of concern was the low c statistics and odds for prediction of depression diagnosis in nursing home settings. This might simply be a function of error variance when computing nine different comparisons; however, it is worth noting that depression is often under-detected in that setting (16, 94). The robust c statistic value in community mental health settings suggest that the problem may be with inadequate recognition in nursing homes rather than with the performance of the scale itself. In addition, lack of access to psychiatrists, facility level characteristics or clinical practices may affect the recognition of symptoms of depression (95).

An important benefit of the mood scale variants is that they can be scaled up for use on a national basis with relative ease where there are existing implementations of interRAI systems. In many countries, large scale adoption of new interRAI assessments is complete or underway. For example, over 20 million interRAI assessments have been completed on over 5 million unique Canadians and there is an existing e-heatlh infrastructure to support front-line clinical use, management, governance, and national policy applications of these systems. Several provinces have already begun transition to the new suite of instruments from older versions, so the inclusion of coding standards for these scales in clinical software will allow for rapid, large-scale deployment. In other countries, like the US, New Zealand, Finland, Belgium, Netherlands, Switzerland, Italy, Hong Kong the adoption of one or more of these newer instruments is complete so conversion to use of this scale becomes a relatively modest undertaking related to information technology and training.

It should be emphasized that the mood scale variants are intended to be a decision support tools that could improve access to necessary mental health services. While they are clearly associated with diagnoses of mood disorders or depression, they are not intended to be a substitute for judgement by mental health professionals. They may be used for screening to flag possible mood disorders for referral purposes, and are likely to be an effective for targeting populations in need of mental health services that are in scarce supply in many countries (96) or specific health sectors (95). The inclusion of both psychiatric and somatic measures in interRAI assessments also allows clinicians to take into account the potential link between emotional problems and potential adverse physical health outcomes (97). By identifying clinically meaningful cut-points we can also flag opportunities for improving the quality of life and health with stepped approaches to management of depression (98).

A key opportunity with these mood scales is the value of having a common measure of mood disturbance that can serve to better integrate the identification and response to needs by different partner agencies and professionals in the continuum of care. These measures can be employed in multiple sectors and can follow them for longitudinal patient reported or clinician rated outcome monitoring as patients access different parts of the health system (40, 41). As has been the case with interRAI's existing care planning protocols, the threshold values identified for these scales can be used to trigger differential responses to indications of varying levels of severity or to change in the person over time (70, 82, 99–102). Hence, these scales lend themselves well to use in a measurement-based care (103) strategy whether using the self-report or composite version of the scale.

Several interRAI systems use the DRS or combinations of clinician rated mood items for risk-adjusted outcome-based quality indicators (32–34, 37–39, 73, 104). Although the present results are promising, additional research is needed to examine the responsiveness of the mood scale variants for use in performance measurement. From a face validity perspective, the ability to use the composite version of the scale should be appealing because it circumvents some of the limitations of clinician only ratings. Similarly, the use of the self-report scale for patient reported outcome measurement should be feasible in a very large range of settings where cognitive impairment is not severe. That raises the possibility of multi-sector outcome evaluations of the relative effectiveness of alternative approaches to the management of psychological wellbeing in at risk populations and in the general population.

There are several next steps that would be helpful in future research. Most obvious is the use of non-Canadian data to validate the psychometric properties of the scale variants in other countries, health systems, and populations. In addition, we did not have data for several newer interRAI instruments that have not yet been widely adopted in Canada, including the interRAI Intellectual Disability (105), interRAI Acute Care (106), interRAI Post-Acute Care (107). Moreover, we only examined adults aged 18+ in our study samples, so we are unable to comment on the performance of these scales in children and youth. interRAI has an extensive new suite of instruments for children and adolescents (5, 13, 14, 48, 108–110) so it will be important to establish the boundaries of where these scales do or do not function effectively.

Our present study has numerous strengths including large sample sizes (allowing for rich variation) in multiple sectors of the health system, population-level data for some settings, diversity of persons assessed in terms of clinical needs and demographic characteristics, and the use of trained health professionals to ensure good quality data. However, there are some important limitations to note as well. First, we have not yet examined the longitudinal, within-person trajectories of change in these scales to determine whether they are sensitive to both improvements and worsening of mood disturbance. Second, we need to consider their responsiveness to change when interventions are applied or their predictive validity for future events (e.g., new diagnosis, self-harm attempts, hospitalization). Third, it will be important to replicate these analyses with data from other countries and across cultural settings. Finally, for some settings we did not have access to validity indicators that were available elsewhere. These limitations can and should be readily addressed in future research. At this point we suggest that the level of evidence already available from this work supports adoption of these mood scale variants in jurisdictions that have already adopted interRAI systems.

Data Availability Statement

The data from mandated use of interRAI systems may be obtained through a request of the Canadian Institute for Health Information. Access to data from the community surveys can be obtained on request from the lead author. Requests to access these datasets should be directed to aGlyZGVzJiN4MDAwNDA7dXdhdGVybG9vLmNh.

Ethics Statement

The studies involving human participants were reviewed and approved by University of Waterloo Office of Research Ethics. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author Contributions

JH drafted the first version of the manuscript and completed most analyses of data. JM and GB contributed to data analyses. JM, CP, JF, MS, GB, MF-M, HH, and SS made editorial changes to initial drafts. All authors contributed to the formulation of the ideas presented in the study and provided critical feedback to the manuscript. All authors contributed to the article and approved the submitted version.

Funding

Portions of the community mental health, emergency department, and community survey datasets were gathered as part of research that received financial support from the Health Transition Fund - Health Canada, Canadian Frailty Network, and MITACS respectively.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

1. ^Note: “home care” refers to community based personal support and nursing services provided in the person's home. “Community support service” agencies provide social and support services they tend to target a lower intensity population.

2. ^The Resident Assessment Instrument 2.0 (RAI 2.0) is the predecessor to the interRAI LTCF. The RAI 2.0 is comprised only of clinician-rated items, so it cannot be used for the self-reported or composite variants of the mood scale. However, it does include the clinician-rated items that can be used for a clinician-only variant of the scale. Additional information is available on request.

3. ^In this manuscript, “married” refers to both formalized legal marriages and common-law partners of either the same or opposite sex.

4. ^Two options are used for anhedonia because some instruments use only one of those two items.

References

1. Butterworth P, Watson N, Wooden M. Trends in the prevalence of psychological distress over time: comparing results from longitudinal and repeated cross-sectional surveys. Front Psychiatry. (2020) 11:1345. doi: 10.3389/fpsyt.2020.595696

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Zulueta J, Piscitello A, Rasic M, Easter R, Babu P, Langenecker SA, et al. Predicting mood disturbance severity with mobile phone keystroke metadata: a biaffect digital phenotyping study. J Med Internet Res. (2018) 20:e9775. doi: 10.2196/preprints.9775

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Marr NC, Van Liew C, Carovich TF, Cecchini GA, McKinley LE, Cronan TA. The effects of racial/ethnic minority status on sleep, mood disturbance, and depression in people with fibromyalgia. Psychol Res Behav Manage. (2020) 13:343. doi: 10.2147/PRBM.S242699

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Betini GS, Hirdes JP, Adekpedjou R, Perlman CM, Huculak N, Hébert P. Longitudinal trends and risk factors for depressed mood among canadian adults during the first wave of COVID-19. Front Psychiatry. (2021) 12:666261. doi: 10.3389/fpsyt.2021.666261

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Stewart SL, Vasudeva AS, Van Dyke JN, Poss JW. Child and youth mental health needs and service utilization during COVID-19. Traumatology. (2021). doi: 10.1037/trm0000345. [Epub ahead of print].

CrossRef Full Text | Google Scholar

6. Davies EL, Puljevic C, Gilchrist G, Potts L, Zhuparris A, Maier LJ, et al. Impacts of changes in alcohol consumption patterns during the first 2020 COVID-19 restrictions for people with and without mental health and neurodevelopmental conditions: a cross sectional study in 13 countries. Int J Drug Policy. (2022) 101:103563. doi: 10.1016/j.drugpo.2021.103563

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Arbeau K, Theall L, Willoughby K, Berman JMJ, Stewart SL. What happened? Exploring the relation between traumatic stress and provisional mental health diagnoses for children and youth. Psychology. (2017) 8:2485–95. doi: 10.4236/psych.2017.814157

CrossRef Full Text | Google Scholar

8. Baiden P, Stewart SL, Fallon B. The mediating effect of depressive symptoms on the relationship between bullying victimization and non-suicidal self-injury among adolescents: findings from community and inpatient mental health settings in Ontario, Canada. Psychiatry Res. (2017) 255:238–47. doi: 10.1016/j.psychres.2017.05.018

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Baiden P, Stewart SL, Fallon B. The role of adverse childhood experiences as determinants of non-suicidal self-injury among children and adolescents referred to community and inpatient mental health settings. Child Abuse Negl. (2017) 69:163–76. doi: 10.1016/j.chiabu.2017.04.011

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Lau C, Stewart SL, Saklofske DH, Hirdes J. Scale development and psychometric properties of internalizing symptoms: the interRAI child and youth mental health internalizing subscale. Psychiatry Res. (2019) 278:235–41. doi: 10.1016/j.psychres.2019.06.013

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Li Y, Babcock SE, Stewart SL, Hirdes JP, Schwean VL. Psychometric evaluation of the Depressive Severity Index (DSI) among children and youth using the interRAI Child and Youth Mental Health (ChYMH) assessment tool. Child Youth Care Forum. (2021) 50:611–30. doi: 10.1007/s10566-020-09592-z

CrossRef Full Text | Google Scholar

12. Stewart SL, Kam C, Baiden P. Predicting length of stay and readmission for psychiatric inpatient youth admitted to adult mental health beds in Ontario, Canada. Child Adolesc Ment Health. (2014) 19:115–21. doi: 10.1111/camh.12022

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Stewart SL, Hirdes JP. Identifying mental health symptoms in children and youth in residential and in-patient care settings. Healthc Manage Forum. (2015) 28:150–6. doi: 10.1177/0840470415581240

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Stewart SL, Poss JW, Thornley E, Hirdes JP. Resource intensity for children and youth: the development of an algorithm to identify high service users in children's mental health. Health Serv Insights. (2019) 12:1178632919827930. doi: 10.1177/1178632919827930

PubMed Abstract | CrossRef Full Text | Google Scholar

15. de Pablo GS, Solmi M, Vaquerizo-Serrano J, Radua J, Passina A, Morsillo P, et al. Primary prevention of depression: an umbrella review of controlled interventions. J Affect Disord. (2021) 294:957–70. doi: 10.1016/j.jad.2021.07.101

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Szczerbinska K, Hirdes JP, Zyczkowska J. Good news and bad news: depressive symptoms decline and undertreatment increases with age in home care and institutional settings. Am J Geriatr Psychiatry. (2012) 20:1045–56. doi: 10.1097/JGP.0b013e3182331702

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Fisher KA, Seow H, Brazil K, Smith TF, Guthrie DM. Dimensionality, reliability and validity of the InterRAI depression rating scale in a Canadian palliative care population. Soc Indicat Res. (2015) 122:297–314. doi: 10.1007/s11205-014-0685-8

CrossRef Full Text | Google Scholar

18. Leitch S, Glue P, Gray AR, Greco P, Barak Y. Comparison of psychosocial variables associated with loneliness in centenarian vs elderly populations in New Zealand. JAMA Netw Open. (2018) 1:e183880. doi: 10.1001/jamanetworkopen.2018.3880

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Coman EN, Wu HZ, Assari S. Exploring causes of depression and anxiety health disparities (HD) by examining differences between 1:1 matched individuals. Brain sciences. (2018) 8:207. doi: 10.3390/brainsci8120207

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Freeman S, Smith TF, Neufeld E, Fisher K, Ebihara S. The wish to die among palliative home care clients in Ontario, Canada: a cross-sectional study. BMC Palliat Care. (2016) 15:24. doi: 10.1186/s12904-016-0093-8

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Neufeld E, Freeman S, Joling K, Hirdes JP. “When the golden years are blue”: changes in depressive symptoms over time among older adults newly admitted to long-term care facilities. Clin Gerontol. (2014) 37:298–315. doi: 10.1080/07317115.2014.885919

CrossRef Full Text | Google Scholar

22. Reppermund S, Heintze T, Srasuebkul P, Trollor JN. Health profiles, health services use, and transition to dementia in inpatients with late-life depression and other mental illnesses. J Am Med Direct Assoc. (2021) 22:1465–70. doi: 10.1016/j.jamda.2020.10.018

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Tang VL, Cenzer I, McCulloch CE, Finlayson E, Cooper Z, Silvestrini M, et al. Preoperative depressive symptoms associated with poor functional recovery after surgery. J Am Geriatr Soc. (2020) 68:2814–21. doi: 10.1111/jgs.16781

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Bhattacharjee S, Naeem S, Knapp SM, Lee JK, Patanwala AE, Vadiei N, et al. Health outcomes associated with adherence to antidepressant use during acute and continuation phases of depression treatment among older adults with dementia and major depressive disorder. J Clin Med. (2020) 9:3358. doi: 10.3390/jcm9103358

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Moraes RP, Casseb J. Depression and adherence to antiretroviral treatment in HIV-positive men in São Paulo, the largest city in South America: social and psychological implications. Clinics. (2017) 72:743–9. doi: 10.6061/clinics/2017(12)05

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Lewis FD, Horn GJ. Depression following traumatic brain injury: impact on post-hospital residential rehabilitation outcomes. NeuroRehabilitation. (2017) 40:401–10. doi: 10.3233/NRE-161427

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Bair MJ, Robinson RL, Katon W, Kroenke K. Depression and pain comorbidity: a literature review. Arch Intern Med. (2003) 163:2433–45. doi: 10.1001/archinte.163.20.2433

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Shulman LM, Taback RL, Rabinstein AA, Weiner WJ. Non-recognition of depression and other non-motor symptoms in Parkinson's disease. Park Relat Disord. (2002) 8:193–7. doi: 10.1016/S1353-8020(01)00015-3

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Carpenter GI, Ikegami N, Ljunggren G, Carrillo E, Fries BE. RUG-III and resource allocation: comparing the relationship of direct care time with patient characteristics in five countries. Age Ageing. (1997) 26 (Suppl. 2):61–5. doi: 10.1093/ageing/26.suppl_2.61

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Fries BE, Schneider DP, Foley WJ, Gavazzi M, Burke R, Cornelius E. Refining a case-mix measure for nursing homes: resource utilization groups (RUG-III). Med Care. (1994) 32:668–85. doi: 10.1097/00005650-199407000-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Turcotte LA, Poss J, Fries B, Hirdes JP. An overview of international staff time measurement validation studies of the RUG-III case-mix system. Health Serv Insights. (2019) 12:1178632919827926. doi: 10.1177/1178632919827926

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Perlman CM, Hirdes JP, Barbaree H, Fries BE, McKillop I, Morris JN, et al. Development of mental health quality indicators (MHQIs) for inpatient psychiatry based on the interRAI mental health assessment. BMC Health Serv Res. (2013) 13:15. doi: 10.1186/1472-6963-13-15

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Jones RN, Hirdes JP, Poss JW, Kelly M, Berg K, Fries BE, et al. Adjustment of nursing home quality indicators. BMC Health Serv Res. (2010) 10:96. doi: 10.1186/1472-6963-10-96

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Foebel AD, van Hout HP, van der Roest HG, Topinkova E, Garms-Homolova V, Frijters D, et al. Quality of care in European home care programs using the second generation interRAI home care quality indicators (HCQIs). BMC Geriatr. (2015) 15:148. doi: 10.1186/s12877-015-0146-5

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Guthrie DM, Harman LE, Barbera L, Burge F, Lawson B, McGrail K, et al. Quality indicator rates for seriously ill home care clients: analysis of resident assessment instrument for home care data in six canadian provinces. J Palliat Med. (2019) 22:1346–56. doi: 10.1089/jpm.2019.0022

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Harman LE, Guthrie DM, Cohen J, Declercq A, Fisher K, Goodridge D, et al. Potential quality indicators for seriously ill home care clients: a cross-sectional analysis using resident assessment instrument for home care (RAI-HC) data for Ontario. BMC Palliat Care. (2019) 18:3. doi: 10.1186/s12904-018-0389-y

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Hirdes JP, Fries BE, Morris JN, Ikegami N, Zimmerman D, Dalby DM, et al. Home care quality indicators (HCQIs) based on the MDS-HC. Gerontologist. (2004) 44:665–679. doi: 10.1093/geront/44.5.665

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Morris JN, Fries BE, Frijters D, Hirdes JP, Steel RK. interRAI home care quality indicators. BMC Geriatr. (2013) 13:127. doi: 10.1186/1471-2318-13-127

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Morris JN, Berg K, Topinkova E, Gray LC, Schachter E. Developing quality indicators for in-patient post-acute care. BMC Geriatr. (2018) 18:161. doi: 10.1186/s12877-018-0842-z

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Gray LC, Berg K, Fries BE, Henrard J-C, Hirdes JP, Steel K, et al. Sharing clinical information across care settings: the birth of an integrated assessment system. BMC Health Serv Res. (2009) 9:71. doi: 10.1186/1472-6963-9-71

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Hirdes JP, Ljunggren G, Morris JN, Frijters DHM, Soveri HF, Gray L, et al. Reliability of the interRAI suite of assessment instruments: a 12-country study of an integrated health information system. BMC Health Serv Res. (2008) 8:277. doi: 10.1186/1472-6963-8-277

PubMed Abstract | CrossRef Full Text

42. Armstrong JJ, Stolee P, Hirdes JP, Poss JW. Examining three frailty conceptualizations in their ability to predict negative outcomes for home-care clients. Age Ageing. (2010) 39:755–8. doi: 10.1093/ageing/afq121

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Hirdes JP, Fries BE, Morris JN, Steel K, Mor V, Frijters D, et al. Integrated health information systems based on the RAI/MDS series of instruments. Healthc Manage Forum. (1999) 12:30–40. doi: 10.1016/S0840-4704(10)60164-0

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Hirdes JP, van Everdingen C, Ferris J, Franco-Martin M, Fries BE, Heikkila J, et al. The interRAI suite of mental health assessment instruments: an integrated system for the continuum of care. Front Psychiatry. (2019) 10:926. doi: 10.3389/fpsyt.2019.00926

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Rolfson DB, Heckman GA, Bagshaw SM, Robertson D, Hirdes JP. Implementing frailty measures in the Canadian healthcare system. J Frailty Aging. (2018) 7:208–16. doi: 10.14283/jfa.2018.29

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Heckman GA, Gray LC, Hirdes JP. Addressing health care needs for frail seniors in Canada: The role of interrai instruments. CGS J CME. (2013) 3:8–16. Available online at: http://hdl.handle.net/10012/11701

Google Scholar

47. Carpenter GI, Hirdes JP. Using interRAI Assessment Systems to Measure and Maintain Quality of Long-Term Care. A Good Life in Old Age? Monitoring and Improving Quality in Long-Term Care, Vol 28. Paris: OECD Publishing (2013).

Google Scholar

48. Stewart SL, Hamza CA. The child and youth mental health assessment (ChYMH): an examination of the psychometric properties of an integrated assessment developed for clinically referred children and youth. BMC Health Serv Res. (2017) 17:82. doi: 10.1186/s12913-016-1970-9

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Boorsma M, Joling K, Dussel M, Ribbe M, Frijters D, van Marwijk HW, et al. The incidence of depression and its risk factors in Dutch nursing homes and residential care homes. Am J Geriatr Psychiatry. (2012) 20:932–42. doi: 10.1097/JGP.0b013e31825d08ac

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Burrows AB, Morris JN, Simon SE, Hirdes JP, Phillips C. Development of a minimum data set-based depression rating scale for use in nursing homes. Age Ageing. (2000) 29:165–72. doi: 10.1093/ageing/29.2.165

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Dalby DM, Hirdes JP, Hogan DB, Patten SB, Beck CA, Rabinowitz T, et al. Potentially inappropriate management of depressive symptoms among Ontario home care clients. Int J Geriatr Psychiatry. (2008) 23:650–9. English. doi: 10.1002/gps.1987

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Fisher KA, Seow H, Brazil K, Freeman S, Smith TF, Guthrie DM. Prevalence and risk factors of depressive symptoms in a Canadian palliative home care population: a cross-sectional study. BMC Palliat Care. (2014) 13:10. doi: 10.1186/1472-684X-13-10

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Langlois L, Martin L. Relationship between diagnostic criteria, depressive equivalents and diagnosis of depression among older adults with intellectual disability. J Intellect Disabil Res. (2008) 52:896–904. doi: 10.1111/j.1365-2788.2008.01041.x

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Hirdes JP, Smith TF, Rabinowitz T, Yamauchi K, Pérez E, Telegdi NC, et al. The resident assessment instrument-mental health (RAI-MH): Inter-rater reliability and convergent validity. J Behav Health Serv Res. (2002) 29:419–32. doi: 10.1097/00075484-200211000-00006

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Hirdes JP, Poss JW, Caldarelli H, Fries BE, Morris JN, Teare GF, et al. An evaluation of data quality in Canada's continuing care reporting system (CCRS): secondary analyses of Ontario data submitted between 1996 and 2011. BMC Med Inform Decis Mak. (2013) 13:27. doi: 10.1186/1472-6947-13-27

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Hogeveen SE, Chen J, Hirdes JP. Evaluation of data quality of interRAI assessments in home and community care. BMC Med Inform Decis Mak. (2017) 17:150. doi: 10.1186/s12911-017-0547-9

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Kim H, Jung YI, Sung M, Lee JY, Yoon JY, Yoon JL. Reliability of the interRAI long term care facilities (LTCF) and interRAI home care (HC). Geriatr Gerontol Int. (2015) 15:220–8. doi: 10.1111/ggi.12330

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Clark LA, Watson D. Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications. J Abnorm Psychol. (1991) 100:316. doi: 10.1037/0021-843X.100.3.316

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Winer ES, Bryant J, Bartoszek G, Rojas E, Nadorff MR, Kilgore J. Mapping the relationship between anxiety, anhedonia, and depression. J Affect Disord. (2017) 221:289–96. doi: 10.1016/j.jad.2017.06.006

PubMed Abstract | CrossRef Full Text | Google Scholar

60. De Fruyt J, Sabbe B, Demyttenaere K. Anhedonia in depressive disorder: a narrative review. Psychopathology. (2020) 53:274–81. doi: 10.1159/000508773

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Martin L, Poss JW, Hirdes JP, Jones RN, Stones MJ, Fries BE. Predictors of a new depression diagnosis among older adults admitted to complex continuing care: implications for the depression rating scale (DRS). Age Ageing. (2008) 37:51–6. doi: 10.1093/ageing/afm162

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Koehler M, Rabinowitz T, Hirdes J, Stones M, Carpenter GI, Fries BE, et al. Measuring depression in nursing home residents with the MDS and GDS: an observational psychometric study. BMC Geriatr. (2005) 5:1. doi: 10.1186/1471-2318-5-1

PubMed Abstract | CrossRef Full Text | Google Scholar

63. Patel V, Prince M. Global mental health: a new global health field comes of age. JAMA. (2010) 303:1976–7. doi: 10.1001/jama.2010.616

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Patel V. The future of psychiatry in low-and middle-income countries. Psychol Med. (2009) 39:1759–62. doi: 10.1017/S0033291709005224

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Kekow J, Moots R, Khandker R, Melin J, Freundlich B, Singh A. Improvements in patient-reported outcomes, symptoms of depression and anxiety, and their association with clinical remission among patients with moderate-to-severe active early rheumatoid arthritis. Rheumatology. (2011) 50:401–9. doi: 10.1093/rheumatology/keq327

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Werner BC, Wong AC, Chang B, Craig EV, Dines DM, Warren RF, et al. Depression and patient-reported outcomes following total shoulder arthroplasty. JBJS. (2017) 99:688–95. doi: 10.2106/JBJS.16.00541

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Crittenden KS, Fugita SS, Bae H, Lamug CB, Un C. A cross-cultural study of self-report depressive symptoms among college students. J Cross Cult Psychol. (1992) 23:163–78. doi: 10.1177/0022022192232003

CrossRef Full Text | Google Scholar

68. Gopalkrishnan N. Cultural diversity and mental health: considerations for policy and practice. Front Public Health. (2018) 6:179. doi: 10.3389/fpubh.2018.00179

PubMed Abstract | CrossRef Full Text | Google Scholar

69. Morris JN, Carpenter I, Berg K, Jones RN. Outcome measures for use with home care clients. Can J Aging. (2000) 19:87–105. doi: 10.1017/S071498080001391X

CrossRef Full Text | Google Scholar

70. Freeman S, Hirdes JP, Stolee P, Garcia J, Smith TF, Steel K, et al. Care planning needs of palliative home care clients: development of the interRAI palliative care assessment clinical assessment protocols (CAPs). BMC Palliat Care. (2014) 13:58. doi: 10.1186/1472-684X-13-58

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Hermans K, De Almeida Mello J, Spruytte N, Cohen J, Van Audenhove C, Declercq A. A comparative analysis of comprehensive geriatric assessments for nursing home residents receiving palliative care: a systematic review. J Am Med Dir Assoc. (2014) 15:467–76. doi: 10.1016/j.jamda.2014.01.002

PubMed Abstract | CrossRef Full Text | Google Scholar

72. Steel K, Ljunggren G, Topinkova E, Morris JN, Vitale C, Parzuchowski J, et al. The RAI-PC: an assessment instrument for palliative care in all settings. Am J Hosp Palliat Med. (2003) 20:211–9. doi: 10.1177/104990910302000311

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Frijters DH, van der Roest HG, Carpenter IG, Finne-Soveri H, Henrard JC, Chetrit A, et al. The calculation of quality indicators for long term care facilities in 8 countries (SHELTER project). BMC Health Serv Res. (2013) 13:138. doi: 10.1186/1472-6963-13-138

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Onder G, Carpenter I, Finne-Soveri H, Gindin J, Frijters D, Henrard JC, et al. Assessment of nursing home residents in Europe: the services and health for elderly in long TERm care (SHELTER) study. BMC Health Serv Res. (2012) 12:5. doi: 10.1186/1472-6963-12-5

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Morris JN, Nonemaker S, Murphy K, Hawes C, Fries BE, Mor V, et al. A commitment to change: revision of HCFA's RAI. J Am Geriatr Soc. (1997) 45:1011–6. doi: 10.1111/j.1532-5415.1997.tb02974.x

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Hirdes JP, Mitchell L, Maxwell CJ, White N. Beyond the 'iron lungs of gerontology': using evidence to shape the future of nursing homes in Canada. Can J Aging. (2011) 30:371–90. doi: 10.1017/S0714980811000304

PubMed Abstract | CrossRef Full Text | Google Scholar

77. Geffen LN, Kelly G, Morris JN, Hogeveen S, Hirdes J. Establishing the criterion validity of the interRAI Check-Up Self-Report instrument. BMC geriatrics. (2020) 20:260. doi: 10.1186/s12877-020-01659-9

PubMed Abstract | CrossRef Full Text | Google Scholar

78. Iheme L, Hirdes JP, Geffen L, Heckman G, Hogeveen S. Psychometric properties, feasibility, and acceptability of the self-reported interRAI check-up assessment. J Am Med Direct Assoc. (2021) 23:117–21. doi: 10.1016/j.jamda.2021.06.008

PubMed Abstract | CrossRef Full Text | Google Scholar

79. Costa AP, Hirdes JP, Heckman GA, Dey AB, Jonsson PV, Lakhan P, et al. Geriatric syndromes predict postdischarge outcomes among older emergency department patients: findings from the interRAI multinational emergency department study. Acad Emerg Med. (2014) 21:422–33. doi: 10.1111/acem.12353

PubMed Abstract | CrossRef Full Text | Google Scholar

80. Jones K, Perlman CM, Hirdes JP, Scott T. Screening cognitive performance with the resident assessment instrument for mental health cognitive performance scale. Can J Psychiatry. (2010) 55:736–40. doi: 10.1177/070674371005501108

PubMed Abstract | CrossRef Full Text | Google Scholar

81. Morris JN, Fries BE, Mehr DR, Hawes C, Phillips C, Mor V, et al. MDS cognitive performance scale. J Gerontol. (1994) 49:M174–82. doi: 10.1093/geronj/49.4.M174

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Martin L, Hirdes JP, Morris JN, Montague P, Rabinowitz T, Fries BE. Validating the mental health assessment protocols (MHAPs) in the resident assessment instrument mental health (RAI-MH). J Psychiatr Ment Health Nurs. (2009) 16:646–53. doi: 10.1111/j.1365-2850.2009.01429.x

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Brousseau AA, Dent E, Hubbard R, Melady D, Emond M, Mercier E, et al. Identification of older adults with frailty in the emergency department using a frailty index: results from a multinational study. Age Ageing. (2018) 47:242–8. doi: 10.1093/ageing/afx168

PubMed Abstract | CrossRef Full Text | Google Scholar

84. Gray LC, Peel NM, Costa AP, Burkett E, Dey AB, Jonsson PV, et al. Profiles of older patients in the emergency department: findings from the interRAI multinational emergency department study. Ann Emerg Med. (2013) 62:467–74. doi: 10.1016/j.annemergmed.2013.05.008

PubMed Abstract | CrossRef Full Text | Google Scholar

85. Hirdes JP, Morris JN, interRAI (Organization), CMH Coordinating Committee., interRAI (Organization). Instrument and Systems Development Committee. interRAI Community Mental Health (CMH) Assessment Form and User's Manual. 9.1, interRAI Standard ed. Ann Arbor, MI: interRAI (2010).

86. Hirdes JP, Morris JN, interRAI (Organization), MH CAP Coordinating Committee., interRAI (Organization). Instrument and Systems Development Committee. interRAI Mental Health Clinical Assessment Protocols (CAPs): for Use With Community and Hospital-Based Mental Health Assessment Instruments. 9.1. ed. Ann Arbor, MI: interRAI; (2011).

Google Scholar

87. Fang H, Tu S, Sheng J, Shao A. Depression in sleep disturbance: a review on a bidirectional relationship, mechanisms and treatment. J Cell Mol Med. (2019) 23:2324–32. doi: 10.1111/jcmm.14170

PubMed Abstract | CrossRef Full Text | Google Scholar

88. Kessler RC, Green JG, Gruber MJ, Sampson NA, Bromet E, Cuitan M, et al. Screening for serious mental illness in the general population with the K6 screening scale: results from the WHO world mental health (WMH) survey initiative. Int J Methods Psychiatr Res. (2010) 19:4–22. doi: 10.1002/mpr.310

PubMed Abstract | CrossRef Full Text | Google Scholar

89. Furukawa TA, Kessler RC, Slade T, Andrews G. The performance of the K6 and K10 screening scales for psychological distress in the Australian national survey of mental health and well-being. Psychol Med. (2003) 33:357–62. doi: 10.1017/S0033291702006700

PubMed Abstract | CrossRef Full Text | Google Scholar

90. Oakley Browne MA, Wells JE, Scott KM, McGee MA, New Zealand Mental Health Survey Research T. The Kessler psychological distress scale in Te Rau Hinengaro: the New Zealand mental health survey. Austral N Z J Psychiatry. (2010) 44:314–22. doi: 10.3109/00048670903279820

PubMed Abstract | CrossRef Full Text | Google Scholar

91. Cairney J, Veldhuizen S, Wade TJ, Kurdyak P, Streiner DL. Evaluation of 2 measures of psychological distress as screeners for depression in the general population. Can J Psychiatry. (2007) 52:111–20. doi: 10.1177/070674370705200209

PubMed Abstract | CrossRef Full Text | Google Scholar

92. Hosmer Jr DW, Lemeshow S, Sturdivant RX. Applied Logistic Regression, Vol. 398. Hoboken, NJ: John Wiley & Sons (2013).

Google Scholar

93. Staples LG, Dear BF, Gandy M, Fogliati V, Fogliati R, Karin E, et al. Psychometric properties and clinical utility of brief measures of depression, anxiety, and general distress: the PHQ-2, GAD-2, and K-6. Gen Hosp Psychiatry. (2019) 56:13–18. doi: 10.1016/j.genhosppsych.2018.11.003

PubMed Abstract | CrossRef Full Text | Google Scholar

94. Hirdes JP, Ikegami N, Jonsson PV, Topinkova E, Maxwell CJ, Yamauchi K. Cross-national comparisons of antidepressant use among institutionalized older persons based on the minimum data set (MDS). Can J Aging. (2000) 19:18–37. doi: 10.1017/S0714980800013878

CrossRef Full Text | Google Scholar

95. Perlman C, Kirkham J, Velkers C, Leung RH, Whitehead M, Seitz D. Access to psychiatrist services for older adults in long-term care: a population-based study. J Am Med Direct Assoc. (2019) 20:610–6. doi: 10.1016/j.jamda.2019.01.121

PubMed Abstract | CrossRef Full Text | Google Scholar

96. Masciocchi E, Maltais M, El Haddad K, Giudici KV, Rolland Y, Vellas B, et al. Defining vitality using physical and mental well-being measures in nursing homes: a prospective study. J Nutr Health Aging. (2020) 24:37–42. doi: 10.1007/s12603-019-1285-8

PubMed Abstract | CrossRef Full Text | Google Scholar

97. Chatterjee S, Bali V, Carnahan RM, Chen H, Johnson ML, Aparasu RR. Risk of mortality associated with anticholinergic use in elderly nursing home residents with depression. Drugs Aging. (2017) 34:691–700. doi: 10.1007/s40266-017-0475-5

PubMed Abstract | CrossRef Full Text | Google Scholar

98. Tesky VA, Schall A, Schulze U, Stangier U, Oswald F, Knopf M, et al. Depression in the nursing home: a cluster-randomized stepped-wedge study to probe the effectiveness of a novel case management approach to improve treatment (the DAVOS project). Trials. (2019) 20:1–8. doi: 10.1186/s13063-019-3534-x

PubMed Abstract | CrossRef Full Text | Google Scholar

99. interRAI (Organization). ChYMH CAP Development Committee, interRAI (Organization). Instrument and Systems Development Committee, interRAI (Organization). InterRAI Child and Youth Mental Health Collaborative Action Plans (CAPs): For Use With the Child and Youth Mental Health Assessment Instrument. 9.3. ed. Washington, DC: interRAI (2015).

100. Mathias K, Hirdes JP, Pittman D. A care planning strategy for traumatic life events in community mental health and inpatient psychiatry based on the InterRAI assessment instruments. Community Ment Health J. (2010) 46:621–7. doi: 10.1007/s10597-010-9308-2

PubMed Abstract | CrossRef Full Text | Google Scholar

101. Kehyayan V, Hirdes JP, Perlman CM. Education and employment needs and receipt of services in community and inpatient mental health settings. Community Ment Health J. (2014) 50:637–45. doi: 10.1007/s10597-014-9694-y

PubMed Abstract | CrossRef Full Text | Google Scholar

102. Neufeld E, Perlman CM, Hirdes JP. Predicting inpatient aggression using the InterRAI risk of harm to others clinical assessment protocol: a tool for risk assessment and care planning. J Behav Health Serv Res. (2012) 39:472–80. doi: 10.1007/s11414-011-9271-x

PubMed Abstract | CrossRef Full Text | Google Scholar

103. Lewis CC, Boyd M, Puspitasari A, Navarro E, Howard J, Kassab H, et al. Implementing measurement-based care in behavioral health: a review. JAMA Psychiatry. (2019) 76:324–35. doi: 10.1001/jamapsychiatry.2018.3329

PubMed Abstract | CrossRef Full Text | Google Scholar

104. Hirdes JP. Quality control in nursing homes. CMAJ. (1999) 161:127.

Google Scholar

105. Martin L, Hirdes JP, Fries BE, Smith TF. Development and psychometric properties of an assessment for persons with intellectual disability—the interRAI ID. J Policy Pract Intellect Disabil. (2007) 4:23–9. doi: 10.1111/j.1741-1130.2006.00094.x

CrossRef Full Text | Google Scholar

106. Gray LC, Bernabei R, Berg K, Finne-Soveri H, Fries BE, Hirdes JP, et al. Standardizing assessment of elderly people in acute care: the interRAI acute care instrument. J Am Geriatr Soc. (2008) 56:536–41. doi: 10.1111/j.1532-5415.2007.01590.x

PubMed Abstract | CrossRef Full Text | Google Scholar

107. Glenny C, Stolee P, Husted J, Thompson M, Berg K. Comparison of the responsiveness of the FIM and the interRAI post acute care assessment instrument in rehabilitation of older adults. Arch Phys Med Rehabil. (2010) 91:1038–43. doi: 10.1016/j.apmr.2010.03.014

PubMed Abstract | CrossRef Full Text | Google Scholar

108. Stewart SL, Falah Hassani K, Poss J, Hirdes J. The determinants of service complexity in children with intellectual disabilities. J Intellect Disabil Res. (2017) 61:1055–68. doi: 10.1111/jir.12423

PubMed Abstract | CrossRef Full Text | Google Scholar

109. Stewart SL, Babcock SE, Li Y, Dave HP. A psychometric evaluation of the interRAI child and youth mental health instruments (ChYMH) anxiety scale in children with and without developmental disabilities. BMC Psychiatry. (2020) 20:390. doi: 10.1186/s12888-020-02785-9

PubMed Abstract | CrossRef Full Text | Google Scholar

110. Stewart SL, Babcock SE. interRAI child and youth mental health-screener (ChYMH-S): a psychometric evaluation and validation study. Child Psychiatry Hum Dev. (2020) 51:769–80. doi: 10.1007/s10578-020-01003-7

PubMed Abstract | CrossRef Full Text | Google Scholar