A correction has been applied to this article in:
Corrigendum: A person-centered approach to home and community-based services outcome measurement
Matthew A. Roberts
Brian H. Abery- Institute on Community Integration, Rehabilitation Research and Training Center on HCBS Outcome Measurement, University of Minnesota, Minneapolis, United States
In the United States, over 2.5 million people with disabilities are recipients of supports through the Center for Medicare and Medicaid Services (CMS) Home and Community-Based Services (HCBS) program. Recent decades have seen a growing focus on providing HCBS in a person-centered manner thereby supporting outcomes that are both important for and to the person. HCBS outcome measurement, however, has not kept pace with advancements in person-centered thinking as it relates to providing supports to people with disabilities. The concept of person-centered outcome measurement has been inadequately defined and is frequently misunderstood including by those in the measurement field. The authors first operationally define person-centered measurement and establish its importance within the context of HCBS and the recent CMS's Final Settings Rule. The important role that person-centered measurement has to play in quality improvement efforts in this area is then explored. A discussion is subsequently provided as to the challenges that are faced in person-centered measurement specific to the disability field. In addition to further conceptualizing and defining this form of measurement, recommendations are provided for moving the field forward.
Introduction
Over 2.5 million people with disabilities in the United States receive Home and Community-Based Services (HCBS) through the Centers for Medicare and Medicaid Services (CMS) Long-Term Services and Supports (LTSS) program (1). The program is intended to support people with disabilities living in more inclusive settings that offer greater access to and integration within the community. Enrollment and HCBS program spending has increased significantly over recent decades as more people with disabilities prefer receiving support in their community in place of institutional settings (1). Unfortunately, in far too many cases HCBS results in a person living physically within the community but failing to experience being part of the community in a psychological and social sense [e.g. (2–4),].
The Medicaid program, including HCBS is jointly funded by the federal government and states. The federal government provides approximately fifty-six cents for every Medicaid dollar spent with states providing the balance (5). Because states are required to partially fund HCBS, they are allowed a significant amount of flexibility in how they design and administer HCBS programs. This includes the capacity to determine, (1) who to cover (i.e., target populations, eligibility criteria), (2) what to cover (a variety of waiver benefit packages), (3) how services are delivered (e.g., self-directed supports, through Managed Care Organizations (MCOs), and (4) how providers are reimbursed. Unlike Medicaid, HCBS waivers allow states to both choose and limit how many people are served under each waiver and which services are covered for which populations. Although HCBS programs vary significantly between states, some of the most common populations eligible for services include people with intellectual and developmental disabilities (IDD), physical disabilities (PD), psychiatric disabilities (psychD), traumatic and acquired brain injury (TBI/ABI), and age-related disabilities (ARD). The ability of states to limit HCBS waiver enrollment has resulted in extremely long waiting lists in most of the country because the number of people seeking services far exceeds the number of waiver slots available (6). Home and Community-Based Services are further complicated because of the extremely diverse and varied support needs of HCBS recipients. Supports range from those that are limited to periods of transition or a single context to services needed on a continuous basis. This has led states to develop and implement a wide variety of programs, services, and supports, aimed at meeting the unique support and service needs of the populations served.
As a result of the variety of programs and diversity of recipients, measurement of the quality of supports that the recipients of HCBS receive and the outcomes these individuals experience is far from a simple process. A nuanced approach needs to be taken that is responsive to a wide variety of personal and contextual factors. This process needs to be decidedly different than that currently used in medical/healthcare contexts due to the dissimilarities in the constructs measured. Unlike many outcome measures related to health (e.g., the number of urinary tract infections or falls experienced by a person, blood pressure, etc.) outcomes associated with HCBS (e.g., the extent to which people with disabilities experience a sense of social connectedness) are both more complex and difficult to assess. A second set of critical contextual factors for which one needs to account are the policies and regulations under which HCBS is implemented which vary significantly between states in the U.S.
In 2014 CMS published the Final Settings Rule for HCBS; thereby, establishing a set of requirements for the qualities that needed to be in place for HCBS settings to be eligible for reimbursement through CMS under sections 1915(c), 1915(i) and 1915(k). The provisions established an outcome-oriented definition of home and community-based services that firmly supports the self-determination and choice of recipients. Through their emphasis on person-centered services and supports, as well as service plans developed through a person-centered approach, the regulations require that planning processes reflect individually identified needs, goals, and preferences. Additionally, it strongly supports the achievement of the unique desired life outcomes of each HCBS recipient. Since its initial publication eight-years ago, states have been granted a number of extensions with respect to the date when they are required to be in compliance with the Final Settings rule. At this time, the deadline has been established as March 17, 2023. After this point, federal reimbursement for HCBS providers will be contingent on their compliance with the Settings Rule and the provision of services in a truly person-centered manner.
Long before implementation of the Final Settings Rule (7), the focus of home and community-based services had begun to move away from custodial-like care to the provision of supports that reflect the uniqueness and desired life outcomes of the recipients of support. No longer is it sufficient to focus services on what's important for the person. Rather, supports must reflect both what is important for and what is important to the person (8). For decades, states and providers have been increasing efforts to design services to be more person-centered. The State of Minnesota (U.S.) Department of Human Services, for example, has over the past 5-years funded a program of “person-centered thinking and planning” education for HCBS providers from across the state. The goal of this program is to equip provider agencies with the knowledge and tools necessary to plan and provide services in a person-centered manner while meeting the requirements of the Final Settings Rule.
In addition to the CMS/HCBS system's move toward person-centered service provision, there are legal and compliance motivations within the HCBS environment that support the need for measurement that is person-centered. In 1999 the U.S. Supreme Court ruled in Olmstead v. L.C. that unjustified segregation of persons with disabilities constituted discrimination and was in direct violation of title II of the Americans with Disabilities Act. Under the Olmstead decision (9), states in the U.S. are now obligated to provide services for people with disabilities in the most inclusive community settings possible as well as support them to achieve desired life outcomes. In many states, obligations under the Olmstead decision continue to be monitored by court-appointed staff to ensure that progress is being made with respect to outcomes. To fully measure the effectiveness of programs that provide services and supports in meeting Olmstead requirements, a person-centered approach to measurement is needed. The approach needs to emphasize the degree to which the outcomes experienced by HCBS recipients match their needs and preferences and move them forward in achieving desired life outcomes.
This article is intended to correct misconceptions that many professionals in community living have about person-centered measurement, discuss the need for a person-centered approach to measurement in this area, and review the strengths and limitations of existing as well as person-centered approaches to measurement in the field of home and community-based services. Information regarding the development process that staff at the RTC/OM are using is provided to supplement the discussion and provide readers with a general idea as to a process that could be used to move in this direction.
The need for new approaches to HCBS outcome measurement
There has been great interest in assessing the outcomes of HCBS recipients over the past twenty-years. During this period, The Human Services Research Institute's National Core Indicators, the Center for Quality Leadership's Personal Outcome Measures, and the CAHPS Home and Community-Based Services Survey have all been developed and are being used by both states and support providers as one means through which to demonstrate compliance with CMS regulations. Each of these approaches has its strengths. However, all have significant limitations that lead to the need to develop new measurement approaches that address these shortcomings.
The National Core Indicators (NCI and NCI-AD) is currently the most widely used tool in the U.S. for the assessment of outcomes associated with the receipt of home and community-based services. The instrument was developed and validated as a state-level compliance measure and not intended to be used at the provider or individual level for quality improvement, service plan development, and/or outcome assessment. Although the NCI includes indicators in a variety of areas, it is intended to be administered (and was validated) at the instrument level as opposed to on an indicator-by-indicator basis. Users are therefore required to administer items related to all indicators as opposed to only those in which there is a specific interest. It should also be noted that although NCI and NCI-AD have been used with populations beyond those for which they were intended (i.e., people with IDD, physical, and age-related disabilities) these tools have only been validated for use with the limited disability groups noted. In addition, research has indicated that while some NCI indicators hold together well psychometrically (10), others do not (11).
CQL's Personal Outcome Measures (12) is one of the better-developed and validated HCBS Outcome tools. It is part of a commercially available system of assessment that can be used to support provider quality improvement efforts. It has been validated with a much wider variety of people with disabilities than the NCI and possesses good psychometric properties. The instrument is administered in a conversational manner to people with disabilities and includes 171 required items. A manual describing administrative procedures and items is accessible online with training available both in-person and online for organizations interested in using this tool.
A third approach to outcome assessment in the human services field that has recently been championed by the Center for Medicaid and Medicare Services is the HCBS CAHPS Survey. This CAHPS is a questionnaire with 69 core items developed for measuring the experiences of people with disabilities who are HCBS recipients. The CAHPS, unfortunately, currently has limited data available with respect to its validity or reliability. Internal consistency reliabilities for seventeen of its nineteen measures fail to meet even the most basic criteria for psychometric acceptability, there are serious questions about the representativeness of the sample used for the field study as well as the evidence presented to support validity, and in a number of indicator areas, there appears to be a ceiling effect with the overwhelming majority of respondents indicating the highest possible level of service quality or personal outcomes (13).
In addition to the individual shortcomings of the most widely used HCBS outcome measures, there are three additional limitations that cut across the instruments noted above as well as other outcome assessment tools that contribute to the need for development of new measurement approaches. The first of these entails the relatively small percentage of items included in most HCBS outcome measurement instruments that meet the criteria for person-centeredness. A recent study of 140 outcome measures used with HCBS populations (14) found that only 36% of the items included in these tools were person-centered in nature. Although some outcome measures (e.g., the CQL-POM) are more person-centered than others, the overall results of this study clearly indicate the need for approaches to assessment that place greater priority of assessing outcomes within the context of what is most important to individual persons with disabilities. Overall, measurement of the extent to which HCBS recipients experience person-centered outcomes—outcomes that go beyond compliance and include assessment of what is important to the person, has lagged far behind the push for person-centered services. Providing person-centered services, however, is incompatible with measurement that does not consider an individual's desired life outcomes.
A second shortcoming that cuts across tools is the lack of evidence that they are sufficiently sensitive to change over time that they can be used in a longitudinal manner. Some developers, such as HSRI (NCI) explicitly state that their measures are not intended to be used longitudinally. Others (e.g., CQL, CAHPS) have yet to provide evidence that, when used in a longitudinal manner, their measures are sufficiently sensitive to change that they can be used as evidence of the effectiveness/efficacy of quality improvement efforts or changes that take place in a HCBS recipient's life. A third reason to think about the development of new approaches to outcome measurement in HCBS emanates from the resources needed to administer measures at a time when the human services field is experiencing serious workforce shortages. All of the tools referenced above are intended to be administered in their entirety as full instruments. They are neither modular in format allowing for administration focused on only one or a few indicators, nor tiered and able to provide both a quick general overview of indicators as well as a more in-depth assessment.
The Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM) at the University of Minnesota, funded by the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR), was created for the purpose of improving HCBS outcome measurement in the United States. The center has conducted its work in multiple phases beginning with the selection and conceptualization of several measurement domains for the development of person-centered measures and, in later phases, the testing and validation of those measures. A key part of the process in completing the RTC/OM phases has been defining person-centered measurement and executing a process for developing and validating person-centered measurement tools.
Person-centered HCBS outcome measurement tools are essential for acquiring valid information regarding both the extent to which the services provided to people with disabilities are truly person-centered and the extent to which these supports foster the achievement of person-centered goals. When this form of measurement is not used, the information collected yields data solely with respect to the extent to which the person's experiences are aligned with benchmarks defined by someone other than the individual with a disability. This form of “non-person-centered measurement” and the benchmarks on which it is based assumes that, unlike the general population, all people with disabilities desire the same life outcomes with respect to employment, education, housing, and social relationships. This assumption must be argued to hold regardless of differences in the cultural, racial/ethnic, and gender make-up of the people in question as well as variation in the types of disability they experience or their level of support needs. Previous research, however, suggests that these assumptions are not supported and that future aspirations as well as how people define their quality of life are as varied as within the general population (15–18). A number of researchers (16, 19–21) therefore suggested some time ago that tools need to be developed that rely less on generalized outcome measures and consider both the unique profiles of people with disabilities and the social and environmental factors that influence the outcomes they both desire and experience.
Much of today's focus on outcome measurement is driven by the need of program administrators and federal and state agencies to have evidence of the impact of HCBS on the outcomes that the recipients of services experience. This is to both demonstrate compliance with current regulations and support continued congressional funding of HCBS programs. Given the Final Settings Rule (7) it is critical to collect and share data with funding agencies that demonstrate the extent to which HCBS are supporting person-centered outcomes associated with the full inclusion in the community. It is also essential that measures are available to track how policy changes, as well as efforts at quality improvement, assess the extent to which services are provided in the manner intended (e.g., program fidelity) and produce better outcomes. In the remainder of this article, we explore the concept of person-centered measurement within the context of HCBS, how it can be operationalized, the challenges with using this approach, and strategies that can be used to develop measures that achieve this measurement pre-requisite.
The concept of person-centeredness
The concept of person-centeredness has existed for decades and can be traced back to Carl Rogers [e.g., (22, 23)]. Fundamentally, person-centeredness posits that the person has the greatest understanding of themselves, and a full appreciation and involvement of the person is necessary to achieve successful outcomes (23). Over the past forty-years the field of disability services has evolved to include person-centeredness in the areas of planning, service delivery and coordination, outcomes, and assessment. Person-centered practice emerged in the United States during the early 1980s as people with IDD transitioned from institutional to community-living. With this came the need for individualized service plans to fit the needs of each person living within the community based upon their preferences and desired life outcomes (24, 25). Recent decades have also seen the parallel development of patient-centered models in health care [e.g., (26–28)]. CMS has pivoted to support the incorporation of person-centered planning and practices into disability support systems (i.e., HCBS, LTSS) including recent efforts by a national stakeholder committee to further define person-centered planning and practices, generate core service delivery competencies in the area, and develop compatible measurement frameworks (29). As the sophistication of person-centered practices have increased, even more attention is needed toward measuring whether the services result in the outcomes that are important to individuals.
Person-centeredness as we define it is essential to treating people with disabilities with fairness and equity. The Convention on the Rights of Persons with Disabilities (30) asserts the right of every person with a disability to live and enjoy their life on an “equal basis with others” (article 10) as fully included participants in society. This includes the right to personal self-determination. In the United States, the HCBS Settings Rule (7) requires that people with disabilities receives support and services that are provided in ways that are based on their personal preferences and assist them in achieving desired life outcomes. This includes the right to choose where one will live and with whom; if and in what type of job one will work, as well as the types and limits of the supports one receives. Environments and the professionals providing supports must promote the individuals having control over day-to-day choices including the kinds of support they will receive (31). The purpose of this rule is to ensure HCBS are provided in a manner that promotes both community inclusion and self-determination and is delivered based on what is important to each individual, rather than asking people to adapt or compromise based on what is most convenient or available within the system. This focus on ensuring that each person has opportunities to make meaningful choices about support to be received and about his/her life, is in keeping with both the CRPD (30) and the rallying call of people with disabilities who have for years been stating, “nothing about us, without us.”
The changes noted above are grounded in a paradigm shift in the field of disability services from a medical model, which focuses on somehow changing or “fixing” people with disabilities so that they will better fit into the existing society, to a social-ecological model of disability, which shifts the onus to creating environments that best accommodate people with disabilities with the intent that they experience life as full members of the community. This paradigm shift requires that HCBS be individualized to address what is important both to and for each person with a disability, rather than designing service systems that assume that all people with disabilities desire to experience the same or similar life outcomes. This paradigm shift demands that tools designed to measure the effectiveness or quality of HCBS must be person-centered and based on the needs and preferences of each individual serving as the benchmark to which we compare experienced outcomes. For example, the idea that all people with disabilities desire to have a large number of friends and that more friends is a better outcome than fewer friends may reflect the preferences of some but certainly not all, people with as well as without disabilities. Some people may feel socially connected to their communities if they have a few close friends. For others, however, a larger number of social relationships will be necessary. Person-centeredness is paramount to ensure both equality and equity with respect to outcomes whether one is considering national or international policy and regulations.
Delivering supports in a person-centered manner requires a responsive service system. It changes the way services are delivered from a top-down approach in which the consumer receives supports according to parameters defined by state and federal agencies funding those supports, to a more bottom-up approach in which the parameters are more flexible and based on the individual needs and preferences of people with disabilities. This process begins with people with disabilities effectively communicating their desired life outcomes and subsequently advocating for supports designed to help them achieve these ends. At a second level, it entails staff or caregivers who directly work with the recipients of services and understand their needs and desires ensuring that service plans and day-to-day supports are directed at facilitating people with disabilities achieving these outcomes. Beyond this, it extends to the leadership of service provider's and the extent to which they support and enable staff to provide person-centered supports. At the uppermost level it extends to government systems that regulate and fund the provider agencies. A similar paradigm shift has taken place in the United States educational system in which there has been a move away from schools dictating educational plans for students with disabilities in favor of the student, family, and school becoming partners in creating an educational plan and determining the best supports for the student.
The concept of person-centered supports is not focused on each person experiencing every outcome they desire. Rather, it focuses on the extent to which a person's desired life outcomes are heard and acknowledged by their planning team, included in their service plan, and efforts made to make progress toward them. Making supports truly person-centered also requires ongoing assessment of the support recipient's preferences, personal goals, needs, and progress/outcomes since these are likely to change over time, as well as a willingness at the provider level to change policies when necessary and adjust services to support the individual in pursuit of their personal goals.
Person-centered measurement
Despite decades of research defining the person-centered concepts, the concept of person-centered measurement has not been well defined or understood. Consequently, measure developers have struggled with identifying exactly what makes a measure or item person-centered. Historically, at least in western cultures, measurement has focused on comparing the performance or experiences of a target person to benchmarks or the performance or outcomes experienced by other people (i.e., the norming group). This approach makes sense and works well when one is measuring outcomes against which there is a known performance criteria or standard that one desires to see a person attain (a benchmark) or it is important to determine an individual's performance relative to a larger group (norm-referenced). For example, in the healthcare field, person-centered practice frameworks [e.g., (27, 28, 32)] have established standards that can be used to compare achieved outcomes against.
In some cases, however, there are no real standards against which to measure a person's outcomes or performance other than the extent to which they meet the individual's desired outcomes and personal needs. We argue that this is the case when one's focus is on measuring the outcomes people with disabilities who receive home and community-based services experience. In these instances, the “standard” against which to compare outcomes or experiences needs to be based on the service recipient's personally defined preferences or goals—not those that other people or the service system sets for them.
In the context of measuring outcomes associated with people who receive HCBS, we contend that for measures to truly be person-centered they meet a number of specific criteria. This is not intended to imply that all HCBS quality measures need to be person-centered. For example, some indicators of workforce characteristics would not make sense to design in a person-centered manner. Rather, we believe that attention in this area needs to be focused on measures of the personal outcomes that people with disabilities desire to experience when they are recipients of HCBS.
From their conceptualization, person-centered HCBS outcome measures need to be designed with the intent that they will be responded to by people with disabilities themselves. Although informed respondents can often provide valuable information with respect to another person's experiences, being able to accurately articulate what another individual believes they need, outcomes they desire to experience, and/or the degree to which they view themselves as making progress toward achieving those outcomes is a difficult task. Previous research indicates that most people have a difficult time understanding how others experience their world, what they desire, or when they are satisfied with the outcomes they experience [e.g., (33–37)]. Designing measures so that they can be directly responded to by people with disabilities themselves places a heavy responsibility on developers that measures are designed so that they (a) are clearly understood by the intended respondents; (b) based upon a time frame that respondent can conceptualize; (c) provide response options that accurately reflect an individual's experiences; and (d) are able to be responded to in a manner that permits people to indicate the extent to which the outcomes they are experiencing align with their desired level of the outcome or indicate progress. For example, although an item that asks a respondent how many hours per-week they work provides some useful data, asking that question and following-up with, “To what extent are you working the number of hours you desire to work?” has the potential to provide more person-centered information.
A second critical aspect of person-centered measurement is its focus on outcomes that are both important for and important to HCBS recipients. Six years ago, the National Quality Forum utilized an expert panel to develop recommendations for the inclusion and prioritization of domains to address performance measure gaps in HCBS outcome measurement (38). On the basis of their work, the NQF developed a framework of eleven core domains each of which included 4–7 subdomains reflecting HCBS quality. As part of a multi-year center, the University of Minnesota's Rehabilitation Research and Training Center on Home and Community-Based Services Outcome Measurement (RTC/OM) undertook a national validation study of the framework with stakeholders representing multiple groups including people with a variety of disabilities (IDD, PD, TBI/ABI, PsychD, Age-Related), family members, HCBS providers, and state and national level program administrators. Results indicated strong support for the framework as well as some needed refinements (39). This refined framework (see Figure 1) includes a myriad of outcomes that require measurement at a person-centered level. However, the developers of new measures as well as the majority of currently available HCBS outcome measures all too often assume that achieving desired life outcomes in all domains and subdomains are of equal importance to people receiving supports. Given differences in people's preferences and the limited resources available within the HCBS system, an approach which weights outcomes with respect to their importance to the individual needs to be incorporated if we are to achieve truly person-centered measurement based upon the unique needs and desired life outcomes of each individual.
FIGURE 1
Figure 1. Revised national quality forum HCBS outcome measurement framework training and training center on home and community-based services outcome measurement (RTC/OM), a systematic search of HCBS outcome measures was undertaken and over 200 instruments reviewed for inclusion into a database of HCBS outcome measures. The items for each instrument were coded into the domains and subdomains included in the NQF framework and for a number of other characteristics including whether they met the criteria for being person-centered. To be coded as “person-centered” an item needed to meet two simple criteria: (a) be designed to be responded to by the person with a disability or when a direct response was impossible, a proxy; (b) enable the responding person to express a preference, desire, need, want, or the extent to which these have been met (see https://rtcom.umn.edu/database). Table 1 summarizes the percentage of items coded as “person-centered” for relevant NQF domains.
TABLE 1
Table 1. Percentage of items coded as person-centered by NQF domain.
A third criteria that we believe is essential for person-centered systems of measurement are their capacity to be used in a longitudinal manner. Given that such systems would be developed with the intent to focus on measuring the extent to which HCBS recipients are progressing toward or achieving their desired life outcomes, suitability for longitudinal use and sensitivity to change over time will be critical characteristics of the system. Current approaches to HCBS outcome measurement are primarily cross-sectional (i.e., the outcomes/experiences of a different set of respondents are assessed every year). As a result, one needs to make many assumptions with respect to the year-to-year representativeness and comparability of samples in order to interpret results. As a result, interpretations of improvement/progress toward outcomes on the part of individuals are not possible and systems improvement is only able to be made in an indirect manner. Although measurement systems of this type do provide important information (e.g., compliance with state and federal regulations) they leave much to be desired as instruments of quality improvement.
Given the criteria specified, what is the extent to which measures currently used to assess the outcomes of HCBS recipients are person-centered? As part of the Rehabilitation Research.
The table indicates that the majority of items that could be coded into an HCBS outcome domain did not meet the established criteria for being person-centered. To illustrate, one recently developed tool is the CAHPS Home and Community-Based Services Survey (40). A total of 87 items were coded into various domains of the NQF framework, but only 10 of these items were coded as person-centered (41). During a follow-up effort, seven states were identified as using this tool for outcome measurement in HCBS programs (42).
In addition to people with disabilities, there are several other stakeholder groups that would benefit from the expansion of person-centered HCBS outcome measurement. Families, together with their member with a disability could use this information to better determine which provider organizations they desire to provide supports as well as to ascertain whether the services their member with a disability receives are facilitating progress toward or the achievement of desired life outcomes. Service providers would also profit from this information utilizing it to help determine if programmatic and policy changes intended to improve service quality have been successful and to assess whether supports are meeting recipients' needs. Managed Care Organizations (MCOS) which are increasingly administering HCBS in the U.S. are another stakeholder group that would benefit from access to psychometrically sound person-centered measures. Such measures would be useful for providing information about the extent to which individual providers within the MCO network are delivering services that result in person-centered outcomes and use this information to both select additional HCBS provider agencies and potentially incentivize those that are facilitating personal outcomes of HCBS recipients that are consistent with the Centers for Medicaid and Medicare Services Final Settings Rule (7).
Person-centered measurement and goal attainment scaling
It is our belief that HCBS outcome measurement should have a prime focus on quality improvement. Therefore, the ability to track the extent to which the services HCBS recipients receive support their making progress toward achieving desired life outcomes over time is essential. This requires measures that can be used on multiple occasions with the same respondents. Such measures need to be sufficiently sensitive to change across time that they are able to detect meaningful differences in a person's experiences, outcomes, and goal attainment within relatively short periods (e.g., 6–12 months). To achieve this level of measurement, developers need to be sensitive both to the manner in which items are worded and the response options that respondents are provided. The former corresponds to developing items that are sufficiently specific so that change can be detected over short periods. The latter focuses on providing those with whom measures are being used with options for responding that allow them to indicate meaningful change in their lives. One approach that we believe responds to this need is the use of Goal Attainment Scaling (GAS).
Goal Attainment Scaling (GAS) is a method for writing personalized evaluation scales (43) in order to quantify progress toward defined goals. Developed over 50-years ago, this approach to measurement is attracting growing interest, especially within the context of intervention and clinical research because it permits the efficacy of treatments to be assessed with respect to goals set by the clients themselves. Although GAS was initially used primarily within the health-related rehabilitation fields for people with physical disabilities and in rehabilitation psychology (44, 45), recent years have found it increasingly used as an outcome measure for people of all ages with a wide variety of functional limitations including adults (46–52), aging adults (53, 54) children in clinical and special education settings (55–62), infants (63) and with parents of children with disabilities (64).
Most recently, Shogren and colleagues (65) have made the case for the use of Goal Attainment Scaling in research focused on determining the efficacy of interventions for people with intellectual and developmental disabilities. She and her colleagues contend that the use of this approach: (a) supports the need for valid and reliable processes to quantify the progress individuals make toward achieving or making progress toward personal goals, (b) allows for the aggregation of data across individuals to determine group effects, and (c) is consistent with the movement toward person-centered services and the support of the self-determination among people with IDD. Within the context of HCBS outcomes measurement, Shogren and her group make the case that traditionally used non-GAS measures while providing information with respect to outcomes, fail to provide a holistic representation of the degree to which the outcomes of programs are truly a function of the supports people receive and the relationship of individuals with disabilities achieving personal goals and longer-term outcomes. Several literature reviews on GAS have been published (54, 66–70) and together with studies that specifically addressed the psychometric qualities of GAS (71–74) these publications suggest that this approach has more than sufficient evidence to support its use in a wide variety of measurement contexts.
How is the process of goal attainment scaling implemented? The first step in GAS is to identify an individualized goal of interest. In the context of HCBS measurement, this could be a desired life outcome either associated with a specific domain of NQF HCBS Outcome Measurement Framework (38) or external to it. The individual with a disability him/herself, with support from others when needed, must be the person on which this phase of GAS centers. The second phase of GAS entails determining what outcomes or behavior will reflect varying degrees of goal attainment in relation to those outcomes of interest. Once again, this step needs to be driven by the perspective of the HCBS recipient as opposed to others. A third step in developing a GAS approach to outcome measurement entails the development of five-point rating scales that operationalize expected outcomes. Typically, these range from −2 (much less than expected) through 0 (expected) to +2 (much more than expected). An alternative approach that has been used entails levels ranging from a −2 (no change) to a +2 (much better than expected) outcome or attainment of the desired outcome or goal. As a next step in the process, a specific time interval for evaluation of progress needs to be set. Depending on the goals or desired outcomes in question this can be anywhere from a few weeks to a full year. The final step in the GAS process is to rate goal attainment after the specified period, using the established GAS rubric and calculate the overall attainment score for the individual's goals.
A number of diverse ways of analyzing the results of GAS can be found in the literature. Scoring each and every goal between −2 and +2 provides a direct indication of the degree to which each goal has been achieved (45). This approach is likely to be easily understood by both HCBS recipients and providers and can be used at the individual level. However, it makes it difficult to undertake aggregated statistical analysis. A second approach is to transform raw GAS scores into T-scores enabling normalization and analysis using a variety of parametric statistics. This is the approach recommended by Kiresuk (43, 75) and covered in depth by Krasny-Pacini and colleagues (44). The mean of raw scores (76) as well as the sum of the differences between the baseline and the level of goal attainment for each person's goals have also been approaches (77). The T-score is the most frequently used method allowing for the reporting of results as a single standardized value.
GAS is a valuable, but certainly not the only strategy to use in order to move toward more person-centered measurement. In some cases, those undertaking program evaluation are interested in aspects of an individual's experience unrelated to the specific goals or outcomes they set for themselves. In other contexts (e.g., freedom from abuse and neglect) personal goals are subservient to state and federal legislation that fully prohibits these negative outcomes. In these instances, ensuring that measure items meet the criteria noted above and are responded to directly by persons with disabilities, solicit a preference, desire, want, need or emotional state from respondents, and provide a chance for people to indicate the degree to which those preferences, needs, etc. are being met provide what we consider to be person-centered data.
Challenges to using person-centered measurement and goal attainment scaling
The GAS process is highly adaptable and has great potential to be used as a person-centered outcome measure to establish the impact of supports received by HCBS recipients regardless of differences in desired outcomes or goals [see (44, 65, 78)]. It is not, however, without its challenges. As Shogren and colleagues (65) point out individualization of goals though desired in practice (79), can change the nature of goals. Goals lacking in precision also have implications for the accuracy of measurement. Shogren also points out that, in many cases, goals identified in one context (e.g., transition planning) are specific to other environments (e.g., work) increasing the challenge of meaningful and reliable GAS rating scales.
Additional challenges to using goal attainment scaling and person-centered approaches within the context of HCBS outcome measurement are related to (a) accounting for differences in the importance (to the person with a disability in question) of specific goals and outcomes, (b) the challenges a person is likely to face in making progress toward or achieving desired life outcomes, (c) the time it is likely to take to achieve sufficient progress to goals for change to be measurable, and (d) the motivation an HCBS recipient has with respect to working toward specific desired outcomes.
When attempting to measure the overall quality of outcomes a person experiences, it is critical to account for the fact that, for most people, some goals/desired life outcomes are significantly more important to achieve than others. Achieving a desired life outcome of a low level of importance is not the same as realizing one that ranks at the top of one's list of important outcomes. GAS is able address this challenge through the weighting of T-scores, giving more weight to certain outcomes/goals and their corresponding scales than others based on an individual's importance weightings. A similar situation exists with respect to the level of challenge or difficulty one is likely to encounter to achieve a specific goal. Some goals (e.g., moving from one occupation to a new one that will require extensive additional training) will require an individual to navigate significantly greater obstacles than other outcomes (e.g., acquiring a bicycle). Various weighting methods have been suggested in the literature as a function of the difficulty (80) and the probability of attaining the goal (81) that when employed properly allow one to take these factors into consideration.
A third challenge that must be confronted when using person-centered and GAS-based measures within an HCBS context relates to time. More specifically, how much time will be necessary in order for individuals to make sufficient progress toward their goals and desired outcomes so that change is detectable? This will likely vary significantly based upon the nature of a person's goals as well as the quality and specificity of the goals that have been developed. In addition, it will be affected by how organizations undertaking measurement/evaluation use the data collected. Regarding the latter, it is important to differentiate between whether the intent of measurement is as part of a formative or summative evaluation process. When the intent is the former, the idea is to monitor progress, ensure that recipients of services are on the right track to eventually achieve desired goals and make needed changes when initial strategies are not working. This approach requires goals to be specified in a fine-toothed manner and likely requires the breaking down of large/long-term goals into subgoals that are measurable over a shorter period of time. If the intent of measurement is summative, or primarily focused on the achievement of a standard after a person has been exposed to a program of supports and services, goals and the measures used to assess them are unlikely to need to be as fine-grained as those employed for assessment of a formative nature.
A final critical challenge to overcome if person-centered approaches to measurement are to be used within the context of HCBS is the necessity of obtaining responses directly from people with disabilities. Minimizing the use of administrative data sets and proxy respondents as a source of data is essential given that in many cases, the questions being asked can best or in some cases only be answered in a valid manner by the people in question themselves. HCBS recipients, however, vary greatly with respect to the nature of their disabilities, intensity of supports they need, and their capacities. This includes the ability to communicate their thoughts and feelings in a valid and reliable manner. Some individuals may not possess or may have lost the capacity for functional communication. The extent to which people who experience disabilities that have a cognitive component can provide valid self-report responses data needs to be carefully considered (82). Some individuals with intellectual and developmental disabilities, psychiatric disabilities, and TBI/ABI experience limitations with respect to understanding the meaning of questions, being able to accurately recall information, determine the order in which events took place, or make comparisons. Others may have great difficulty expressing their thoughts and feelings (83).
The language and cognitive demands of items as well as the response formats provided whether in the form of a survey or interview can present challenges to the reliability and validity of data collected. Items phrased negatively have been found more difficult for individuals with cognitive limitations to comprehend (83). Additionally, research indicates that questions about frequency, time, or abstract concepts (e.g., how inclusive do you feel when in the community?) can also be problematic (82, 84, 85). Fang and colleagues reported that complex rating scales are often quite difficult for people with cognitive limitations to comprehend (86). For some years now it has been known that people with intellectual disabilities may be prone to response bias including a tendency to select positive/agreeable response options (87–89) and both acquiescence and recency bias (84, 90) irrespective of one's true opinion). Additional research indicates that the higher the cognitive demand of a question/item, the more likely it is that a person will provide a biased response (91).
In spite of the challenges, a number of approaches have been shown to reduce the difficulties most people with intellectual disabilities experience in responding to self-report interview questions. These include tools to engage people with IDD such as participatory photographic research methods (92) or visual and metaphorical devices (93). Hollomotz (94) found that when questions were posed in plain language and accompanied by concrete reference tools, including picture cards and photo-story vignettes people with IDD were able to respond to a range of questions about sensitive topics including sex, risk, and their social and leisure lives. Cognitive and language limitations have been shown to be able to be minimized through the use of simplified question wording and response formats (84, 95, 96). Limitations in the ability of interviewees to respond to questions have been avoided through the use of response formats that require no more than a pointing response to emojis/icons or pictures. Simple response scales (e.g., yes, sometimes, no) have also been successfully used. Difficulties responding to questions regarding time have been minimized through the use of reference points with which an individual is likely to be familiar (e.g., birthdays or holidays). Adjusting the depth of questioning in line with what a respondent wants to or can offer has also been found to enhance the quality of data obtained as has a simplified conversational approach (97–100).
The strategies noted above have been shown to increase the capacity of people with a variety of disabilities to respond in a reliable and valid manner to self-report measures. There are still some individuals, however, who in spite of these approaches are unable to report accurately on the outcomes they experience. In these cases, a proxy respondent may be needed. In addition to the obvious person-centeredness limitations of not obtaining a direct response from the person, there are other difficulties associated with proxy responding that need to be considered. There may not be a proxy who truly knows the person well enough to provide a valid response. Moreover, evidence suggests that the validity of proxy responses decreases when the judgment/response made on behalf of the person is more subjective (101).
This does not mean however proxy responses do not provide a viable and important alternative when there is no other way to solicit information. For the past twenty-years, research has been undertaken in an attempt to better understand how proxy data can be used and its limitations. Stancliffe (102) and McVilly and colleagues (103) both found that in contrast to earlier research utilizing non-standardized approaches to assess quality of life, use of the Quality of Life Questionnaire (QOL-Q) resulted in a high degree of concordance between people with IDD and proxy respondents. More recently, Simões & Santos (104) as well as a host of other researchers [e.g., (105–107)] who have compared the points of view of clients with IDD and independent ratings of family members and staff, have found moderate to strong correlations (.69–.89) between persons with disabilities and knowledgeable caregivers when comparing various aspects of quality of life on both the QOL-Q and the WHOQOL-BREF. This does not mean that differences in perspectives do not exist. As might be expected, agreement is higher in some areas than others with higher levels of concordance with respect to more objective assessments of conditions of life and lower when the focus is on perceptions of satisfaction [e.g., (108)]. With respect to the latter, most findings indicate that the ratings of people with IDD are higher than those of family and staff (104, 105, 107). As Perkins (109) concluded, overall, proxy reports can be useful in determining a variety of aspects of well-being of people with disabilities as long as those using measures keep in mind that variety of factors that have the capacity to enhance (e.g., experiences/abilities that are more objectively assessed, and attention to question format) or diminish (e.g., experiences/abilities that are more subjectively assessed, severity of dementia, and level of ID) the quality of information obtained.
Alternative methods of using a proxy have also been put forth. Kaye (110) proposed that using a proxy-assisted approach can sometimes be effective as a compromise between proxy-only and self-reported responding methods. Using this method, the proxy responds with the person who has difficulty responding for themselves to assist with choosing a response. In an application of this approach to healthcare experiences, Elliot et al. (111) found a reduction in the level of bias compared to a proxy-only approach, but the proxy-assisted responses were still found to have a greater potential for bias than self-reports. Rand and colleagues (112) proposed a novel method of obtaining responses from a proxy. They posited that the proxy needed to first provide their own opinion on the outcome experienced by the person they are responding for prior to providing a response on how they think the person with a disability might respond. They suggest that this may reduce some of the response bias related to the proxy's own opinion. This method was utilized by the RTC/OM to develop proxy measures that include a reduced set of items that proxy respondents reported as both understandable and answerable during cognitive testing. This approach has the added benefit of providing two unique pieces of information for each item answered: (1) the opinion of someone who knows the person well and; (2) the proxy's best guess as to how the person with a disability would respond if they could. Further research is needed on this approach as to whether the proxy can sufficiently separate these distinct types of information when responding.
A final challenge to the use of person-centered measurement in the HCBS field results from the limited financial resources available to providers to undertake such evaluation and the workforce shortages endemic to the field. However, any type of assessment or progress monitoring, including alternative approaches, is going to require resources. Some (e.g., administrative data sets) might be less expensive than securing the information from persons with disabilities themselves. However, these alternatives would certainly: (a) not be person-centered and (b) be significantly less likely to provide actionable data that would lead to improved individual outcomes and/or enhanced supports and services. Although desired life outcomes/goals as well as their importance to an individual are in fact likely to change over time, the approach we advocate can be effectively used as a progress monitoring tool to detect these changes and allow for modifications in both supports and outcome measurement related to an individual's current desired life outcomes. In conjunction with person-centered approaches to planning, assessment, and services/supports this approach possesses the potential to more effectively ensure that the support received by an HCBS recipient actually address outcomes relevant to the lives they desire to lead. The approach for which we are advocating is broader than merely assessing the extent to which people with disabilities are making progress or achieving their goals. It includes an assessment of outcome domains and subdomains laid out in the National Quality Forum's HCBS Outcome Measurement Framework. This approach is needed by providers to assure both state and federal funding agencies that services and supports as well as the outcomes experienced by HCBS recipients and in concordance with the Final Settings Rule (7).
The need for a person-centered measure development framework
As Lipson (113) notes, there has been a significant amount of research and development in the area of person-reported measurement as it relates to people with disabilities. Unfortun-ately, there appears to be a mistaken belief that person-reported measures are equivalent to person-centered measures. As noted previously, this is not the case. Both CMS and the National Quality Forum (NQF) have provided extensive guidance on measure development (see CMS MMS Blueprint, 5 & HCBS Outcome Measurement Framework, 38) in addition to guidance on developing person-reported measures. Yet, there is little guidance on how to develop measures that are person-centered.
Person-centered measurement infuses person-centeredness into the measurement tool, items, and the information obtained from the tool from the initiation to the end of the development process. What is measured, how it is measured, and the manner in which people are able to respond to questions all need to be informed through input from people with disabilities. What is measured needs to be important to them as well as important for them so that measurement informs us of the degree to which HCBS supports people with disabilities to achieve personally defined desired life outcomes. Given the relative lack of person-centered measures, further development of a framework and process for developing such measurement tools is warranted. In the following sections, we will describe the process used by the RTC/OM to develop person-centered measures.
A person-centered measure development process
The Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM), funded by the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) was tasked with developing person-centered HCBS quality and outcome measures. The measures, based on the National Quality Forum's (NQF) HCBS Measurement Outcome Framework, were developed based on input from over 350 stakeholders who took part in a series of national participatory planning and decision-making (PPDM) groups. Groups included persons with a variety of disabilities, family members, HCBS providers, and state program administrators. These groups reviewed the NQF Framework to determine the relative importance of each domain and subdomain in the NQF framework. These importance data were used, in conjunction with a gap analysis of existing measures, to prioritize the development of multiple person-centered measures. The PPDM format allowed stakeholders to weigh the importance of potential measure domains and subdomains, add or subtract from the NQF model and move toward consensus as to which were most important to measure.
Much of what has been discussed thus far has focused on person-centered measurement at a broad measure/instrument level. However, the items of which measures are composed are fundamental to person-centered measurement and unfortunately this aspect of measurement has often been neglected. As noted previously, in order to meet the criteria for person-centeredness an item must: (a) be responded to by the person, (b) solicit from the respondent a preference, desire, want, need or emotional state; and (c) provide a chance for the individual to indicate the degree to which those preferences, needs, etc. are being met. It should also be noted that individual should have the opportunity to either indicate the level of importance they place on the content included in the item and/or have the prospect of creating desired life outcomes of their own if items do not correspond well to Table 2 provides examples of items in several NQF domains that are not person-centered as well as items from RTC/OM measures that meet person-centered criteria.
TABLE 2
Table 2. Examples of person-centered measurement.
The RTC/OM has used an iterative, multi-phased process for developing measures based on extensive stakeholder feedback. This approach is based not only on the belief that measures need to be person-centered but that they should also have strong evidence of their reliability and validity prior to being used. Following the completion of draft items for each measure concept, a technical expert panel (TEP) consisting of people with disabilities, family members, content and measurement experts in each concept area, and HCBS program administrators was convened to review and rate each item that was part of a measure. Reviewers rated items on four-point scales with respect to their importance to the construct, understandability, utility, and feasibility of administration. When items received low scores, reviewers responded to open-ended questions to provide specific feedback related to that item. TEPs also provided feedback on the appropriateness of the response options for each item with respect to their understandability, completeness, and potential ability to accurately convey the experiences of people with disabilities. TEP ratings and feedback were used to revise and, in some cases, remove or replace items that stakeholders indicated did not adequately measure a concept.
An innovative strategy taken during measure concept development was to design the measures under development to be modular as opposed to intended to be used as an instrument. This will allow users interested in better understanding the outcomes experience by HCBS recipients in specific areas to avoid having to administer an entire interest. In addition, each measure has been developed as consisting of two tiers. Four to five Tier-1 items can be used to provide an overall picture of outcomes within a specific domain or across all domains. Tier-2 items which number from 12 to 20 for each measure provide more detailed information with respect to the outcomes experienced by respondents and are intended to support measure users to collect actionable data.
A second step in the measure development process included extensive cognitive testing (CT) of items using the Cognitive Aspects of Survey Methodology (CASM) framework (114, 115) and receiving direct input from individuals with disabilities. This process is necessary to confirm items are understood as intended (116, 117) and response options provide respondents with the opportunity to respond in a manner that accurately reflects their thoughts and feelings (118). This form of stakeholder involvement was essential given the intended use of measures with people with a wide variety of disabilities who receive a variety of HCBS.
Following revisions to items based on the results of cognitive testing, all measures were pilot tested with members of each disability population with which they were intended to be used to determine their reliability (internal consistency, test-retest, and inter-interviewer) and the extent to which they were feasible and usable for their intended purpose. Piloting with a diverse sample of adults with disabilities with varying support needs provided measure developers with a more robust set of data related not only with respect to measures and measure items but information about the extent to which the measures developed were suitable for use with HCBS recipients with a variety of disabilities and support needs. Results of the pilot-testing of thirteen person-centered measures spanning seven domains of the NQF HCBS Outcome Measurement Framework (38) have been extremely encouraging with internal consistency (.63–.94; Mean = .81), test-retest (.72–.99; Mean = .85) and inter-rater (.89–.98; Mean = .92) reliabilities on all but one measure found to be at more than acceptable levels. Administration time indicated that most individuals could complete a full measure in no more than 10–15 min and had little difficulty understanding or responding to items indicating a high degree of feasibility with respect to administration.
At the present time, Center staff are in the midst of a national field study being conducted to gather additional information with respect to the psychometric characteristics of the measures that have been developed. Due to the manner in which measures are intended to be used, recruitment is taking place at the provider organization level with multiple participants being recruited from each organization. Participant recruitment has focused on developing a sample of up to 1,000 HCBS recipients with intellectual and developmental disabilities, physical disabilities, traumatic/acquired brain injury, and both psychiatric and age-related disabilities of vary degrees of severity and with a wide range of support needs. Data is being collected over three points approximately 6-months apart with the goal of being able to provide estimates of the degree to which measures are sensitive to change over time. Given that some people with disabilities across all groups of interest may not be able to effectively communicate their experiences as HCBS recipients, a truncated set of proxy measures is also being tested as part of the study.
A final goal of the national field study centers on developing benchmarks against which to compare the outcomes people without disabilities experience in those areas covered by the National Quality Forum's HCBS Outcome Measurement Framework (38). As part of this effort, a national sample of 400 people without disabilities is being surveyed as to the outcomes they experience with respect to a variety of aspects of self-determination/choice and control, social connectedness, meaningful community activity, employment, and transportation. It is hoped that this data will provide an initial set of outcome benchmarks toward which provider organizations can work in an effort to provide people with disabilities with an enhanced degree of equity with respect to outcomes related to a wide variety of aspects of quality of life.
Conclusion
In this article, we first reviewed the need for HCBS outcome measurement to move beyond its current focus on enumerating the extent to which people with disabilities achieve a predefined set of outcomes (what is important for them). We contend that it is just as important to take into consideration an individual's personal needs, preferences, desires, and context (what is important to them). If the overall goal of HCBS is to support people with disabilities to lead the lives they desire within inclusive communities, it is imperative that the field move beyond its current focus toward an approach to measurement that is person-centered. This approach is consistent with the HCBS final settings rule (7) in the U.S. and the basic tenets of the Conference on the Rights of People with Disabilities (30) as well as grounded in a paradigm shift in the field of disability services from a medical to a social-ecological model of disability. We assert that person-centered measurement, which includes a focus on both what is important for and to people with disabilities, is consistent with the National Quality Forum's Framework for HCBS Outcome Measurement (38) and is a key element to fully understanding the effectiveness (or lack thereof) of the supports provided to people receiving community-based services and the quality of outcomes such individuals experience.
The concept of person-centeredness was next explored with a focus on how programs of measurement can move toward a more person-centered approach. This will require a change in focus in many western cultures from measurement focused on comparing the experiences of a target person to benchmarks or outcomes experienced by others to a measurement system in which the “standard” is based on the service recipient's personally defined preferences or goals—not those that other people or the service system sets for them. In the context of measuring outcomes associated with people who receive HCBS, we contend that for measures to truly be person-centered they must be (a) designed with the intent that they will be responded to by people with disabilities themselves; (b) focus on outcomes that are both important for and important to the recipients of supports; (c) allow people to accurately articulate what they need, outcomes they desire to experience, and the degree to which they view themselves as making progress toward achieving those outcomes; (d) possess the capacity to be used in a longitudinal manner; and (e) permit the individual to indicate the extent to which specific outcomes are of importance to them. As part of this discussion, Goal Attainment Scaling (GAS) was explored as one, but certainly not the only, method for moving toward more person-centered measurement as it potentially allows individuals with disabilities who are receiving supports to quantify the progress they see themselves as making toward personally desired life outcomes or goals. Although the use of this approach does require one to overcome some challenges, evidence of its reliability and validity when used within the rehabilitation sciences is quite encouraging. In addition, in the approach that we advocate, it is the recipients of HCBS supports who identify the desired life outcomes most important to them which then serve as the basis of measurement thus increasing the likelihood that measures are culturally relevant and appropriate.
Given the current state of HCBS outcome measurement, it is clear to us that a framework for the development and validation of person-centered community-based measures would be useful. As an initial step in this direction, we offer the approach to measure concept development that has been used by the University of Minnesota's Research and Training Center on HCBS Outcome Measurement. This approach which is consistent with the NQF's Framework for HCBS outcome Measurement (38) was initiated on the basis of what people with disabilities themselves indicated was most important to measure. It involved a structured, iterative process of item and measure concept development grounded in existing research and theory with respect to the domains of measurement. The iterative process employed allowed a variety of stakeholder groups including people with a variety of disabilities, family members, content area experts, community support providers, and state program administrators to weigh in on the measures under development. Although the process is not yet complete with measures undergoing national field-testing, the results of extensive cognitive testing, and piloting of the measures are quite promising and suggest that this may be an approach to measure development that has potential utility for much needed future efforts in this area.
Author contributions
MAR contributed to the original conceptualization of the manuscript, the development of the first draft, and the editing of the final draft. BHA contributed to the initial conceptualization and made significant additions and revisions toward the formulation of the final draft. All authors contributed to the article and approved the submitted version.
Funding
The development of this manuscript was funded by the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR), federal grant # 90RT5039.
Acknowledgments
John Smith, MSW, Jean-Baptiste Quillien, Ph.D., and Adele Dimian, Ph.D. each assisted with the original conceptualization of the manuscript.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Watts MO, Musumeci M, Chidambaram P. Medicaid home and community-based services enrollment and spending. Kaiser Fam Found. (2020) 1–22.
2. Chong N, Akobirshoev I, Caldwell J, Stephen Kaye H, Mitra M. The relationship between unmet need for home and community-based services and health and community living outcomes. Disabil Health J. (2022) 15(2):101222. doi: 10.1016/j.dhjo.2021.101222
3. Fabius C, Shugrue N, Robison J. Outcomes associated with home and community-based service type among older money follows the person participants. Innovation in Aging. (2018) 2(suppl_1):972–73. doi: 10.1093/geroni/igy031.3602
4. Firsing SL, Dantzler JA, Hackman C, Rush SE, Borkovich RA, Delport J. Exploration of the effects of medicaid home and community-based services waiver services on outcomes for people with intellectual disability. Inclusion (Washington, D.C.). (2016) 4(2):120–32. doi: 10.1352/2326-6988-4.2.120
5. Centers for Medicare and Medicaid Services (CMS). Blueprint for the CMS Measures Management System Version 17.0. (2021). Available from: https://www.cms.gov/Medicare/Quality-Initiatives-Patient-Assessment-Instruments/MMS/Downloads/Blueprint.pdf
6. Musumeci MB, O’Malley Watts M, Chidambaram P. Key State Policy Choices About Medicaid Home and Community-Based Services, Kaiser Family Foundation, February 4, 2020 (2020). Available from: https://www.kff.org/medicaid/issue-brief/key-state-policy-choices-about-medicaid-home-and-community-based-services/
7. Centers for Medicare & Medicaid Services (CMS), HHS. Medicaid program; state plan home and community-based services, 5-year period for waivers, provider payment reassignment, and home and community-based setting requirements for community first choice and home and community-based services (HCBS) waivers. Final rule. Fed Regist. (2014) 79(11):2947–3039.24443765
8. Smull M. Choice and control. Supported Development Associates. (2017). Available from: https://www.sdaus.com/_files/ugd/17ee81_1168fc9451614ff58929cb8bf5d63e72.pdf
10. Tichá R, Lakin KC, Larson S, Stancliffe R, Taub S, Engler J, et al. Correlates of everyday choice and support-related choice for 8,892 randomly sampled adults with intellectual and developmental disabilities in 19 states. Intellect Dev Disabil. (2012) 50(6):486–504. doi: 10.1352/1934-9556-50.06.486
11. Tichá R, Stancliffe RJ, Lakin KC, Larson SA, Engler J, Bershadsky J, et al. Community participation of adults with intellectual and developmental disabilities receiving residential supports in 19 states. Minneapolis, MN, United States: University of Minnesota – Institute on Community Integration (2015).
12. The Council on Quality and Leadership (CQL). Personal outcome measures: Measuring personal quality of life. 3rd ed. Towson, Maryland: The Council on Quality and Leadership (2017).
13. Nyce A, Abery B, Tichá R. An analysis of the HCBS CAHPS survey [Unpublished manuscript]. Institute on Community Integration, University of Minnesota. (2020).
14. Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM). HCBS Instrument Database [Online database]. (2017). Available from: https://rtcom.umn.edu/database
15. Buntinx WH, Schalock RL. Models of disability, quality of life, and individualized supports: implications for professional practice in intellectual disability. J Policy Pract Intellect Disabil. (2010) 7(4):283–94. doi: 10.1111/j.1741-1130.2010.00278.x
16. Henninger NA, Taylor JL. Outcomes in adults with autism spectrum disorders: a historical perspective. Autism. (2013) 17(1):103–16. doi: 10.1177/1362361312441266
17. Howlin P, Moss P. Adults with autism spectrum disorders. Can J Psychiatry. (2012) 57(5):275–83. doi: 10.1177/070674371205700502
18. Schalock RL, Keith KD, Verdugo MÁ, Gómez LE. Quality of life model development and use in the field of intellectual disability. In: Kober R, editor. Enhancing the quality of life of people with intellectual disabilities. Dordrecht: Springer (2010). p. 17–32.
19. Howlin P, Goode S, Hutton J, Rutter M. Adult outcome for children with autism. J Child Psychol Psychiatry. (2004) 45(2):212–29. doi: 10.1111/j.1469-7610.2004.00215.x
20. Renty JO, Roeyers H. Quality of life in high-functioning adults with autism spectrum disorder: the predictive value of disability and support characteristics. Autism. (2006) 10(5):511–24. doi: 10.1177/1362361306066604
21. Rodogno R, Krause-Jensen K, Ashcroft RE. “Autism and the good life”: a new approach to the study of well-being. J Med Ethics. (2016) 42(6):401–8. doi: 10.1136/medethics-2016-103595
23. Rogers CR. The foundations of the person-centered approach. Education. (1979) 100(2):98–107. Available from: https://doi.org/10.5840/dialecticshumanism19818123
24. O’Brien CL, O’Brien J. The Origins of Person-Centered Planning: A Community of Practice Perspective. (2000).
25. O’Brien J. A Genealogy of Person-Centered Planning With People With Developmental Disabilities. (2021). Available from: https://inclusion.com/site/wp-content/uploads/2021/10/Geneology-of-person-centered-planning.pdf
26. Mead N, Bower P. Patient-Centredness: a conceptual framework and review of the empirical literature. Soc Sci Med. (2000) 51(7):1087–110. doi: 10.1016/S0277-9536(00)00098-8
27. McCormack B, McCance TV. Development of a framework for person-centred nursing. J Adv Nurs. (2006) 56(5):472–9. doi: 10.1111/j.1365-2648.2006.04042.x
28. McCance T, McCormack B, editors. Person-centred practice in nursing and health care: theory and practice. Chichester, West Sussex; Ames, Iowa: John Wiley & Sons (2017).
29. National Quality Forum (NQF). Person-centered practice and planning: Final report. (2020). Available from: https://www.qualityforum.org/Publications/2020/07/Person_Centered_Planning_and_Practice_Final_Report.aspx
30. United Nations. Convention on the rights of people with disabilities (CRPD). (2006). Available from: https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities/convention-on-the-rights-of-persons-with-disabilities-2.html
31. Riesen T, Snyder A. A guide to the home-and community-based services (HCBS) final settings rule. Logan, UT: Center for Persons with Disabilities Utah State University. (2019). Available from: https://ceiutah. com/wp-content/uploads/2020/01/HCBS-Provider-Manual-final. pdf
32. McCormack, Brendan. “A Conceptual Framework for Person-Centred Practice with Older People.” International Journal of Nursing Practice. (2003) 9(3):202–9. doi: 10.1046/j.1440-172X.2003.00423.x
33. Hutchinson C, Worley A, Khadka J, Milte R, Cleland J, Ratcliffe J. Do we agree or disagree? A systematic review of the application of preference-based instruments in self and proxy reporting of quality of life in older people. Soc Sci Med. (2022) 305:115046. doi: 10.1016/j.socscimed.2022.115046
34. Kinghorn P, Afentou N. Proxy responses to ICECAP-A: exploring variation across multiple proxy assessments of capability well-being for the same individuals. PLoS One. (2020) 15(7):e0236584. doi: 10.1371/journal.pone.0236584
35. Nicholas M, Jennelle L, Connor LT, Haynes C, Zipse L. Do caregiver proxy reports and congruence of client–proxy activity participation goals relate to quality of life in people with aphasia? Int J Lang Commun Disord. (2020) 55(3):373–86. doi: 10.1111/1460-6984.12524
36. Scott HM, Havercamp SM. Comparisons of self and proxy report on health-related factors in people with intellectual disability. J Appl Res Intellect Disabil. (2018) 31(5):927–36. doi: 10.1111/jar.12452
37. van der Vorst A, Zijlstra GA, De Witte N, De Lepeleire J, Kempen GI, Schols JM. Can proxy assessments serve as a first screener for identifying people at risk for multidimensional frailty? Eur Geriatr Med. (2018) 9(4):501–7. doi: 10.1007/s41999-018-0067-x
38. National Quality Forum (NQF). Quality in Home and Services to Support Community Living: Addressing Gaps in Performance Measurement. (2016). doi: 10.1111/j.1365-2648.2006.04042.x. Available from: http://www.qualityforum.org/Publications/2016/09/Quality_in_Home_and_Community-Based_Services_to_Support_Community_Living__Addressing_Gaps_in_Performance_Measurement.aspx
39. Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM). Stakeholder Input: Identifying Critical Domains and Subdomains of HCBS Outcomes. (2016). Available from: https://rtcom.umn.edu/phases/phase-1-stakeholder-input
40. Centers for Medicare and Medicaid Services (CMS). CAHPS Home- and Community-Base Services Survey Version 1. (2016). Available from: https://www.medicaid.gov/medicaid/quality-of-care/downloads/cahps-home-and-community-based-services-survey-10-english.pdf
41. Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM). CAHPS Home and Community-based Services Survey EoC [online database]. (2020a). Available from: https://rtcom.umn.edu/database/instruments/cahps%20hcbs%20eoc
42. Rehabilitation Research and Training Center on HCBS Outcome Measurement (RTC/OM). State HCBS Assessment Tools [Online database]. (2019).
43. Kiresuk TJ, Sherman RE. Goal attainment scaling: a general method for evaluating comprehensive community mental health programs. Community Ment Health J. (1968) 4(6):443–53. doi: 10.1007/BF01530764
44. Krasny-Pacini A, Hiebel J, Pauly F, Godon S, Chevignard M. Goal attainment scaling in rehabilitation: a literature-based update. Ann Phys Rehabil Med. (2013) 56(3):212–30. doi: 10.1016/j.rehab.2013.02.002
45. Steenbeek D, Meester-Delver A, Becher JG, Lankhorst GJ. The effect of botulinum toxin type A treatment of the lower extremity on the level of functional abilities in children with cerebral palsy: evaluation with goal attainment scaling. Clin Rehabil. (2005) 19(3):274–82. doi: 10.1191/0269215505cr859oa
46. Ashford S, Turner-Stokes L. Goal attainment for spasticity management using botulinum toxin. Physiother Res Int. (2006) 11(1):24–34. doi: 10.1002/pri.36
47. Borg J, Ward AB, Wissel J, Kulkarni J, Ertzgaard P, Åkerlund P, et al. Rationale and design of a multicentre, double-blind, prospective, randomized, European and Canadian study: evaluating patient outcomes and costs of managing adults with post-stroke focal spasticity. J Rehabil Med. (2011) 43:15–22. doi: 10.2340/16501977-0663
48. Desloovere K, Schörkhuber V, Fagard K, Van Campenhout A, De Cat J, Pauwels P, et al. Botulinum toxin type A treatment in children with cerebral palsy: evaluation of treatment success or failure by means of goal attainment scaling. Eur J Paediatr Neurol. (2012) 16(3):229–36. doi: 10.1016/j.ejpn.2010.09.006
49. Gould KR, Feeney TJ, Hicks AJ, Ponsford JL. Individualized goal attainment scaling during a trial of positive behaviour support in adults with acquired brain injury. Neuropsychol Rehabil. (2021) 32:1–19. doi: 10.1080/09602011.2021.2016447
50. Hanssen KT, Beiske AG, Landrø NI, Hofoss D, Hessen E. Cognitive rehabilitation in multiple sclerosis: a randomized controlled trial. Acta Neurol Scand. (2016) 133(1):30–40. doi: 10.1111/ane.12420
51. Turner-Stokes L, Williams H, Johnson J. Goal attainment scaling: does it provide added value as a person-centred measure for evaluation of outcome in neurorehabilitation following acquired brain injury? J Rehabil Med. (2009) 41(7):528–35. doi: 10.2340/16501977-0383
52. Turner-Stokes L, Baguley IJ, De Graaff S, Katrak P, Davies L, McCrory P, et al. Goal attainment scaling in the evaluation of treatment of upper limb spasticity with botulinum toxin: a secondary analysis from a double-blind placebo-controlled randomized clinical trial. J Rehabil Med. (2010) 42(1):81–9. doi: 10.2340/16501977-0474
53. Clare L, Kudlicka A, Oyebode JR, Jones RW, Bayer A, Leroi I, et al. Individual goal-oriented cognitive rehabilitation to improve everyday functioning for people with early-stage dementia: a multicentre randomised controlled trial (the GREAT trial). Int J Geriatr Psychiatry. (2019) 34(5):709–21. doi: 10.1002/gps.5076
54. van Seben R, Reichardt L, Smorenburg S, Buurman B. Goal-setting instruments in geriatric rehabilitation: a systematic review. In: The impact of acute hospitalization on older persons. Amsterdam: ProefschriftMaken (2017) 107 p.
55. Adair B, Ullenhag A, Keen D, Granlund M, Imms C. The effect of interventions aimed at improving participation outcomes for children with disabilities: a systematic review. Dev Med Child Neurol. (2015) 57(12):1093–104. doi: 10.1111/dmcn.12809
56. Barton EE, Reichow B, Schnitz A, Smith IC, Sherlock D. A systematic review of sensory-based treatments for children with disabilities. Res Dev Disabil. (2015) 37:64–80. doi: 10.1016/j.ridd.2014.11.006
57. Carter EW, Asmus J, Moss CK, Biggs EE, Bolt DM, Born TL, et al. Randomized evaluation of peer support arrangements to support the inclusion of high school students with severe disabilities. Except Child. (2016) 82(2):209–33. doi: 10.1177/0014402915598780
58. Case-Smith J, Weaver LL, Fristad MA. A systematic review of sensory processing interventions for children with autism spectrum disorders. Autism. (2015) 19(2):133–48. doi: 10.1177/1362361313517762
59. Gaffney E, Gaffney K, Bartleson L, Dodds C. Goal attainment scaling made easy with an app: GOALed. Pediatr Phys Ther. (2019) 31(2):225–30. doi: 10.1097/PEP.0000000000000602
60. O’Connor C, Stagnitti K. Play, behaviour, language and social skills: the comparison of a play and a non-play intervention within a specialist school setting. Res Dev Disabil. (2011) 32(3):1205–11. doi: 10.1016/j.ridd.2010.12.037
61. Schoen SA, Lane SJ, Mailloux Z, May-Benson T, Dianne Parham L, Roley SS, et al. A systematic review of ayres sensory integration intervention for children with autism. Autism Res. (2019) 12(1):6–19. doi: 10.1002/aur.2046
62. Wales D, Skinner L, Hayman M. The efficacy of telehealth-delivered speech and language intervention for primary school-age children: a systematic review. Int J Telerehabil. (2017) 9(1):55. doi: 10.5195/ijt.2017.6219
63. Morgan C, Novak I, Dale RC, Badawi N. Optimising motor learning in infants at high risk of cerebral palsy: a pilot study. BMC Pediatr. (2015) 15(1):1–11. doi: 10.1186/s12887-015-0347-2
64. Mayson TA, Ward VJ, Harris SR. Parent goals as outcome measures for children receiving treadmill training: a series of case reports. Dev Neurorehabil. (2012) 15(3):219–22. doi: 10.3109/17518423.2011.654282
65. Shogren KA, Dean EE, Burke KM, Raley SK, Taylor JL. Goal attainment scaling: a framework for research and practice in the intellectual and developmental disabilities field. Intellect Dev Disabil. (2021) 59(1):7–21. doi: 10.1352/1934-9556-59.1.7
66. Hurn J, Kneebone I, Cropley M. Goal setting as an outcome measure: a systematic review. Clin Rehabil. (2006) 20(9):756–72. doi: 10.1177/0269215506070793
67. Shankar S. Investigating substantive validity evidence using action-project method for the goal attainment scaling measure [Phd diss.]. University of British Columbia (2019).
68. Shankar S, Marshall SK, Zumbo BD. A systematic review of validation practices for the goal attainment scaling measure. J Psychoeduc Assess. (2020) 38(2):236–55. doi: 10.1177/0734282919840948
69. Steenbeek D, Ketelaar M, Galama K, Gorter JW. Goal attainment scaling in paediatric rehabilitation: a critical review of the literature. Dev Med Child Neurol. (2007) 49(7):550–6. doi: 10.1111/j.1469-8749.2007.00550.x
70. Vu M, Law AV. Goal-attainment scaling: a review and applications to pharmacy practice. Res Soc Adm Pharm. (2012) 8(2):102–21. doi: 10.1016/j.sapharm.2011.01.003
71. Lee CE, Shogren KA, Segal J, Pezzimenti F, Aleman-Tovar J, Taylor JL. Goal attainment scaling—community-based: a method to incorporate personalized outcomes into intervention research with youth and adults on the autism spectrum. Autism. (2022) 26(1):178–87. doi: 10.1177/13623613211024492
72. May-Benson TA, Schoen SA, Teasdale A, Koomar J. Inter-rater reliability of goal attainment scaling with children with sensory processing disorder. Open J Occup Ther. (2021) 9(1):1–13. doi: 10.15453/2168-6408.1693
73. Urach S, Gaasterland CMW, Posch M, Jilma B, Roes K, Rosenkranz G, et al. Statistical analysis of goal attainment scaling endpoints in randomised trials. Stat Methods Med Res. (2019) 28(6):1893–910. doi: 10.1177/0962280218777896
74. van Blijswijk SC, Gussekloo J, Heijmans FM, Wind AW, den Elzen WP, Blom JW. Goal attainment scaling with older people in general practice: a feasibility study. Int J Nurs Stud Adv. (2021) 3:100015. doi: 10.1016/j.ijnsa.2020.100015
75. Kiresuk TJ, Lund SH. Implementing goal attainment scaling. In: Kiresuk TJ, Smith A, Cardillo JE, editors. Goal attainment scaling: applications, theory and measurement. Hillsdale, NJ: Lawrence Erlbaum Associates (1994) 1–22.
76. Wallen M, Ziviani J, Naylor O, Evans R, Novak I, Herbert RD. Modified constraint-induced therapy for children with hemiplegic cerebral palsy: a randomized trial. Dev Med Child Neurol. (2011) 53(12):1091–9. doi: 10.1111/j.1469-8749.2011.04086.x
78. Shogren KA, Burke KM, Antosh A, Wehmeyer ML, LaPlante T, Shaw LA, et al. Impact of the self-determined learning model of instruction on self-determination and goal attainment in adolescents with intellectual disability. J Disabil Policy Stud. (2019) 30(1):22–34. doi: 10.1177/1044207318792178
79. Shogren KA, Abery B, Antosh A, Broussard R, Coppens B, Finn C, et al. Recommendations of the self-determination and self-advocacy strand from the national goals 2015 conference. Inclusion. (2015) 3(4):205–10. doi: 10.1352/2326-6988-3.4.205
80. Turner-Stokes L. Goal attainment scaling (GAS) in rehabilitation: a practical guide. Clin Rehabil. (2009) 23(4):362–70. doi: 10.1177/0269215508101742
81. Khan F, Pallant JF, Turner-Stokes L. Use of goal attainment scaling in inpatient rehabilitation for persons with multiple sclerosis. Arch Phys Med Rehabil. (2008) 89(4):652–9. doi: 10.1016/j.apmr.2007.09.049
82. Fujiura GT, RRTC Expert Panel on Health Measurement. Self-reported health of people with intellectual disability. Intellect Dev Disabil. (2012) 50(4):352–69. doi: 10.1352/1934-9556-50.4.352
83. Emerson E, Felce D, Stancliffe RJ. Issues concerning self-report data and population-based data sets involving people with intellectual disabilities. Intellect Dev Disabil. (2013) 51(5):333–48. doi: 10.1352/1934-9556-51.5.333
84. Finlay WM, Lyons E. Methodological issues in interviewing and using self-report questionnaires with people with mental retardation. Psychol Assess. (2001) 13(3):319. doi: 10.1037/1040-3590.13.3.319
85. Stancliffe RJ, Tichá R, Larson SA, Hewitt AS, Nord D. Responsiveness to self-report interview questions by adults with intellectual and developmental disability. Intellect Dev Disabil. (2015) 53(3):163–81. doi: 10.1352/1934-9556-53.3.163
86. Fang J, Fleck MP, Green A, McVilly K, Hao Y, Tan W, et al. The response scale for the intellectual disability module of the WHOQOL: 5-point or 3-point? J Intellect Disabil Res. (2011) 55(6):537–49. doi: 10.1111/j.1365-2788.2011.01401.x
87. Heal LW, Sigelman CK. Response biases in interviews of individuals with limited mental ability. J Intellect Disabil Res. (1995) 39(4):331–40. doi: 10.1111/j.1365-2788.1995.tb00525.x
88. Sigelman CK, Budd EC, Spanhel CL, Schoenrock CJ. When in doubt, say yes: acquiescence in interviews with mentally retarded persons. Ment Retard. (1981) 19(2):53.7231176
89. Sigelman CK, Budd EC, Spanhel CL, Schoenrock CJ. Asking questions of retarded persons: a comparison of yes-no and either-or formats. Appl Res Ment Retard. (1981) 2(4):347–57. doi: 10.1016/0270-3092(81)90029-1
90. Stancliffe RJ. Proxy respondents and quality of life. Eval Program Plann. (2000) 23(1):89–93. doi: 10.1016/S0149-7189(99)00042-7
91. Krosnick JA. Response strategies for coping with the cognitive demands of attitude measures in surveys. Appl Cogn Psychol. (1991) 5(3):213–36. doi: 10.1002/acp.2350050305
92. Aldridge J. Picture this: the use of participatory photographic research methods with people with learning disabilities. Disabil Soc. (2007) 22(1):1–17. doi: 10.1080/09687590601056006
93. Nind M, Vinha H. Creative interactions with data: using visual and metaphorical devices in repeated focus groups. Qual Res. (2016) 16(1):9–26. doi: 10.1177/1468794114557993
94. Hollomotz A. Successful interviews with people with intellectual disability. Qual Res. (2018) 18(2):153–70. doi: 10.1177/1468794117713810
95. Cuthill FM, Espie CA, Cooper S-A. Development and psychometric properties of the Glasgow depression scale for people with a learning disability: individual and carer supplement versions. Br J Psychiatry. (2003) 182(4):347–53. doi: 10.1192/bjp.182.4.347
96. Lloyd V, Gatherer A, Kalsy S. Conducting qualitative interview research with people with expressive language difficulties. Qual Health Res. (2006) 16(10):1386–404. doi: 10.1177/1049732306293846
97. Antaki C, Richardson E, Stokoe E, Willott S. Can people with intellectual disability resist implications of fault when police question their allegations of sexual assault and rape? Intellect Dev Disabil. (2015) 53(5):346–57. doi: 10.1352/1934-9556-53.5.346
98. Cridland EK, Phillipson L, Brennan-Horley C, Swaffer K. Reflections and recommendations for conducting in-depth interviews with people with dementia. Qual Health Res. (2016) 26(13):1774–86. doi: 10.1177/1049732316637065
99. Finlay WM, Antaki C. How staff pursue questions to adults with intellectual disabilities. J Intellect Disabil Res. (2012) 56(4):361–70. doi: 10.1111/j.1365-2788.2011.01478.x
100. Perry J. Interviewing people with intellectual disabilities. In: Emerson E, Hatton C, Thompson T, Parmenter T, editors. The international handbook of applied research in intellectual disabilities. Chichester, West Sussex; Ames, Iowa: John Wiley & Sons, Ltd. (2004). p. 115–32. doi: 10.1002/9780470713198.ch5
101. Hart T, Sherer M, Temkin N, Whyte J, Dikmen S, Heinemann AW, et al. Participant-proxy agreement on objective and subjective aspects of societal participation following traumatic brain injury. J Head Trauma Rehabil. (2010) 25(5):339–48. doi: 10.1097/HTR.0b013e3181c7e60b
102. Stancliffe RJ. Proxy respondents and the reliability of the quality of life questionnaire empowerment factor. J Intellect Disabil Res. (1999) 43(3):185–93. doi: 10.1046/j.1365-2788.1999.00194.x
103. McVilly KR, Burton-Smith RM, Davidson JA. Concurrence between subject and proxy ratings of quality of life for people with and without intellectual disabilities. J Intell Dev Disabil. (2000) 25(1):19–39. doi: 10.1080/132697800112767
104. Simões C, Santos S. The quality of life perceptions of people with intellectual disability and their proxies. J Intellect Dev Disabil. (2016) 41(4):311–23. doi: 10.3109/13668250.2016.1197385
105. Balboni G, Coscarelli A, Giunti G, Schalock RL. The assessment of the quality of life of adults with intellectual disability: the use of self-report and report of others assessment strategies. Res Dev Disabil. (2013) 34(11):4248–54. doi: 10.1016/j.ridd.2013.09.009
106. Claes C, Van Hove G, Vandevelde S, van Loon J, Schalock R. The influence of supports strategies, environmental factors, and client characteristics on quality of life-related personal outcomes. Res Dev Disabil. (2012) 33(1):96–103. doi: 10.1016/j.ridd.2011.08.024
107. Schmidt S, Power M, Green A, Lucas-Carrasco R, Eser E, Dragomirecka E, et al. Self and proxy rating of quality of life in adults with intellectual disabilities: results from the DISQOL study. Res Dev Disabil. (2010) 31(5):1015–26. doi: 10.1016/j.ridd.2010.04.013
108. Verdugo MA, Navas P, Gómez LE, Schalock RL. The concept of quality of life and its role in enhancing human rights in the field of intellectual disability. J Intellect Disabil Res. (2012) 56(11):1036–45. doi: 10.1111/j.1365-2788.2012.01585.x
109. Perkins EA. Self-and proxy reports across three populations: older adults, persons with Alzheimer’s disease, and persons with intellectual disabilities. J Policy Pract Intellect Disabil. (2007) 4(1):1–10. doi: 10.1111/j.1741-1130.2006.00092.x
110. Kaye HS. NHIS And NHIS-D: non-response, proxy. In: Kroll T, Keer D, Placek P, Cyril J, Hendershot G, editors. Towards best practices for surveying people with disabilities. Vol. 1, New York: Nova Science Publishers, Inc. (2007). 105 p.
111. Elliott MN, Beckett MK, Chong K, Hambarsoomians K, Hays RD. How do proxy responses and proxy-assisted responses differ from what medicare beneficiaries might have reported about their health care? Health Serv Res. (2008) 43(3):833–48. doi: 10.1111/j.1475-6773.2007.00820.x
112. Rand S, Caiels J, Collins G, Forder J. Developing a proxy version of the adult social care outcome toolkit (ASCOT). Health Qual Life Outcomes. (2017) 15(1):108. doi: 10.1186/s12955-017-0682-0
113. Lipson DJ. Person-reported outcome measures for home and community-based services. HCBS Quality Measures Issue Brief, Mathematica. (2019). Available from: https://www.medicaid.gov/medicaid/quality-of-care/downloads/hcbs-quality-measures-brief-2-person-reported-outcome.pdf
114. Tourangeau R. Cognitive science and survey methods. In: Jabine T, Straf ML, Tanur JM, Tourangeau R, editors. Cognitive aspects of survey design: Building a bridge between disciplines. Washington, DC: National Academy Press (1984). p. 73–100.
115. Tourangeau R. The survey response process from a cognitive viewpoint. Qual Assur Educ. (2018) 26(2):169–81. doi: 10.1108/QAE-06-2017-0034
116. Kramer JM, Schwartz A. Reducing barriers to patient-reported outcome measures for people with cognitive impairments. Arch Phys Med Rehabil. (2017) 98(8):1705–15. doi: 10.1016/j.apmr.2017.03.011
117. Willis GB, Royston P, Bercini D. The use of verbal report methods in the development and testing of survey questionnaires. Appl Cogn Psychol. (1991) 5(3):251–67. doi: 10.1002/acp.2350050307
Keywords: HCBS, outcome measurement, measure development, person-centered analysis/approach, person-reported outcome, home and community-based services, person-centered measurement
Citation: Roberts MA and Abery BH (2023) A person-centered approach to home and community-based services outcome measurement. Front. Rehabil. Sci. 4:1056530. doi: 10.3389/fresc.2023.1056530
Received: 28 September 2022; Accepted: 10 January 2023;
Published: 1 February 2023.
Edited by:
Brendan McCormack, The University of Sydney, AustraliaReviewed by:
V TY, Queen Margaret University, United KingdomDi Yan, University of Rochester Medical Center, United States
Parthenia Dinora, Virginia Commonwealth University, United States
© 2023 Roberts and Abery. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Matthew A. Roberts robe0290@umn.edu
Specialty Section: This article was submitted to Disability, Rehabilitation, and Inclusion, a section of the journal Frontiers in Rehabilitation Sciences