Hua-Fang Liao1,2*
Chia-Feng Yen3*
Tzu-Ying Chiu4
Wen-Chou Chi5
Tsan-Hon Liou6,7Ben-Sheng Chang8
Ting-Fang Wu9Shu-Jen Lu10- 1School and Graduate Institute of Physical Therapy, National Taiwan University, Taipei, Taiwan
- 2Taiwan Society of ICF, Taipei, Taiwan
- 3Department of Public Health, Tzu Chi University, Hualien, Taiwan
- 4Department of Health and Welfare, College of City Management, University of Taipei, Taipei, Taiwan
- 5Department of Occupational Therapy, Chungshan Medical University, Taichung, Taiwan
- 6Department of Physical Medicine and Rehabilitation, Shuang Ho Hospital, Taipei Medical University, Taipei, Taiwan
- 7Department of Physical Medicine and Rehabilitation, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan
- 8Department of Psychology, Soochow University, Taipei, Taiwan
- 9Graduate Institute of Rehabilitation Counseling, National Taiwan Normal University, Taipei, Taiwan
- 10School of Occupational Therapy, College of Medicine, National Taiwan University, Taipei, Taiwan
To assess activity and participation for adults in Taiwan's Disability Eligibility Determination System (DEDS), we developed a measure, the Functioning Disability Evaluation Scale—Adult version (FUNDES-Adult), based on the 36-item interviewer-administered version of the WHO Disability Assessment Schedule 2.0. The purpose of this study was to examine the factor structures of performance and capability dimensions of the FUNDES-Adult. This study followed a methodology research design to investigate the construct validity of the two dimensions of the FUNDES-Adult. Two samples were randomly stratified from the databank of adults with disabilities to examine structural validity by the exploratory factor analysis (EFA) (n = 8,730, mean age of 52.9 ± 16.81) and the confirmatory factor analysis (CFA) (n = 500, mean age of 54.3 ± 16.81). The results demonstrated that the EFA yielded 5-factor structures for both performance dimension (73.5% variance explained) and capability dimension (75.9% variance explained). The CFA indicated that the second-order factor structures of both dimensions were more parsimonious with adequate fit indices (GFI, NFI, CFI, and TLI ≥ 0.95, RMSEA < 0.09). The results of this study provide evidence that the FUNDES-Adult has acceptable structural validity for use in Taiwan's DEDS. Utility of the FUNDES-Adult in rehabilitation, employment, welfare, and long-term care services needs further study.
Introduction
According to Taiwan's People with Disabilities Rights Protection Act promulgated in 2007 (1), the local government in Taiwan should issue the disability identification and provide welfare and services based on the framework of the International Classification of Functioning, Disability, and Health (ICF) (2, 3). Taiwan is one of the pioneer countries to use the ICF Chapter code as a basis for the classification of disability and for the application of ICF in the disability eligibility determination system (DEDS) (4–7). In Article 5 of the People with Disabilities Rights Protection Act, people with disabilities refer to those who, with the following deviation or loss resulting from physical or mental impairments, are limited or restricted to be engaged in the ordinary living activities and participation (AP) in the society; and they, after processes of evaluation and assessment by the committee composed of professionals from medicine, social work, special education, and employment counseling and evaluation, can be regarded as suffering one of the following malfunction categories and issued a disability identification. The eight disability types are listed as follows: (1) Mental functions and structures of the nervous system; (2) Sensory functions and pain, the eye, the ear, and the related structures; (3) Functions and structures of/involved in voice and speech; (4) Functions and structures of/related to the cardiovascular, hematological, immunological, and respiratory systems; (5) Functions and structures of/related to the digestive, metabolic, and endocrine systems; (6) Functions and structures of/related to the genitourinary and reproductive systems; (7) Neuromusculoskeletal and movement related functions and structures; (8) Functions and related structures of the skin. The eight disability types or malfunctional categories corresponding to the eight chapters of body functions and structures of the ICF. The statement of the Article 1 of that act also emphasizes the focuses of societal participation in Taiwan government services. The societal participation therefore is one major outcome of welfare and services for people with disabilities. Besides, the ICF proposes that disability, or participation restriction, is the results of interaction among disease, body function and structures, environmental factors, and personal factors (2). In Taiwan's past disability evaluation system, the disability identification was issued after physician diagnosis and impairment examinations only. In the current DEDS system, the disability identification will be issued after a more comprehensive evaluation of body function, AP, and environmental/personal factors and needs assessment by a team (4–7). To assess the status of AP for adult applicants, the World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) (8) was then adapted by the ICF team.
After 5 years' preparation, the ICF-based DEDS have launched nationwide since July 2012, and the disability identification is issued based on the results of the ICF-based disability evaluation by a medical team from the authorized hospitals and on the results of the needs assessment from the local social welfare department (4, 5). The content of the disability evaluation includes tests related to body function and structure codes as well as AP components of the ICF. To assess the status of AP in the ICF-based DEDS, the ICF taskforce group have developed the Functioning Disability Evaluation Scale (FUNDES) since 2007 in Taiwan (5–7). The FUNDES has adult version (FUNDES-Adult) and child version (FUNDES-Child). The FUNDES-Adult has been developed with bilingual translation based on the 36-item interviewer-administered version of the WHODAS 2.0 (8), the mobility trial version for functional assessment (9), and environmental ICF codes (10) that designed and revised at the evaluation tool development phase for the DEDS (6). The FUNDES-Child has been developed based on the Child and Family Follow-up Survey (CFFS) (11).
To take into account, the localization and instrument validity of nationwide application, the changes and revisions of the FUNDES has been on-going based on the feedback of the field testers and experts or from the data analyses nearly every year. Several versions of the FUNDES have been developed (6, 12). Some psychometric properties of the previous FUNDES-Adult, version 5 (13, 14) and FUNDES-Child version (11, 15–17) have been examined and published. The previous construct validity of the FUNDES-Adult version only included the items of 36 items which are the same as WHODAS 2.0 and to follow the same 6-domain structures (13, 18). However, during the revision process, the measurement items have been added for collecting more AP information for people with disability and we did not re-check the psychometric properties of all items in the FUNDES-Adult yet. With the changes in the purpose and background of the assessment tools used, the factor structure of the inspection tools is very much necessary (19), which can assist us in the understanding and analyzing intervention impact of the disability.
This study aimed to examine the factor structures of AP part of the seventh version of the FUNDES-Adult (FUNDES-Adult, version 7) which was revised base on the Taiwan culture and for the purposes of the disability eligibility determination. The FUNDES-Adult, version 7 has applied to the DEDS for a long time, and it is also the basis and reference basis for all future versions and with large number of accumulated cases. Although we also published and used the eighth version later, this version differs only in typography. In the seventh version, we put all the information in one book, including ICF introduction, detailed description of the content and psychometric properties of the FUNDES-Adult and FUNDES-Child, test items, evaluation forms, and flash cards. In the eighth version, there are one FUNDES Manual and one FUNDES Item Booklet. The streamlined FUNDES Item Booklet was designed to assist the testers to evaluating the applicants in the field directly, which made it was not necessary to take the whole heavy FUNDES manual. All questions and measurement procedures of the FUNDES-Adult, version 7, were the same as that of the eighth version, so we have chosen the FUNDES-Adult, version 7, as the target of this study.
Each item of the Domain 1 to 6 of the FUNDES-Adult, version 7, has two dimensions—performance and capability—to measure AP in daily life over the previous 30 days (13, 14, 18). The performance refers to the extent of restriction on participation in daily life and the qualifier of performance is described as what an individual does in his or her current environment. Since the current environment always includes the overall societal context, performance can also be understood as “involvement in a life situation” or “the lived experience” of people in their actual context. As the assistive devices and other persons' assistance changed the performance difficulty level of persons with disabilities (20, 21), for the disability eligibility determination, the FUNDES team decided to add items with capability dimension in the FUNDES-Adult (5). The capability refers to the extent of restriction on participation in a real environment without assisting by any assistive device or persons. The capability dimension therefore captures the extent of difficulty in daily life without environmental supports (13). Therefore, the purpose of this study was to examine the factor structures of two dimensions of the FUNDES-Adult. We expected that the factor structures of performance and capability dimensions of the FUNDES-Adult, version 7, would be different.
Methods
This secondary data analysis study was part of a larger national survey conducted in Taiwan by the DEDS team (7). The present study was approved by the Research Ethics Committee of the Hualien Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation (IRB104-04-A;IRB107-46-B) and Joint Institutional Review Board, Taipei Medical University (TMU-JIRB), Taiwan. The de-identified data were retrieved from the database of the Taiwan Databank of Persons with Disability (TDPD) that included 144,850 adult-times who received the DEDS assessment in 201 authorized hospitals from November 2013 to January 2015 (6, 11, 15, 22, 23).
Certified testers associated with authorized hospitals in Taiwan administered the FUNDES-Adult, version 7, by interviewing the applicant's caregivers or him/herself (24). The certified testers were professionals licensed as physical therapists, occupational therapists, speech therapists, social workers, clinical psychologists, counseling psychologists, nurses, audiologists, special educators, and vocational evaluators. To ensure the number and quality of FUNDES testers, training programs were funded by the Taiwan central government with recruitment of all these licensed professionals, especially those in the DEDS hospitals. The training programs for certified testers covered the procedures of the DEDS and regulations (30 min), introduction to ICF and ICF-CY (30 min), introduction to assessment instruments [FUNDES-Adult (60 min), FUNDES-Child (40 min)], practice of assessment instruments (200 min), and the web-based platform for entry and storage of data (30 min). At the end of each training course, a paper-and-pencil test was administered to certify the attending professionals (24). By the end of 2014, there were about 7,700 certified testers in Taiwan (12). Names, identification (ID) number and other related information of all certified FUNDES testers are kept in the FUNDES tester personnel dataset for manpower quality control in the DEDS (12).
Participants
To examine the factor structures of the FUNDES-Adult, version 7, the information of the FUNDES-Adult, version 7, in the TDPD (22) has been retrieved. To reduce the bias, data with missing items or “not applicable” items that were higher than 30% in one of the domains (i.e., Domains 1~6) of the FUNDES-Adult were excluded. After data cleaning, the data of 88,124 adults left for factor analyses. Based on the consideration of age, disability severity, disability type, and place of residence, we used multi-step probability proportional to size (PPS) sampling to obtain an exploratory factor analysis (EFA) sample of 8,730 people (about 10%), and from the remaining 79,394 people, 500 people were sampled in the same way for confirmatory factor analysis (CFA). There are no significant differences in age, sex, severity, disability type, and place of residence between samples and the whole group (p > 0.05). The EFA is mostly used when developing or compiling scales to understand which indicators should be selected or deleted, and which dimensions are under a construct. The CFA is mostly used after the development of a scale to check whether specific indicators fall under the expected dimensions of the theory. The main purpose is theoretical verification. The best sample size being used in CFA is 250∽500 persons (25).
Individuals with information in the TDPD were assessed via face-to-face interview (to applicants themselves or to caregivers of the applicants) and direct tested by physicians and a certified tester in the authorized hospitals. The databank included a record of demographic characteristics (including personal factors), the individual's body function and body structures, AP functioning, and some environmental factors.
The disability severity of one person with disability was determined in the medical examination stage of the DEDS (6, 7). Relevant ICF body function/structure categories for specific diagnoses were coded by physicians trained in using a 0–4-point qualifier (no problem = 0, mild = 1, moderate = 2, severe = 3, and profound = 4). A final summative severity level was determined based on decision rules for combining levels of severity among the individual body function/structure codes (26). There were nine types of disability in the DEDS system, and the first eight types are based on the eight body–function and body–structure chapters of the ICF. The nineth type is the rare disease group.
Measurement
The FUNDES-Adult, version 7, has been developed in year of 2014, and used for training programs and part of national evaluation for determining the disability eligibility qualification (11). The team also examined the psychometric properties of internal consistency, test-retest, content validity, concurrent validity, and construct validity of the FUNDES-Adult, version 7 (5, 13, 14). The FUNDES-Adult, version 7 has 94 items, including 72 AP items with performance and capability dimensions of the first six domains, eight environmental items in Domain 7 (Do7, Environmental attributes) and 14 motor AP items in Domain 8 (Do8, Motor action). The first six domains are Cognition (Do1, item number, n = 6*2), Mobility (Do2, n = 5*2), Self-care (Do3, n = 4*2), Getting alone (Do4, n = 5*2), Life activities (Do5, n = 8*2), and Participation (Do6, n = 8*2). In Domain 5 (Life activities), there are two subdomains: Household activities (Do5–1, n = 4) and Work or school activities (Do5–2, n = 4). Do7 (Environmental attributes) includes items to measure the perceived environmental barriers (12). In Do8 (n = 7*2), each item has independence and capacity dimensions. For items with performance dimension, the question would be “because of your health condition in the past 30 days, how much difficulty did you have in … activities,” and it refers to the extent of restriction on participation in daily life with existed assistance. For items with capabilities dimension, the question would be “how much difficulty did you have if without assistive technology and without others' assistance,” and it refers to the extent of restriction on daily participation without assistance. In Do8, the item with independence dimension was the degree of other's help with existed assistive technology by interview, and the capacity item was rated after direct test by certified testers (27). In this study, only AP items of Domain 1∽6 and motor independence items of Domain 8 by interview were chosen for factor structure examination.
The Do1 Cognition domain, item D1.1 to item D1.6, is designed to assess cognitive and communication activities, including concentrating, remembering, problem solving, learning, and communicating; Do2 Mobility, item D2.1 to item D2.5, to assess mobility activities such as standing, moving around inside the home, getting out of the home and walking long distances; Do3 Self-care, item D3.1 to item D3.4, for assessing hygiene, dressing, eating and staying alone; Do4 Getting along, item D4.1 to item D4.5, for assessing difficulties of interactions with other people; Do5-1 Household activities, item D5.1 to item D5.4, for assessing difficulty with day-to-day household activities, and Do5-2, item D5.5 to item D5.8, for assessing difficulty with activities related to work or school; Do6 Participation, item D6.1 to item D6.8, for assessing difficulty of community activities, barriers and hindrances in the world around the respondent, and problems with other issues, such as maintaining personal dignity. Then, Do8 Motor action, independent dimension of item D8.1 to item D8.7 were rated by interview to answer dependence extent in basic motor activities in daily living, such as sit-to-stand, walking, picking up objects, buttoning, and tying a knot with existed assistive devices.
The possible scores to each item of Domain 1∽6 are 0: no difficulty, 1: mild difficulty, 2: moderate difficulty, 3: severe difficulty, and 4: extreme difficulty, and items with independent dimension of Domain 8 are 0: independence, 1: supervision or reminding; 2: mild assistance; 3: moderate assistance; and 4: full assistance. The AP scoring methods were following the 6 frames of reference for answering questions in the WHODAS 2.0 Manual (8).
The WHODAS 2.0 has been translated into 47 languages and dialects and is suitable for assessing health status and disability in a variety of settings and populations (28). Psychometric properties of the WHODAS 2.0 and/or the FUNDES-Adult have been evaluated for a number of clinical conditions, including, but not limited to, the following health conditions: musculoskeletal diseases (29–32), chronic diseases (31, 33–36), psychiatric conditions (29, 31, 33, 37–47), cancer (33, 48, 49), hearing impairment (50–52), visual impairment (50), stroke (10, 31, 33, 53–58), Parkinson's disease (59–62), spinal conditions (18, 63–65), traumatic brain injury (63, 66, 67), multiple sclerosis (68), persons with disabilities (22, 23, 35, 69, 70), older patients discharged from emergency departments (71) and general population (8, 72). Psychometric properties for WHODAS 2.0 36-item and/or FUNDES-Adult have generally been found adequate. For example, the internal consistencies at the domain and summary levels of the WHODAS 2.0 ranged from 0.59~0.99 (8), excellent internal consistency in all languages (alpha > 0.90) (28), and that of both performance and capability dimensions of the FUNDES-Adult ranged 0.90~0.99 (13, 18). The test–retest reliability of the WHOAS 2.0 had an intra-class coefficient of 0.69~0.89 at item level; 0.93~0.96 at domain level; and 0.98 at overall level (8). The test–retest reliability of Domain 1~6 and Domain 8 of FUNDES-Adult was 0.40~0.99 (ICCs) for 30 adults with spinal cord injuries (12).
To our knowledge, only few studies examine the factor structures of different language versions of the WHODAS 2.0 36 items (8, 31, 43, 58, 70). The lack of consistency with original developers of WHODAS 2.0 may indicate the needs of future investigation of the factor structure. Besides, the factor structures of the FUNDES-Adult have been examined in two studies (13, 18), also demonstrated some inconsistent findings. The study of Chiu et al. was based on persons with spinal cord injuries (18), and the CFA study of Yen et al. was only based on the 6-domain assumption (13). The differences between performance dimension and capability dimension of the FUNDES-Adult could be used to understand the possible impacts of environmental factors (5). Therefore, the factor structure of both dimensions of the FUNDES-Adult, version 7, were examined in this study. We used one sample to obtained the factor structure by the EFA first and then used another sample to check the good fitness of that factor structure by the CFA.
Data Reduction and Statistical Method
For factor analysis, we used the performance scores of 36 items of Domain 1∽6 of the FUNDES-Adult, version 7t, that translated and derived from 36 items of the WHODAS 2.0 to examine the factor structure of the performance dimension. Using the capability scores of Domain 1∽6 and independence scores of the Domain 8 that modified for disability eligibility evaluation to examine the factor structure of the capability dimension. Due to culture reasons, most scores of the item D3.4 (“Staying by yourself for a few days?”) and item D4.5 (sexual activities) were 9 (not applicable). These two items were deleted before the factor analysis. Therefore, there were 34 items for factor analyses of the performance dimension. The team also found that item D8.4 (stand up from chair) was almost the same as item D2.2 (Standing up from sitting). The item D8.4 item was then also deleted before the factor analysis. Totally, 40 items were used for factor analyses of the capability dimension.
Factor analysis is a statistical method used to describe variability among observed, correlated variables in terms of a potentially lower number of unobserved variables called factors. Users of factor analysis believe that it helps to deal with data sets where there are large numbers of observed variables that are thought to reflect a smaller number of underlying/latent variables.
Statistical analyses and the EFA were performed using SPSS 20.0 (IBM SPSS Statistics, Chicago, IL, USA, 2016). Since most observed item distributions violated the normality assumptions and were inter-correlated, we used the iterative principal axis factoring followed by oblique promax rotation (73). Factorability of items was examined by the Bartlett test (α was set at 0.05) and the Kaiser–Meyer–Olkin (KMO) measure of sampling adequacy. For EFA, a value of KMO >0.6 is tolerable (74) and of >0.8 is good fit (75). The number of factors was decided by multiple methods including eigenvalues > 1 and scree tests. Factor loadings ≥ 0.3 were considered salient loadings (73). The extracted latent factors were then named based on conceptual interpretation of the items.
We used correlation matrix to understand the correlations between each pair of factors and used structural equation modeling (SEM) of SPSS AMOS V.20 to analyze the CFA. If there were significant correlations at the factor level and overall level, the two-level hierarchical structure (second-order confirmatory factor) will be presented (76–78). To assess model fit, the fit indices with their cutoff criteria [goodness-of-fit index (GFI) ≥ 0.95, normed fit index (NFI) ≥ 0.95, comparative fit index (CFI) ≥0.95, Tucker–Lewis index (TLI) ≥ 0.95, and root mean square error of approximation (RMSEA) <0.06 was excellent and <0.08 was acceptable] were used (79, 80).
Results
The population was 88,124 adults with disabilities. Their mean age was 53.02 ± 16.84 years old, ranged from 18 to 110 years. The EFA of psychometric properties of the FUNDES-Adult, version 7, was examined based on 8,730 adults with disabilities (aged 52.98 ± 16.81 years), and the other 500 people with disability (aged 54.30 ± 16.81 years) were used for CFA (Table 1). There were no significant differences in gender, age, disability type, and severity of disability between the EFA and CFA samples (p > 0.05) (Table 1). For disability type of our samples, most of them were with impairment of “mental functions and structures of the nervous system.” We compared the samples between those with and without that particular disability type, respectively, there was no significant differences in every type (p > 0.05).
Table 1. Demographic data of the study sample.
Exploratory Factor Analysis
At first, we used EFA to analyze 34 items of performance dimension and 40 items of capability dimension separately, and to delete the items with <0.3 factor loading value base on analyses results and in expert meetings.
The EFA yielded five-factor FUNDES-Adult structures with a variance of 73.5% (Table 2) and of 75.9% (Table 3) for the performance and capability dimensions, respectively. For the performance dimension, the first factor included 10 items (D1.1–D1.6 and D4.1–D4.4) and named as performance of learning and interaction, the second included 8 items (D2.1–D2.5, and D3.1–D3.3) and named as performance of mobility and self-care, the third included 4 items (D5.1–D5.4) and named as performance of housework, the fourth included 8 items (D6.1 to D6.8) and named as impact of health on participation performance, and the last domain included 4 items (D5.5–D5.8) and named as performance in work/school. The factors correlation matrix in Table 2 showed moderate correlations across all factors (r = 0.622∽0.677). The KMO value is 0.968 (p < 0.001). In this study, we calculated each performance factor score of each participant as the mean of the item values. For the five performance factors, the mean scores were 1.42 ± 1.508 (Factor 1, performance of learning and interaction); 0.99± 1.300 (Factor 2, performance of mobility and self-care); 1.78 ± 1.566 (Factor 3, performance of housework); 1.63 ± 1.349 (Factor 4, impact of health on participation performance); 3.27 ± 1.418 (Factor 5, performance in work/school), and with Cronbach-α of 0.96, 0.95, 0.99, 0.91, and 0.99, respectively.
Table 2. Factor loading of the performance dimension of the FUNDES-Adult by exploratory factor analysis (n = 8730).
Table 3. Factor loading of the capability dimension of the FUNDES-Adult by exploratory factor analysis (n = 8730).
For the 40 items of the capacity dimension, the first domain included 14 items (D2.1–D2.5; D3.1–D3.3; D8.1–D8.3; and D8.5–D8.7), the second included 5 items (D5.1–D5.4; and D6.1), the third included 10 items (D1.1–D1.6; and D4.1–4.4), the fourth included 7 items (D6.2–D6.8), and the last domain included 4 items (D5.5–D5.8). The factors were named as “Basic capability,” “Capability of housework,” “Capability of learning and interaction,” “Impact of health on participation capability,” and “Capability in work/school.” The factors correlation matrix in Table 3 showed moderate correlations across all factors (r = 0.316∽0.668). The KMO value was 0.975 (p < 0.001). Each capability factor score of each participant was calculated by averaging the item scores that comprised. For the five capacity factors, the mean scores were 1.16 ± 1.508 (Factor 1, Basic capability); 2.17 ± 1.539 (Factor 2, Capability of housework); 1.53 ± 1.408 (Factor 3, Capability of learning and interaction); 1.68 ± 1.388 (Factor 4, Impact of health on participation capability); 3.32 ± 1.352 (Factor 5,Capability in work/school), and with Cronbach-α of 0.98, 0.97, 0.96,0.90, 0.90, and 0.99, respectively.
Confirmatory Factor Analysis
The ICC were ranged from 0.351 to 0.884 at the domain level and 0.655 (p < 0.05) at the overall level that meant that we must use multidimensional measurement to confirm the disability concept. The second-order CFA is one of the hierarchical measurement models. The factor loadings for the second-order CFA for the 34 items of performance dimension were from 0.62 to 0.85 (Figure 1) and the fit indices on this model were TLI = 0.99, CFI = 0.99, NFI = 0.97, and RMSEA = 0.028. All fit indices showed a good fit. All 34 items had factor loadings >0.75 on their corresponding factors, supporting the construct validity of the performance dimension.
Figure 1. Factor structure of the performance dimension of the FUNDES-Adult, version 7, by the CFA. (N = 500, 34 items); Fit index (Bollen–Stine bootstrap p-correction estimated): TLI = 0.99, CFI = 0.99, NFI = 0.97, RMSEA = 0.028.
For the 40 items of capability dimension, the factor loadings for the second-order CFA were from 0.64 to 0.91(Figure 2). The fit indices of the model were TLI = 0.99, CFI = 0.99, NFI = 0.97, and RMSEA = 0.087, indicating acceptable to excellent model fit. All 40 items had factor loadings >0.69 on their corresponding factors, supporting the construct validity of the capability dimension.
Figure 2. Factor structure of the capability dimension of the FUNDES-Adult, version 7, by the CFA (N= 500, 40 items); Fit indices (Bollen–Stine bootstrap p-correction estimated): TLI = 0.99, CFI = 0.99, NFI = 0.97, RMSEA = 0.087.
Discussion
Participation is one of the most significant outcomes of rehabilitation, social, and educational interventions (81). Using a large nationwide DEDS sample, the results of this study provided evidence of construct (structural) validity of the AP part of FUNDES-Adult by using both EFA and CFA for adults with disabilities and aged more than 18 years. The 5-factor structures of two dimensions of the FUNDES-Adult, version 7, are similar to our previous finding of FUNDES-Adult, version 5 (13). The items loading on each of the five factors of the performance dimension reflected the following domains: Performance of learning and interaction, Performance of mobility and self-care, Performance of housework, Impact of health on participation performance, and Performance in work/school; and that of capability dimensions are: Basic capability, Capability of housework, Capability of learning and interaction, Impact of health on participation capability, and Capability in work/school. This study also confirmed the second-order factor structure of the FUNDES-Adult. However, the items of each factor of two dimensions were different slightly and the names of the five factors were also different. The hypothesis of this study was partially supported. In Taiwan DEDS, the 5 domain scores and an overall disability score in two dimensions could be computed, each ranging from zero (indicating no perceived disability) to 100 (indicating maximum perceived disability). These disability scores are important for disability practices, research, and policies in the future in Taiwan.
Although Üstün et al. proposed the WHODAS 2.0 36-item version has a second-order factor structure in all cultures and populations tested (82) and it shows a mild correspondence with the theoretically six-domain structure. Such factor structure also found in the performance dimension of the FUNDES-Adult of persons with spinal cord injuries (18). However, the six-domain structure did not be confirmed by some previous studies (31, 58, 68, 70, 83). The possible reasons for somewhat different factor structures among the studies include differences in samples, influence of cultural and language differences, item numbers, and testing procedures between the initial WHODAS 2.0 and the Chinese FUNDES-Adult.
For example, the answers of “D3.4 Staying by himself or herself for a few days” in the WHODAS 2.0 were usually “not applicable” in Taiwan disability population. One of the reasons may be that most Chinese families are seldom core families and for those with disabilities are usually cared by other family members. They do not have the opportunities to be alone in our daily life in the past 30 days. These results are similar to the spinal cord injury studies which used the WHODAS 2.0 (65) or the FUNDES-Adult (18). Nielsen et al. (71) also found that aged persons discharged from emergency department in Denmark had more than 15% missing data in item D3.4. The item D4.5 “Sexual activities” was always missing due to the conservative culture and be refused to answer or the answer from the attitude of the respondent was not highly credible (71). The rating problem of the item D4.5 was also mentioned and suggested a cultural problem (68, 70). Therefore, we deleted this item in the FUNDES-Adult, version 10 (84).
For developing an ICF-based evaluation tool in Taiwan's DEDS, the FUNDES team has done some pilot studies (9, 85–87) and conducted a literature review for reliabilities and validities of the WHODAS 2.0 at the very beginning (87). The team then revised each item of the WHODAS 2.0 to be with performance dimension and capability dimension. Each item with performance dimension is almost just translated from the original English, with more detailed description of each item and adapting Chinese culture in the FUNDES Manual (27). For example, most male Taiwanese answered the item D5.1 (“Taking care of household responsibilities”) with “not applicable” (9), because male Taiwanese thought household activities were women's responsibilities. Therefore, the D5.1 question has been changed to” Taking care of household issues and family members.” A lot of examples are provided in the manual, including managing finances, car and house repairs, disciplining children, water flowers, etc. Some items that frequently confused testers were also revised based on the feedback of qualified testers. For example, item D1.4 (Learning a new task; for example, learning how to get to a new place?) was usually interpreted as testing the mobility problem due to the example sentence of “learning how to get to a new place”. We then revised the question of that item as “Learning a new task, for example, learning how to get to a new place and learning to use new daily living necessities and skills?”
For using the FUNDES-Adult as disability eligibility determination tools, the FUNDES team thought only the performance dimension is not enough. If performance dimension is the only criteria, one disabled person could possibly be deprived the disability qualification because of appropriate services and environmental support that leading to little restriction. We then add capability dimension to each item to measure the problem the applicants had without adaptive devices and others' assistance. Besides, to increase the better understanding of the capacity of the participants, the testers always started to test Do8 Motor action after demographic data collection. The process and results of the direct testing of the Do8 Motor action could help tester to deal with few applicants who responded most items with scores of 4 (profound) deliberately. The results of the Do8 could also to be used as later needs assessment related to mobility devices.
Using the EFA, Yen et al. found capability dimensions of the FUNDES-Adult, version 5, have five factors for 5,736 adults with disabilities (13); however, Chiu et al. found 6 factors in 521 adults with spinal cord injuries (18). As we mentioned before, differences of sample characteristics are possible reasons. Hence, we do not compare factor structures in different samples, disability group vs. spinal problems. We compared the factor structures between the FUNDES-Adult, version 5, and the FUNDES-Adult, version 7, further. It was found that the names of the five factors were the same, and only one item loaded in different factors. For FUNDES-Adult, version 5, the item D6.1 (How much of a problem did you have joining in community activities?) cross-loaded on three factors, Impact of health on participation capability factor (Factor loading = 0.577), Capability of learning and interaction factor (Factor loading = 0.359), and Capability of housework factor (Factor loading = 0.348) (13). The number of cross loading items might be due to the partial conceptual overlap between some aspects of the different domains of the WHODAS 2.0 (28). For FUNDES-Adult, version 7, the item D6.1 loaded only in the capability of housework factor (factor loading = 0.493). Therefore, the second-order 5-factor structures of two dimensions of the FUNDUS-Adult, version 7, was confirmed.
Besides the correlation matrix of the factor levels, we also calculated the omega reliability coefficients based on the formula proposed by McDonald (88, 89) and the estimated omega reliability coefficients were the average of the factor loadings in the Figures 1, 2 of this study (90). It showed that omega reliability coefficients were 0.78 and 0.80 for performance and capability dimension, respectively. Those are within the well-structured indicator of omega range of 0.75–0.83 (90).
Because most of the Do6 items of the FUNDESA-Adult, version 7, were loaded on a factor named as “Impact of health on participation performance. The modifications to the WHODAS 2.0 for the World Mental Health Surveys did not use original Do6 items (91). The FUNDES team then decided to add five new items and to keep the item D6.1 of the FUNDES, version 7, in the new Domain 6 (Societal participation) of the FUNDES-Adult, version 10. Then, we renamed the original Do6 as Do7 (Impact of health on participation) with seven items. The new five items of the Do6 (Societal participation) of the FUNDES-Adult 10th are derived from the Participation Measure−3 Domains, 4 Dimensions (PM-3D4D) (92, 93). The PM-3D4D is a 19-item measure that was developed on the basis of the conceptual model of participation (93). It is designed to evaluate participation in 3 domains—Productivity, Social, and Community—across 4 dimensions—Diversity, Frequency, Desire for change, and Difficulty. We selected and revised five items of Community domain of the PM-3D4D and Item D6.1 to form Do6 (Societal participation) of the FUNDES, version 10 (84).
Disability data is very important for the disability-inclusive development and for estimating disability prevalence (94). Guidebook published by the World Bank supports the implementation of the Washington Group Short Set (WG-SS) in multi-topic household surveys (95). The six questions of the WG-SS include seeing, hearing, walking, cognition, self-care, and communication. In the FUNDES-Adult, there were items related to walking, cognition, self-care, and communication functioning. Therefore, the FUNDES team have added seeing and hearing items in the FUNDES- Adult, version 10, and FUNDES-Child, version 10. The FUNDES, version 10, started to be used on 1 January 2022. Its psychometrics will be examined in the near future.
This study demonstrates the factor structure of the FUNDES-Adult, a modified assessment tool from the WHODAS 2.0, could be used as an ICF-based measure of AP successfully in the DEDS. The Taiwan's DEDS took the results of the FUNDES as references for the first stage of needs assessment to determine the supports related to parking space for persons with disabilities, transportation supports, and necessary accompany, and RehabBus services (a public transportation services to people with disabilities) (12, 85). The possibility of adjusting the disability grading by the FUNDES has been proposed. Right now, the disability grading or severity of the disability identification is decided mainly by the results of body structure and function assessment due to political and cultural reasons. The previous studies demonstrated there were significant correlations between body structure and function scores and FUNDES-Adult scores or WHODAS scores in each type of diagnosis or disability (30, 50, 51, 60). However, the FUNDES-Adult score of the extreme severe hearing impairment was lower than that of the mild stroke (22). That means that the disability grading based on body structure and function scores only is not fair. The impacts of combining body structure and function scores and FUNDES score on disability grading adjustment are under investigation. We expect the 5-factor structures of the FUNDES-Adult, version 7, could be used as references to adjust the disability grading when we collect enough data of the FUNDES, version 10, in the near future. The application of the FUNDES by clinicians or social welfare service providers to enhance the social participation and outcome evaluation tools for people with disabilities will be presented. However, the FUNDES-Adult requires additional testing and validation. For example, the WHODAS 2.0 shows as a valid instrument to assess functioning differences related to the clinical impact classification level in subjects with chronic obstructive pulmonary disease (36) and has the potential to become a patient-reported outcome measure (20). For persons with depression, most performance on the WHODAS 2.0 were improved after 2-year follow-up (40). We need to investigate the progress of other health conditions. Besides, the ICF-based collaborative problem-solving model could be used in the family-centered early intervention service process and the person-centered services (85, 96). We hope the main theme of ICF, enhancing the full participation of people with disabilities in society, could be reached through the application of the FUNDES.
Data Availability Statement
The data analyzed in this study is subject to the following licenses/restrictions: The data set is an official data bank. Researchers can access the de-identification data through an application process. Requests to access these datasets should be directed to Head of the Department of Health and Welfare Services, Taiwan, through send the application letter to Taiwan Society of ICF, dGFpd2Fuc29jaWV0eWljZiYjeDAwMDQwO2dtYWlsLmNvbQ== and the website of the TSICF is http://www.icf.org.tw/.
Ethics Statement
The studies involving human participants were reviewed and approved by the Research Ethics Committee of the Hualien Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation (IRB104-04-A;IRB107-46-B) and Joint Institutional Review Board Taipei Medical University (TMU- Joint Institutional Review Board), Taiwan. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.
Author Contributions
C-FY and H-FL provided concept/idea/research design, data analysis, and writing. T-YC, W-CC, and T-HL provided data collection and data set maintenance as well as data analysis assistance. H-FL and T-HL provided project management. facilities/equipment, institutional liaisons, and administrative support. W-CC, B-SC, T-FW, and S-JL assisted testers training and data checking. All authors reviewed the manuscript before submission. All authors contributed to the article and approved the submitted version.
Funding
The study was funded by Ministry of Health and Welfare/Taipei, Taiwan (M05F4145, M06F5054, M07F5223, M08F3147, M09F4089, and M1006158).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. People With Disabilities Rights Protection Act. (2021). Available online at: https://law.moj.gov.tw/ENG/LawClass/LawHistory.aspx?pcode=D0050046 (accessed March 20, 2022).
2. World Health Organization. International Classification of Functioning, Disability and Health: ICF. Geneva: WHO (2001).
3. World Health Organization. International Classification of Functioning, Disability and Health: Children & Youth Version (ICF-CY). Geneva: WHO (2007).
4. Liao HF, Hwang AW. Introduction to international classification of functioning, disability and health (ICF) and recommendations for its application in disability evaluations in Taiwan. FJPT. (2009) 34:310–8. (in Chinese with English abstract).
5. Liao HF, Yen CF, Hwang AW, Liou TH, Chang BS, Wu TF, et al. Introduction to the application of the functioning scale of the disability evaluation system. Formosan J Med. (2013) 17:368–80.
6. Chiu WT, Yen CF, Teng SW, Liao HF, Chang KH, Chi WC, et al. Implementing disability evaluation and welfare services based on the framework of the international classification of functioning, disability and health: experiences in Taiwan. BMC Health Serv Res. (2013) 13:416. doi: 10.1186/1472-6963-13-416
7. Teng SW, Yen CF, Liao HF, Chang KH, Chi WC, Wang YH, et al. Evolution of system for disability assessment based on the international classification of functioning, disability, and health: a Taiwanese study. J Formos Med Assoc. (2013) 112:691–8. doi: 10.1016/j.jfma.2013.09.007
8. Üstün T, Kostanjsek N, Chatterji S, Rehm J World Health Organization. Measuring Health and Disability: Manual for WHO Disability Assessment Schedule. WHODAS 2.0. Geneva: World Health Organization (2010).
9. Liao HF, Hwang AW, Pan YL, Liou TH, Yen CF. Application of ICF / ICF-CY to physical therapy and the ICF mobility scale in Taiwan. FJPT. (2013) 38:1–15.
10. Chang KH, Lin YN, Liao HF, Yen CF, Escorpizo R, Yen TH, Liou TH. Environmental effects on WHODAS 20 among patients with stroke with a focus on ICF category e120. Qual Life Res. (2014) 23:1823–31. doi: 10.1007/s11136-014-0624-9
11. Hwang AW, Yen CF, Liao HF, Chi WC, Liou TH, Chang BS, et al. Structural validity of an ICF-based measure of activity and participations for children in Taiwan's disability eligibility determination system. Int J Environ Res Public Health. (2020) 17:6134. doi: 10.3390/ijerph17176134
12. Liao HF, Yen CF, Hwang AW, Liou TH, Liou TH, Chi WC. The development and application of the functioning disability evaluation scale. Commun Dev Q. (2015) 105:77–98. (in Chinese)
13. Yen CF, Hwang AW, Liou TH, Chiu TY, Hsu HY, Chi WC, et al. Validity and reliability of the functioning disability evaluation scale-adult version based on the WHODAS 20 - 36 items. J Formos Med Assoc. (2014) 113:839–49. doi: 10.1016/j.jfma.2014.08.008
14. Chiu TY, Yen CF, Chou CH, Lin JD, Hwang AW, Liao HF, et al. Development of the World Health Organization disability assessment schedule 20 36-item traditional Chinese version (WHODAS 20) in Taiwan: validity and reliability analyses. Res Dev Disabil. (2014) 35:2812–20. doi: 10.1016/j.ridd.2014.07.009
15. Chen WC, Bedell GM, Yen CF, Liou TH, Kang LJ, Liao HF, et al. Psychometric properties of the traditional Chinese version of the child and adolescent factors inventory (CAFI-C). Res Dev Disabil. (2017) 68:111–21. doi: 10.1016/j.ridd.2017.07.007
16. Hwang AW, Yen CF, Liou TH, Bedell G, Granlund M, Teng SW, et al. Development and validation of the ICF-CY-based functioning scale of the disability evaluation system -child version in Taiwan. J Formos Med Assoc. (2015) 114:1170–80. doi: 10.1016/j.jfma.2015.11.002
17. Kang LJ, Yen CF, Bedell G, Simeonsson RJ, Liou TH, Chi WC, et al. The Chinese version of the child and adolescent scale of environment (CASE-C): validity and reliability for children with disabilities in Taiwan. Res Dev Disabil. (2015) 38:64–74. doi: 10.1016/j.ridd.2014.12.019
18. Chiu TY, Finger ME, Fellinghauer CS, Escorpizo R, Chi WC, Liou TH, et al. Validation of the World Health Organization Disability Assessment Schedule 20 in adults with spinal cord injury in Taiwan: a psychometric study. Spinal Cord. (2019) 57:516–24. doi: 10.1038/s41393-018-0231-7
19. Thompson B, Daniel LG. Factor analytic evidence for the construct validity of scores: a historical overview and some guidelines. Educ Psychol Meas. (1996) 56:197–208. doi: 10.1177/0013164496056002001
20. Kulnik ST., Nikoletou D. WHODAS 20 in community rehabilitation: a qualitative investigation into the validity of a generic patient-reported measure of disability. Disabil Rehabil. (2014) 36:146–54. doi: 10.3109/09638288.2013.782360
21. Pettersson I, Törnquist K, Ahlström G. The effect of an outdoor powered wheelchair on activity and participation in users with stroke. Disabil Rehabil Assist Technol. (2006) 1:235–43. doi: 10.1080/17483100600757841
22. Chi WC, Chang KH, Escorpizo R, Yen CF, Liao HF, Chang FH, et al. Measuring disability and its predicting factors in a large database in Taiwan using the World Health Organization Disability Assessment Schedule 20. Int J Environ Res Public Health. (2014) 11:12148–61. doi: 10.3390/ijerph111212148
23. Chiu TY, Yen CF, Escorpizo R, Chi WC, Liou TH, Liao HF, et al. What is the gap in activity and participation between people with disability and the general population in Taiwan? Int J Equity Health. (2017) 16:136–48. doi: 10.1186/s12939-017-0628-5
24. Liao HF, Fan CJ, Liou TH, Yen CF, Wu TF, Chang BS, et al. Training programs for testers of the functioning scale of the disability evaluation system in Taiwan and outcomes. J Formos Med Assoc. (2013) 17:368–80. (text in Chinese with English abstract).
25. Schumacker ER, Lomax GR. A Beginner's Guide to Structural Equation Modeling. Mahwah, NJ: Erlbaum (1996).
26. The The Regulations for the Classification Categories Grades Grades of Disability Standards in Disability Evaluation System. [in Chinese] (2021). Available online at: http://law.moj.gov.tw/LawClass/LawContent.aspx?PCODE=L0020020 (accessed January 20, 2022).
27. Liao HF, ed. Functioning Scale of the Disability Evaluation System 7.0 – Manual. Sponsored by the Ministry of Health and Welfare, Taiwan. Taipei: Taiwan Society of International Classification of Functioning, Disability and Health (TSICF); March, 2013. [in Chinese].
28. Federici S, Bracalenti M, Meloni F, Luciano JV. World Health Organization disability assessment schedule 20: an international systematic review. Disabil Rehabil. (2017) 39:2347–80. doi: 10.1080/09638288.2016.1223177
29. Chwastiak LA, Von Korff M. Disability in depression and back pain: evaluation of the World Health Organization Disability Assessment Schedule (WHODAS II) in a primary care setting. J Clin Epidemiol. (2005) 56:507–14. doi: 10.1016/S0895-4356(03)00051-9
30. van Tubergen A, Landewe R, Heuft-Dorenbosch L, Spoorenberg A, van der Heijde D, van der Tempel H, et al. Assessment of disability with the World Health Organization Disability Assessment Schedule II in patients with ankylosing spondylitis. Ann Rheum Dis. (2003) 62:140–5. doi: 10.1136/ard.62.2.140
31. Garin O, Ayuso-Mateos J, Almansa J, Nieto M, Chatterji S, Vilagut G, et al. Validation of the “World Health Organization Disability Assessment Schedule, WHODAS2” in patients with chronic diseases. Health Qual Life Outcomes. (2010) 8:51. doi: 10.1186/1477-7525-8-51
32. Kutlay S, Kucukdeveci AA, Ethan AH, Oztuna D, Koç N, Tennant A. Validation of the World Health Organization disability assessment schedule (WHODAS II) in patients with osteoarthritis. Rheumatol Int. (2011) 31:339–46. doi: 10.1007/s00296-009-1306-8
33. Posl M, Cieza A, Stucki G. Psychometric properties of the WHODAS II in rehabilitation patients. Qual Life Res. (2007) 16:1521–31. doi: 10.1007/s11136-007-9259-4
34. Chang KH, Liao HF, Yen CF, Escorpiza R, Hwang AW, Chi WC, et al. Association between muscle power impairment and WHODAS 20 in older adults with physical disability in Taiwan. Disabil Rehabil. (2015) 37:712–20. doi: 10.3109/09638288.2014.940428
35. Cheung MK, Hung AT, Poon PK, Fong DY Li LS, Chow ES, et al. Validation of the World Health Organization Assessment Schedule II Chinese traditional version (WHODAS II CT) in persons with disabilities and chronic illnesses for Chinese population. Disabil Rehabil. (2015) 37:1902–7. doi: 10.3109/09638288.2014.989336
36. Zacarias LC, Câmara KJDC, Alves BM, Morano MTAP, Viana CMS, Mont'Alverne DGB, et al. Validation of the World Health Organization Disability Assessment Schedule (WHODAS 20) for individuals with COPD. Disabil Rehabil. (2021) 14:1–6. doi: 10.1080/09638288.2021.1948117
37. Chen R, Liou TH, Chang KH, Yen CF, Liao HF, Chi WC, et al. Assessment of functioning and disability in patients with schizophrenia using the WHO Disability Assessment Schedule 20 in a large-scale database. Eur Arch Psychiatry Clin Neurosci. (2018) 268:65–75. doi: 10.1007/s00406-017-0834-6
38. Chen R, Liou TH, Miao NF, Chang KH, Yen CF, Liao HF, et al. Using World Health Organization Disability Assessment Schedule 20 in people with schizophrenia: a 4-year follow-up. Eur Arch Psychiatry Clin Neurosci. (2020) 270:301–10. doi: 10.1007/s00406-019-01000-5
39. Chiang YC, Liou TH, Lee HC, Escorpizo R. Using WHODAS 20 to assess functional impairment in people with depression: should employment receive more attention? Int J Environ Res Public Health. (2021) 18:4552. doi: 10.3390/ijerph18094552
40. Chi WC, Yen CF, Liou TH, Chang KH, Liao HF, Chang YL. Exploring factors associated with functional change and predictors of participation improvement - a two years follow-up on people with depression. Int J Environ Res Public Health. (2021) 18:3439. doi: 10.3390/ijerph18073439
41. Huang SW, Chang KH, Escorpizo R, Hu CJ, Chi WC, Yen CF, et al. Using the World Health Organization Disability Assessment Schedule 20 (WHODAS 20) for predicting institutionalization of patients with dementia in Taiwan. Medicine. (2015) 94:e2155. doi: 10.1097/MD.0000000000002155
42. Huang SW, Chang KH, Escorpizo R, Chi WC, Yen CF, Liao HF, et al. Functioning and disability analysis by using WHO Disability Assessment Schedule 20 in older adults Taiwanese patients with dementia. Disabil Rehabil. (2016) 38:1652–63. doi: 10.3109/09638288.2015.1107636
43. Habtamu K, Alem A, Medhin G, Fekadu A, Dewey M, Prince M, et al. Validation of the World Health Organization Disability Assessment Schedule in people with severe mental disorders in rural Ethiopia. Health Qual Life Outcomes. (2017) 15:64. doi: 10.1186/s12955-017-0647-3
44. Huang SW, Chi WC, Yen CF, Chang KH, Liao HF, Escorpizo R, et al. Does more education mean less disability in people with dementia? A large cross-sectional study in Taiwan. BMJ Open. (2017) 7:e013841. doi: 10.1136/bmjopen-2016-013841
45. Lee HH, Hong CT, Wu D, Chi WC, Yen CF, Liao HF, et al. Association between ambulatory status and functional disability in elderly people with dementia. Int J Environ Res Public Health. (2019) 16:2168. doi: 10.3390/ijerph16122168
46. Lu SJ, Liou TH, Yen CF, Chang FH, Chen YL, Escorpizo R, et al. Determinants of employment outcome for the people with schizophrenia using the WHODAS 20. J Occup Rehabil. (2019) 29:375–83. doi: 10.1007/s10926-018-9794-6
47. Liou WC, Chan L, Hong CT, Chi WC, Yen CF, Liao HF, et al. Hand fine motor skill disability correlates with dementia severity. Arch Gerontol Geriatr. (2020) 90:104168. doi: 10.1016/j.archger.2020.104168
48. Lee YH, Chang KH, Escorpizo R, Chi WC, Yen CF, Liao HF, et al. Accuracy of the World Health Organization Disability Assessment Schedule 20 (WHODAS 20) score as an objective assessment tool for predicting return-to-work status after head and neck cancer in male survivors. Support Care Cancer. (2019) 27:433–41. doi: 10.1007/s00520-018-4322-y
49. Lee YH, Goo-Yoshino S, Lew HL, Chi WC, Yen CF, Liao HF, et al. Social participation in head and neck cancer survivors with swallowing disorder: World Health Organization Disability Assessment Schedule 20 study. Head Neck. (2020) 42:905–12. doi: 10.1002/hed.26062
50. Chang KF, Chang KH, Chi WC, Huang SW, Yen CF, Liao HF, et al. Influence of visual impairment and hearing impairment on functional dependence status among people in Taiwan-An evaluation using the WHODAS 20 score. J Chin Med Assoc. (2018) 81:376–82. doi: 10.1016/j.jcma.2017.08.011
51. Chao PZ, Huang SW, Escorpizo R, Chi WC, Yen CF, Liao HF, et al. Effects of hearing disability on the employment status using WHODAS 20 in Taiwan. Int J Environ Res Public Health. (2020) 17:9374. doi: 10.3390/ijerph17249374
52. Chisolm T, Abrams H, McArdle R, Wilson RH, Doyle PJ. Psychometric properties in the measurement of functional health status in adults with acquired hearing loss. Trends Amplif. (2005) 9:111–26. doi: 10.1177/108471380500900303
53. Hu HY, Chi WC, Chang KH, Yen CF, Escorpizo R, Liao HF, et al. The World Health Organization Disability Assessment Schedule 20 can predict the institutionalization of the patients with stroke. Eur J Phys Rehabil Med. (2017) 53:856–62. doi: 10.23736/S1973-9087.17.04615-9
54. Huang SW, Chi WC, Chang KH, Yen CF, Liao HF, Escorpizo R, et al. World Health Organization Disability Assessment Schedule 20 as an objective assessment tool for predicting return to work after a stroke. Disabil Rehabil. (2018) 40:2592–7. doi: 10.1080/09638288.2017.1342280
55. Jen HJ, Kao CM, Chang KH, Yen CF, Liao HF, Chi WC. et al. Assessment of functioning using the WHODAS 20 among people with stroke in Taiwan: a 4-year follow-up study. Ann Phys Rehabil Med. (2021) 64:101442. doi: 10.1016/j.rehab.2020.09.006
56. Schlote A, Richter M, Wunderlich MT, Poppendick U, Möller C, Schwelm K, et al. WHODAS II with people after stroke and their relatives. Disabil Rehabil. (2009) 31:855–64. doi: 10.1080/09638280802355262
57. Küçükdeveci AA, Kutlay S, Yildizlar D, Öztuna D, Elhan AH, Tennant A. The reliability and validity of the World Health Organization Disability Assessment Schedule (WHODAS-II) in stroke. Disabil Rehabil. (2013) 35:214–20. doi: 10.3109/09638288.2012.690817
58. Yuliana S, Muslih M. Jenny Sim, Vidyanti AN, Brahmadhi A, Tsai HT. Development and validation of the World Health Organization Disability Assessment Schedule 20 (WHODAS 20) Indonesian version in stroke survivors. Disabil Rehabil. (2021) 21:1–8. doi: 10.1080/09638288.2021.1900413
59. Chen JH, Hong CT, Wu D, Chi WC, Yen CF, Liao HF, et al. Dementia-related functional disability in moderate to advanced Parkinson's disease: assessment using the World Health Organization Disability Assessment Schedule 20. Int J Environ Res Public Health. (2019) 16:2230. doi: 10.3390/ijerph16122230
60. Hsu TH, Liou TH, Chou KR, Chi WC, Yen CF, Liao HF, et al. Large-scale assessment of function and disability in patients with Parkinson's disease using the functioning disability evaluation scale-adult version. Int J Environ Res Public Health. (2018) 15:2788. doi: 10.3390/ijerph15122788
61. Tan S, Hong CT, Chen JH, Chan L, Chi WC, Yen CF, et al. Hand fine motor skill disability correlates with cognition in patients with moderate-to-advanced Parkinson's disease. Brain Sci. (2020) 10:337. doi: 10.3390/brainsci10060337
62. Wang CY, Chan L, Wu D, Chi WC, Yen CF, Liao HF, et al. Effect of cognitive disability and ambulation status on functioning in moderate-to-advanced Parkinson disease. Front Neurol. (2020) 10:1360. doi: 10.3389/fneur.2019.01360
63. Kuo CY, Liou TH, Chang KH, Chi WC, Escorpizo R, Yen CF, et al. Functioning and disability analysis of patients with traumatic brain injury and spinal cord injury by using the world health organization disability assessment schedule 20. Int J Environ Res Public Health. (2015) 12:4116–27. doi: 10.3390/ijerph120404116
64. Noonan V, Kopec J, Noreau L, Singer J, Mâsse LC, Zhang H, et al. Comparing the validity of five participation instruments in persons with spinal conditions. J Rehabil Med. (2010) 42:724–34. doi: 10.2340/16501977-0584
65. Wolf AC, Tate RL, Lannin NA, Middleton J, Lane-Brown A, Cameron ID. The World Health Organization Disability Assessment Scale, WHODAS II: reliability and validity in the measurement of activity and participation in a spinal cord injury population. J Rehabil Med. (2012) 44:747–55. doi: 10.2340/16501977-1016
66. Huang SW, Chang KH, Escorpizo R, Chang FH, Liou TH. WHODAS 20 can predict institutionalization among patients with traumatic brain injury. Int J Environ Res Public Health. (2019) 16:1484. doi: 10.3390/ijerph16091484
67. Huang SW, Chang KH, Escorpizo R, Liou TH. Accuracy of a modified World Health Organization Disability Assessment Schedule 20 as an assessment tool for predicting return-to-work among patients with traumatic brain injury. Disabil Rehabil. (2020) 42:3370–6. doi: 10.1080/09638288.2019.1594401
68. Salehi R, Negahban H, Khiavi FF, Saboor S, Majdinasab N, Shakhi K. Validity and reliability of the World Health Organization Disability Assessment Schedule 20 36-item Persian version for persons with multiple sclerosis Korean. J Fam Med. (2020) 41:195–201. doi: 10.4082/kjfm.18.0155
69. Lin SW, Chiu TY, Liou TH, Yen CF, Chen HG. The relationship of urbanization and performance of activity and participation functioning among adults with developmental disabilities in Taiwan. Int J Environ Res Public Health. (2020) 17:7553. doi: 10.3390/ijerph17207553
70. Moen VP, Drageset J, Eide GE, Klokkerud M, Gjesdal S. Validation of World Health Organization Assessment Schedule 20 in specialized somatic rehabilitation services in Norway. Qual Life Res. (2017) 26:505–14. doi: 10.1007/s11136-016-1384-5
71. Nielsen LM, Oestergaard LG, Kirkegaard H. Maribo T. Construct validity and clinical utility of World Health Organization Disability Assessment Schedule 20 in older patients discharged from emergency departments. Front Rehabilit Sci. (2021) 2:710137. doi: 10.3389/fresc.2021.710137
72. Yen CF, Chiu TY, Liou TH, Chi WC, Liao HF, Liang CC, et al. Development of activity and participation norms among general adult populations in Taiwan. Int J Environ Res Public Health. (2017) 14:603–12. doi: 10.3390/ijerph14060603
73. Costello AB, Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval. (2005) 10:7. doi: 10.7275/jyj1-4868
74. Sharma S. Applied Multivariate Techniques. New York, NY: John Wiley and Sons. Inc. (1996). p. 90–143.
75. Kaiser HF. An index of factorial simplicity. Psychometrika. (1974) 39:31–6. doi: 10.1007/BF02291575
76. McGraw KO, Wong SP. Forming inferences about some intraclass correlation coefficients. Psychol Methods. (1996) 1:30–46. doi: 10.1037/1082-989X.1.1.30
77. Shrout PE, Fleiss JL. Intraclass correlations: uses in assessing rater reliability. Psychol Bull. (1979) 86:420. doi: 10.1037/0033-2909.86.2.420
78. Üstün TB, Chatterji S, Villanueva M, Bendib L, Celik C, Sadana R, et al. WHO Multi-Country Survey Study on Health and Responsiveness 2000-2001. GPE Discussion Paper 37. Geneva: World Health Organization (2001).
79. Beauducel A, Wittmann WW. Simulation study on fit indexes in CFA based on data with slightly distorted simple structure. Struct Equ Modeling A Multidiscip J. (2005) 12:41–75. doi: 10.1207/s15328007sem1201_3
80. Prinsen CAC, Vohra S, Rose MR, Boers M, Tugwll P, Clarke M, et al. How to select outcome measurement instruments for outcomes included in a “Core Outcome Set” - a practical guideline. Trials. (2016) 17:449. doi: 10.1186/s13063-016-1555-2
81. Dijkers MP. Issues in the conceptualization and measurement of participation: an overview. Arch Phys Med Rehabil. (2010) 91:S5–16. doi: 10.1016/j.apmr.2009.10.036
82. Üstün TB, Chatterji S, Kostanjsek N, Rehm J, Kennedy C, Epping-Jordan J., et al. Developing the World Health Organization disability assessment schedule 20 Bull. World Health Organ. (2010) 88:815–23. doi: 10.2471/BLT.09.067231
83. Buist-Bouwman MA, Ormel J, Graaf RD, Vilagut G, Alonso J, Van Sonderen E, et al. Psychometric properties of the World Health Organization Disability Assessment Schedule used in the European study of the epidemiology of mental disorders. Int J Methods Psychiatr Res. (2008) 17:185–97. doi: 10.1002/mpr.261
84. Liao HF. ed. Functioning Scale of the Disability Evaluation System 100 – Manual sponsored by the Ministry of Health and Welfare, Taiwan. Taipei: Taiwan Society of International Classification of Functioning, Disability and Health (TSICF) & Taipei Medical University (2021).
85. Liao HF, Hwang AW, Kang LJ, Liao YT, Granlund M, Simeonsson RJ. The development of the FUNDES-Child and its implications for the education of Taiwanese children. In: Castro S, Palikara O, editors. An Emerging Approach for Education and Care: Implementing a World-Wide Classification of Functioning and Disability. London: Routledge (2017). p. 85–111. doi: 10.4324/9781315519692-7
86. Wu TF, Shih SH, Liao HF, Liou TH. ICF scale of activities of daily living and its reliabilities and validities for stroke. Formosan J Med. (2012) 16:236–52. (in Chinese).
87. Chiu TY, Yen CF. To examine the assessment feasibility of WHODAS 2.0 in Taiwan: a system literature review. J Disabil Res. (2014) 12:175–90. (in Chinese).
88. McDonald RP. Generalizability in factorable domains: domain validity and generalizability. Educ Psychol Meas. (1978) 38:75–9. doi: 10.1177/001316447803800111
90. Viladrich C, Angulo-Brunet A, Doval E. A journey around alpha and omega to estimate internal consistency reliability. Anales De Psicología. (2017) 33:755–82. doi: 10.6018/analesps.33.3.268401
91. Von Korff M, Crane PK, Alonso J, Vilagut G, Angermeyer MC, Bruffaerts R, et al. Modifications to the WHODAS-II for the world mental health surveys: Implications of filter items. J Clin Epidemiol. (2008) 61:1132–43. doi: 10.1016/j.jclinepi.2007.12.009
92. Chang FH, Chang KH, Liou TH, Whiteneck GG. Validation of the participation measure−3 domains, 4 dimensions (PM-3D4D). Arch Phys Med Rehabil. (2017) 98:2498–506. doi: 10.1016/j.apmr.2017.05.027
93. Chang FH, Liou TH Ni P, Chang KH, Lai CH. Development of the participation measure-3 domains, 4 dimensions (PM-3D4D): a new outcome measure for rehabilitation. Arch Phys Med Rehabil. (2017) 98:286–94. doi: 10.1016/j.apmr.2016.08.462
94. Amilon A, Hansen KM, Kjær AA, Steffensen T. Estimating disability prevalence and disability-related inequalities: Does the choice of measure matter? Soc Sci Med. (2021) 272:113740. doi: 10.1016/j.socscimed.2021.113740
Keywords: disability evaluation, functioning, ICF, measurement, participation
Citation: Liao H-F, Yen C-F, Chiu T-Y, Chi W-C, Liou T-H, Chang B-S, Wu T-F and Lu S-J (2022) Factor Structure of an ICF-Based Measure of Activity and Participations for Adults in Taiwan's Disability Eligibility Determination System. Front. Rehabilit. Sci. 3:879898. doi: 10.3389/fresc.2022.879898
Received: 20 February 2022; Accepted: 11 April 2022;
Published: 13 May 2022.
Edited by:
Alberto Raggi, IRCCS Carlo Besta Neurological Institute Foundation, ItalyReviewed by:
Makoto Kyougoku, Kibi International University, JapanZhuoying QIU, China Rehabilitation Research Center/WHO Collaborating Center for Family International Classifications, China
Copyright © 2022 Liao, Yen, Chiu, Chi, Liou, Chang, Wu and Lu. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hua-Fang Liao, aGZsaWFvJiN4MDAwNDA7bnR1LmVkdS50dw==; Chia-Feng Yen, bWFwbGV5ZW5nJiN4MDAwNDA7Z21haWwuY29t