- 1Faculty of Nursing and Health Science, Nord University, Bodø, Norway
- 2Department of Physiotherapy, Nordland Hospital Trust, Bodø, Norway
- 3Department of Physiotherapy, Kongsgården Physiotherapy A/S, Bodø, Norway
- 4School of Psychological Sciences, University of Tasmania, Launceston, TAS, Australia
- 5Launceston General Hospital, Launceston, TAS, Australia
Background and purpose: Multiple sclerosis (MS) is associated with high rates of unemployment, and barriers for work are essential to identify in the regular follow-up of these people. The current study aimed to culturally adapt and evaluate the psychometric properties of the Norwegian version of the Multiple Sclerosis Work Difficulties Questionnaire-23 (MSWDQ-23).
Methods: Following backward and forward translation, the Norwegian version of the MSWDQ-23 (MSWDQ-23NV) was completed by 229 people with multiple sclerosis (MS). Validity was evaluated through confirmatory factor analysis and by associating scores with employment status, disability, and health-related quality of life outcome measures. Convergent validity was checked by correlating MSWDQ-23 scores with alternative study measures. Internal consistencies were examined by Cronbach's alfa.
Results: A good fit for the data was demonstrated for the MSWDQ-23NV in confirmatory factor analysis, with excellent internal consistencies also demonstrated for the full scale and its subscales (physical barriers, psychological/cognitive barriers, external barriers). The MSWDQ-23NV subscales were related in the expected direction to health-related quality of life outcome measures. While higher scores on the physical barriers subscale was strongly associated with higher levels of disability and progressive MS types, higher scores on all subscales were associated with not working in the past year.
Discussion: The Norwegian MSWDQ-23 is an internally consistent and valid instrument to measure perceived work difficulties in persons with all types of MS in a Norwegian-speaking population. The MSWDQ-23NV can be considered a useful tool for health care professionals to assess self-reported work difficulties in persons with MS. The Norwegian MSWDQ-23 scale should be examined for test-retest reliability and considered implemented in the regular follow up at the MS-outpatient clinics in Norway to support employment maintenance.
1 Introduction
Multiple Sclerosis (MS) is a chronic immune-mediated, demyelinating degenerative disease of the central nervous system affecting young adults of working age (1). A variety of symptoms may occur, such as visual and sensorimotor disturbances, cognitive difficulties, pain and fatigue (1). The disease is associated with early retirement from work and high rates of unemployment (2–5), which in turn reduces quality of life (6), and increase personal burdens and societal economic costs (3–5, 7–9). Norway is a high risk area for MS with a prevalence of 248/100 000 and incidence 8–12/100 000 (10). In the Norwegian population, minor to moderate levels of disability, measured by the Expanded Disability Status Scale (EDSS), dominates (10, 11). Still, unemployment is reported in 55%–70% of Norwegian people with MS (pwMS) (7, 12, 13). Globally, 43% of pwMS quit their job within the first 3 years after diagnosis, and 70% quit within 10 years (4).
There is little monitoring and follow-up of employment difficulties or the need for work adaptations at hospitals’ MS-outpatient (MS-OP) clinics. Consequently, employment status, and known work barriers such as fatigue, poor mobility and physical functioning, cognitive difficulties, depression, anxiety, and difficulties balancing the workload and family-life (12, 13, 14–17) are not typically addressed and remediated. Immense prospects for personal and societal benefits exist if employment issues are addressed early at routine follow-up of pwMS. One issue preventing the successful identification of work difficulties in pwMS at routine follow-up, however, is the lack standardized Norwegian instruments available to assess these difficulties.
Multiple Sclerosis Work Difficulties Questionnaire (MSWDQ), developed by Honan et al. is a suitable self-report instrument, developed to assess the perceived impact of MS on work difficulties (18). Because of its length (50 items), the authors subsequently created a shortened version (MSWDQ-23 containing 23 items), which was more suited for clinical practice (19). Both the full and shortened versions show good psychometric properties (18, 19) and the MSWDQ-23 has been translated into several European languages (20–26) as well as Turkish, Tunisian and Persian (27–29). The measure has also been successfully used to predict and understand a range of negative work outcomes. For example, the work difficulties assessed in the MSWDQ-23 have not only consistently been found to be related to withdrawal from work and productivity loss (22, 30), but they have also been found to mediate the relationship between job demands and burnout, between job resources and work engagement, and between job resources and burnout (31). The MSWDQ-23 contains 23 items with five response options [0 (never), 1 (rarely), 2 (sometimes), 3 (often) and 4 (almost always)], which assess how frequently the individual experienced difficulties over the previous four weeks in their current or most recent job. Items are grouped into three subscales (physical, psychological/cognitive, and external barriers). Patients’ perception of psychological and cognitive barriers in the workplace, as measured by the MSWDQ-23, is predictive of both unemployment and reducing the number of work hours since the MS diagnosis (32). A Norwegian version of the MSWDQ-23 may be an adequate tool to assess work difficulties in the Norwegian MS population and to address the specific work-related challenges that occur within this group.
The current study aims to culturally adapt the MSWDQ-23 for the Norwegian population and to examine its validity by verifying its three-factor structure and evaluating its other psychometric properties. We hypothesized that the Norwegian version of MSWDQ-23 would demonstrate acceptable internal consistency and model of fit based on confirmatory factor analysis, in line with previous validation studies (19, 22). We also expected acceptable construct validity with conceptually related measures of physical disability, psychological and cognitive difficulties, and health-related quality of life, using defined hypothesis.
2 Materials and methods
The study consists of two parts. (I) The translation and cultural adaptation. (II) The validation study.
2.1 Ethics
The study was approved by the Reginal Committee for Medical and Health Research Ethics, Norway (REK Nord 174837) and the Nordland Hospital Research Ethical Authority (project number 209). We conducted in accordance with the Helsinki declaration, and all participants provided written informed consent prior to inclusion. The study was funded by the Nortern Norway Regional Health Authority (Grant number 174837). The funder played no role in the design, conduct or reporting of the study.
2.2 Part I
The adaptation of the MSWDQ-23 (19) into Norwegian, followed the recommendations made by the International Society for Pharmacoeconomics and Outcomes Research (33), containing nine steps, described in the following.
(1) First, we obtained permission from the developer of MSWDQ-23 who agreed to participate as a consultant. Then we established a team consisting of one key person (ECA) who worked closely with the project manager (BN) throughout the adaptation process, two native Norwegian physical therapists to conduct the forward translation of whom one had studied in English speaking countries. For the back translation, we recruited one other native Norwegian physical therapist, who had studied in English speaking countries, and one native English speaker who was also fluent in Norwegian and worked as a professional translator. (2) The team members independently translated the questionnaire into Norwegian and made comments regarding ambiguities or word choice. (3) Reconciliation: The team members discussed the translated drafts and recognized some variations and challenges. The Norwegian version introduced some language changes in the instructions and some of the items. In Norwegian the word “please” is not so commonly used while giving instructions. We decided, in line with the Spanish version, to preserve the word. However, we did not repeat it twice in the last sentence of the introduction. When translating “I found” and “I thought” we used the same Norwegian word (“jeg syntes”). We used job (“jobb”) instead of work and leader (“leder”) instead of manager. Moreover, we discussed the differences between “I thought”, “I felt”, “I experienced”, “I found”, “I feared” with the original MSWDQ author (CH) to ensure that the translation covered the intended meaning. Since the Norwegian health care system implies that there is no immediate loss of payment, we, in agreement with CH, changed item No.21 (corresponding No.48 in the original 50-item scale) to include future decrease of payment. (4) By involving both a professional with knowledge in MS and experience of treating these patients, as well as a native English person with professional linguistic knowledge in the back translation of the reconciled translation of the questionnaire, we aimed for both conceptual, cultural as well as linguistic equivalence. (5) Back translation review was first discussed within the team and then with the developer of the original MSWDQ-23 (CH). (6) Harmonization was conducted by the project manager (BN) and the key person (ECA) by comparing the original, the Norwegian version and the back translated version. (7) Cognitive debriefing was obtained by distributing the Norwegian version of MSWDQ-23 to a group of pwMS (n = 6) who completed the questionnaire and were telephone interviewed about their item interpretation/understanding. (8) The whole team reviewed the cognitive debriefing results and made some adjustments. (9) Proofreading was performed by the BN and ECA. An overview of the process is shown in Figure 1. The MSWDQ-23 Norwegian Version (MSWDQ-23NV) is available as Supplementary Materials.
2.3 Part II
2.3.1 Design
A non-interventional, cross-sectional validation study was carried out in Nordland County, Norway from July 2021–January 2022.
2.3.2 Participants
Study participants were recruited in Nordland County, through the Nordland Hospital Trust. Inclusion criteria were: diagnosed with MS according the McDonald's criteria (34) and ≥18–67 years of age. There were no exclusion criteria. There were 252 pwMS who originally participated in the study. Among these, 23 participants were removed due to excessive missing data (>50% on the MSWDQ-23NV) (19), leaving 229 participants. The demographic characteristics of the original and final sample of participants are presented in Table 1. Most participants in the final sample had relapsing remitting MS (RRMS) and were female, and more than half were in paid employment within the past year. Most participants completed either a bachelor's degree or high school education. The average age of the participants was 51.6 (SD 12.5) years and the average EDSS was 2.8 (SD 2.2). The final sample of participants represented individuals from 45 municipalities across Nordland County, with the majority from Bodø (24.5%) and Rana (13.5%) municipalities.
2.3.3 Procedure
Informed consent forms and the questionnaires were sent by mail to all persons with MS who were registered at Nordland Hospital (NLSH) (512 persons). After two reminders, 252 persons had provided their written informed consent, and had returned their completed questionnaires to the MS-outpatient clinic at NLSH.
2.3.4 Measures
To record perceived work difficulties, the Norwegian version of MSWDQ-23 (19) was administered. Subscale scores regarding physical, psychological/cognitive, and external barriers, were computed by summing the observed items scores and dividing this by the total possible item scores in each subscale and then multiplying the value by 100. The maximum score for each dimension is 100, with higher scores indicating higher perceived difficulties. The total MSWDQ-23 score is the average of the three subscale scores.
2.3.4.1 Expanded disability status scale
The Expanded Disability Status Scale (EDSS) is a method of quantifying disability in multiple sclerosis (35). The EDSS scale ranges from 0 to 10 with 0.5-unit increments that represent higher levels of disability. Scoring is based on an examination by a neurologist. It is widely used in clinical trials and in the assessment of pwMS.
2.3.4.2 Multiple sclerosis quality of life-54
Multiple Sclerosis Quality of Life-54 (MSQOL-54) (36) measures health related quality of life. It is a validated instrument with an adequate test-retest reliability, construct validity and internal consistency (37). MSQOL-54 contains 52 QOL items that are divided across 12 scales (physical function, role limitations-physical, role limitations-emotional, pain, emotional well-being, energy, health perceptions, social function, cognitive function, health distress, overall quality of life, and sexual function) and two single items (satisfaction with sexual function and change in health) (37). Two summary scores, physical health composite score (PHCS) and mental health composite score (MHCS) are derived from a weighted combination of scale scores. The composite scores range from 0 to100, with a higher score indicating a better perceived health.
2.3.5 Demographic and employment registrations
In the survey the participants registered their age, time since diagnosis, type of MS, EDSS value, height, weight, relationship status, level of education, their work% the previous year, % of disability benefits, sick leave, and recovery benefits and how much they wanted to work if the job had been perfectly adjusted to their needs.
2.3.6 Statistical analyses
The three-factor structure of the MSWDQ-23 as originally devised by Honan et al. (19), was examined using Confirmatory Factor Analysis (CFA) in AMOS (Version 27.0) (38). Since CFA assumes that variables are normally distributed, in accordance with the recommendations of Enders, the Bollen-Stine bootstrapping procedure was used (39, 40). Positively skewed distributions were present in (1) the following psychological/cognitive barriers subscale: “colleagues not supportive”, “needed to be reminded”, “interact with people”, and “forgot what task”; (2) the following physical barriers subscale: “tolerate temperature”, “accessing office/worksite”, “experienced pain”, “write or type”, and “feared incontinent”; and (3) in the following external barriers subscale: “responsibilities at home”. Acceptable fit was evaluated against the recommendations of Hu and Bentler (41) and Kline (42). According to Hu and Bentler a normed χ2 (χ2/df) <2 indicates good model fit, a root-mean squared error of approximation (RMSEA) of <.08 indicates fair model fit (90% confidence intervals of ≤.05 and ≤.10 for the lower and upper bound, respectively, indicates good model fit), a comparative fit index (CFI) >.90 indicates fair model fit (>.95 indicates good fit), and a standardized root-mean-square residual (SRMR) <.08 indicates good model fit. According to Kline's less conservative criteria, acceptable model fit is indicated by a χ2/df <3, the lower-bound of the 90% RMSEA ≤.05 and upper bound ≤.10, a CFI >.90, and SRMR <.10. Bayesian information criteria (BIC) values were also interpreted with lower numbers representative of better fit. To better reflect the structure of the MSWDQ-23 in participants experiencing work difficulties and to improve factorability of the data, 16 cases with extremely low scores (<3) were removed prior to the CFA. Missing data for the MSWDQ-23 items on the sample of 229 participants was minimal (≤2.2%), and the data was missing completely at random (Little's MCAR test, χ2 = 409.94, df = 384, p = .174). The missing data was estimated using the expectation maximization method in SPSS prior to the CFA and validity analyses.
Floor and ceiling effects were calculated on the 229 participants. These effects were considered present if 15% of the participants achieved the highest or lowest score possible on the total MSWDQ-23 scale or its subscales (22). Internal consistency of the subscales was examined using Cronbach's α, with values ≥.70 and ≥.80 representing acceptable and excellent internal consistencies, respectively (43).
Construct validity of the MSWDQ-23 was examined using Pearson correlation analyses with alternative subscales included in the study (i.e., the MSQoL-54) and between the MSWDQ-23 subscales (i.e., factorial validity, a form of construct validity).The interpretation of correlations were guided by the recommendations of Cohen (44), where .10, .30, and .50 indicate small, moderate, and large effects, respectively. The relative magnitude of the correlations was used to establish convergence or divergence with alternative measures, with those at least moderate in size generally deemed to establish convergence. The concurrent validity of the MSWDQ-23 was examined using independent samples t-tests (one-tailed due to a priori directional hypothesis) for employment status, one-way analysis of variance (ANOVA) with Sidak correction to control for inflated alpha for MS type. IBM SPSS Version 28 (45) was used to conduct the analyses. Assumptions for these analyses were met, except where specified in the Results section.
3 Results
3.1 Floor and ceiling effects
No floor effects with the best possible score of zero on the MSWDQ-23 were present (5.2% of participants had scores of 0 and no participant had scores of 100). For the individual subscales, while no floor effects were present with the psychological/cognitive and physical barriers subscales (8.7% and 8.3%, respectively with best possible scores) a floor effect was present in the external barriers subscale, with 15.3% of participants indicating the best possible score of zero. There were no ceiling effects present in the total MSWDQ-23 or subscales.
3.2 Confirmatory factor analysis
An initial CFA produced the following statistics: χ2/df = 3.016, RMSEA = .098 (lower bound = .089, upper bound = .106), SRMR = 0.0736, CFI = 0.809, and BIC = 846.96, indicating a poor fit of the data. Following inspection of the modification indices, several conceptually linked error terms were correlated (19, 22). In the psychological/cognitive barriers subscale these included: “forgot what task”, “needed to be reminded” and “remember conversation”; and “employer not understanding” and “colleagues not supportive”. In the physical barriers subscale these included: “disturbances in bowel/bladder” and “feared incontinent”. In the external barriers subscale these included: “feared no longer support self” and “reduce work hours, reduced pay”. Correlating the error terms improved the model fit as follows: χ2/df = 1.979, RMSEA = .068 (lower bound = .059, upper bound = .077), SRMR = 0.0692, CFI = 0.910, and BIC = 613.347. These indices represent overall fair model fit for the data, thus supporting the structure of the MSWDQ-23. Modification indices pertaining to item loadings were also inspected to see if any removal would improve fit indices, particularly the lower bound of the RMSEA which remained slightly outside the requirements for good fit. The removal of items “perform to level expected” and “became sleepy” in the psychological/cognitive barriers subscale improved the fit further as follows: χ2/df = 1.796, RMSEA = .061 (lower bound = .050, upper bound = .072), SRMR = 0.0686, CFI = 0.931, and BIC = 483.957. However, given the very high correlation (r = .988) between the scores for the psychological/cognitive barriers subscale with and without these items, this improvement was determined to be negligible, hence supporting the inclusion of all 23 items in the scale. Table 2 shows factor loadings for the MSWDQ-23.
Correlations between the three subscales were large (psychological/cognitive barriers and physical barriers, r = .611; psychological/cognitive barriers and external barriers, r = .846; and physical barriers and external barriers, r = .596). Given the very large correlation between the psychological/cognitive barriers and external barriers, an alternative model with respective items for these subscales loading onto a single factor was conducted in CFA. However, this did not improve the fit of the model [χ2/df = 2.119, RMSEA = .073 (lower bound = .064, upper bound = .082), SRMR = 0.0692, CFI = 0.896, and BIC = 643.955].
A second-order CFA with all 23 items loading onto the three factors, and in turn, a further higher-order overall MSWDQ factor was also examined. Fit statistics for this model were identical to the first order model and were as follows: χ2/df = 1.979, RMSEA = .068 (lower bound = .059, upper bound = .077), SRMR = 0.0692, CFI = 0.910, and BIC = 613.347.
3.3 Internal consistency
Cronbach's α values for the MSWDQ-23 subscales are shown in Table 2. All subscales had excellent internal consistency. No removal of any item would substantially improve these internal consistency values. Cronbach's α was.94 for the full MSWDQ-23.
3.4 Construct validity
The Norwegian MSWDQ-23 physical, psychological/cognitive, and external barriers subscales, had large, small-to-moderate, and small positive relationships respectively with EDSS scores (46). Total MSWDQ-23 scores were moderately and positively related to EDSS. There were large relationships present between the MSWDQ-23 total and subscales and the physical and the mental health composite scores. There were moderate-to-large relationships present between Total MSWDQ-23 and psychological/cognitive barriers scores and employment status. Physical barriers and external barriers had a moderate and small relationship respectively with work status (%). Table 3 shows correlations with the alternative scales used in this study.
Table 3. Construct validity: Pearson correlations between MSWDQ-23 total and subscales correlations with alternative measures (N = 229).
3.5 Concurrent validity
MSWDQ total and subscale scores according to MS type, together with inferential statistical information, is shown in Table 4. While differences in MSWDQ-23 scores were not detected in the psychological/cognitive barriers and external barriers subscales, and the full MSWDQ-23, group differences were found in the physical barriers subscale. In particular, the participants with RRMS had significantly fewer physical work difficulties than both the SPMS and PPMS participants. There were no differences between SPMS and PPMS in physical barriers scores. MSWDQ total and subscale scores according to employment status, together with inferential statistic information, is shown in Table 5. The participants who were working over the previous 12 months had significantly fewer work difficulties than people who had not been working over the previous 12 months.
Table 5. Descriptive and inferential statistics for the MSWDQ-23 stratified by employment status (N = 229).
4 Discussion
The goal of the current study was to culturally adapt the MSWDQ-23 for the Norwegian population and to verify the three-factor structure and evaluate the psychometric properties of the Norwegian version of the MSWDQ-23. The Norwegian version of the MSWDQ-23 and its subscales showed an excellent internal consistency, similar to the original questionnaire (19) and previous validation studies (21–24, 27, 28). It may be concluded that the original 3-factor structure of the MSWDQ-23 are acceptable in the Norwegian-translated version of the scale. However, the fit of the data in the CFA would also suggest that the overall MSWDQ-23NV total scores are also interpretable. In addition, given the high correlation between the scales psychological/cognitive barriers and external barriers, and support for adequate model fit, these scales may be combined and interpreted together in the Norwegian Version.
It seems that in the Norwegian population, psychological and cognitive barriers are very much tied to external barriers. The causal direction of this relationship, however, is not known. In the Australian study (19), these correlation between these barriers was only .72 compared to.85 in the Norwegian study. Note that the prior Dutch-language validation study also exhibited high correlations, but the pattern of the relationships were slightly different (22). They had quite large relationships between physical and psychological (.84) and between physical and external (.91) barriers. Psychological and external barriers was correlated .76. All these relationships, nonetheless, are likely to reflect sampling differences rather than regional/population differences. At the end of the day, all subscales are very much related to each other regardless of region/population.
No ceiling effects were present in the total MSWDQ-23NV or subscales. There were floor effects present in the external barriers subscale, although scores for this subscale were on average higher than the other two subscales. The floor effect may reflect the possibility of a proportion of pwMS in the sample who are accessing benefits and the strong social support networks in the welfare system available to employed workers in Norway. For example, in Norway, government-related support includes up to one year of fully paid leave due to illness. These are extremely generous employment conditions that are not offered in many countries. Such increased social and financial support may mean there are minimal external factors affecting employment such as lacking the ability to maintain adequate home/work balance and an increased risk of reduced pay if hours are reduced, relative to both psychological/cognitive barriers and physical barriers. It is interesting nonetheless that scores for external barriers in an Australian cohort of pwMS are very similar (19). By comparison, sickness benefits in Australia are paid by an employer, and depending on the employer, may constitute only 5–10 days per year. Eighty-five percent of Norwegian individuals, however, did not demonstrate this floor effect, indicating that external barriers are still relevant for this population. Compared to a Dutch cohort of pwMS (22), it seems work difficulties in Norway are substantially higher. That could be a reflection of the higher age that was present in the current study compared to the Dutch study (52 vs. 43 years).
The Norwegian version of the MSWDQ-23 showed acceptable construct and concurrent validity. In particular, the MSWDQ-23NV subscales were related to HRQol subscales in the expected direction. The strongest of these relationships were between the psychological/cognitive barriers subscale and the mental health composite score of the MSQOL-54 and between the physical barriers subscale and the physical composite score of the MSQOL-54. Regarding concurrent validity (i.e., being able to distinguish current group or disease status), the MSWDQ-23NV differentiated RRMS from progressive MS types in the physical barriers subscale. Similar levels of difficulties were experienced in the psychological/cognitive domain as well as difficulties relating to external factors. The MSWDQ-23NV differentiated people who worked within the past year vs. those that did not. Considered together this would indicate that all difficulties may predict withdrawal from work, although it is interesting that RRMS experiences psychological and cognitive impact in the workplace just as much as the progressive MS types. Those with RRMS also experience difficulties with external factors. This would suggest that there is a universal need to target psychological/cognitive factors and external barriers in vocational remediation programs.
4.1 Strengths and limitations
A clear limitation of the present study is that we did not examine test–retest reliability, which is due to the selected cross-sectional design. However, prior studies have reported a high test–retest reliability for the MSWDQ-23 (21, 23, 28). Thus, there are indications of likely adequate test–retest reliability for the Norwegian version of the MSWDQ-23 but future studies should examine this. Moreover, we did not include healthy controls in our study, which would have helped us attribute the reported work difficulties to MS. Although one of the available MSWDQ-23 validation studies showed good discrimination (27), and notwithstanding the fact that the scale asks participants to report on difficulties that are attributable to their MS, the hypothesis that the reported difficulties in the Norwegian study extend beyond those experienced by healthy individuals was not tested. Finally, this study did not investigate the future employment status of the participants, which would have allowed us to confirm the predictive validity of this instrument. However, previous studies (19, 22) have demonstrated the predictive validity of the instrument for future employment.
A strength of the current study is that we used a confirmatory factor analysis technique to verify the three-factor model structure and evaluated it against both Kline (47) and Hu and Benter (41), documenting a fair fit. Moreover, an advantage of the current study was the inclusion of persons with all types of MS, low EDSS (2.81), and both employed and not employed pwMS. Additionally, the relatively large sample (n = 229) can be considered a strength given it is likely to be representative of the Norwegian MS population.
5 Conclusion
The Norwegian MSWDQ-23 is an internally consistent and valid instrument to measure perceived work difficulties in persons with all types of MS. The fit of the current data was fair, but the results suggest that the three subscales are strongly related. The MSWDQ-23NV can be considered a useful tool for health care professionals to assess self-reported work difficulties in persons with MS. Thus, it serves to provide tailored follow up to optimize work outcomes. The Norwegian MSWDQ-23 scale should be examined for test-retest reliability and considered implemented in the regular follow up at the MS-outpatient clinics in Norway to support employment maintenance.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by Regional Committee for Medical and Health Research Ethics, Norway (REK Nord 174837), and the Nordland Hospital Research Ethical Authority (project number 209). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
BN: Conceptualization, Data curation, Funding acquisition, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing. EA: Conceptualization, Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing. CH: Formal Analysis, Methodology, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. The study was funded by the Northern Norway Regional Health Authority (Grant nr 174837).
Acknowledgments
We thank the participants for their collaboration and time. Also, we would like to thank the neurologist Merethe Kalberg and the MS nurse Anne Lise Amundsen for their help with data collection and the physiotherapists Stine S. H. Dahl, Marianne Sivertsen and Hanne Fikke for their help in translation of the MSWDQ-23. Finally, we thank the Northern Norway Regional Health Authority for funding of the study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fresc.2024.1404723/full#supplementary-material
References
1. Dobson R, Giovannoni G. Multiple sclerosis–a review. Eur J Neurol. (2019) 26(1):27–40. doi: 10.1111/ene.13819
2. García-Domínguez JM, Maurino J, Martínez-Ginés ML, Carmona O, Caminero AB, Medrano N, et al. Economic burden of multiple sclerosis in a population with low physical disability. BMC Public Health. (2019) 19(1):609–8. doi: 10.1186/s12889-019-6907-x
3. Giovannoni G. Can We Afford not to Prevent MS-related disability? London, England: SAGE Publications Sage UK (2017).
4. Jones J. Global MS Employment Report: MS International Federation. The MS International Federation (2016). Available online at: https://www.msif.org/wp-content/uploads/2016/05/Global-MS-Employment-Report-2016.pdf
5. Kobelt G, Thompson A, Berg J, Gannedahl M, Eriksson J, Group MS, et al. New insights into the burden and costs of multiple sclerosis in Europe. Mult Scler. (2017) 23(8):1123–36. doi: 10.1177/1352458517694432
6. Miller A, Dishon S. Health-related quality of life in multiple sclerosis: the impact of disability, gender and employment status. Qual Life Res. (2006) 15(2):259–71. doi: 10.1007/s11136-005-0891-6
7. Svendsen B. High cost of MS to patients in Norway. Pharmacoeconomics Outcomes News. (2018) 802:16–5. doi: 10.1007/s40274-018-4907-1
8. Ernstsson O, Gyllensten H, Alexanderson K, Tinghög P, Friberg E, Norlund A. Cost of illness of multiple sclerosis-a systematic review. PLoS One. (2016) 11(7):e0159129. doi: 10.1371/journal.pone.0159129
9. Gyllensten H, Kavaliunas A, Murley C, Alexanderson K, Hillert J, Tinghög P, et al. Costs of illness progression for different multiple sclerosis phenotypes: a population-based study in Sweden. Mult Scler J Exp Transl Clin. (2019) 5(2):2055217319858383. doi: 10.1177/2055217319858383
10. Aarseth JH, Smedal T, Skår AB, Wergeland SB. The annual report 2022. In: Bergen H, editor. The Norwegian Multiple Sclerose Register and Biobank. Bergen: Haukeland University Hospital (2022). p. 32.
11. Grytten N, Torkildsen Ø, Myhr KM. Time trends in the incidence and prevalence of multiple sclerosis in Norway during eight decades. Acta Neurol Scand. (2015) 132:29–36. doi: 10.1111/ane.12428
12. Lunde HMB, Telstad W, Grytten N, Kyte L, Aarseth J, Myhr K-M, et al. Employment among patients with multiple sclerosis-a population study. PLoS One. (2014) 9(7):e103317. doi: 10.1371/journal.pone.0103317
13. Glad SB, Nyland H, Aarseth JH, Riise T, Myhr K-M. How long can you keep working with benign multiple sclerosis?. J Neurol Neurosurg Psych. (2011) 82(1):78–82. doi: 10.1136/jnnp.2010.210732
14. Grytten N, Skår AB, Aarseth JH, Assmus J, Farbu E, Lode K, et al. The influence of coping styles on long-term employment in multiple sclerosis: a prospective study. Mult Scler. (2017) 23(7):1008–17. doi: 10.1177/1352458516667240
15. Kavaliunas A, Wiberg M, Tinghög P, Glaser A, Gyllensten H, Alexanderson K, et al. Earnings and financial compensation from social security systems correlate strongly with disability for multiple sclerosis patients. PLoS One. (2015) 10(12):e0145435. doi: 10.1371/journal.pone.0145435
16. Forslin M, Fink K, Hammar U, von Koch L, Johansson S. Predictors for employment status in people with multiple sclerosis: a 10-year longitudinal observational study. Arch Phys Med Rehabil. (2018) 99(8):1483–90. doi: 10.1016/j.apmr.2017.12.028
17. Strober LB, Chiaravalloti N, DeLuca J. Should I stay or should I go? A prospective investigation examining individual factors impacting employment status among individuals with multiple sclerosis (MS). Work. (2018) 59(1):39–47. doi: 10.3233/WOR-172667
18. Honan CA, Brown RF, Hine DW, Vowels L, Wollin JA, Simmons RD, et al. The multiple sclerosis work difficulties questionnaire. Mult Scler. (2012) 18(6):871–80. doi: 10.1177/1352458511431724
19. Honan CA, Brown RF, Hine DW. The multiple sclerosis work difficulties questionnaire (MSWDQ): development of a shortened scale. Disabil Rehabil. (2014) 36(8):635–41. doi: 10.3109/09638288.2013.805258
20. Martínez-Ginés M, García-Domínguez J, Sarmiento M, Maurino J. Adaptación cultural al español del cuestionario sobre las dificultades para trabajar con esclerosis múltiple. Versión corta de 23 ítems (MSWDQ-23). Neurologia. (2019) 34(9):611–4. doi: 10.1016/j.nrl.2017.01.016
21. Martínez-Ginés ML, García-Domínguez JM, Forero L, Canal N, Rebollo P, Prefasi D, et al. Spanish validation of a specific measure to assess work-related problems in people with multiple sclerosis: the multiple sclerosis work difficulties questionnaire (MSWDQ-23). Mult Scler Relat Disord. (2018) 22:115–9. doi: 10.1016/j.msard.2018.04.003
22. van Egmond E, van Gorp D, Honan C, Heerings M, Jongen P, van der Klink J, et al. A Dutch validation study of the multiple sclerosis work difficulties questionnaire in relapsing remitting multiple sclerosis. Disabil Rehabil. (2019):1–10. doi: 10.1080/09638288.2019.1686072
23. Bakirtzis C, Artemiadis A, Nteli E, Boziki MK, Karakasi M-V, Honan C, et al. Greek validation study of the multiple sclerosis work difficulties questionnaire-23. Healthcare (Basel). (2021) 9(7):897. doi: 10.3390/healthcare9070897
24. Joly H, Lebrun-Frenay C, Brissart H. Questionnaire de difficultés au travail dans la sclérose en plaques : validation française du multiple sclerosis work difficulties questionnaire (MSWDQ). Pratique Neurol FMC. (2023) 14(4):195–7. doi: 10.1016/j.praneu.2023.10.001
25. Slavković S, Golubović Š, Nađ Č, Odović G, Honan C, Brkić-Jovanović N. Work status and factors affecting work engagement of people with multiple sclerosis. Med Pregl. (2017) 70(7-8):216–22. doi: 10.2298/MPNS1708216S
26. Ellenberger D, Friede T, Sterz C, Flachenecker P. Validation of the German Version of the Multiple Sclerosis Work Difficulties Questionnaire (MSWDQ). London: Multiple Sclerosis Journal, Sage Publications Ltd. (2015).
27. Kahraman T, Özdoğar AT, Honan CA, Ertekin Ö, Özakbaş S. The multiple sclerosis work difficulties questionnaire: translation and cross-cultural adaptation to Turkish and assessment of validity and reliability. Disabil Rehabil. (2019) 41(21):2556–62. doi: 10.1080/09638288.2018.1470262
28. Mirmosayyeb O, Shaygannejad V, Najdaghi S, Ghajarzadeh M. Psychometric properties of the Persian version of the multiple sclerosis work difficulties questionnaire (MSWDQ) questionnaire. Int J Prev Med. (2022) 13(1):94. doi: 10.4103/ijpvm.IJPVM_393_20
29. Boussaid H, Souissi A, Jarradi A, Gharbi A, Abida Y, Gargouri A, et al. Work difficulties evaluation in people with multiple sclerosis: a Tunisian study. Mult Scler Relat Disord. (2023) 80:105282. doi: 10.1016/j.msard.2023.105282
30. de la Maza SS, Maurino J, Borges M, Martín-Martínez J, Sotoca J, Alonso A, et al. Measuring productivity loss in early relapsing-remitting multiple sclerosis. Mult Scler Relat Disord. (2022) 58:103398. doi: 10.1016/j.msard.2021.103398
31. Lehmann AI, Rodgers S, Calabrese P, Kamm CP, Wyl V, Bauer GF. Relationship between job demands-resources and turnover intention in chronic disease–the example of multiple sclerosis. Stress Health. (2021) 37(5):940–8. doi: 10.1002/smi.3054
32. Honan CA, Brown RF, Batchelor J. Perceived cognitive difficulties and cognitive test performance as predictors of employment outcomes in people with multiple sclerosis. J Int Neuropsychol Soc. (2015) 21(2):156. doi: 10.1017/S1355617715000053
33. Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A, et al. Principles of good practice for the translation and cultural adaptation process for patient-reported outcomes (PRO) measures: report of the ISPOR task force for translation and cultural adaptation. Value Health. (2005) 8(2):94–104. doi: 10.1111/j.1524-4733.2005.04054.x
34. McDonald WI, Compston A, Edan G, Goodkin D, Hartung H-P, Lublin FD, et al. Recommended diagnostic criteria for multiple sclerosis: guidelines from the international panel on the diagnosis of multiple sclerosis. Ann Neurol. (2001) 50(1):121–7. doi: 10.1002/ana.1032
35. Kurtzke JF. Rating neurologic impairment in multiple sclerosis. Neurology. (1983) 33:1444–52. doi: 10.1212/WNL.33.11.1444
36. Vickrey BG, Hays RD, Genovese BJ, Myers LW, Ellison GW. Comparison of a generic to disease-targeted health-related quality-of-life measures for multiple sclerosis. J Clin Epidemiol. (1997) 50(5):557–69. doi: 10.1016/S0895-4356(97)00001-2
37. Vickrey B, Hays R, Harooni R, Myers L, Ellison G. A health-related quality of life measure for multiple sclerosis. Qual Life Res. (1995) 4(3):187–206. doi: 10.1007/BF02260859
39. Enders CK. Applying the bollen-stine bootstrap for goodness-of-fit measures to structural equation models with missing data. Multivariate Behav Res. (2002) 37(3):359–77. doi: 10.1207/S15327906MBR3703_3
40. Bollen KA, Stine RA. Bootstrapping goodness-of-fit measures in structural equation models. Sociol Methods Res. (1992) 21(2):205–29. doi: 10.1177/0049124192021002004
41. Hu L-t, Bentler PM. Fit indices in covariance structure modeling: sensitivity to underparameterized model misspecification. Psychol Methods. (1998) 3(4):424. doi: 10.1037/1082-989X.3.4.424
42. Kline RB. Principles and Practice of Structural Equation Modeling. 2nd edn New York: Guilford Press (2005).
43. Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. (1951) 16:297–334. doi: 10.1007/BF02310555
44. Cohen J. Set correlation and contingency tables. Appl Psychol Meas. (1988) 12(4):425–34. doi: 10.1177/014662168801200410
46. Cohen J. Statistical Power Analysis. Hillsdale, NJ: Lawrence Erlbaum Associates Publishers (1988).
Keywords: multiple sclerosis, work, employment status, validation studies, surveys, questionnaires
Citation: Normann B, Arntzen EC and Honan CA (2024) Barriers for work in people with multiple sclerosis: a Norwegian cultural adaptation and validation of the short version of the multiple sclerosis work difficulties questionnaire. Front. Rehabil. Sci. 5:1404723. doi: 10.3389/fresc.2024.1404723
Received: 21 March 2024; Accepted: 29 October 2024;
Published: 20 November 2024.
Edited by:
Manuela Altieri, University of Campania Luigi Vanvitelli, ItalyCopyright: © 2024 Normann, Arntzen and Honan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Britt Normann, britt.normann@nord.no