Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 06 December 2023
Sec. Quantitative Psychology and Measurement
This article is part of the Research Topic Neuropsychological Testing: From Psychometrics to Clinical Neuropsychology View all 6 articles

Psychometrics and validation of the EQ-5D-5L instrument in individuals with ischemic stroke in Lithuania

  • Laboratory of Behavioral Medicine, Neuroscience Institute, Lithuanian University of Health Sciences, Palanga, Lithuania

Background: Experiencing stroke is associated with deterioration in health-related quality of life (HRQL). One of the generic tools used for HRQL assessment is the EuroQol instrument of five dimensions and five levels (EQ-5D-5L), which has not yet been validated in Lithuania. This study aimed to evaluate validity, reliability, and factor structure of the EQ-5D-5L instrument in a sample of Lithuanian individuals at the end of the first week after experiencing ischemic stroke (IS).

Methods: The study had a cross-sectional design, including 134 individuals [61.9% men and 38.1% women; median (IQR) age was 66 years (59–73) years, in the final analysis]. Alongside the EQ-5D-5L, psychological distress was evaluated using the Hospital Anxiety and Depression Scale (HADS), Patient Health Questionnaire-9 (PHQ-9), and Generalized Anxiety Disorder Assessment-7 (GAD-7); neurological impairment with the National Institutes of Health Stroke Scale (NIHSS); and functional independence with the Barthel index (BI). Confirmatory factor analysis (CFA) was performed for validation of the factor structure.

Results: The internal consistency of the EQ-5D-5L instrument was 0.81. A significant ceiling effect (17.2%) of the descriptive part of the EQ-5D-5L was detected. The convergent validity of the EQ-5D-5L descriptive system was confirmed, with significant correlations with the other scales used, except for the visual analog scale. The two-factor (“physical” and “emotional”) model was confirmed by CFA, with acceptable fit [root mean square error of approximation (RMSEA) = 0.045, RMSEA 90% CI = 0.000–0.145; comparative fit indices (CFI) = 0.996; non-normal fit index (NFI) = 0.983; Tucker–Lewis Index (TLI) = 0.936; χ2/df = 1.27)].

Conclusion: This study provides information on the psychometric properties of the EQ-5D-5L instrument in Lithuanian individuals, showing that the EQ-5D-5L descriptive system is a reliable and valid tool for HRQL assessment. The Lithuanian version of the descriptive part of the EQ-5D-5L instrument is best expressed as a two-factor model, estimating the physical and emotional dimensions of HRQL in individuals who have experienced IS.

1 Introduction

HRQL is recognized as of paramount importance in health outcomes (Kaplan, 1990; Bunevicius et al., 2022). In one study, a single question about self-rated health has been shown to be strongly associated with mortality at follow-up (DeSalvo et al., 2006). Although there are some problems arising with the universal definition of HRQL (Karimi and Brazier, 2016), it is usually described as the daily level of functioning and perceived health-associated wellbeing on a personal level (Stenman et al., 2010). Therefore, the multifaceted construct of HRQL is characterized subjectively by an individual as the impact of illness and its treatment on physical, mental, and social domains of functioning (Revicki et al., 2014). It is assumed that the evaluation of HRQL enables better patient-directed healthcare than the traditional biomedical model, which is focused primarily on diagnosis and treatment (Kaplan, 2003).

Although there are many HRQL instruments implemented in practice, according to previous research, there is no “best” or “worst” instrument (Coons et al., 2000); the choice should depend on the purpose of the measurement. The attractiveness of each instrument depends on the ease of use, its psychometric properties, free availability, and usefulness in the economic assessment of public health interventions. One such instrument belongs to one of the most widely used generic methods of HRQL assessment—the EQ-5D set of instruments (Pequeno et al., 2020). The latest version of the EQ-5D for adults is the EQ-5D-5L, which has better psychometric properties (increased reliability and sensitivity) than its precedent, the EQ-5D-3L (Feng et al., 2021). Regarding the psychometric properties of the EQ-5D-5L, this instrument is valid and reliable for health status assessment across a broad spectrum of populations, with acceptable responsiveness. However, it has some limitations, including the tendency for a ceiling effect and the lack of positive health aspects (Feng et al., 2021).

According to the EQ-5D-5L factor structure, at least one study has suggested that it consists of two latent factors encompassing physical and psychological functioning (Gao et al., 2019), but other studies suggested one-factor structure (Bilbao et al., 2022). However, some concern has recently been raised over the scale's lack of social dimension (Chen and Olsen, 2020). Despite the aforementioned limitations, this scale is used widely due to its simplicity, free-of-charge use for non-commercial reasons, availability in many languages, and applicability for various conditions (Lau et al., 2022).

Stroke, as one of the most frequent worldwide causes of disability (Campbell and Khatri, 2020), is associated with reduced post-stroke HRQL (Cadilhac et al., 2010; Gall et al., 2010; Mar et al., 2015; Chen et al., 2019). In the United States, it has been shown that the consequences of stroke significantly impair the HRQL of respondents who are not committed to an institution compared with those without stroke (Xie et al., 2006). Another study, based on a population in northern Manhattan study, showed a significant worsening of HRQL independent of various risk factors, including functional independence, during the 5-year follow-up (Dhamoon et al., 2010). On the contrary, a study conducted in Lithuania with stroke survivors after 3 and 12 months using the 12-item Short Form Survey of Health showed that the survivors had poorer HRQL than the controls but showed remarkable improvement over time (Kranciukaite-Butylkiniene, 2014). Furthermore, hyperacute recanalization therapy in acute ischemic stroke (IS) is not clearly related to better long-term HRQL, despite better functional outcomes (Kainz et al., 2021). Based on the results of the mentioned studies, it is important to continue research on impaired post-stroke HRQL in order to better understand this phenomenon and thus make suggestions for HRQL improvement-directed interventions.

In terms of HRQL for stroke patients, the validity of the EQ-5D-5L instrument was recently demonstrated for individuals from Poland after stroke (Golicki et al., 2015). Another study performed in Taiwan proved the validity of this instrument for HRQL assessment in patients after stroke undergoing rehabilitation (Chen et al., 2016). Furthermore, a systematic review of the instruments for assessing self-reported HRQL after stroke showed that the EQ-5D instrument was the best choice (Cameron and Wales, 2022).

Given that the EQ-5D-5L has not been validated in Lithuania, this study focused on the psychometric properties, including applicability, internal consistency, validity, and factor structure of this instrument in Lithuanian residents who had experienced IS.

2 Materials and methods

2.1 Study procedure

This study was a part of a research described previously (Burkauskas et al., 2014). Individuals who had experienced acute IS and were admitted to the three different Lithuanian health institutions (Klaipeda University Hospital, Hospital of the Lithuanian University of Health Sciences Kauno Klinikos, and Klaipeda Seamen's Hospital) were invited by a neurologist in the emergency room on duty to participate in the study during two 1-year periods, starting in 2013 and 2016, respectively. In total, 612 consecutive individuals were asked to participate in this study.

The inclusion criteria were: (1) ages 18–80 years; (2) current diagnosis of acute IS as described by the World Health Organization criteria (Hatano, 1976), affirmed by neurovisual imaging with brain-computer or magnetic resonance tomography; and (3) capable of communication and cognition, according to a Mini-Mental State Exam (MMSE) score of more than 19, assessed at the end of the first week. The exclusion criteria were: (1) co-diagnosis of severe pathology (infection, liver and/or renal insufficiency, and malignancy); (2) noted thyroidopathy and/or intake of thyroid-affecting substances; and (3) arrival 2 days later after the onset of IS.

The following characteristics of the individuals were assessed in the emergency department: (1) age; (2) sex; (3) body mass index; (4) presence of premorbid disability, defined as dependency in daily activity according to a Modified Rankin Scale (mRS) score of ≥3; (5) use of antithrombotic drugs; (6) chemical thrombolysis; and (7) stroke risk factors, including arterial hypertension, atrial fibrillation, smoking, diabetes mellitus, previous cerebral ischemic event, and experienced myocardial infarction. In addition, the individuals' neurological impairment was assessed using the National Institutes of Health Stroke Scale (NIHSS) (Spilker et al., 1997).

At the end of their hospital stay, all study individuals were asked to fill out questionnaires in paper form: (1) EQ-5D-5L (Herdman et al., 2011) for HRQL and (2) Hospital Anxiety and Depression Scale (HADS) (Zigmond and Snaith, 1983), Patient Health Questionnaire-9 (PHQ-9) (Kroenke et al., 2001), and Generalized Anxiety Disorder assessment-7 (GAD-7) (Spitzer et al., 2006) for psychological distress assessment. At this time point after IS, individuals were checked for functional independence according to the Barthel index (BI) (Mahoney and Barthel, 1965). At the end of the first year of the study, participants were asked to fill in the EQ-5D-5L once more.

For a sufficient sample, power analysis was based on the suggested rule—at least 10 respondents to 1 scale item (Boateng et al., 2018), and it was more than 50 individuals in our case. Figure 1 shows the selection of individuals for the study. In total, 134 individuals were included in the final analysis.

FIGURE 1
www.frontiersin.org

Figure 1. Recruitment process.

The study was conducted in accordance with the Declaration of Helsinki and met the requirements of the Regional Biomedical Research Ethics Committee, with the assigned licenses P1-BE-2-11/2013 and P2-BE-2-11/2013. Individuals were included only after giving written consent for participation in this study.

2.2 Measurements and applied questionnaires

2.2.1 Modified rankin scale

This global disability-assessing instrument is used to evaluate dependence in daily life activities among individuals with experienced stroke. Despite the fact that this scale is weighted more toward physical disability, it captures (indirectly) other attributes essential to daily activity, including wellbeing, socialization, mood, and cognitive status. The estimate of mRS ranges from 0 (no disability at all) to 6 (dead). The reliability of this scale, including inter-rater and test–retest, lies within moderate and strong limits, respectively (Banks and Marotta, 2007). This scale shortage is associated with its low stroke specificity because it automatically includes other disability causes, such as a previous bone fracture (Kasner, 2006).

2.2.2 National institutes of health stroke scale

The NIHSS scale for quantification of stroke-related neurological impairment consists of 11 neurological examination categories, scored from 0 to 4, with a total score from 0 to 42 (Spilker et al., 1997). On this scale, a higher score indicates more pronounced neurological impairment. The reliability of this scale lies within reasonable limits (Lyden, 2017). To use this scale, one needs special training to reach sufficient reliability and validity. Another shortage of this scale is its inappropriateness for self-report usage or by telephone (Kasner, 2006).

2.2.3 Mini-mental state exam

MMSE is a screening tool used to evaluate cognitive functioning including its five domains (orientation, memory, attention, recollection, and language), with a score rating from 0 to 30 (Folstein et al., 1975). This scale is characterized by better sensitivity for capturing moderate and higher cognitive impairment than mild cognitive impairment (Tombaugh and McIntyre, 1992).

2.2.4 Barthel index

BI was created for the assessment of independence in activities of daily living (Mahoney and Barthel, 1965). This instrument is composed of 10 items, with four possible choices scored as 0, 5, 10, or 15. The possible scores range from 0 to 100. Higher values indicate better functional independence. The reliability of this scale was 0.98 when assessed with Cronbach's α (Shinar et al., 1987). The limitation of this scale is its “ceiling effect” because it does not include many aspects that are important for daily activity, such as emotional disturbances, cognition, and language among others (Kasner, 2006).

2.2.5 EQ-5D-5L

The EQ-5D-5L instrument is composed of two parts, including a descriptive part made up of five different health dimensions (mobility, self-care, usual activities, pain/discomfort, and anxiety/depression) with five possible options and a thermometer-like visual analog scale (EQ-VAS) numbered from 0 (“worst” HRQL) to 100 (“best” HRQL) to measure overall health (Herdman et al., 2011). The self-described descriptive part of the EQ-5D-5L can be expressed as one of 3,125 different health states, from “No” (“best” HRQL or level 1) to “Extreme” (“worst” HRQL or level 5) problems in all dimensions, or expressed as one index value (EQ index), ranging from slightly <0–1, with higher values indicating a better HRQL. The EQ index mirrors how positive or negative the health state is, depending on the preferences of the country of study. The EQ-VAS is scored by the respondent marking “X” on the scale and separately clarifying the marked point with a number indicating their current health. The self-filled paper version of the EQ-5D-5L in the Lithuanian language has been available since 2014. The self-complete version of the Lithuanian EQ-5D-5L paper was used with formal consent from EuroQol Group with the assigned number 53563. As there is no calculated country-specific EQ index value set for the Lithuanian population, the set from the closest available country is selected, which is from the German population (Ludwig et al., 2018). In the current study, Cronbach's alpha for the measurement was 0.81, while McDonald's Omega was 0.83.

2.2.6 Hospital anxiety and depression scale

The HADS, a self-report screening scale, is composed of two parts, assigned to depression and anxiety severity assessment, respectively (Zigmond and Snaith, 1983). Each part has seven items with four possible options ranging from 0 to 3 according to the psychological distress experienced during the past week, thus generating a score from 0 to 21, with a higher score indicating more pronounced psychological distress. According to previous studies, Cronbach's α of the anxiety part varied from 0.68 to 0.83, while the depression part ranged from 0.67 to 0.90 (Bjelland et al., 2002). The shortcoming of HADS is its dependence on self-reporting which could be impaired because of language and emotional disturbances. A validated Lithuanian version of this instrument (Bunevicius, 1991) was used with permission from the “GL Education Group”.

2.2.7 Patient health questionnaire-9

The PHQ-9, a self-report questionnaire for estimating the severity of depression, is composed of nine questions, each of them reflecting depression symptoms in the past 2 weeks, rated from 0 to 3 (Kroenke et al., 2001). The total score can range from 0 to 27, with higher scores reflecting more severe depression. At the end of the questionnaire, there is an additional optional question for global functional impairment assessment. Recently, this scale was validated in a Lithuanian student sample and individuals with anxiety and mood disorders with an estimated reliability (Cronbach's α) of 0.86 (Pranckeviciene et al., 2022; Stanyte et al., 2023). Currently, the Lithuanian version is available on the screener's website (https://www.phqscreeners.com/select-screener). The limitation of this scale is its dependence on intact respondents' communication.

2.2.8 Generalized anxiety disorder-7

The GAD-7 questionnaire was developed for generalized anxiety screening and assessment of its severity (Spitzer et al., 2006). This instrument is composed of seven questions, reflecting anxiety symptoms during the past 2 weeks, with four possible answers ranging from “not at all” to “nearly every day”, scored 0 and 3, respectively. Thus, the overall GAD-7 score can range from 0 to 21, with a higher score showing more pronounced symptoms of anxiety. Recently, in Lithuania, the GAD-7 was validated as a first-line anxiety screening tool (Pranckeviciene et al., 2022; Stanyte et al., 2023). For this instrument, Cronbach's α was 0.91. Lithuanian form of instrument is available on the website (https://www.phqscreeners.com/select-screener). The limitation of this scale is its dependence on intact respondents' communication.

2.3 Statistical analysis

Statistical analysis was performed using IBM SPSS Statistics for Windows (version 28) (SPSS Inc, Chicago, IL, USA) and IBM SPSS AMOS 28 (IBM Corp., Armonk, NY, USA). Quantitative data were expressed as the mean (±standard deviation, SD) or median (interquartile range, IQR), with normality checked using the Kolmogorov–Smirnov test. Qualitative data were expressed in number (%).

The reliability of the used questionnaires is expressed as Cronbach's α and McDonald's omega (Hayes and Coutts, 2020). Cronbach's α coefficient estimates between 0.70 and 0.95 were considered to be acceptable (Tavakol and Dennick, 2011). Both the ceiling and floor effects of the EQ-5D-5L health profile, with scores of level “1” or “5” in all dimensions, EQ index, EQ-VAS, HADS for depression and anxiety, HADS total, PHQ-9, and GAD-7 scores, were reported as the proportion of individuals reporting the highest and lowest possible estimates, respectively. A questionnaire was considered to show a ceiling or floor effect if at least 15% of respondents scored the highest or lowest achievable score (Terwee et al., 2007).

The convergent evidence for the EQ-5D-5L, including the separate dimensions of this scale, the EQ index and the EQ-VAS, with other used self-reported questionnaires (BI and NIHSS), was evaluated using Spearman's correlation coefficient. The closeness of co-variation was defined according to the value of the correlation coefficient: ≤ 0.30 as negligible, 0.31–0.50 as low, 0.51–0.70 as moderate, 0.71–0.90 as high, and 0.91–1.00 as very high (Mukaka, 2012).

Confirmatory factor analysis was performed for validation of the factor structure considered for one (Bilbao et al., 2022) and two factors (Santiago et al., 2021). Analysis of Moment Structures (AMOS) 27.0 software was used to test the model of the EQ-5D-5L using CFA. The proposed thresholds for the CFA fit indices were: CFI > 0.90 adequate and >0.95 good; TLI > 0.90 adequate and >0.95 good; NFI > 0.90 adequate and >0.95 good; RMSEA < 0.08; and χ2/df with the desired range of 2–5 (Hooper et al., 2008; Brown, 2015). In addition, standardized coefficients for each EQ-5D-5L item were calculated.

The dimensions of the EQ-5D-5L in stroke patients at baseline and after a year were compared using the Wilcoxon signed-rank test. Changes were interpreted according to the Pareto Classification of Health Change (Devlin et al., 2010).

3 Results

Table 1 shows the basic characteristics of study participants. Table 2 shows the main identified characteristics of the used scales. Estimates of the reliability coefficient were within acceptable limits for all scales, except for the HADS depression scale, for which this was marginal (Cronbach's α = 0.699). The ceiling effect of the EQ-5D-5L health profile with a full health state of “11111” was highlighted at a significant level in 17.2% of all respondents. In contrast, no floor effect was detected (health state of “55555”). Regarding the EQ index, alongside the same ceiling estimate for the EQ-5D-5L health profile, the floor effect was observed in 0.7% of all respondents. Ceiling and floor effects of the EQ-VAS were observed in 0.7 and 1.5% of individuals, respectively. Of the other scales for the evaluation of psychological distress, only the GAD-7 showed a significant ceiling effect, with a fixed estimate of 41.7%. A significant floor effect was observed for the BI (23.5%).

TABLE 1
www.frontiersin.org

Table 1. Characteristics of all study patients.

TABLE 2
www.frontiersin.org

Table 2. Characteristics of the scales used in the study population (n = 134).

The convergent validity of the EQ-5D-5L was analyzed, and its correlation with other variables is presented in Table 3. A positive but low correlation was established between the EQ-5D-5L mobility dimension and HADS depression (r = 0.337, p < 0.001), HADS total (r = 0.328, p < 0.001), GAD-7 (r = 0.300, p = 0.006), and NIHSS (r = 0.413, p < 0.001); between the EQ-5D-5L self-care dimension and NIHSS (r = 0.483, p < 0.001); between the EQ-5D-5L usual activity dimension and HADS total (r = 0.306, p < 0.001) and NIHSS (r = 0.472, p < 0.001); between the EQ-5D-5L pain/discomfort dimension and PHQ-9 (r = 0.410, p < 0.001) and GAD-7 (r = 0.312, p = 0.004); and between the EQ-5D-5L anxiety/depression dimension and HADS depression (r = 0.393, p < 0.001), HADS anxiety (r = 0.438, p < 0.001), HADS total (r = 0.495, p < 0.001), PHQ-9 (r = 0.338, p < 0.001), and GAD-7 (r = 0.338, p < 0.001). A statistically significant (p < 0.001), moderate, negative correlation was found between the EQ-5D-5L mobility (r = −0.695, p < 0.001) and usual activity dimensions (r = −0.663, p < 0.001), and a high negative correlation was found between the self-care dimension (r = −0.756, p < 0.001) and the BI. The correlation between the EQ index and HADS depression (r = −0.405, p < 0.001), HADS anxiety (r = −0.339, p < 0.001), HADS total (r = −0.443, p < 0.001), PHQ-9 (r = −0.411, p < 0.001), GAD-7 (r = −0.392, p < 0.001), and NIHSS (r = −0.371, p < 0.001) was low and negative but positive and moderate with BI (r = 0.612, p < 0.001). The correlations between other variables were at a negligible correlation level and/or statistically insignificant.

TABLE 3
www.frontiersin.org

Table 3. Convergent evidence of the EQ-5D-5L with HADS, PHQ-9, GAD-7, NIHSS, and Barthel Index in the overall sample (n = 134).

Table 4 shows that the fit of the unidimensional structure was mixed since RMSEA (>0.08) had unacceptable values. On the other hand, the fit of the two-dimensional structure was excellent since both CFI (>0.95) and RMSEA (<0.08) had good values. The two-factor model showed an acceptable fit (RMSEA = 0.045, 90% CI = 0.000–0.145; CFI = 0.996; NFI = 0.983; TLI = 0.991; χ2/df = 1.27).

TABLE 4
www.frontiersin.org

Table 4. Confirmatory factor analysis of two measurement models of EQ-5D-5L.

The results supporting convergent evidence between isolated factors from the EQ-5D-5L and other applied measures are presented in Table 5, expressed as correlations. Factor 1 (physical) was positively and significantly (0.201–0.377, p < 0.05) correlated with the HADS depression, HADS total, PHQ-9, and NIHSS within low correlation limits but negatively (−0.708, p < 0.001) and highly correlated with BI. Additionally, a positive, low correlation (0.362–0.478, p < 0.001) was established between factor 2 (emotional) and HADS anxiety, HADS depression, PHQ-9, and GAD-7, and a high correlation was established with HADS total (p < 0.001). Standardized coefficients for EQ-5D-5L items ranged from 0.55 (anxiety/depression), 0.62 (pain discomfort), 0.82 (mobility), and 0.87 (activities) to 0.92 (self-care).

TABLE 5
www.frontiersin.org

Table 5. Convergent evidence of the factors of EQ-5D-5L with HADS, PHQ-9, GAD-7, NIHSS, and Barthel Index in the overall sample.

After 1 year of IS, the EQ-5D-5L data were available for 117 of the included individuals. The comparison of EQ-5D-5L dimensions between two different time points is shown in Table 6. Significant changes were observed in the mobility (p = 0.013) and anxiety/depression (p < 0.001) dimensions.

TABLE 6
www.frontiersin.org

Table 6. Descriptive statistics of the EQ-5D-5L dimensions in stroke patients at baseline and after a year.

4 Discussion

Our results indicate that the descriptive EQ-5D-5L system could be used as a reliable and valid tool for HRQL assessment in individuals living in Lithuania during their hospitalization period due to IS. Furthermore, the presented results suggest the presence of two EQ-5D-5L factors in individuals who have experienced IS.

This study establishes that the EQ-5D-5L health profile shows no floor effect but has a significant ceiling effect. This is consistent with the ceiling effect described in the post-stroke population in Taiwan, which was even higher (20%) (Chen et al., 2016). Another study, which included native Polish speakers, found a much lower ceiling effect of 5.6% (Golicki et al., 2015). In general, it is agreed that the EQ-5D-5L is prone to a large ceiling effect because of its nature in measuring more aspects of negative health than positive health (Feng et al., 2021). In addition, the tendency for more positive HRQL self-evaluation in Lithuania may be associated with cultural and historical (post-Soviet) aspects, such as denial of psychological distress (Gailiene, 2021). In terms of the EQ index and EQ-VAS, the ceiling and floor effects were non-significant.

The convergent validity of the EQ-5D-5L health profile justifies the identified significant correlations between the anxiety/depression dimension and all other used scales for measuring psychological distress, as well as between the pain/discomfort dimension and PHQ-9 and GAD-7. EQ-5D-5L dimensions such as mobility, self-care, and usual activities correlated more with scales that included a mobility component, namely, the NIHSS scale, and even with BI. In addition, the latter EQ-5D-5L dimensions were correlated with the HADS total, and the mobility dimension was correlated with HADS depression and GAD-7. The EQ index showed a significant correlation with all included instrument scores, adding additional justification for the convergent validity of the descriptive EQ-5D-5L system. As for EQ-VAS, no significant correlations point to unjustified convergent validity of this EQ-5D-5L component. An established difference could be attributed to the EQ-5D-5L health profile and the EQ index to social perspectives and EQ-VAS to personal perspectives. Furthermore, another explanations could be that the EQ-VAS is a wider construct than the EQ-5D-5L health profile; misinterpretation of the EQ-VAS filling instructions; and difficulty in understanding this two-pole scale (Feng et al., 2014), especially keeping in mind that our study population consisted of individuals with an organically injured brain—the substrate for cognition. In addition, the study from Taiwan did not show EQ-VAS power for predicting rehabilitation outcomes after stroke (Kainz et al., 2021).

Our study revealed the existence of two factors of the EQ-5D-5L, which is in line with a study exploring the validity of this instrument among individuals with heart disease (Gao et al., 2019). The latter study separated only the EQ-5D-5L anxiety/depression dimension into the second factor, while our results additionally identified the pain/discomfort dimension. In our study, we highlighted that the first factor, composed of EQ-5D-5L mobility, self-care, and usual activity dimensions, could be attributed to the physical component of this scale, while the other two dimensions—pain/discomfort and anxiety/depression—could be attributed to the emotional one. According to our results, research from Australia with indigenous people found identical EQ-5D-5L two-dimensional latent factor composition (Santiago et al., 2021). On the other hand, in Spain, evaluating psychometrics of this instrument in individuals with depression showed uni-dimensionality of latent factors (Bilbao et al., 2022). Different results could be attributed to different clinical entities (stroke, strictly organic brain disease with physical and emotional consequences, vs. depression, with a more pronounced emotional component).

Convergent analysis of revealed factors substantiated their relevance, with a significant correlation between the first factor and NIHSS and BI and between the second factor and applied questionnaires dedicated to psychological distress assessment (HADS, PHQ-9, and GAD-7). Here, the low positive correlation between NIHSS and the first factor could be attributed to differences in the evaluation of NIHSS and EQ-5D-5L in time and less sensitivity of the latter measure to neurologic deficits evaluated with NIHSS such as neglect and visual disturbances (van der Ende et al., 2023).

Finally, our results showed that HRQL was not static after stroke. An unadjusted analysis of the EQ-5D-5L health profile confirmed meaningful changes in responses to the mobility and anxiety/depression dimensions. Here, mobility improved, but anxiety/depression deteriorated.

5 Strengths, limitations, and applications

The strengths of the present study are the participation of three different centers, a large enough sample size, and the use of validated scales. The limitations of the study were the exclusion of individuals with communication disorders, the unavailability of radiological data related to stroke volume and place, and the lack of comparisons made with other HRQL instruments. This study further expands the territory of usage of the EQ-5D-5L instrument for HRQL assessment in individuals after IS, adding the country of Lithuania. This validated instrument creates an opportunity for further clinical and economic research dedicated to improving IS-associated HRQL in Lithuania.

6 Conclusion

This study adds knowledge of the psychometric properties of the EQ-5D-5L instrument in individuals who have experienced IS in Lithuania. The research confirmed that the EQ-5D-5L instrument and its derivative EQ index are a valid and reliable tool for HRQL assessment in individuals at the end of the first week after IS. In addition, the analysis revealed two factors behind the EQ-5D-5L health profile, with possible physical and emotional dimensions. The data did not support the validity of overall health expressed as EQ-VAS scoring in these individuals. Our study supports further research using the EQ-5D-5L instrument for HRQL assessment in individuals who have experienced stroke.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by Regional Biomedical Research Ethics Committee (Permission Numbers: BE-2-11/2013; P2-BE-2-11/2013). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

ST: Investigation, Methodology, Writing—original draft. JB: Investigation, Methodology, Writing—review & editing. AP: Methodology, Writing—review & editing. NK: Project administration, Writing—review & editing. NM: Conceptualization, Funding acquisition, Resources, Writing—review & editing.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was funded by a Grant (No. S-MIP-23-103) from the Research Council of Lithuania.

Acknowledgments

The authors would like to thank the patients who participated in the study.

Conflict of interest

JB, is a consultant at Cronos and Saulius Taroza, and reports personal fees from Berlin Chemie Menarini Baltic.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Banks, J. L., and Marotta, C. A. (2007). Outcomes validity and reliability of the modified Rankin scale: implications for stroke clinical trials: a literature review and synthesis. Stroke 38, 1091–1096. doi: 10.1161/01.STR.0000258355.23810.c6

PubMed Abstract | CrossRef Full Text | Google Scholar

Bilbao, A., Martín-Fernández, J., García-Pérez, L., Mendezona, J. I., Arrasate, M., Candela, R., et al. (2022). Psychometric properties of the EQ-5D-5L in patients with major depression: factor analysis and Rasch analysis. J. Ment. Health 31, 506–516. doi: 10.1080/09638237.2021.1875422

PubMed Abstract | CrossRef Full Text | Google Scholar

Bjelland, I., Dahl, A. A., Haug, T. T., and Neckelmann, D. (2002). The validity of the hospital anxiety and depression scale. An updated literature review. J. Psychosom. Res. 52, 69–77. doi: 10.1016/S0022-3999(01)00296-3

CrossRef Full Text | Google Scholar

Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., and Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioral research: a primer. Front. Public Health 6, 149. doi: 10.3389/fpubh.2018.00149

PubMed Abstract | CrossRef Full Text | Google Scholar

Brown, T. A. (2015). Confirmatory Factor Analysis for Applied Research. New York, NY: Guilford Publications.

Google Scholar

Bunevicius, A., Donovan, L., and Sheehan, J. (2022). Health related quality of life trajectories after stereotactic radiosurgery for brain metastases: a systematic review. J. Neurooncol. 159, 319–331. doi: 10.1007/s11060-022-04067-8

CrossRef Full Text | Google Scholar

Bunevicius, R. Z. S. (1991). Correlations between MMPI and HAD scale. Psychol. Res. Arch. Lithuan. Univ. 11, 95–102. doi: 10.15388/Psichol.1991.11.9062

CrossRef Full Text | Google Scholar

Burkauskas, J., Mickuviene, N., Brozaitiene, J., Staniute, M., Podlipskyte, A., Rastenyte, D., et al. (2014). Gene-environment interactions connecting low triiodothyronine syndrome and outcomes of cardiovascular disease (GET-VASC): study protocol. Biol. Psychiatry Psychopharmacol. 16, 66–73.

Google Scholar

Cadilhac, D. A., Dewey, H. M., Vos, T., Carter, R., and Thrift, A. G. (2010). The health loss from ischemic stroke and intracerebral hemorrhage: evidence from the North East Melbourne Stroke Incidence Study (NEMESIS). Health Qual Life Outcomes 8, 49. doi: 10.1186/1477-7525-8-49

PubMed Abstract | CrossRef Full Text | Google Scholar

Cameron, L. J., and Wales, K. (2022). Self-reported quality of life following stroke: a systematic review of instruments with a focus on their psychometric properties. Qual. Life Res. 31, 329–342. doi: 10.1007/s11136-021-02944-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Campbell, B. C. V., and Khatri, P. (2020). Stroke. Lancet 396, 129–142. doi: 10.1016/S0140-6736(20)31179-X

CrossRef Full Text | Google Scholar

Chen, G., and Olsen, J. A. (2020). Filling the psycho-social gap in the EQ-5D: the empirical support for four bolt-on dimensions. Qual. Life Res. 29, 3119–3129. doi: 10.1007/s11136-020-02576-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, P., Lin, K.-C., Liing, R.-J., Wu, C.-Y., Chen, C.-L., and Chang, K.-C. (2016). Validity, responsiveness, and minimal clinically important difference of EQ-5D-5L in stroke patients undergoing rehabilitation. Qual Life Res. 25, 1585–1596. doi: 10.1007/s11136-015-1196-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, Q., Cao, C., Gong, L., and Zhang, Y. (2019). Health related quality of life in stroke patients and risk factors associated with patients for return to work. Medicine 98, e15130. doi: 10.1097/MD.0000000000015130

PubMed Abstract | CrossRef Full Text | Google Scholar

Coons, S. J., Rao, S., Keininger, D. L., and Hays, R. D. (2000). A comparative review of generic quality-of-life instruments. Pharmacoeconomics 17, 13–35. doi: 10.2165/00019053-200017010-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

DeSalvo, K. B., Bloser, N., Reynolds, K., He, J., and Muntner, P. (2006). Mortality prediction with a single general self-rated health question. A meta-analysis. J. Gen. Intern. Med. 21, 267–275. doi: 10.1111/j.1525-1497.2005.00291.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Devlin, N. J., Parkin, D., and Browne, J. (2010). Patient-reported outcome measures in the NHS: new methods for analysing and reporting EQ-5D data. Health Econ. 19, 886–905. doi: 10.1002/hec.1608

PubMed Abstract | CrossRef Full Text | Google Scholar

Dhamoon, M. S., Moon, Y. P., Paik, M. C., Boden-Albala, B., Rundek, T., Sacco, R. L., et al. (2010). Quality of life declines after first ischemic stroke. The Northern Manhattan Study. Neurology 75, 328–334. doi: 10.1212/WNL.0b013e3181ea9f03

PubMed Abstract | CrossRef Full Text | Google Scholar

Feng, Y., Parkin, D., and Devlin, N. J. (2014). Assessing the performance of the EQ-VAS in the NHS PROMs programme. Qual. Life Res. 23, 977–989. doi: 10.1007/s11136-013-0537-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Feng, Y. S., Kohlmann, T., and Janssen, M. F. (2021). Psychometric properties of the EQ-5D-5L: a systematic review of the literature. Qual. Life Res. 30, 647–673. doi: 10.1007/s11136-020-02688-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Folstein, M. F., Folstein, S. E., and McHugh, P. R. (1975). “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J. Psychiatr. Res. 12, 189–198. doi: 10.1016/0022-3956(75)90026-6

PubMed Abstract | CrossRef Full Text | Google Scholar

Gailiene, D. (2021). Ka jie mums padare: Lietuvos gyvenimas traumu psichologijos Žvilgsniu. Vilnius: Tyto alba, 246.

Google Scholar

Gall, C., Franke, G. H., and Sabel, B. A. (2010). Vision-related quality of life in first stroke patients with homonymous visual field defects. Health Qual. Life Outcomes 8, 33. doi: 10.1186/1477-7525-8-33

PubMed Abstract | CrossRef Full Text | Google Scholar

Gao, L., Moodie, M., and Chen, G. (2019). Measuring subjective wellbeing in patients with heart disease: relationship and comparison between health-related quality of life instruments. Qual. Life Res. 28, 1017–1028. doi: 10.1007/s11136-018-2094-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Golicki, D., Niewada, M., Buczek, J., Karlińska, A., Kobayashi, A., Janssen, M. F., et al. (2015). Validity of EQ-5D-5L in stroke. Qual. Life Res. 24, 845–850. doi: 10.1007/s11136-014-0834-1

CrossRef Full Text | Google Scholar

Hatano, S. (1976). Experience from a multicentre stroke register: a preliminary report. Bull. World Health Organ. 54, 541–553.

PubMed Abstract | Google Scholar

Hayes, A. F., and Coutts, J. J. (2020). Use omega rather than Cronbach's alpha for estimating reliability. But Commun. Methods Meas. 14, 1–24. doi: 10.1080/19312458.2020.1718629

CrossRef Full Text | Google Scholar

Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., et al. (2011). Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual. Life Res. 20, 1727–1736. doi: 10.1007/s11136-011-9903-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Hooper, D., Coughlan, J., and ve Mullen, M. R. (2008). Structural equation modelling: guidelines for determining model fit. Electr. J. Bus. Res. Methods. 6, 53–60.

Google Scholar

Kainz, A., Meisinger, C., Linseisen, J., Kirchberger, I., Zickler, P., Naumann, M., et al. (2021). Changes of health-related quality of life within the 1st year after stroke-results from a prospective stroke cohort study. Front. Neurol. 12, 715313. doi: 10.3389/fneur.2021.715313

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaplan, R. M. (1990). Behavior as the central outcome in health care. Am. Psychol. 45, 1211–1220. doi: 10.1037/0003-066X.45.11.1211

PubMed Abstract | CrossRef Full Text | Google Scholar

Kaplan, R. M. (2003). The significance of quality of life in health care. Qual. Life Res. 12(Suppl. 1), 3–16. doi: 10.1023/A:1023547632545

CrossRef Full Text | Google Scholar

Karimi, M., and Brazier, J. (2016). Health, health-related quality of life, and quality of life: what is the difference? Pharmacoeconomics 34, 645–649. doi: 10.1007/s40273-016-0389-9

CrossRef Full Text | Google Scholar

Kasner, S. E. (2006). Clinical interpretation and use of stroke scales. Lancet Neurol. 5, 603–612. doi: 10.1016/S1474-4422(06)70495-1

CrossRef Full Text | Google Scholar

Kranciukaite-Butylkiniene, D. (2014). Quality of Life After Stroke: The EROS Study in Urban Lithuania. Göteborg: Nordic School of Public Health NHV.

Google Scholar

Kroenke, K., Spitzer, R. L., and Williams, J. B. (2001). The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613. doi: 10.1046/j.1525-1497.2001.016009606.x

PubMed Abstract | CrossRef Full Text | Google Scholar

Lau, V. I., Johnson, J. A., Bagshaw, S. M., Rewa, O. G., Basmaji, J., Lewis, K. A., et al. (2022). Health-related quality-of-life and health-utility reporting in critical care. World J. Crit. Care Med. 11, 236–245. doi: 10.5492/wjccm.v11.i4.236

PubMed Abstract | CrossRef Full Text | Google Scholar

Ludwig, K., Graf von der Schulenburg, J. M., and Greiner, W. (2018). German value set for the EQ-5D-5L. Pharmacoeconomics 36, 663–674. doi: 10.1007/s40273-018-0615-8

CrossRef Full Text | Google Scholar

Lyden, P. (2017). Using the National Institutes of Health Stroke Scale: a cautionary tale. Stroke 48, 513–519. doi: 10.1161/STROKEAHA.116.015434

PubMed Abstract | CrossRef Full Text | Google Scholar

Mahoney, F. I., and Barthel, D. W. (1965). Functional evaluation: the barthel index. Md State Med. J. 14, 61–65. doi: 10.1037/t02366-000

PubMed Abstract | CrossRef Full Text | Google Scholar

Mar, J., Masjuan, J., Oliva-Moreno, J., Gonzalez-Rojas, N., Becerra, V., Casado, M. Á., et al. (2015). Outcomes measured by mortality rates, quality of life and degree of autonomy in the first year in stroke units in Spain. Health Qual. Life Outcomes 13, 36. doi: 10.1186/s12955-015-0230-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Mukaka, M. M. (2012). Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med. J. 24, 69–71.

PubMed Abstract | Google Scholar

Pequeno, N. P. F., Cabral, N. L. D. A., Marchioni, D. M., Lima, S. C. V. C., and Lyra, C. D. O. (2020). Quality of life assessment instruments for adults: a systematic review of population-based studies. Health Qual. Life Outcomes 18, 208. doi: 10.1186/s12955-020-01347-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Pranckeviciene, A., Saudargiene, A., Gecaite-Stonciene, J., Liaugaudaite, V., Griskova-Bulanova, I., Simkute, D., et al. (2022). Validation of the patient health questionnaire-9 and the generalized anxiety disorder-7 in Lithuanian student sample. PLoS ONE 17, e0263027. doi: 10.1371/journal.pone.0263027

PubMed Abstract | CrossRef Full Text | Google Scholar

Revicki, D. A., Kleinman, L., and Cella, D. (2014). A history of health-related quality of life outcomes in psychiatry. Dialogues Clin. Neurosci. 16, 127–135. doi: 10.31887/DCNS.2014.16.2/drevicki

PubMed Abstract | CrossRef Full Text | Google Scholar

Santiago, P. H. R., Haag, D., Macedo, D. M., Garvey, G., Smith, M., Canfell, K., et al. (2021). Psychometric properties of the EQ-5D-5L for aboriginal Australians: a multi-method study. Health Qual. Life Outcomes 19, 81. doi: 10.1186/s12955-021-01718-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Shinar, D., Gross, C. R., Bronstein, K. S., Licata-Gehr, E. E., Eden, D. T., Cabrera, A. R., et al. (1987). Reliability of the activities of daily living scale and its use in telephone interview. Arch. Phys. Med. Rehabil. 68, 723–728.

PubMed Abstract | Google Scholar

Spilker, J., Kongable, G., Barch, C., Braimah, J., Bratina, P., Daley, S., et al. (1997). Using the NIH Stroke Scale to assess stroke patients. The NINDS rt-PA stroke study group. J. Neurosci. Nurs. 29, 384–392. doi: 10.1097/01376517-199712000-00008

PubMed Abstract | CrossRef Full Text | Google Scholar

Spitzer, R. L., Kroenke, K., Williams, J. B., and Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: the GAD-7. Arch. Intern. Med. 166, 1092–1097. doi: 10.1001/archinte.166.10.1092

PubMed Abstract | CrossRef Full Text | Google Scholar

Stanyte, A., Fineberg, N. A., Podlipskyte, A., Gecaite-Stonciene, J., Macijauskiene, J., et al. (2023). Validation of the Patient Health Questionnaire-9 and the Generalized Anxiety Disorder-7 in Lithuanian individuals with anxiety and mood disorders. J. Psychiatr. Res. 164, 221–228. doi: 10.1016/j.jpsychires.2023.06.027

PubMed Abstract | CrossRef Full Text | Google Scholar

Stenman, U., Hakama, M., Knekt, P., Aromaa, A., Teppo, L., Leinonen, J., et al. (2010). Measurement and modeling of health-related quality of life. Epidem. Demog. Public Health 195, 130–135.

Google Scholar

Tavakol, M., and Dennick, R. (2011). Making sense of Cronbach's alpha. Int. J. Med. Educ. 2, 53–55. doi: 10.5116/ijme.4dfb.8dfd

CrossRef Full Text | Google Scholar

Terwee, C. B., Bot, S. D., de Boer, M. R., van der Windt, D. A., Knol, D. L., Dekker, J., et al. (2007). Quality criteria were proposed for measurement properties of health status questionnaires. J. Clin. Epidemiol. 60, 34–42. doi: 10.1016/j.jclinepi.2006.03.012

PubMed Abstract | CrossRef Full Text | Google Scholar

Tombaugh, T. N., and McIntyre, N. J. (1992). The mini-mental state examination: a comprehensive review. J. Am. Geriatr. Soc. 40, 922–935. doi: 10.1111/j.1532-5415.1992.tb01992.x

CrossRef Full Text | Google Scholar

van der Ende, N. A. M., den Hartog, S. J., Broderick, J. P., Khatri, P., Visser-Meily, J. M. A., van Leeuwen, N., et al. (2023). Disentangling the association between neurologic deficits, patient-reported impairments, and quality of life after ischemic stroke. Neurology 100, e1321–e1328. doi: 10.1212/WNL.0000000000206747

PubMed Abstract | CrossRef Full Text | Google Scholar

Xie, J., Wu, E. Q., Zheng, Z. J., Croft, J. B., Greenlund, K. J., Mensah, G. A., et al. (2006). Impact of stroke on health-related quality of life in the noninstitutionalized population in the United States. Stroke 37, 2567–2572. doi: 10.1161/01.STR.0000240506.34616.10

PubMed Abstract | CrossRef Full Text | Google Scholar

Zigmond, A. S., and Snaith, R. P. (1983). The hospital anxiety and depression scale. Acta Psychiatr. Scand. 67, 361–370. doi: 10.1111/j.1600-0447.1983.tb09716.x

CrossRef Full Text | Google Scholar

Keywords: psychometrics, quality of life, ischemic stroke, depression, cross-sectional studies, Lithuanian people, anxiety

Citation: Taroza S, Burkauskas J, Mickuviene N, Kazukauskiene N and Podlipskyte A (2023) Psychometrics and validation of the EQ-5D-5L instrument in individuals with ischemic stroke in Lithuania. Front. Psychol. 14:1284859. doi: 10.3389/fpsyg.2023.1284859

Received: 29 August 2023; Accepted: 09 November 2023;
Published: 06 December 2023.

Edited by:

Alessio Facchin, University of Milano-Bicocca, Italy

Reviewed by:

Isa Zappullo, University of Campania Luigi Vanvitelli, Italy
Neringa Grigutyte, Vilnius University, Lithuania

Copyright © 2023 Taroza, Burkauskas, Mickuviene, Kazukauskiene and Podlipskyte. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Saulius Taroza, saulius.taroza@lsmuni.lt

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.