Skip to main content

ORIGINAL RESEARCH article

Front. Public Health , 11 December 2024

Sec. Public Health Education and Promotion

Volume 12 - 2024 | https://doi.org/10.3389/fpubh.2024.1474539

The validity and reliability of the Slovenian version of the health literacy questionnaire short-form (HLS-EU-Q16) among adults and older adults

Monika Lamot
Monika Lamot*Andrej Kirbi&#x;Andrej Kirbiš
  • Department of Sociology, University of Maribor, Maribor, Slovenia

Introduction: Health literacy is an important predictor of health behavior and self-rated health, playing a crucial role in shaping public health outcomes. Valid and reliable health literacy assessments are essential for effectively tailoring health interventions, particularly in different cultural contexts. Several questionnaires have been developed to measure health literacy, including the widely used 47-item Health Literacy Questionnaire and its shorter versions. However, the validity of these shorter and more time efficient HLS-EU versions, such as the 16-item HLS-EU-Q16, has been less extensively researched in different age subgroups. Given Slovenia’s aging population and the differences in health literacy between adults and older adults, it is important to assess whether the HLS-EU-Q16 performs reliably across these groups. Therefore, the present study aimed to examine the validity and reliability of the 16-item health literacy questionnaire (HLS-EU-Q16) in Slovenia across two age groups: adults and older adults.

Methods: We analyzed representative Slovenian sample data from the Health Literacy of Adults study. The sample included 2,327 adults aged 23–64 years (53.7% women) and 876 older adults aged 65–99 years (55.7% women).

Results: Construct validity revealed a modified three-factor structure of the HLS-EU-Q16 among adults, reflecting a broader conceptualization of health literacy that encompasses overlapping domains of health promotion, disease prevention, and health care. In contrast, a two-factor structure emerged among older adults, indicating a more consolidated approach where these domains are perceived as part of an integrated health management strategy. This suggests that adults may conceptualize health literacy across multiple, yet interconnected dimensions, while older adults approach it more holistically. Convergent validity, reliability, concurrent-predictive, concurrent, and discriminant validity results were satisfactory for both age groups. Predictive validity, however, provided somewhat inadequate results, as the tool poorly predicted certain health behaviors, such as smoking, alcohol consumption, and physical activity, in both age groups.

Conclusion: Overall, the HLS-EU-Q16 demonstrated adequate validity and reliability among both adults and older adults, indicating that it is an appropriate instrument for assessing health literacy in Slovenia.

1 Introduction

Health literacy, defined as the ability to understand and use information to make health decisions (1), is measured using various scales and questionnaires. One prominent tool is the Health Literacy Questionnaire (HLS-EU), originally consisting of 47 items across three dimensions and domains: healthcare, disease prevention, and health promotion, which include accessing, understanding, evaluating, and using health information (2). Due to its length, shorter versions with 16 items (2), 12 items (3), and 6 items (4) were developed. This study focuses on the validity of the HLS-EU-Q16 in Slovenia, a tool whose satisfactory psychometric properties have been confirmed in India (5), Portugal (6), and Greece (7). However, the HLS-EU-Q16 has not been extensively validated for different age sub-populations, particularly in older adults. Although older adults have been included in validation studies as part of the general population (8, 9), they have not been examined separately.

Specific tools for assessing health literacy among older adults have been developed. For example, the Rapid Estimate of Inadequate Health Literacy (REIHL) (10) and the TLSA questionnaire in Taiwan (11) both show favorable psychometric properties. Given the widespread use of the HLS-EU-16 (1214), it is crucial to validate it in the Slovenian context, taking into account cultural factors that may affect its validity. Health literacy is a dynamic construct shaped not only by cognitive abilities but also by life experiences, social opportunities, and the broader cultural and societal context (15). As highlighted by Lorini et al. (15), healthcare, education, social systems, cultural norms and media sources, can influence how health literacy manifests across different populations. In Slovenia, factors such as healthcare access, educational background, and social norms may affect how individuals engage with and understand health information. Moreover, since older adults exhibit lower health literacy levels (16), lower functional literacy (17), and issues with health information in media (18), examining the validity and reliability of the HLS-EU-Q16 specifically for this population is essential.

Lower health literacy has been shown to directly impact health outcomes and healthcare utilization. For instance, Cho et al. (19) found that improving health literacy in older adults could enhance health outcomes and reduce the use of costly hospital and emergency services. Furthermore, Mirzaei et al. (20) demonstrated that health literacy levels significantly affect the effectiveness of educational interventions, especially in improving nutrition knowledge and behaviors among the older adult, with higher health literacy leading to greater improvements.

Studies assessing the validity of the HLS-EU-Q16 often focus on construct validity, neglecting discriminant and predictive validity (9, 14, 21, 22). Additionally, some studies report internal reliability as a single factor without analyzing the factorial structure (6, 15). Previous studies often identify multiple factors within the health literacy construct, but subsequent analyses, like correlations or regressions, often treat it as a single factor without confirming a second-order structure (12, 13). The aim of the present research is to present a more comprehensive analysis of the validity and reliability of the questionnaire separately for the two age groups.

1.1 Psychometric structure of the HLS-EU-Q16 questionnaire

The three-dimensional factorial structure of the HLS-EU-Q16, following the theoretical framework, has been confirmed in adults aged 25–65 years (5). CFA (Confirmatory Factor Analysis) indicated a good fit for the three-dimensional model, which includes healthcare, disease prevention, and health promotion. High correlations between these dimensions suggest they are closely related and collectively represent the broader construct of health literacy. In this study, older adults were included alongside adults (21). This finding aligns with an Exploratory Factor Analysis (EFA) study that found a unidimensional structure, suggesting the HLS-EU-Q16 can function as a one-factor questionnaire with strong psychometric properties and reliability (23). Notably, Mousum et al. (14) confirmed both the three-factor and one-factor solutions in a population that included both adults and older adults, indicating that the questionnaire can function as either a single-factor or a three-factor scale.

H1: The HLS-EU-Q16 demonstrates a three-factor solution among Slovenian adults.

H2: The HLS-EU-Q16 demonstrates a single-factor solution among Slovenian adults.

Eronen et al. (18) examined individuals aged 66 and above in Finland, reporting good test–retest reliability of the HLS-EU-Q16 but without addressing other indicators of reliability or validity. Another study involving individuals aged 72–92 years found poor reliability of HLS-EU-Q16 (24). Furthermore, differential item functioning (DIF) analyses revealed age-related differences in HLS-EU-Q16 responses. Specifically, older adults found it more difficult to understand what their doctor says and to judge when to seek a second opinion compared to younger individuals. These findings suggest that certain items in the HLS-EU-Q16 may not be equally valid across different age groups. However, CFA for age subgroups was not reported, leaving the construct validity for different age groups unclear (4). Another study also did not report the factorial structure for age subgroups but identified age-related differences in items such as finding information on treatments and judging when to seek a second opinion, which were more challenging for older adults (25). Consequently, the factorial structure of the HLS-EU-Q16 among older adults remains unknown.

RQ1: What is the factorial structure of the HLS-EU-Q16 among Slovenian older adults?

1.2 Discriminant validity

Discriminant validity of health literacy questionnaires has been assessed using various methods in previous studies. For instance, Elsworth et al. (26) and Maindal et al. (27) examined discriminant validity of the Health Literacy Questionnaire (HLQ) by analyzing inter-factor correlations and factor loadings within factors. Abacigil et al. (28) assessed the discriminant validity of the HLS-EU-Q47 by comparing participant scores across different age groups, educational levels, genders, health statuses, and socioeconomic statuses, ensuring the questionnaire could distinguish effectively between these groups. Similarly, Sun et al. (29) evaluated discriminant validity of the Oral Health Literacy Scale by comparing scores between the highest and lowest scoring groups, finding significant differences that confirmed the scale’s ability to distinguish effectively between these groups.

Discriminant validity can also be evaluated in relation to other distinct constructs. Pelikan et al. (3) analyzed the discriminant validity of the 12-item HLS19-Q12, a shorter version of the HLS-EU-Q47, by correlating it with digital, communicative, and navigational health literacy measures, which are related but distinct constructs. Their study demonstrated good discriminant validity for the 12-item questionnaire in comparison to these other constructs. Previous studies have not assessed the discriminant validity of the HLS-EU-Q16 questionnaire by comparing it with communicative and navigational health literacy measures. Therefore, in this study, we focus on the discriminant validity of the HLS-EU-Q16 in relation to communicative and navigational health literacy. Communicative health literacy pertains to the skills required for active participation in interactions with healthcare providers, including expressing treatment preferences and asking clarifying questions (30). Navigational health literacy refers to the ability to locate, comprehend, and use information to effectively navigate the healthcare system, such as accessing services and making informed healthcare decisions (31). By adopting this approach, we aim to evaluate whether the HLS-EU-Q16 can effectively distinguish between these theoretically distinct constructs of health literacy.

H3: The HLS-EU-Q16 demonstrates discriminant validity in relation to communicative and navigational health literacy questionnaires among adults (H3a) and older adults (H3b).

1.3 Concurrent-predictive validity

Concurrent predictive validity was assessed based on the approach used by Pelikan et al. (3), who examined sociodemographic and socioeconomic factors as determinants of health literacy. Cross-country studies, such as Sørensen et al. (16), have demonstrated that individuals with lower socioeconomic status, lower educational attainment, and older age tend to exhibit lower health literacy. Similarly, research from Australia confirmed that individuals with lower levels of education experienced greater difficulty understanding and accessing health information. Furthermore, women scored slightly lower than men on some dimensions of the health literacy scale (32). In Spain, lower health literacy scores were observed among individuals over 65, those with incomplete secondary education, and those who were unemployed, across several dimensions of health literacy (33). These findings support the relevance of sociodemographic and socioeconomic factors in establishing the concurrent-predictive validity of health literacy measures.

1.4 Predictive validity

Predictive validity is often examined by checking whether health literacy predicts various health outcomes, since health literacy is known as a predictor of subjective health (34) and health behaviors (35, 36). Suka et al. (37), for example, found that those exhibiting higher health literacy were less likely to smoke, drink or lack exercise. Predictive validity of the HLS-EU-Q16 has previously been confirmed for predicting poorer self-assessment of health, higher prevalence of disability, obesity, lower physical activity, and less frequent consumption of fruits and vegetables (38). The same holds true for older adults, as those with lower health literacy are more likely to engage in unhealthy behaviors such as smoking, alcohol consumption, and lower physical activity (39). Additionally, we assessed predictive validity while controlling for sociodemographic and socioeconomic determinants, which are significant predictors of health behavior. For instance, smoking is more prevalent among men, individuals with lower education, less household wealth, those living in rural areas, and older adults (40). Moreover, higher income levels are associated with higher fruit intake (41), while younger individuals and men have higher alcohol consumption (42).

H4: When controlling for sociodemographic and socioeconomic confounders, the HLS-EU-Q16 statistically significantly predicts better self-rated health (H4a), less frequent smoking (H4b), alcohol consumption (H4c), more frequent physical activity (H4d) and healthy eating (H4e).

2 Materials and methods

2.1 Sample

We analyzed data from the Health Literacy of Adults in Slovenia (HLS-SI19) (43), involving 3,360 participants, 53.7% of whom were women. Participants ranged from 18 to 99 years old (M = 51.6). The data was collected as part of a larger European study M-POHL. The Slovenian data were collected through a combination of computer-assisted personal interviews (CAPI), self-administered questionnaires (SAQ), and computer-assisted web-based interviews (CAWI). Participants were selected using a multi-stage random sampling method. The inclusion criteria required all participants to be permanent residents aged 18 and above. Respondents were informed that they could opt out of the survey at any time (43). As the present study aimed to validate the HLS-EU-Q16 questionnaire in two groups—adults and the older adult—the characteristics of each subgroup are presented below.

2.1.1 Adults

The adult group comprised 2,327 participants aged 23–64 years (M = 45.2 years), with 53.4% women. Of the participants, 65.4% were employed, 12.9% retired, 8.4% unemployed, and 7.2% self-employed. Additionally, 2.1% were students, 1.8% homemakers, and 1.3% unable to work. The average self-assessed socioeconomic status was mid-level (M = 5.49; SD = 1.59). Educational attainment was diverse: 25.3% reported completing secondary vocational education, 16.2% lower or intermediate vocational education, 14.4% second-degree higher education, 11.6% general secondary education, 9.8% higher vocational education, 8.7% first-degree higher education, and 3.8% had a master’s or doctorate.

2.1.2 Older adults

The older adults group included 876 participants aged 65 to 99 years (M = 73.9 years), with 55.7% women. Most were retired (96.3%), with a small percentage still working. The average self-assessed socioeconomic status was slightly below average (M = 5.18; SD = 1.56). The majority of the sample reported having completed secondary vocational education (24.4%), followed by primary education (24.0%), lower or intermediate vocational education (23.4%), higher vocational or college education (8.3%), second-degree higher education (5.4%), first-degree higher education (2.1%), and 0.7% had a master’s or doctorate.

2.2 Measures

2.2.1 Health literacy questionnaire

The Slovenian version of the HLS-EU-Q47 questionnaire was used solely to verify concurrent validity of the HLS-EU-Q16. The primary focus of the research was to validate HLS-EU-Q16, which comprises 16 items across three domains: healthcare, disease prevention, and health promotion (6). Participants responded using a four-point scale (1 = very difficult; 4 = very easy). An example item includes “How easy or difficult is it for you to find information on treatments of illness that concern you” (see Table 1 for the full list).

Table 1
www.frontiersin.org

Table 1. Explorative factor analysis on the adult population.

2.2.2 Communicative health literacy

Communicative health literacy was measured with 11 statements on a four-point scale (1 = very difficult; 4 = very easy). Example questions included: “How easy or difficult is it to describe to your doctor the reasons for your visit?,” “Explain your health concerns to your doctor?,” and “Understand the words your doctor uses?.” The scale demonstrated excellent internal reliability (Cronbach’s α adults = 0.94, Cronbach’s α older adults = 0.95).

2.2.3 Navigational health literacy

Navigational health literacy was assessed with 12 statements, such as, “Understand information about how the healthcare system works (e.g., what types of healthcare services are available),” “Judge which type of healthcare service you need in case of a health problem,” and “Judge how much of the healthcare service is covered by your health insurance (e.g., whether co-payments are required).” Participants responded on a four-point scale (1 = very difficult; 4 = very easy). The scale also showed excellent internal reliability (Cronbach’s α adults = 0.93, Cronbach’s α older adults = 0.94).

2.2.4 Self-rated health and health behaviors

Subjective health was assessed with a standard self-rated health question using a five-point scale (1 = very good; 5 = very poor). Health behaviors examined included frequency of smoking, alcohol consumption, physical activity, and fruit and vegetable intake. Participants reported their weekly frequency of these behaviors (99 = never, 0 = less than once a week, 1 = one day, 2 = two days, 3 = three days, 4 = four days, 5 = five days, 6 = six days, 7 = seven days). Variables were recoded from 0 (never) to 8 (7 days).

2.2.5 Sociodemographic and socioeconomic determinants

The analysis also included sociodemographic and socioeconomic variables, including gender (1 = male, 2 = female), education (1 = no formal education; 11 = master’s degree, doctorate), self-assessed socioeconomic status (1 = lowest socioeconomic level in society; 10 = highest socioeconomic level in society), and self-assessed economic deprivation, measured with the question “How easily can you pay your living expenses each month?” (1 = very easily; 4 = very difficult).

2.3 Statistical analyses

This study evaluated the validity and reliability of the shorter version of the health literacy questionnaire, HLS-EU-16, using Mplus 8.3 and SPSS 29. We examined construct, convergent, discriminant, concurrent-predictive, and predictive validity. Construct validity was assessed using confirmatory factor analysis (CFA), with the following model fit indices: chi-square (χ2), comparative fit index (CFI > 0.90), Tucker-Lewis index (TLI > 0.90), root mean square error of approximation (RMSEA <0.08), and standardized root mean square residual (SRMR <0.08) (44). For construct validity, explorative factor analysis (EFA) was also employed. Convergent validity was evaluated through standardized factor loadings, average variance extracted (AVE > 0.50), and composite reliability (CR > 0.70) as recommended by Fornell and Larcker (45). High AVE and CR values indicate good convergent validity, meaning the indicators adequately explain the latent constructs. Internal reliability was assessed using Cronbach’s alpha (α > 0.70), indicating the degree of internal consistency of the measurement instrument (46). Furthermore, discriminant validity was assessed following the methodology of Pelikan et al. (3), using the navigational and communicative health literacy questionnaires. We used correlation analysis (Pearson’s coefficient) to determine whether the constructs were distinct from each other. A range of correlation coefficients between 0.40 and 0.70 was considered indicative of good discriminant validity. Concurrent-predictive validity was examined with linear regression where we employed the same predictors as Pelikan et al. (3), namely sociodemographic and socioeconomic predictors. Next, concurrent validity was verified by correlating the HLS-EU-Q47 questionnaire with the shorter HLS-EU-Q16 questionnaire. A high correlation (r > 0.75) indicates high concurrent validity (47). Predictive validity was assessed using sociodemographic and socioeconomic factors, health behaviors, and self-rated health as predictors. The inclusion of health literacy (HLS-EU-Q16) in the model was examined using hierarchical regression to determine if health literacy contributed to additional explained variance in health behaviors and self-rated health (45).

3 Results

3.1 Construct validity

We first assessed the construct validity of the questionnaire using confirmatory factor analysis (CFA). CFA was performed on the questionnaire’s three theoretically proposed dimensions (factors): health care, disease prevention, and health promotion (results shown in Supplementary Table S1). Based on the model fit statistic, we conclude that the theoretically proposed three-factor structure of the HLS-EU-Q16 questionnaire falls below the recommended thresholds for model fit among Slovenian adults and older adults, indicating its use may not be appropriate. In accordance with Hypothesis 2, we also examined the single-factor structure of the questionnaire in both age groups (Supplementary Table S2). The analyses revealed that the usage of the one-factor HLS-EU-Q16 among adults and older adults is also not appropriate, as the model fit statistics fell below the recommended thresholds.

Due to the unsatisfactory model fit, we conducted an exploratory factor analysis (EFA) to examine the factor structure of the questionnaire in both age groups (Tables 1, 2). In the adult population, the analysis largely confirmed a three-dimensional factor structure for the HLS-EU-Q16 questionnaire, but the dimensions were not identical to the original structure (Table 1). Items related to finding and understanding health information and doctors’ instructions (health care) primarily loaded onto Factor 3. Items related to disease prevention loaded onto Factor 2. Items related to health promotion mainly loaded onto Factor 1. However, some health care and disease prevention items, such as “find out about activities that are good for your mental well-being” and “understand advice on health from family members or friends” also loaded onto Factor 1. This suggests that adults may interpret health promotion more broadly, incorporating aspects of disease prevention and health care into their perception of health enhancement.

Table 2
www.frontiersin.org

Table 2. Explorative factor analysis on the older adult population.

A two-factor solution of the questionnaire emerged in the older adult population (Table 2), which indicated a different structure from the original HLS-EU-Q16 structure. Specifically, items related to health care and health promotion primarily loaded onto the first factor, suggesting older adults perceive these aspects as more interconnected in comparison to the originally proposed factor structure of the questionnaire. Items related to disease prevention, along with some health promotion items about media reliability and protective measures, loaded onto the second factor. This indicates that older adults may integrate health care, disease prevention, and health promotion into a more cohesive concept, consolidating items into fewer factors compared to the original HLS-EU-Q16 structure.

After the exploratory factor analysis revealed the factor structure of the questionnaire in both populations, we further confirmed it with CFA (Table 3). The fit indices were consistent with recommended values, indicating that the questionnaire structure identified with EFA is suitable for both age groups.

Table 3
www.frontiersin.org

Table 3. Construct validity of the HLS-EU-Q16 Questionnaire.

Next, standardized factor loadings among the adult population (Table 4) showed satisfactory values, exceeding the recommended threshold for all three factors. Factor 1 loadings ranged from 0.50 to 0.70, Factor 2 loadings ranged from 0.62 to 0.71, and Factor 3 loadings ranged from 0.67 to 0.75. All factor loadings were statistically significant at p < 0.001. Regarding average variance extracted (AVE), the evidence for convergent validity was less satisfactory. AVE values for Factors 1, 2, and 3 were 0.43, 0.46, and 0.49, respectively, all below the recommended threshold, with Factor 3 being the closest. On the other hand, composite reliability (CR) demonstrated better convergent validity, with values of 0.84 for Factors 1 and 2, and 0.74 for Factor 3, all above the 0.70 threshold (results not presented in a table).

Table 4
www.frontiersin.org

Table 4. Standardized factor loading in the adult population.

For the older adult sample, the questionnaire also demonstrated good convergent validity based on standardized factor loadings (Table 5). Factor 1 loadings ranged from 0.58 to 0.78, and Factor 2 loadings ranged from 0.71 to 0.76, with all indicators being statistically significant at p < 0.001. The good convergent validity was further supported by the average variance extracted (0.48 for Factor 1 and 0.54 for Factor 2) and composite reliability results, which were 0.92 for Factor 1 and 0.78 for Factor 2.

Table 5
www.frontiersin.org

Table 5. Standardized factor loading in the older adult population.

We further assessed the internal consistency or reliability of the HLS-EU-16 questionnaire. For the adult group, all three dimensions of the HLS-EU-Q16 demonstrated good reliability. Specifically, Cronbach’s alpha was 0.83 for Factor 1 (mainly health promotion and some health care items), 0.84 for Factor 2 (disease prevention), and 0.75 for Factor 3 (health care). For the older adult group, we found excellent reliability for the first factor (health care and health promotion), with Cronbach’s alpha at 0.92, and good reliability for the second factor (disease prevention), with Cronbach’s alpha at 0.78. Thus, we can conclude that the modified three-factor questionnaire in the adult group and the two-factor questionnaire in the older adult group exhibit good reliability in both age groups.

3.2 Discriminant validity

Discriminant validity of the HLS-EU-Q16 questionnaire was examined by its correlation with the communicative health literacy and navigational health literacy questionnaires. In the adult population (Table 6), the first dimension of the HLS-EU-Q16 questionnaire demonstrated good discriminant validity with the communicative health literacy questionnaire (COM-HL) (r = 0.47, p < 0.01) and the navigational health literacy questionnaire (NAV-HL) (r = 0.45, p < 0.01). The second dimension showed poorer discriminant validity with the COM-HL questionnaire (r = 0.19, p < 0.01) but good discriminant validity with the NAV-HL questionnaire (r = 0.48, p < 0.01). The third dimension also demonstrated good discriminant validity, with a correlation coefficient greater than 0.40 for both the COM-HL and NAV-HL questionnaires.

Table 6
www.frontiersin.org

Table 6. Discriminant validity of the HLS-EU-Q16 in the adult population.

For the older adult population (Table 7), the first dimension of the questionnaire showed excellent discriminant validity with the COM-HL (r = 0.62, p < 0.01) and NAV-HL (r = 0.66, p < 0.01). The second dimension showed adequate discriminant validity with the COM-HL questionnaire, as the correlation was slightly below the 0.40 threshold (r = 0.37, p < 0.01), and good validity with the NAV-HL (r = 0.61, p < 0.01). Overall, the discriminant validity of the HLS-EU-19 and its dimensions was confirmed in both age groups.

Table 7
www.frontiersin.org

Table 7. Discriminant validity of the HLS-EU-Q16 in the older adult population.

3.3 Concurrent-predictive validity

Concurrent-predictive validity was assessed through linear regression analysis (see Tables 8, 9), where gender, age, education, self-assessed economic deprivation, and self-assessed socioeconomic status were included as predictors. In the adult population (Table 8), all variables were statistically significant predictors of the third dimension of the questionnaire, i.e., health care. In the first dimension, only age was not a statistically significant predictor, and in the second dimension, both gender and age did not significantly predict health literacy. All significant predictors of health literacy dimensions were in the expected direction, except for education, which negatively predicted the disease prevention dimension (β = −0.06, p < 0.01). Among older adults (see Table 9), socioeconomic status did not statistically significantly predict any dimension of the HLS-EU-Q16. Gender did not predict the first dimension, and education did not predict the second dimension. Significant predictors were in the expected direction. Since the majority of determinants were significant predictors of the questionnaire dimensions in both groups, we can conclude that the questionnaire has adequate concurrent-predictive validity.

Table 8
www.frontiersin.org

Table 8. Concurrent-predictive validity in the adult population.

Table 9
www.frontiersin.org

Table 9. Concurrent-predictive validity in the older adult population.

3.4 Concurrent validity

We assessed concurrent validity by examining the correlation coefficient between the three dimensions of the HLS-EU-Q16 in the adult population and two dimensions in the older adult population with the longer, original version of the questionnaire, HLS-EU-Q47. In the adult population we found that the concurrent validity of the questionnaire was excellent for the first (r = 0.81, p < 0.01) and third (0.79, p < 0.01) dimension, and satisfactory for the second dimension (r = 0.59, p < 0.01). For the older adults we found excellent concurrent validity for the first (r = 0.94, p < 0.01) and second (r = 0.76, p < 0.01) dimension. The high correlations thus indicate that the shorter HLS-EU-Q16 effectively measures the same construct of health literacy as the longer HLS-EU-Q47 among adults and older adults.

3.5 Predictive validity

We further performed hierarchical regression analyses regarding the predictive value of the HLS-EU-Q16 in predicting various health outcomes in both age groups. Among the adult sample (Table 10), we found that all three dimensions of the questionnaire statistically significantly predicted self-rated health so that higher levels of health literacy predicted better self-rated health. The inclusion of the three dimensions in the model for the self-rated health also statistically significantly increased the explained variance of the model (ΔR2 = 0.015, ΔF = 13.802, p < 0.001). For smoking, alcohol consumption, physical activity and healthy eating the three dimensions of the HLS-EU-Q16 were not able to explain significant variance over and above gender, age, education, economic deprivation and socioeconomic status. We did, however, find that the third dimension of the questionnaire—“health care”—significantly predicted smoking (β = 0.08, p < 0.01) but in an unexpected direction; higher health literacy was associated with more frequent smoking. Additionally, we found that the “disease prevention” dimension positively predicted physical activity (β = 0.05, p < 0.05), and “health prevention” positively predicted healthy eating (β = 0.05, p < 0.05). To summarize, the predictive validity of the questionnaire among adults was somewhat inadequate, as it mostly did not significantly increase the variance of the examined outcomes, and the dimensions were generally not significant predictors of health behaviors.

Table 10
www.frontiersin.org

Table 10. Predictive validity of the HLS-EU-Q16 in the adult population.

For the older adult sample (Table 11), we found that both dimensions of the HLS-EU-Q16 predicted better self-rated health and improved the explained variance of the regression model (ΔR2 = 0.015, ΔF = 13.802, p < 0.001). For the rest of the health behaviors, the inclusion of the health literacy questionnaire did not statistically significantly improve the explained variance of the outcomes. The analysis did confirm that disease prevention statistically significantly predicted more frequent physical activity (β = 0.05, p < 0.05), while the first dimension of the questionnaire—health care and health promotion—predicted healthy eating (β = 0.05, p < 0.05). Similar to the findings for the adult population, the HLS-EU-Q16 revealed unsatisfactory predictive validity, as it mostly failed to predict health behaviors among older adults.

Table 11
www.frontiersin.org

Table 11. Predictive validity of the HLS-EU-Q16 in the older adult population.

4 Discussion

Health literacy is considered an important determinant of health and health behavior (3436). Thus, it is critical to use psychometrically appropriate tools to accurately measure the health literacy of individuals. The HLS-EU questionnaires are widely used for assessing health literacy. Therefore, this study aimed to evaluate the validity and reliability of the HLS-EU-Q16 questionnaire among a Slovenian sample of adults and older adults. Examining the validity and reliability of health literacy questionnaires in different age groups, including target groups such as the older adult who tend to have lower levels of health literacy, is also important for understanding and addressing their specific health literacy needs.

First, construct validity was assessed using confirmatory factor analysis (CFA) based on the theoretical structure of three factors: health care, disease prevention, and health promotion (2). The analysis indicated poor model fit in both age groups. Consequently, we re-examined the factor structure using exploratory factor analysis (EFA), which revealed different structures for each group. Among adults, a three-factor structure emerged, with some overlap between health promotion, disease prevention, and health care. This finding suggests that adults may perceive health promotion in a broader context. For example, adults may interpret activities such as managing well-being or understanding advice from family members as part of health promotion, which indicates that health literacy in this population extends beyond traditional categories into a more fluid perception of health. In contrast, a two-factor structure was identified in the older adult population, demonstrating a more holistic approach to health literacy. Older adults seem to perceive health care and health promotion as interconnected. This consolidation suggests that older adults might prioritize practical health management over distinguishing between health promotion, disease prevention, and health care. Instead, they may see these aspects as part of a cohesive strategy to maintain health and well-being. Additionally, older adults grouped items related to disease prevention—such as media reliability and protective measures—into a single factor, potentially reflecting their greater reliance on external information regarding health. Therefore, these findings highlight the dynamic nature of health literacy across different life stages. For adults, health literacy involves a broad understanding of how to promote health and prevent disease, suggesting that interventions targeting this group may need to address these interconnected aspects more explicitly. For older adults, however, the emphasis on a more integrated approach to health management indicates that health literacy interventions should focus on helping them navigate the complex interactions between healthcare services, disease prevention, and health promotion in a way that resonates with their more holistic view of health.

Our findings suggest that construct validity of the HLS-EU-Q16 questionnaire in Slovenia is appropriate for both adults (the modified three-factor structure) and older adults (two-factor structure). Although some previous studies confirmed the theoretically proposed three-factor solution (5, 12, 21), it is not surprising that different structures emerged in our study. The originally proposed three-structure of the questionnaire has not been consistently supported in prior research, with some studies identifying four-factor solutions (9, 13). In addition, contrary to findings supporting a one-factor (higher order) structure of the questionnaire (14, 23), we did not find such evidence, as model fit statistics fell below acceptable thresholds in both groups. This suggests that the HLS-EU-Q16 should not be examined as a single factor in future research in Slovenia.

Next, discriminant validity was confirmed in both age groups, indicating that the constructs measure distinct aspects of health literacy without multicollinearity, consistent with Pelikan et al. (3) findings for the HLS19-Q12 version of the questionnaire. Regarding concurrent predictive validity, most sociodemographic determinants significantly predicted health literacy. For example, in the adult sample, we found that age and socioeconomic status statistically significantly predicted all three HLS-EU-Q16 dimensions, aligning with findings from a study on Hungarian mothers (48).

Finally, with regard to predictive validity, several previous studies have demonstrated a positive relationship between health literacy and self-rated health (34, 38). Our findings align with these results, as all three dimensions of the HLS-EU-Q16 significantly predicted self-rated health among adults. However, our study found limited predictive validity for other health behaviors such as smoking, alcohol consumption, physical activity, and healthy eating. This is in line with the results by Aaby et al. (49) who examined health literacy using two subscales of the HLQ questionnaire: understanding health information and the ability to actively engage with healthcare providers. They found that while health literacy, particularly understanding health information, does predict several health behaviors, its effect is inconsistent for alcohol consumption, dietary quality score, and certain BMI categories. The ability to actively engage with healthcare providers does not consistently predict former alcohol consumption, underweight status, average dietary quality, or obesity when adjusting for other factors (41). Similarly, a study by Tiller et al. (50) examined the HLS-EU-Q16 as a predictor of health outcomes among older adults and found that health literacy did not significantly predict blood pressure. This suggests that the relationship between health literacy and certain health behaviors is complex and might be influenced by other factors.

One potential explanation for the limited predictive validity of health behaviors in our study could be the role of mediating factors. Findings from a meta-analysis support this notion, revealing that the relationship between health literacy and health behaviors is mediated by other determinants like self-efficacy (51). Individuals with higher health literacy may not automatically engage in healthy behaviors unless they also feel confident in their ability to act. For example, someone with adequate health literacy might understand the risks of smoking or the benefits of healthy eating, but if they lack self-efficacy, they may not translate this knowledge into action. Moreover, Wieczorek et al. (52) found that social connectedness moderates the relationship between health literacy and health behaviors, further complicating direct predictions. Social networks and support systems can influence the ability to engage in healthy behaviors, particularly for older adults who may rely more on family and community for health-related decisions. We should note that we did not take social connectedness nor self-efficacy into account in our study as we lacked measures. For older adults, the HLS-EU-Q16 also showed limited predictive validity, similar to the adult sample. While it significantly predicted self-rated health, it did not substantially improve the explained variance for other health behaviors. This means that other factors may play a potential role in the relationship between health literacy and health behaviors.

To summarize, HLS-EU-Q16 showed reliability and validity in Slovenian adults (modified-three factor structure) and older adults (two-factor structure), suggesting it can be used in future research or in practical settings. This is particularly advantageous as researchers can adopt the shorter version instead of the longer HLS-EU-Q47, lowering the burden on respondents and allowing them to fill out the questionnaire faster. This also reduces the cost of studies. Healthcare professionals can utilize the HLS-EU-Q16 to assess patients’ health literacy levels, enabling them to tailor their communication and healthcare instructions accordingly. Despite demonstrating limited predictive validity for predicting certain health behaviors, the tool’s ability to reliably predict self-rated health highlights its value in clinical settings.

4.1 Limitations and future research

The present study focused on the validity of the HLS-EU-Q16 questionnaire among adults and older adults in Slovenia, which may limit the generalizability of the results to other national contexts. We did not examine specifics regarding national identity or gender. The data were self-reported, which could lead to socially desirable answers or inaccurate representations of behaviors. Additionally, the cross-sectional design of the study prevents us from making causal inferences.

Since we did not confirm the proposed three-factor structure of the questionnaire in both age groups, as different factor structures emerged in both groups, we suggest that future studies explore the construct validity on their samples before using the construct for further analyses to ensure the accuracy of the results. The findings also suggest that while health literacy is a critical factor in self-rated health, its role in predicting specific health behaviors may be limited and mediated by other factors, which should be further investigated. Future studies should also examine the predictive validity of the questionnaire concerning other health behaviors and attitudes, such as vaccination uptake.

5 Conclusion

The HLS-EU-Q16 was shown to be a reliable and valid tool for assessing health literacy among Slovenian adults and older adults. This study’s findings support its use in both research and clinical settings, offering a practical alternative to the longer HLS-EU-Q47. The distinct factor structures identified for different age groups suggest that health literacy is perceived variably across the lifespan, necessitating age-specific approaches. While the questionnaire demonstrated strong predictive validity for self-rated health, its limited predictive validity for other health behaviors highlights the complex interplay of factors that influence health literacy outcomes. Consequently, health literacy interventions should address additional determinants such as education, economic status, and access to healthcare resources to be more effective.

Data availability statement

The dataset used in this study is not yet publicly available due to NIJZ’s research project restrictions. Requests to access these datasets should be directed to National Institute of Public Health Slovenia: https://nijz.si/.

Ethics statement

The studies involving humans were approved by the National Institute of Public Health. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

ML: Formal analysis, Methodology, Writing – original draft, Writing – review & editing. AK: Conceptualization, Funding acquisition, Project administration, Supervision, Writing – review & editing.

Funding

The author(s) declare that financial support was received for the research, authorship, and/or publication of this article. This work was supported by the Slovenian Research and Innovation Agency (ARIS) (J5-4579; V5-2242) and the Slovenian Ministry of Health (V5-2242). The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

Acknowledgments

After completing the writing of this work, the author Andrej Kirbiš used ChatGPT solely to improve the language and readability of the text. The authors subsequently reviewed and edited the content as necessary and take full responsibility for the final publication.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2024.1474539/full#supplementary-material

References

1. Nutbeam, D. Defining, measuring and improving health literacy. J Stage. (2015) 42:450–6. doi: 10.7143/jhep.42.450

Crossref Full Text | Google Scholar

2. Pelikan, J, Ganahl, K, Van den Broucke, S, and Sørensen, K. Measuring health literacy in Europe: Introducing the European health literacy survey questionnaire (HLS-EU-Q). In: O Okan, U Bauer, P Pinheiro, and K Sørensen, editors. International handbook of health literacy: Research, practice and policy across the lifespan. Policy Press. (2019). 115–38.

Google Scholar

3. Pelikan, J, Link, T, Straßmayr, C, Waldherr, K, Alfers, T, Bøggild, H, et al. Measuring comprehensive, general health literacy in the general adult population: the development and validation of the HLS19-Q12 instrument in seventeen countries. Int J Environ Res Public Health. (2022) 19:14129. doi: 10.3390/ijerph192114129

Crossref Full Text | Google Scholar

4. Rouquette, A, Nadot, T, Labitrie, P, Van den Broucke, S, Mancini, J, Rigal, L, et al. Validity and measurement invariance across sex, age, and education level of the French short versions of the European health literacy survey questionnaire. PLoS One. (2018) 13:e0208091. doi: 10.1371/journal.pone.0208091

Crossref Full Text | Google Scholar

5. Dsouza, JP, Van den Broucke, S, and Pattanshetty, S. Validity and reliability of the Indian version of the HLS-EU-Q16 questionnaire. Int J Environ Res Public Health. (2021) 18:495. doi: 10.3390/ijerph18020495

PubMed Abstract | Crossref Full Text | Google Scholar

6. Pedro, AR, Raposo, B, Luís, L, Amaral, O, Escoval, A, and Simões, DS. Portuguese version of the HLS-EU-Q6 and HLS-EU-Q16 questionnaire: psychometric properties. Int J Environ Res Public Health. (2023) 20:2892. doi: 10.3390/ijerph20042892

PubMed Abstract | Crossref Full Text | Google Scholar

7. Michou, M, and Costarelli, V. Validity and reliability of the european health literacy survey questionnaire (HLS_EU_Q16) in the Greek language. Mediterr J Nutr Metab. (2022) 15:285–94. doi: 10.3233/MNM-211538

Crossref Full Text | Google Scholar

8. Finbråten, HS, Wilde-Larsson, B, Nordström, G, Pettersen, KS, Trollvik, A, and Guttersrud, Ø. Establishing the HLS-Q12 short version of the European health literacy survey questionnaire: latent trait analyses applying Rasch modelling and confirmatory factor analysis. BMC Health Serv Res. (2018) 18:506. doi: 10.1186/s12913-018-3275-7

PubMed Abstract | Crossref Full Text | Google Scholar

9. Gustafsdottir, SS, Sigurdardottir, AK, Arnadottir, SA, Heimisson, GT, and Mårtensson, L. Translation and cross-cultural adaptation of the European health literacy survey questionnaire, HLS-EU-Q16: the Icelandic version. BMC Public Health. (2020) 20:61. doi: 10.1186/s12889-020-8162-6

PubMed Abstract | Crossref Full Text | Google Scholar

10. Leung, AYM, Yu, EYT, Luk, JKH, Chau, PH, Levin-Zamir, D, Leung, ISH, et al. Rapid estimate of inadequate health literacy (REIHL): development and validation of a practitioner-friendly health literacy screening tool for older adults. Hong Kong Med J Xianggang Yi Xue Za Zhi. (2020) 26:404–12. doi: 10.12809/hkmj208395

PubMed Abstract | Crossref Full Text | Google Scholar

11. Shih, YL, Hsieh, CJ, Li, PS, and Liu, CY. Psychometric properties of the health literacy scale used in the Taiwan longitudinal study on middle-aged and older people. Healthc Basel Switz. (2021) 9:1391. doi: 10.3390/healthcare9101391

Crossref Full Text | Google Scholar

12. Bergman, L, Nilsson, U, Dahlberg, K, Jaensson, M, and Wångdahl, J. Validity and reliability of the arabic version of the HLS-EU-Q16 and HLS-EU-Q6 questionnaires. BMC Public Health. (2023) 23:304. doi: 10.1186/s12889-023-15226-5

PubMed Abstract | Crossref Full Text | Google Scholar

13. Coman, MA, Forray, AI, Van den Broucke, S, and Chereches, RM. Measuring health literacy in Romania: validation of the HLS-EU-Q16 survey questionnaire. Int J Public Health. (2022) 67:1604272. doi: 10.3389/ijph.2022.1604272

PubMed Abstract | Crossref Full Text | Google Scholar

14. Mousum, S, Salwa, M, Fatema, K, and Haque, MA. Psychometric validation of the translated and adapted Bengali version of the HLS-EU-Q16/Q6 for adults. Inq J Health Care Organ Provis Financ. (2024) 61:00469580241248132. doi: 10.1177/00469580241248132

Crossref Full Text | Google Scholar

15. Lorini, C, Lastrucci, V, Mantwill, S, Vettori, V, and Bonaccorsi, G. Florence health literacy research group. Measuring health literacy in Italy: a validation study of the HLS-EU-Q16 and of the HLS-EU-Q6 in Italian language, conducted in Florence and its surroundings. Ann Ist Super Sanita. (2019) 55:10–8. doi: 10.4415/ANN_19_01_04

PubMed Abstract | Crossref Full Text | Google Scholar

16. Sørensen, K, Pelikan, JM, Röthlin, F, Ganahl, K, Slonska, Z, Doyle, G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Pub Health. (2015) 25:1053–8. doi: 10.1093/eurpub/ckv043

PubMed Abstract | Crossref Full Text | Google Scholar

17. Romero, SS, De M, SH, and Doring, M. Functional health literacy level and behavior in the health of the elderly. Texto Contexto Enferm. (2019) 27:e5230017. doi: 10.1590/0104-07072018005230017

Crossref Full Text | Google Scholar

18. Eronen, J, Paakkari, L, Portegijs, E, Saajanaho, M, and Rantanen, T. Assessment of health literacy among older Finns. Aging Clin Exp Res. (2019) 31:549–56. doi: 10.1007/s40520-018-1104-9

PubMed Abstract | Crossref Full Text | Google Scholar

19. Cho, YI, Lee, SYD, Arozullah, AM, and Crittenden, KS. Effects of health literacy on health status and health service utilization amongst the elderly. Soc Sci Med. (2008) 66:1809–16. doi: 10.1016/j.socscimed.2008.01.003

Crossref Full Text | Google Scholar

20. Mirzaei, A, Ramezankhani, A, Taheri Tanjani, P, Ghaffari, M, Jorvand, R, Bazyar, M, et al. The effectiveness of health literacy based educational intervention on nutritional outcomes of elderly. Iran J Ageing. (2020) 15:324–37. doi: 10.32598/sija.15.3.2569.1

Crossref Full Text | Google Scholar

21. Bas-Sarmiento, P, Poza-Méndez, M, Fernández-Gutiérrez, M, González-Caballero, JL, and Falcón, RM. Psychometric assessment of the European health literacy survey questionnaire (HLS-EU-Q16) for Arabic/French-speaking migrants in southern Europe. Int J Environ Res Public Health. (2020) 17:8181. doi: 10.3390/ijerph17218181

PubMed Abstract | Crossref Full Text | Google Scholar

22. Wangdahl, JM, Dahlberg, K, Jaensson, M, and Nilsson, U. Psychometric validation of Swedish and Arabic versions of two health literacy questionnaires, eHEALS and HLS-EU-Q16, for use in a Swedish context: a study protocol. BMJ Open. (2019) 9:e029668. doi: 10.1136/bmjopen-2019-029668

PubMed Abstract | Crossref Full Text | Google Scholar

23. Mialhe, FL, Sampaio, HADC, Moraes, KL, Brasil, VV, and Rebustini, F. Psychometric properties of the Brazilian version of the European health literacy survey questionnaire short form. Health Promot Int. (2022) 37:daac130. doi: 10.1093/heapro/daac130

PubMed Abstract | Crossref Full Text | Google Scholar

24. Konopik, N, Kaspar, R, Penger, S, Oswald, F, and Himmelsbach, I. Advancing health literacy measurement in old age. Health Promot Int. (2021) 36:1310–23. doi: 10.1093/heapro/daaa137

PubMed Abstract | Crossref Full Text | Google Scholar

25. Maie, A, Kanekuni, S, Yonekura, Y, Nakayama, K, and Sakai, R. Evaluating short versions of the European health literacy survey questionnaire (HLS-EU-Q47) for health checkups. 総合健診 (2021);48:351–8, 358, doi: 10.7143/jhep.2020-28

Crossref Full Text | Google Scholar

26. Elsworth, GR, Beauchamp, A, and Osborne, RH. Measuring health literacy in community agencies: a Bayesian study of the factor structure and measurement invariance of the health literacy questionnaire (HLQ). BMC Health Serv Res. (2016) 16:508. doi: 10.1186/s12913-016-1754-2

PubMed Abstract | Crossref Full Text | Google Scholar

27. Maindal, HT, Kayser, L, Norgaard, O, Bo, A, Elsworth, GR, and Osborne, RH. Cultural adaptation and validation of the health literacy questionnaire (HLQ): robust nine-dimension Danish language confirmatory factor model. Springerplus. (2016) 5:1232. doi: 10.1186/s40064-016-2887-9

PubMed Abstract | Crossref Full Text | Google Scholar

28. Abacigil, F, Harlak, H, Okyay, P, Kiraz, DE, Gursoy Turan, S, Saruhan, G, et al. Validity and reliability of the Turkish version of the European health literacy survey questionnaire. Health Promot Int. (2019) 34:658–67. doi: 10.1093/heapro/day020

PubMed Abstract | Crossref Full Text | Google Scholar

29. Sun, Y, Sun, J, Zhao, Y, Cheng, A, and Zhou, J. A new comprehensive oral health literacy scale: development and psychometric evaluation. BMC Oral Health. (2021) 21:429. doi: 10.1186/s12903-021-01795-7

PubMed Abstract | Crossref Full Text | Google Scholar

30. Finbråten, HS, Nowak, P, Griebler, R, Bíró, É, Vrdelja, M, Charafeddine, R, et al. The HLS(19)-COM-P, a new instrument for measuring communicative health literacy in interaction with physicians: development and validation in nine European countries. Int J Environ Res Public Health. (2022) 19:11592. doi: 10.3390/ijerph191811592

PubMed Abstract | Crossref Full Text | Google Scholar

31. Griese, L, Finbråten, HS, Francisco, R, De Gani, SM, Griebler, R, Guttersrud, Ø, et al. HLS(19)-NAV-validation of a new instrument measuring navigational health literacy in eight European countries. Int J Environ Res Public Health. (2022) 19:13863. doi: 10.3390/ijerph192113863

PubMed Abstract | Crossref Full Text | Google Scholar

32. Beauchamp, A, Buchbinder, R, Dodson, S, Batterham, RW, Elsworth, GR, McPhee, C, et al. Distribution of health literacy strengths and weaknesses across socio-demographic groups: a cross-sectional survey using the health literacy questionnaire (HLQ). BMC Public Health. (2015) 15:678. doi: 10.1186/s12889-015-2056-z

PubMed Abstract | Crossref Full Text | Google Scholar

33. García-García, D, and Pérez-Rivas, FJ. Health literacy and its sociodemographic predictors: a cross-sectional study of a population in Madrid (Spain). Int J Environ Res Public Health. (2022) 19:11815. doi: 10.3390/ijerph191811815

PubMed Abstract | Crossref Full Text | Google Scholar

34. Ehmann, AT, Groene, O, Rieger, MA, and Siegel, A. The relationship between health literacy, quality of life, and subjective health: results of a cross-sectional study in a rural region in Germany. Int J Environ Res Public Health. (2020) 17:1683. doi: 10.3390/ijerph17051683

PubMed Abstract | Crossref Full Text | Google Scholar

35. Lindau, ST, Basu, A, and Leitsch, SA. Health literacy as a predictor of follow-up after an abnormal pap smear. J Gen Intern Med. (2006) 21:829–34. doi: 10.1111/j.1525-1497.2006.00534.x

PubMed Abstract | Crossref Full Text | Google Scholar

36. Zanobini, P, Lorini, C, Lastrucci, V, Minardi, V, Possenti, V, Masocco, M, et al. Health literacy, socio-economic determinants, and healthy Behaviours: results from a large representative sample of Tuscany region, Italy. Int J Environ Res Public Health. (2021) 18:12432. doi: 10.3390/ijerph182312432

Crossref Full Text | Google Scholar

37. Suka, M, Odajima, T, Okamoto, M, Sumitani, M, Igarashi, A, Ishikawa, H, et al. Relationship between health literacy, health information access, health behavior, and health status in Japanese people. Patient Educ Couns. (2015) 98:660–8. doi: 10.1016/j.pec.2015.02.013

PubMed Abstract | Crossref Full Text | Google Scholar

38. Duplaga, M. Determinants and consequences of limited health literacy in polish society. Int J Environ Res Public Health. (2020) 17:642. doi: 10.3390/ijerph17020642

PubMed Abstract | Crossref Full Text | Google Scholar

39. Liu, YB, Liu, L, Li, YF, and Chen, YL. Relationship between health literacy, health-related behaviors and health status: a survey of elderly Chinese. Int J Environ Res Public Health. (2015) 12:9714–25. doi: 10.3390/ijerph120809714

PubMed Abstract | Crossref Full Text | Google Scholar

40. Theilmann, M, Lemp, JM, Winkler, V, Manne-Goehler, J, Marcus, ME, Probst, C, et al. Patterns of tobacco use in low and middle income countries by tobacco product and sociodemographic characteristics: nationally representative survey data from 82 countries. BMJ. (2022) 378:e067582. doi: 10.1136/bmj-2021-067582

Crossref Full Text | Google Scholar

41. Li, L, Ouyang, Y, Wang, H, Huang, F, Wang, Y, Zhang, J, et al. Disparities in fresh fruit and vegetable intake by sociodemographic and behavioural factors among adults in China. Public Health Nutr. (2022) 25:649–56. doi: 10.1017/S1368980020003274

PubMed Abstract | Crossref Full Text | Google Scholar

42. Garnett, C, Kastaun, S, Brown, J, and Kotz, D. Alcohol consumption and associations with sociodemographic and health-related characteristics in Germany: a population survey. Addict Behav. (2022) 125:107159. doi: 10.1016/j.addbeh.2021.107159

PubMed Abstract | Crossref Full Text | Google Scholar

43. Vrdelja, M, Vrbovšek, S, and Berzelak, J. Zdravstvena pismenost odraslih v Sloveniji Nacionalni inštitut za javno zdravje (2022) Available at: http://www.dlib.si/?URN=URN:NBN:SI:DOC-LWRMMFD6.

Google Scholar

44. Tze, HL, and Bentler, PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Struct Equ Model. (1999) 6:1–55. doi: 10.1080/10705519909540118

Crossref Full Text | Google Scholar

45. Fornell, C, and Larcker, DF. Evaluating structural equation models with unobservable variables and measurement error. J Mark Res. (1981) 18:39–50. doi: 10.1177/002224378101800104

Crossref Full Text | Google Scholar

46. Nunnally, JC, and Bernstein, IH. Psychometric theory. 3rd ed. New York, NY: McGraw-Hill (1994).

Google Scholar

47. Kline, RB. Principles and practice of structural equation modeling. 4th ed. New York, NY: Guilford Press (2016).

Google Scholar

48. Sántha, Á. The sociodemographic determinants of health literacy in the ethnic Hungarian mothers of young children in Eastern Europe. Int J Environ Res Public Health. (2021) 18:5517. doi: 10.3390/ijerph18115517

PubMed Abstract | Crossref Full Text | Google Scholar

49. Aaby, A, Friis, K, Christensen, B, Rowlands, G, and Maindal, HT. Health literacy is associated with health behaviour and self-reported health: a large population-based study in individuals with cardiovascular disease. Eur J Prev Cardiol. (2017) 24:1880–8. doi: 10.1177/2047487317729538

Crossref Full Text | Google Scholar

50. Tiller, D, Herzog, B, Kluttig, A, and Haerting, J. Health literacy in an urban elderly east-German population – results from the population-based CARLA study. BMC Public Health. (2015) 15:883. doi: 10.1186/s12889-015-2210-7

Crossref Full Text | Google Scholar

51. McAnally, K, and Hagger, MS. Health literacy, social cognition constructs, and health behaviors and outcomes: a meta-analysis. Health Psychol. (2023) 42:213–34. doi: 10.1037/hea0001266

PubMed Abstract | Crossref Full Text | Google Scholar

52. Wieczorek, M, Meier, C, Kliegel, M, and Maurer, J. Health literacy and unhealthy lifestyle behaviors in older adults: does social connectedness matter? Eur J Pub Health. (2023) 33:ckad160.254. doi: 10.1093/eurpub/ckad160.254

Crossref Full Text | Google Scholar

Keywords: HLS-EU-Q16, health literacy, Slovenia, adults, older adults, validity, reliability

Citation: Lamot M and Kirbiš A (2024) The validity and reliability of the Slovenian version of the health literacy questionnaire short-form (HLS-EU-Q16) among adults and older adults. Front. Public Health. 12:1474539. doi: 10.3389/fpubh.2024.1474539

Received: 01 August 2024; Accepted: 15 November 2024;
Published: 11 December 2024.

Edited by:

Rong Yang, Shandong University, China

Reviewed by:

Dirk Bruland, Bielefeld University of Applied Sciences, Germany
Laura Rabin, Brooklyn College (CUNY), United States
Francisco Javier Ferreira-Alfaya, University of Granada, Spain

Copyright © 2024 Lamot and Kirbiš. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Monika Lamot, bW9uaWthLmxhbW90MUB1bS5zaQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Research integrity at Frontiers

Man ultramarathon runner in the mountains he trains at sunset

95% of researchers rate our articles as excellent or good

Learn more about the work of our research integrity team to safeguard the quality of each article we publish.


Find out more