Hoai Thi Thu Nguyen1,2*
Thuong Thi Thu Ha2
Hieu Ba Tran1,2
Dung Viet Nguyen1,2
Hung Manh Pham1,3
Phuong Minh Tran1Tuan Minh Pham1,3Thomas G. Allison4Christopher M. Reid5,6James N. Kirkpatrick7,8- 1Vietnam National Heart Institute, Bach Mai Hospital, Hanoi, Vietnam
- 2Department of Internal Medicine, VNU-University of Medicine and Pharmacy, Hanoi, Vietnam
- 3Department of Cardiology, Hanoi Medical University, Hanoi, Vietnam
- 4Department of Cardiovascular Medicine, Mayo Clinic, Rochester, MN, United States
- 5School of Population Health, Curtin University, Perth, WA, Australia
- 6School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
- 7Cardiovascular Division, Department of Medicine, University of Washington Medical Center, Seattle, WA, United States
- 8Department of Bioethics and Humanities, University of Washington Medical Center, Seattle, WA, United States
Background: Insufficient data exists regarding the relationship between body mass index (BMI) and the prognosis of chronic heart failure (CHF) specifically within low- and middle-income Asian countries. The objective of this study was to evaluate the impact of BMI on adverse outcomes of ambulatory patients with CHF in Vietnam.
Methods: Between 2018 and 2020, we prospectively enrolled consecutive outpatients with clinically stable CHF in an observational cohort, single-center study. The participants were stratified according to Asian-specific BMI thresholds. The relationships between BMI and adverse outcomes (all-cause death and all-cause hospitalization) were analyzed by Kaplan–Meier survival curves and Cox proportional-hazards model.
Results: Among 320 participants (age 63.5 ± 13.3 years, 57.9% male), the median BMI was 21.4 kg/m2 (IQR 19.5–23.6), and 10.9% were underweight (BMI <18.50 kg/m2). Over a median follow-up time of 32 months, the cumulative incidence of all-cause mortality and hospitalization were 5.6% and 19.1%, respectively. After multivariable adjustment, underweight patients had a significantly higher risk of all-cause mortality than patients with normal BMI (adjusted hazard ratios = 3.03 [95% CI: 1.07–8.55]). Lower BMI remained significantly associated with a worse prognosis when analyzed as a continuous variable (adjusted hazard ratios = 1.27 [95% CI: 1.03–1.55] per 1 kg/m2 decrease for all-cause mortality). However, BMI was not found to be significantly associated with the risk of all-cause hospitalization (p > 0.05).
Conclusion: In ambulatory patients with CHF in Vietnam, lower BMI, especially underweight status (BMI < 18.5 kg/m2), was associated with a higher risk of all-cause mortality. These findings suggest that BMI should be considered for use in risk classification, and underweight patients should be managed by a team consisting of cardiologists, nutritionists, and geriatricians.
Introduction
Heart failure (HF) stands as a prominent contributor to global morbidity and mortality and has become a rapidly growing healthcare burden in Vietnam (1–3). Overweight and obesity, characterized by a higher body mass index (BMI), have been identified as important risk factors for the development of HF due to negative changes in hemodynamics and cardiac structure (4). The number of overweight/obese people is expected to rise rapidly, especially in low- and middle-income countries (5). The improved living standards in the Asia-Pacific region have led to lifestyle changes, including adopting unhealthy diets and physical inactivity (6, 7). This contributes to a dramatic rise in the prevalence of overweight/obesity in the region. Although Vietnam has the lowest obesity rate in Southeast Asia, it has experienced the fastest increase in obesity prevalence (7, 8). A study conducted in Hanoi by Wall et al. revealed that both underweight and overweight were prevalent among urban adults (9).
Some previous longitudinal studies have shown that obese patients with chronic heart failure (CHF) have a lower risk of mortality, which is termed the “obesity paradox” (10–12). In addition, these findings also suggest that individuals who are underweight may have a higher risk of mortality compared to those who are normal or overweight (12, 13). Nevertheless, a recent study published in 2023 found no supporting evidence for the protective effect of obesity, raising questions about the existence of the “obesity paradox” (14). On the other hand, the prognosis of CHF is also influenced by the management of post-discharged patients, which may confound the relationship between BMI and clinical outcomes. Multiple large clinical trials have confirmed that the implementation of guideline-directed medication therapy (GDMT) effectively decreases mortality rates, reduces heart failure (HF) hospitalizations, and enhances functional capacity (15). The association between BMI and the outcome of CHF may become more apparent when there are fewer confounding factors present in patients who are stable and managed within a heart failure program. Currently, there are limited available data on the relationship between BMI and the outcomes of HF patients in low- and middle-income Asian countries, particularly in Vietnam. To address this gap, we conducted a prospective cohort study to investigate the association between BMI and the prognosis of ambulatory CHF patients at the Vietnam National Heart Institute (VNHI), Bach Mai Hospital, Hanoi, Vietnam.
Methods
Study population
Our prospective study enrolled consecutive patients with stable CHF in the specialized HF program at Outpatient Department (ODP), VNHI, Bach Mai Hospital from April 2018 to September 2020. Inclusion criteria were as follows: (1) age ≥ 18 years, (2) diagnosis of CHF was established according to the European Society of Cardiology (ESC) guidelines (1, 16), (3) comprehensive clinical and laboratory tests were conducted at the ODP, VNHI during the first appointment, (4) patients were treated with GDMT for HF with optimal doses of disease-modifying drugs, and (5) patients were advised on diet and lifestyle modification during the treatment duration. We excluded patients with acute HF, acute exacerbation of CHF, and other severe medical conditions. Patients who did not comply with the GDMT in the HF program were also excluded. In cases where the patient or patient’s family members could not be contacted, we excluded patients due to loss to follow-up.
Data collection and definitions
Baseline survey
The cardiologists of VNHI’s HF program recorded patients’ demographics, medical history, clinical characteristics, medications, and HF risk factors on a pre-established data collection form (DCF). Systolic/diastolic blood pressure was measured with an automatic sphygmomanometer by trained nurses. Data on electrocardiograms, echocardiography, and laboratory tests were also collected upon presentation. The estimated glomerular filtration rate (eGFR) was determined by employing the Modification of Diet in Renal Disease (MDRD) formula for calculation (17). Anemia was defined based on the criteria established by the World Health Organization (hemoglobin levels <13.0 g/dL for males and < 12.0 g/dL for females) (18). Patients were classified as current smokers if they were currently smoking or had smoked for at least 5 years and quit smoking within 1 year before the study. Alcohol consumption was defined as a weekly alcohol intake of ≥7 standard drinks (19). The HF subtypes were determined based on the left ventricle ejection fraction (LVEF): HF with reduced LVEF (HFrEF, LVEF ≤40%), HF with mildly reduced LVEF (HFmrEF, 41% ≤ LVEF ≤49%), and HF with preserved LVEF (HFpEF, LVEF ≥50%) (1).
BMI was calculated as body weight (kg) divided by squared height (m2) (20). Weight was measured by a vertical scale R62-120 and was recorded to the nearest 0.1 kg. Height was measured using a metric stadiometer attached to a wall and calibrated according to local policy, with measurements taken to the nearest 1 cm. The process of measuring weight and height was carried out by the HF nurses. Participants were classified into four groups based on Asian-specific BMI cutoff points using WHO classifications: underweight (BMI <18.5 kg/m2), normal (BMI 18.5–22.9 kg/m2), overweight (BMI 23.0–24.9 kg/m2) and obesity (BMI ≥25.00 kg/m2) (21, 22).
Outcomes and follow-up
A three-year follow-up survey was designed to collect data on outcomes of interest, including all-cause mortality and all-cause hospitalizations. All-cause mortality included all deaths which were determined by hospital death records or confirmed by patients’ family members. All-cause hospitalization was defined as hospital admission for any cause. Our patients were followed by dedicated cardiologists and nurses via direct contact in the outpatient setting if the participants attended in-person visits at VNHI. Alternatively, phone interviews were conducted when the participants were unavailable for an in-person visit. The information was collected by trained nurses using pre-written questionnaires in the DCFs.
Statistical analysis
Continuous variables were presented as either the mean ± standard deviation (SD) or the median (interquartile range, IQR), while categorical variables were expressed as the number of subjects (%) in the dataset. Between-group differences were evaluated using Student’s t-test, Mann–Whitney U test, ANOVA test, or Kruskal Wallis test for continuous variables as appropriate. The Chi-square (χ2) test or Fisher’s exact test was used to compare categorical variables. The unadjusted risks of the clinical outcomes (all-cause mortality and hospitalization) across the BMI groups were assessed using the Kaplan–Meier survival curve analysis with the intergroup differences assessed by the log-rank test. Given the low occurrence of events among individuals classified as overweight or obese, we categorized the body mass index (BMI) into three groups: underweight (BMI <18.5 kg/m2), normal range (BMI 18.5–22.9 kg/m2), and overweight/obesity (BMI ≥23.0 kg/m2) to evaluate the impact of BMI on the outcomes of interest. Univariable and multivariable Cox proportional hazard regression analyses were then performed to evaluate the hazard ratios (HR), adjusted HRs, and their corresponding 95% confidence intervals (95% CI) using BMI as either a continuous or categorical variable. To avoid overfitting, only variables which reached a p-value less than 0.10 (in univariable analysis) were included in the multivariable analysis. In addition, sensitivity analysis was performed to assess whether using LVEF or heart failure classification in the multivariate Cox regression model caused significant change in the result. All tests were two-sided, and a value of p < 0.05 was considered statistically significant. All analyses were performed using Stata MP version 17.0 (Stata, College Station, TX, United States).
Ethics approval
Ethical approval for the study was obtained from the ethics committee of Bach Mai Hospital. Each patient was given an information sheet that explicitly outlined the study’s objectives, procedures, and participant rights. Written informed consent was obtained from all participants. All patient-identifying information was coded and maintained in strict confidentiality.
Results
Baseline patients’ characteristics
From April 2018 to September 2020, a total of 320 outpatients with CHF were included in our study, 124 patients were excluded due to their baseline medical condition, and eight patients were excluded because of loss to follow-up. The detailed population flow diagram may be found in Figure 1. The overall mean age was 63.5 ± 13.3 years, and BMI (median, IQR) was 21.4 (19.5–23.6) kg/m2. Figure 2 shows the sex distribution across the BMI categories. There were 188 patients with BMI within the normal range, which accounted for 58.8% of patients: 112 men (35.0%), 76 women (23.8%); 35 underweight patients (10.9%): 19 men (5.9%), six women (5.0%); 52 overweight patients (16.3%): 29 men (9.1%), 23 women (7.2%); and 45 obese patients (14.1%): 31 men (9.7%), 14 women (4.4%). Notably, a majority of obese patients (42; 13.1%) had obesity class I (25.0 ≤ BMI ≤29.9), and there were only three patients (0.9%) had obesity class II (BMI ≥30.0 kg/m2) (21). Among them, there were no patients with a BMI exceeding 31.0 kg/m2. The baseline characteristics of the entire study population and by categories of BMI are shown in Table 1. There were no significant differences across the BMI groups regarding socio-demographics, dyslipidemia, diabetes, hypertension, smoking, drinking, HF duration, blood pressure, heart rate, NYHA functional class, NT-proBNP, renal function, the prevalence of atrial fibrillation, and the use of disease-modifying medications (p > 0.05 for all). Anemia was more common in the underweight group than in the higher BMI groups, but the differences were not statistically significant (p > 0.05).
Figure 1. The study population flow diagram.
Figure 2. Distribution of genders by BMI categories.
Table 1. Baseline characteristics of study participants stratified by BMI categories.
There was no significant difference observed in the prevalence of HFrEF and HFpEF among the various BMI categories (p > 0.05). Nevertheless, HFmrEF prevalence was more frequent in the overweight and obesity groups (34.6 and 39.1%, respectively) than in the underweight and the normal range groups (22.9% and 17.0%, respectively). Additionally, the HFmrEF tended to have a higher mean BMI (22.5 ± 3.2) compared to the HFrEF and HFpEF groups (21.4 ± 3.2 and 21.5 ± 2.5, respectively) with a p-value of less than 0.05. Echocardiographic left ventricular as well as right ventricular end-diastolic diameters were not different between groups (p > 0.05 for both).
Impact of body mass index on the outcomes
During a median follow-up time of 32 months (IQR 27–40 months), there were 18 patients (5.6%) with all-cause death and 61 patients (19.1%) with all-cause hospitalization. The incident mortality rate was 2.1% per 100 person-years in the overall study population, 6.6% among underweight patients, 2.1% among normal range patients, and 0.4% among overweight/obesity patients. Kaplan–Meier curves illustrating the cumulative probability of time to occurrence of all-cause mortality and all-cause hospitalization are represented in Figure 3. The underweight group showed a markedly higher incidence of all-cause mortality compared to both the normal range and overweight groups, with statistical significance (p = 0.0008). However, there was no significant difference between the three groups regarding all-cause hospitalization (p = 0.1473).
Figure 3. Kaplan–Meier curves of clinical outcomes stratified by BMI categories. Kaplan–Meier curves to predict (A) all-cause mortality and (B) all-cause hospitalization for outpatients with chronic heart failure by body mass index categories.
Table 2 displays the results of univariable Cox regression analyses of predictive factors for all-cause mortality and all-cause hospitalization. Older age, worse NYHA functional class, lower LVEF, eGFR <60 (mL/min/1.73 m2), and lower BMI (both as a continuous variable and as a categorial variable) were significantly associated with higher mortality risk while only age and sex were found to be significantly associated with the risk of all-cause hospitalization. Nevertheless, multivariable Cox regression analyses (Table 3) indicated that only age (adjusted HR = 1.08 [95% CI: 1.03–1.13] in model 1 and adjusted HR = 1.08 [95% CI: 1.04–1.13] in model 2) and BMI were independent predictors of all-cause mortality. Specifically, when used as a continuous variable, model 1 demonstrated an inverse relationship between BMI and the risk of all-cause mortality (adjusted HR per 1 kg/m2 decrease: 1.27 [95%CI: 1.03–1.55, p = 0.023]). When used as a categorial variable, the underweight group (BMI <18.5 kg/m2) was significantly associated with a higher mortality risk (adjusted HR = 3.03 [95% CI: 1.07–8.55, p = 0.036]) compared to the normal range group (BMI 18.5–22.9 kg/m2). However, the risk for all-cause mortality was not significantly different between the overweight/obese group (BMI ≥23.0 kg/m2) and the normal range group, although there was a trend towards a lower risk of death in overweight/obese compared to normal weight patients (adjusted HR = 0.22 [95% CI: 0.03–1.79, p = 0.159]). Similar results were obtained in a sensitivity analysis where the HF phenotype variable was utilized in place of the LVEF variable (Supplementary Table S1).
Table 2. Univariable cox regression analysis of predictors for clinical outcomes.
Table 3. Multivariable cox regression analysis of predictors for clinical outcomes.
Notably, BMI was not found to be significantly associated with the risk of all-cause hospitalization (adjusted HR per 1 kg/m2 decrease: 1.06 [95%CI: 0.97–1.16, p = 0.215] in model 1 and adjusted HR = 1.60 [95% CI: 0.79–3.23, p = 0.193] for underweight group/adjusted HR = 0.81 [95% CI: 0.45–1.49, p = 0.504] for overweight/obesity group in model 2) in multivariable analyses. Nevertheless, older age (adjusted HR per 1 year increase: 1.03 [95%CI: 1.01–1.05] in both models) and female sex (adjusted HR = 1.68 [95% CI: 1.01–2.78] in model 1 and adjusted HR = 1.68 [95% CI: 1.02–2.78] in model 2) remained significant predictors of all-cause hospitalization.
Discussion
To our knowledge, this is the first prospective study investigating the association between BMI and clinical outcomes among HF outpatients in Vietnam. The major findings of the present study were as follows: (1) A lower body mass index, particularly being underweight, demonstrated a significant association with a higher incidence of all-cause mortality; (2) There was a trend towards a lower risk of death in overweight/obese compared to normal weight patients, but it is not significant; and (3) BMI did not show a significant association with the risk of all-cause hospitalization.
BMI and all-cause mortality risk
The phenomenon known as the obesity paradox in patients with heart failure (HF) refers to the noteworthy observation of a lower risk of mortality and other adverse events among individuals with higher body mass index (BMI), in contrast to those with lower BMI who exhibit a worse prognosis (23, 24). This phenomenon is counterintuitive to the well-known associations between obesity and recognized risk factors for cardiovascular disease, including diabetes, high blood pressure, high low-density lipoprotein (LDL) cholesterol, and heightened chronic inflammation, but is observed in several chronic conditions, particularly those with heart failure (25).
Horwich et al. (23) were the pioneering authors who reported on this paradox in a prospective, single-center cohort study involving 1,203 patients diagnosed with systolic heart failure. The results revealed that higher BMI was not associated with increased mortality but may be a protective factor for improved survival (23). In this study, the underweight HF patients exhibited the worst prognosis, with the normal-range BMI group following suit. After that time, numerous studies have reported similar findings. For example, the largest retrospective analysis investigating the association between body mass index (BMI) and in-hospital mortality involved over 108,000 patients diagnosed with HFrEF and HFpEF from the ADHERE study. This study demonstrated a significant association, as a 10% increase in mortality was observed with each five-unit decrease in BMI (26). A more recent meta-analysis of published research on BMI and HF outcomes included 22,807 hospitalized patients with both HFrEF and HFpEF and showed that those at the highest risk of the three outcomes had low BMI (<20 kg/m2) while those at lowest risk were in the overweight category (BMI 25–29.9 kg/m2), after a median follow-up of 2.85 years (13). Furthermore, a negative correlation between mortality and BMI was also observed in Asian heart failure populations. An analysis of a Korean HF registry that included 4,146 patients hospitalized for acute HF showed that a lower BMI is associated with an increased risk of mortality, and this relationship is observed consistently across various comorbidities and heart failure subtypes (27). The data from the PURSUIT-HFpEF registry in Japan, which included 846 patients, also determined that being underweight was significantly associated with poor prognosis in HFpEF (28). In addition, a collaborative meta-analysis, which included 8 studies involving 7,224 East Asian HF patients, also demonstrated a strong inverse association between BMI and mortality (29).
Despite abundant evidence supporting an inverse association between BMI and mortality in HF, most of the studies were conducted in Western and high-income Asian countries. Therefore, acquiring additional data on the relationship between BMI and the outcomes of HF patients in low- and middle-income Asian countries, characterized by lower mean body mass indices, a higher prevalence of underweight patients, and differing eating habits and nutritional statuses compared to those in Western countries, could make a valuable contribution to the existing literature (22, 28). In this study, after adjusting for appropriate confounders, the results showed that lower BMI (aHR per 1 kg/m2 decrease: 1.27 [95% CI: 1.03–1.55]), especially underweight status (aHR = 3.03 [95% CI: 1.07–8.55]), was independently associated with a higher risk of all-cause mortality. However overweight/obesity status was not significantly linked to the outcome (aHR = 0.22 [95% CI: 0.03–1.79]).
A recent study, based on PARADIGM-HF data, yielded results similar to ours, as it found no survival benefits associated with obesity while the alterative anthropometric indices (e.g., waist-to-height ratio) was significantly associated with the primary outcome (14). This result can be explained by the close impact of waist-to-height ratio (WHtR) on cardiorespiratory fitness (CRF), which is an important prognostic factor for HF (30). Specifically, in patients with abdominal obesity and a high WHtR, the increase in intra-abdominal pressure due to chest expansion and diaphragm descent during inspiration may contribute to a decrease in CRF (30). Furthermore, a recent study has demonstrated that WHtR and waist circumference (WC) are more strongly associated with VO2 max than BMI (31). Notably, it has been also suggested that the obesity paradox may be more pronounced in HF patients with low CRF (32).
The blunting of the obesity paradox in this study may also be attributed to several other factors. First, the study population did not show substantial differences in baseline characteristics across BMI subgroups, specifically in relation to potential confounding variables such as age, gender, comorbidities, smoking status, and optimal medications for the treatment of heart failure. This condition is important in minimizing the risk of bias when evaluating the influence of BMI since overweight and obese individuals are more likely to have obesity-related symptoms, including dyspnea, fatigue, and leg swelling, earlier and more frequently, and thus are monitored more closely by physicians (33). VNHI’s outpatient heart failure program comprehensively evaluates and monitors all patients, enabling physicians to remain current on their patient’s conditions and make timely treatment adjustments. It ensures adherence to guideline-directed medical therapy in the majority of patients. Additionally, several studies demonstrated that patients who were managed in specialized HF centers were more likely to receive GDMT and target doses of disease-modifying drugs and, as a result, likely had better prognoses compared to those in general cardiology outpatient clinics (34). The survival and readmission rates were significantly improved, especially in patients with home telemonitoring by trained medical staff, which may also make it difficult to evaluate the differences in mortality among BMI groups (35, 36). Second, the patients with obesity class I and II in this study made up significantly lower proportions (13.1% and 0.9%) of the total population, compared to previous studies, and therefore the sample size may be insufficiently powered to detect the survival benefits of high BMI on mortality. Third, differences in race and other clinical characteristics of the enrolled patients between our study and previous studies may impact the effects of BMI. Finally, the 32-month median follow-up period in this study may not provide adequate time to assess mortality events, especially if there are time-dependent changes in the interaction between BMI and HF and their effects on total mortality (37).
Several hypotheses explaining the mechanistic links between underweight status and poor outcomes have been proposed. In heart failure, it has been demonstrated that being underweight is characterized by a decrease in muscle mass and function (sarcopenia), as well as a reduction in tissue mass (cachexia) (38, 39). Sarcopenia can be attributed to various factors, including the natural process of aging, lack of physical activity leading to disuse muscle atrophy, malnutrition, and disease (39). Cardiac cachexia arises from the imbalance between protein synthesis and protein degradation, and it can also stem from impaired nutrient absorption (40). Data from Studies Investigating Comorbidities Aggravating Heart Failure (SICA-HF) revealed that sarcopenia and cachexia are prevalent in patients with CHF (41–43). Both of these conditions result in unintentional weight loss, which has been demonstrated to be associated with an increased risk of mortality in chronic heart failure (44). Moreover, another study involving 268 ambulatory HF patients from SICA-HF with a mean follow-up of 67.2 ± 28.02 months revealed that muscle wasting is a strong predictor of death (45). Furthermore, the prevalence of acute cardiovascular events in underweight patients with CHF may be higher than in those with normal weight because of immunodeficiency, which leads to susceptibility to severe infection and frailty (46). In addition to the mentioned mechanisms, the lack of protective effects of obesity may also contribute to poor outcomes in underweight patients. The increase in lean mass among obese patients may significantly contribute to improved long-term outcomes by enabling greater cardio-respiratory fitness. Additionally, surplus adiposity appears to induce the production of pro-inflammatory cytokines, potentially offering greater protective effects in overweight and obese patients with lower levels of systemic inflammation. Moreover, excess adipose tissue mobilizes fat molecules, thereby providing additional energy in patients with severe HF and thereby preventing the wasting of lean tissue more efficiently than exogenous nutrients (47–49). On the other hand, obesity is also associated with catecholamine resistance, which may potentially confer a protective effect (48–50).
It is known that CHF patients had a high risk of experiencing malnutrition due to an imbalance that exists between the processes of protein catabolism and anabolism (51). Given that the recent guidelines employ a BMI <18.5 kg/m2 as a diagnostic indicator of malnutrition, a lower BMI can be considered a strong indicator of malnutrition and is, therefore, closely associated with being underweight (52). A post hoc analysis of the TOPCAT database found that patients with HFpEF with moderate to severe risk of malnutrition had a higher risk of adverse outcomes than those without risk for malnutrition (53). In addition, even after adjusting for lifestyle and clinical risk factors, the significant relationship between moderate to severe malnutrition risk and the cardiovascular adverse outcomes persisted. On the other hand, skeletal muscle wasting and reduced muscle strength due to sarcopenia ultimately lead to reduced exercise capacity and contribute to the development of frailty in affected patients (25). A study in Japan showed that a low BMI exhibited a strong association with a high prevalence of frailty, especially in the elderly population (54). Furthermore, this study also showed that underweight patients displayed frailty not only in terms of physical health but also in the aspects of oral and social well-being (54). These findings suggest that underweight patients may exhibit multiple types of frailty, which in turn can lead to reduced energy intake and an increased risk of malnutrition. Furthermore, malnutrition itself can lead to a reduction of muscle mass, which can exacerbate frailty development, creating a harmful cycle that culminates in a decline in BMI (55). Ultimately, this can result in an individual being underweight. Consequently, nearly all underweight patients are likely to experience concurrent malnutrition and frailty, with underweight itself representing an advanced stage of systemic illness (28). Data from the PURSUIT-HFpEF registry showed that being underweight was a trend in the Asian HFpEF population, and the patients experienced poor outcomes partly due to their frailty and malnutrition (28). Notably, a recent retrospective study showed that underweight and the risk of malnutrition independently predict in-hospital death in males but not in females with HF (56). This study differs from ours in terms of the study population (inpatients vs. outpatients) and the follow-up duration (in-hospital monitoring vs. long-term follow-up). Nevertheless, the results from Kwaśny et al. still suggest that malnutrition may not always be the primary factor contributing to increased in-hospital mortality in HF patients.
In addition to inadequate intake of protein and calories, malnutrition in heart failure patients may also encompass deficiencies in vitamins and minerals. Several micronutrients act as crucial cofactors in metabolic processes and play a vital role in optimizing energy efficiency and utilization (57). Some specific cardiomyopathies are identified that relate to genetic deficiencies in taurine, L-carnitine, and thiamine (58). It has also been revealed that several micronutrient deficiencies were present in the failing heart (59). Moreover, micronutrient supplementation could play an essential role in managing the catabolic state of cardiac cachexia (60). Consequently, the administration of both protein-energy malnutrition and micronutrient deficiencies should be considered a favorable choice for patients with heart failure.
BMI and all-cause hospitalization risk
In the present study, BMI was not found to be an independent risk factor of all-cause hospitalization. Similar results were shown in a study on 2,501 CHF patients with HFpEF (61). Time to HF re-hospitalization is shorter in patients with high BMI compared with normal BMI. However, there was no significant difference observed in the time from follow-up to the first all-cause hospitalization between BMI categories. Recently, an analysis of data from the Kyoto Congestive Heart Failure registry involving 3,509 patients with acute decompensated HF also revealed that the BMI status did not appear to affect the risk of HF hospitalization (62). On the other hand, in a meta-analysis that included six studies, wherein the secondary outcomes were HF hospitalization rates during a follow-up period of 1.5 to 4.1 years, it was discovered that a BMI of ≥30 kg/m2 was linked with an equivalent risk of hospitalization due to heart failure as compared to the normal BMI group (13). Another retrospective study comprising 2,252 elderly patients with heart failure found that despite a lower incidence of death, higher BMI was associated with an increased risk of 30-day all-cause hospital readmission following HF hospitalization (63). The conflicting associations reported may be due to differences in the time period investigated and the characteristics of the populations studied. Moreover, symptoms of congestive HF, which are not correlated with BMI, are known to be the major cause of hospitalization (64). Similar to the obesity-mortality paradox, further research is required to comprehensively investigate the association between BMI and hospitalization among CHF patients.
Implications and future directions
The current findings demonstrate a notable prevalence of underweight patients within the outpatient HF population in Vietnam and suggest that we should consider using BMI as a supplement to the existing heart failure risk models in risk classification, particularly in resource-constrained settings such as Vietnam and other low- and middle-income Asian countries due to its ease of measurement, requiring neither advanced laboratory tests nor exercise data. In addition, it is essential to pay careful attention to the follow-up of heart failure (HF) patients with underweight status due to their high mortality rates. On the other hand, the importance of recognizing and addressing frailty, sarcopenia, cachexia, and malnutrition in HF patients should also be acknowledged in order to improve their clinical outcomes. Particularly, identifying loss of weight over time may also be an important marker in this population as this has recently shown to be associated with increased all-cause and CVD specific mortality in a healthy elderly cohort (65). To achieve those goals, we recommend managing stable chronic HF patients in an outpatient heart failure program with the collaboration of a multidisciplinary team consisting of cardiologists, nutritionists, and geriatricians. Moreover, further studies are necessary to investigate in detail the impact of protein and vitamin deficiencies on clinical outcomes and evaluate the efficacy of nutritional and BMI-based interventional strategies for underweight HF patients.
Limitations
The present study has several limitations. First, the data of other obesity-related anthropometric measures (waist and hip circumference, muscle mass, adiposity percentage), cardiorespiratory fitness, and formal frailty assessment were lacking. Second, specific serum laboratory tests for the diagnosis of malnutrition status were not performed. Third, relying solely on BMI is inadequate to evaluate body composition compartments and may result in an underestimation of sarcopenia and cachexia among obese patients. Fourth, even after appropriate adjustment, the presence of residual unmeasured confounding factors has the potential to impact the results. Therefore, the conclusion should be treated with caution. Finally, this is a single-center study, subject to limitations in selection and generalizability.
Conclusion
This study results revealed that, among ambulatory outpatients with CHF, a lower BMI, particularly underweight, was associated with an increased risk of all-cause mortality. BMI should be considered for use in risk classification, and underweight patients should be managed by a team consisting of cardiologists, nutritionists, and geriatricians.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving humans were approved by Bach Mai Hospital’s ethics committee and institutional review board. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
HN: supervision, conceptualization, methodology, investigation, writing – original draft preparation and editing, and visualization. TH: investigation, formal analysis, and writing – original draft preparation. HT: methodology, investigation, and writing – original draft preparation. DN: methodology, formal analysis, writing – original draft preparation and editing, and visualization. HP: conceptualization, methodology, investigation, and writing – reviewing and editing. PT: investigation and writing – original draft preparation. TP: investigation and writing – reviewing. TA: conceptualization, methodology, and writing-reviewing and editing. CR: conceptualization, methodology, and writing-reviewing and editing. JK: conceptualization, methodology, writing – reviewing and editing, and visualization. All authors contributed to the article and approved the submitted version.
Acknowledgments
We express our gratitude to the Vietnam National Heart Institute, Bach Mai hospital, for granting us the chance to conduct this study.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnut.2023.1251601/full#supplementary-material
References
1. McDonagh, TA, Metra, M, Adamo, M, Gardner, RS, Baumbach, A, Böhm, M, et al. 2021 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure: developed by the task force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC) with the special contribution of the heart failure association (HFA) of the ESC. Eur Heart J. (2021) 42:3599–726. doi: 10.1093/eurheartj/ehab368
2. Heidenreich, P, Bozkurt, B, Aguilar, D, Allen, LA, Byun, JJ, Colvin, MM, et al. AHA/ACC/HFSA guideline for the management of heart failure. J Card Fail. (2022) 28:810–30. doi: 10.1016/j.cardfail.2022.02.009
3. Nguyen, N-T-V, Tran, DT, Le An, P, Van Hoang, S, Nguyen, H-A, and Chau, HN. Clinical phenotypes and age-related differences in presentation, treatment, and outcome of heart failure with preserved ejection fraction: a Vietnamese multicenter research. Cardiol Res Pract. (2021) 2021:1–9. doi: 10.1155/2021/4587678
4. Ebong, IA, Goff, DC, Rodriguez, CJ, Chen, H, and Bertoni, AG. Mechanisms of heart failure in obesity. Obes Res Clin Pract. (2014) 8:e540–8. doi: 10.1016/j.orcp.2013.12.005
5. Kelly, TY, Yang, W, Chen, CS, Reynolds, K, and He, J. Global burden of obesity in 2005 and projections to 2030. Int J Obes. (2008) 32:1431–7. doi: 10.1038/ijo.2008.102
6. Bays, HE, Ng, J, Sicat, J, and Look, M. Obesity pillars roundtable: obesity and east Asians. Obesity Pillars. (2022) 2:100011. doi: 10.1016/j.obpill.2022.100011
7. BMI company. Impact of growing obesity prevalence in Asia pacific to put pressure on healthcare systems London, UK. (2019). Available from: https://www.fitchsolutions.com/pharma-healthcare/impact-growing-obesity-prevalence-asia-pacific-put-pressure-healthcare-systems-18-07-2019.
8. Huong, PTT, Lam, NT, Thu, NN, Quyen, TC, Lien, DT, Anh, NQ, et al. Prevalence of malnutrition in patients admitted to a major urban tertiary care hospital in Hanoi, Vietnam. Asia Pac J Clin Nutr. (2014) 23:437–44. doi: 10.6133/apjcn.2014.23.3.19
9. Walls, HL, Peeters, A, Son, PT, Quang, NN, Hoai, NT, Loi, D, et al. Prevalence of underweight, overweight and obesity in urban Hanoi, Vietnam. Asia Pac J Clin Nutr. (2009) 18:234–9.
10. Dong, Y, Liang, Z, Donataccio, M, Vanzo, A, and Bosello, O. Obesity paradox and heart failure. Eat Weight Disord. (2020) 26:1697–707. doi: 10.1007/s40519-020-00982-9
11. Alrob, OA, Sankaralingam, S, Alazzam, S, Nusairat, B, Qattoum, M, and Nusair, MB. Obesity paradox among heart failure with reduced ejection fraction patients: a retrospective cohort study. Medicina. (2022) 59:60. doi: 10.3390/medicina59010060
12. Kenchaiah, S, Pocock, SJ, Wang, D, Finn, PV, Zornoff, LAM, Skali, H, et al. Body mass index and prognosis in patients with chronic heart failure: insights from the candesartan in heart failure: assessment of reduction in mortality and morbidity (CHARM) program. Circulation. (2007) 116:627–36. doi: 10.1161/CIRCULATIONAHA.106.679779
13. Sharma, A, Lavie, CJ, Borer, JS, Vallakati, A, Goel, S, Lopez-Jimenez, F, et al. Meta-analysis of the relation of body mass index to all-cause and cardiovascular mortality and hospitalization in patients with chronic heart failure. Am J Cardiol. (2015) 115:1428–34. doi: 10.1016/j.amjcard.2015.02.024
14. Butt, JH, Petrie, MC, Jhund, PS, Sattar, N, Desai, AS, Køber, L, et al. Anthropometric measures and adverse outcomes in heart failure with reduced ejection fraction: revisiting the obesity paradox. Eur Heart J. (2023) 44:1136–53. doi: 10.1093/eurheartj/ehad083
15. Greene, SJ, Butler, J, Hellkamp, AS, Spertus, JA, Vaduganathan, M, Devore, AD, et al. Comparative effectiveness of dosing of medical therapy for heart failure: from the CHAMP-HF registry. J Card Fail. (2022) 28:370–84. doi: 10.1016/j.cardfail.2021.08.023
16. Ponikowski, P, Voors, AA, Anker, SD, Bueno, H, Cleland, JGF, Coats, AJS, et al. 2016 ESC guidelines for the diagnosis and treatment of acute and chronic heart failure: the task force for the diagnosis and treatment of acute and chronic heart failure of the European Society of Cardiology (ESC)developed with the special contribution of the heart failure association (HFA) of the ESC. Eur Heart J. (2016) 37:2129–200. doi: 10.1093/eurheartj/ehw128
17. Levey, A, Greene, T, Kusek, J, and Beck, G, Group MS. A simplified equation to predict glomerular filtration rate from serum creatinine. J Am Soc Nephrol. (2000) 11:155.
18. WHO. Haemoglobin concentrations for the diagnosis of anaemia and assessment of severity In: LM de Regil, editor. Vitamin and mineral nutrition information system. Geneva: World Health Organization (2011)
19. Wong, B, Moore, A, Radhakrishna, A, McDonald, K, and Ledwidge, M. 18 moderate alcohol consumption is associated with progression of left ventricular dysfunction in pre-heart failure. Heart. (2022) 108:A15–6. doi: 10.1136/heartjnl-2022-ICS.18
20. World Health Organization. Obesity and Overweight: World Health Organization. (2021) [cited 2023]. Available from: https://www.who.int/news-room/fact-sheets/detail/obesity-and-overweight.
21. WHO/IASO/IOTF. The Asia-Pacific perspective: Redefining obesity and its treatment. Australia: Health Communications Australia Pty Limited (2000).
22. Consultation, WE. Appropriate body-mass index for Asian populations and its implications for policy and intervention strategies. Lancet (London, England). (2004) 363:157–63. doi: 10.1016/S0140-6736(03)15268-3
23. Horwich, TB, Fonarow, GC, Hamilton, MA, MacLellan, WR, Woo, MA, and Tillisch, JH. The relationship between obesity and mortality in patients with heart failure. J Am Coll Cardiol. (2001) 38:789–95. doi: 10.1016/S0735-1097(01)01448-6
24. Powell-Wiley, TM, Ngwa, J, Kebede, S, Lu, D, Schulte, PJ, Bhatt, DL, et al. Impact of body mass index on heart failure by race/ethnicity from the get with the guidelines-heart failure (GWTG-HF) registry. JACC Heart Fail. (2018) 6:233–42. doi: 10.1016/j.jchf.2017.11.011
25. Lavie, CJ, Alpert, MA, Arena, R, Mehra, MR, Milani, RV, and Ventura, HO. Impact of obesity and the obesity paradox on prevalence and prognosis in heart failure. JACC Heart Fail. (2013) 1:93–102. doi: 10.1016/j.jchf.2013.01.006
26. Fonarow, GC, Srikanthan, P, Costanzo, MR, Cintron, GB, and Lopatin, M. An obesity paradox in acute heart failure: analysis of body mass index and inhospital mortality for 108927 patients in the acute decompensated heart failure National Registry. Am Heart J. (2007) 153:74–81. doi: 10.1016/j.ahj.2006.09.007
27. Hwang, IC, Choi, HM, Yoon, YE, Park, JJ, Park, JB, Park, JH, et al. Body mass index, muscle mass, and all-cause mortality in patients with acute heart failure: the obesity paradox revisited. Int J Heart Fail. (2022) 4:95–109. doi: 10.36628/ijhf.2022.0007
28. Matsuhiro, Y, Nishino, M, Ukita, K, Kawamura, A, Nakamura, H, Yasumoto, K, et al. Underweight is associated with poor prognosis in heart failure with preserved ejection fraction. Int Heart J. (2021) 62:1042–51. doi: 10.1536/ihj.21-195
29. Lin, GM, Li, YH, Yin, WH, Wu, YW, Chu, PH, Wu, CC, et al. The obesity-mortality paradox in patients with heart failure in Taiwan and a collaborative Meta-analysis for east Asian patients. Am J Cardiol. (2016) 118:1011–8. doi: 10.1016/j.amjcard.2016.06.056
30. Lin, GM, Tsai, KZ, and Lavie, CJ. Waist-to-height ratio for the obesity paradox in heart failure: is it a matter of fitness? Eur Heart J. (2023) 44:3386–7. doi: 10.1093/eurheartj/ehad503
31. Lin, GM, Tsai, KZ, Sui, X, and Lavie, CJ. Estimated power output for a distance run and maximal oxygen uptake in young adults. Front Physiol. (2023) 14:1110802. doi: 10.3389/fphys.2023.1110802
32. Lavie, CJ, McAuley, PA, Church, TS, Milani, RV, and Blair, SN. Obesity and cardiovascular diseases: implications regarding fitness, fatness, and severity in the obesity paradox. J Am Coll Cardiol. (2014) 63:1345–54. doi: 10.1016/j.jacc.2014.01.022
33. Elagizi, A, Kachur, S, Lavie, CJ, Carbone, S, Pandey, A, Ortega, FB, et al. An overview and update on obesity and the obesity paradox in cardiovascular diseases. Prog Cardiovasc Dis. (2018) 61:142–50. doi: 10.1016/j.pcad.2018.07.003
34. Joseph, J, PS, S, James, J, Abraham, S, and Abdullakutty, J. Guideline-directed medical therapy in heart failure patients: impact of focused care provided by a heart failure clinic in comparison to general cardiology out-patient department. Egyptian Heart J. (2020) 72:1–8. doi: 10.1186/s43044-020-00088-8
35. Jones, NR, Roalfe, AK, Adoki, I, Hobbs, FR, and Taylor, CJ. Survival of patients with chronic heart failure in the community: a systematic review and meta-analysis. Eur J Heart Fail. (2019) 21:1306–25. doi: 10.1002/ejhf.1594
36. Dinh, TTH. A self-management program for people with heart failure in Hanoi, Vietnam: a cluster randomised controlled trial. Brisbane, Queensland, Australia: Queensland University of Technology (2016).
37. Li, YH, Lin, GM, Lin, CL, Wang, JH, and Han, CL. Relation of body mass index to mortality among patients with percutaneous coronary intervention longer than 5 years follow-up: a meta-analysis. Int J Cardiol. (2013) 168:4315–8. doi: 10.1016/j.ijcard.2013.04.174
38. Anker, SD, and Morley, JE. Cachexia: a nutritional syndrome? J Cachexia Sarcopenia Muscle. (2015) 6:269–71. doi: 10.1002/jcsm.12088
39. Kida, K, Miyajima, I, Suzuki, N, Greenberg, BH, and Akashi, YJ. Nutritional management of heart failure. J Cardiol. (2023) 81:283–91. doi: 10.1016/j.jjcc.2022.11.001
40. Soto, ME, Pérez-Torres, I, Rubio-Ruiz, ME, Manzano-Pech, L, and Guarner-Lans, V. Interconnection between cardiac Cachexia and heart failure-protective role of cardiac obesity. Cells. (2022) 11:1039. doi: 10.3390/cells11061039
41. Emami, A, Saitoh, M, Valentova, M, Sandek, A, Evertz, R, Ebner, N, et al. Comparison of sarcopenia and cachexia in men with chronic heart failure: results from the studies investigating co-morbidities aggravating heart failure (SICA-HF). Eur J Heart Fail. (2018) 20:1580–7. doi: 10.1002/ejhf.1304
42. Saitoh, M, Dos Santos, MR, Emami, A, Ishida, J, Ebner, N, Valentova, M, et al. Anorexia, functional capacity, and clinical outcome in patients with chronic heart failure: results from the studies investigating co-morbidities aggravating heart failure (SICA-HF). ESC Heart Fail. (2017) 4:448–57. doi: 10.1002/ehf2.12209
43. Bekfani, T, Pellicori, P, Morris, DA, Ebner, N, Valentova, M, Steinbeck, L, et al. Sarcopenia in patients with heart failure with preserved ejection fraction: impact on muscle strength, exercise capacity and quality of life. Int J Cardiol. (2016) 222:41–6. doi: 10.1016/j.ijcard.2016.07.135
44. von Haehling, S, Morley, JE, and Anker, SD. From muscle wasting to sarcopenia and myopenia: update 2012. J Cachexia Sarcopenia Muscle. (2012) 3:213–7. doi: 10.1007/s13539-012-0089-z
45. von Haehling, S, Garfias Macedo, T, Valentova, M, Anker, MS, Ebner, N, Bekfani, T, et al. Muscle wasting as an independent predictor of survival in patients with chronic heart failure. J Cachexia Sarcopenia Muscle. (2020) 11:1242–9. doi: 10.1002/jcsm.12603
46. Ruffner, MA, Group UBW, and Sullivan, KE. Complications associated with underweight primary immunodeficiency patients: prevalence and associations within the USIDNET registry. J Clin Immunol. (2018) 38:283–93. doi: 10.1007/s10875-018-0492-0
47. Horwich, TB, Fonarow, GC, and Clark, AL. Obesity and the obesity paradox in heart failure. Prog Cardiovasc Dis. (2018) 61:151–6. doi: 10.1016/j.pcad.2018.05.005
48. Das, S. Effect of obesity in the cardiovascular system. In: MK Kutty and A Elengoe, editors. Obesity and its impact on health. Singapore: Springer Singapore (2021). p. 67–90.
49. Wolk, R, Bertolet, M, Singh, P, Brooks, MM, Pratley, RE, Frye, RL, et al. Prognostic value of adipokines in predicting cardiovascular outcome: explaining the obesity paradox. Mayo Clin Proc. (2016): Elsevier) 91:858–66. doi: 10.1016/j.mayocp.2016.03.020
50. Lee, HS, Visco, F, Mushiyev, S, Pekler, G, Savadkar, A, Cativo, EH, et al. The obesity paradox in heart failure: what is real obesity in heart failure? Curr Cardiovasc Risk Rep. (2016) 10:1–4. doi: 10.1007/s12170-016-0510-9
51. Yamamoto, K, Tsuchihashi-Makaya, M, Kinugasa, Y, Iida, Y, Kamiya, K, Kihara, Y, et al. Japanese heart failure society 2018 scientific statement on nutritional assessment and management in heart failure patients. Circ J. (2020) 84:1408–44. doi: 10.1253/circj.CJ-20-0322
52. Cederholm, T, Jensen, GL, Correia, M, Gonzalez, MC, Fukushima, R, Higashiguchi, T, et al. GLIM criteria for the diagnosis of malnutrition – a consensus report from the global clinical nutrition community. Clin Nutr. (2019) 38:1–9. doi: 10.1016/j.clnu.2018.08.002
53. Minamisawa, M, Seidelmann, SB, Claggett, B, Hegde, SM, Shah, AM, Desai, AS, et al. Impact of malnutrition using geriatric nutritional risk index in heart failure with preserved ejection fraction. JACC: Heart Failure. (2019) 7:664–75. doi: 10.1016/j.jchf.2019.04.020
54. Watanabe, D, Yoshida, T, Watanabe, Y, Yamada, Y, and Kimura, M. A U-shaped relationship between the prevalence of frailty and body mass index in community-dwelling Japanese older adults: the Kyoto–Kameoka study. J Clin Med. (2020) 9:1367. doi: 10.3390/jcm9051367
55. Mareschal, J, Achamrah, N, Norman, K, and Genton, L. Clinical value of muscle mass assessment in clinical conditions associated with malnutrition. J Clin Med. (2019) 8:1040. doi: 10.3390/jcm8071040
56. Kwaśny, A, Uchmanowicz, I, Juárez-Vela, R, Młynarska, A, Łokieć, K, and Czapla, M. Sex-related differences in the impact of nutritional status on in-hospital mortality in heart failure: a retrospective cohort study. Eur J Cardiovasc Nurs. (2023). doi: 10.1093/eurjcn/zvad050 [Epub ahead of print].
57. Krim, SR, Campbell, P, Lavie, CJ, and Ventura, H. Micronutrients in chronic heart failure. Curr Heart Fail Rep. (2013) 10:46–53. doi: 10.1007/s11897-012-0118-4
58. Allard, ML, Jeejeebhoy, KN, and Sole, MJ. The management of conditioned nutritional requirements in heart failure. Heart Fail Rev. (2006) 11:75–82. doi: 10.1007/s10741-006-9195-3
59. Witte, KK, Clark, AL, and Cleland, JG. Chronic heart failure and micronutrients. J Am Coll Cardiol. (2001) 37:1765–74. doi: 10.1016/S0735-1097(01)01227-X
60. Alsafwah, S, Laguardia, SP, Arroyo, M, Dockery, BK, Bhattacharya, SK, Ahokas, RA, et al. Congestive heart failure is a systemic illness: a role for minerals and micronutrients. Clin Med Res. (2007) 5:238–43. doi: 10.3121/cmr.2007.737
61. Mandviwala, TM, Basra, SS, Khalid, U, Pickett, JK, Przybylowicz, R, Shah, T, et al. Obesity and the paradox of mortality and heart failure hospitalization in heart failure with preserved ejection fraction. Int J Obes. (2020) 44:1561–7. doi: 10.1038/s41366-020-0563-1
62. Seko, Y, Kato, T, Morimoto, T, Yaku, H, Inuzuka, Y, Tamaki, Y, et al. Association between body mass index and prognosis of patients hospitalized with heart failure. Sci Rep. (2020) 10:16663. doi: 10.1038/s41598-020-73640-w
63. Cox, ZL, Lai, P, Lewis, CM, and Lindenfeld, J. Body mass index and all-cause readmissions following acute heart failure hospitalization. Int J Obes. (2020) 44:1227–35. doi: 10.1038/s41366-019-0518-6
64. Heo, S, Moser, DK, Pressler, SJ, Dunbar, SB, Lee, KS, Kim, J, et al. Association between obesity and heart failure symptoms in male and female patients. Clin Obesity. (2017) 7:77–85. doi: 10.1111/cob.12179
Keywords: chronic heart failure, body mass index, obesity paradox, underweight, mortality, hospitalization
Citation: Nguyen HTT, Ha TTT, Tran HB, Nguyen DV, Pham HM, Tran PM, Pham TM, Allison TG, Reid CM and Kirkpatrick JN (2023) Relationship between BMI and prognosis of chronic heart failure outpatients in Vietnam: a single-center study. Front. Nutr. 10:1251601. doi: 10.3389/fnut.2023.1251601
Edited by:
Owen Kelly, Sam Houston State University, United StatesReviewed by:
Michał Czapla, Wroclaw Medical University, PolandGen-Min Lin, Hualien Armed Forces General Hospital, Taiwan
Paula Acevedo-Cantero, Autonomous University of Madrid, Spain
Copyright © 2023 Nguyen, Ha, Tran, Nguyen, Pham, Tran, Pham, Allison, Reid and Kirkpatrick. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hoai Thi Thu Nguyen, hoainguyen1973@gmail.com