Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 16 February 2022
Sec. Atherosclerosis and Vascular Medicine

Hemoglobin-to-Red-Cell Distribution Width Ratio Is a Novel Predictor of Long-Term Patient Outcomes After Percutaneous Coronary Intervention: A Retrospective Cohort Study

\nWen-Juan XiuWen-Juan Xiu1Ying-Ying Zheng,Ying-Ying Zheng1,2Ting-Ting WuTing-Ting Wu1Xian-Geng HouXian-Geng Hou1Yi YangYi Yang1Yi-Tong MaYi-Tong Ma1Xiang Xie
Xiang Xie1*
  • 1Department of Cardiology, First Affiliated Hospital of Xinjiang Medical University, Urumqi, China
  • 2Key Laboratory of Cardiac Injury and Repair of Henan Province, Department of Cardiology, First Affiliated Hospital of Zhengzhou University, Zhengzhou, China

Background: The hemoglobin level and red cell distribution width (RDW) have been linked to the prognosis of coronary atherosclerotic heart disease (CAHD). However, the relationship between the ratio of hemoglobin to the RDW (HRR) and clinical outcomes after percutaneous coronary intervention (PCI) is not known. Here, we explored the impact of the HRR on clinical outcomes after PCI.

Methods: In our study, we selected 6,046 CAHD patients with PCI hospitalized in the First Affiliated Hospital of Xinjiang Medical University from 2008 to 2016. The patients were grouped according to their HRR ratio: group A (HRR < 10.25, n = 2,344) and group B (HRR ≥ 10.25, n = 3,702). The difference in clinical outcomes between the two groups was compared. Patients were followed up for 35.9 ± 22.6 months.

Results: Three hundred nine patients died during follow-up. These included 166 patients (7.1%) in the HRR < 10.25 group and 143 patients (3.9%) in the HRR ≥ 10.25 group (P < 0.001). The incidences of cardiogenic death (5.7 vs. 3.2%) and major cardiovascular adverse events (16.5 vs. 12.9%) also differed significantly between the groups (both Ps < 0.001). Analysis using the multivariate Cox proportional hazard model found a significant association between a decreased HRR and post-PCI mortality (all-cause death, adjusted HR: 1.479, 95% CI: 1.156–1.893, p = 0.002; cardiac death, adjusted HR: 1.470, 95% CI: 1.116–1.936, p = 0.006).

Conclusion: The HRR is predictive of post-PCI mortality among CAHD patients.

Introduction

Coronary atherosclerotic heart disease (CAHD) is jeopardizing human health with increasing morbidity and mortality rates (1, 2). Multiple risk factors, including gender, age, diabetes, hypertension, smoking, and alcohol consumption, affect the prognosis of CAHD patients (3). Red blood cell (RBC) size variations can be quantified by measuring the RDW (4). The index is calculated automatically by dividing the standard deviation (SD) of the red blood cell volume by the mean red blood cell volume (MCV). Then multiply the result of this equation by 100 and express the result as a percentage (%) (5). The most vital application of RDW is to assess diverse kinds of anemia in the clinic. RDW would rise as well in cases of blood transfusion, chronic liver disease (6), autoimmune disorders (7), and tumor (8). RDW can be used not only as a diagnostic tool, but also as a risk and prognostic factor (4). The RDW has been shown to be predictive of adverse outcomes after acute myocardial infarction (MI) as well as in among patients with stable coronary heart disease (CHD) and heart failure (HF) (912).

Tonelli et al. (12) reported a randomized controlled trial that included CHD patients free of HF. The results showed that there was a graded independent relationship between RDW and death (P = 0.001 or trend). Compared with those in the lowest quartile, RDW participants in the highest quartile had an adjusted risk ratio of death of 1.78 (95% CI: 1.28–2.47). Osadnik et al. (13) retrospectively analyzed the clinical data of 2,550 CAD patients treated with PCI during 2.5 years of follow-up and found that, after adjusting for risk factors [age, gender, HF, atrial fibrillation, hypertension, previous MI, PCI, coronary artery bypass graft surgery (CABG), and sudden cardiac death (SCD), peripheral vascular disease (PVD), previous stroke, diabetes, lipid abnormalities, fatness, chronic obstructive pulmonary disease (COPD), chronic kidney disease (CKD), smoking, New York Heart Association (NYHA) and CCS class, heart rate, blood pressure, ejection fraction, quantity and kinds of stent implantation, quantity of PCI vessels, hemoglobin, and MCV], higher RDW corresponded to a higher burden of comorbidities and higher mortality.

Like RDW, hemoglobin (Hb) levels also affect CAD prognosis. McKechnie et al. (14) prospectively analyzed 48,851 consecutive patients with PCIs, and data for anemia in 6,471 men (21.7%) and 4,659 women (30.4%) were included. Compared with non-anemic patients, those with anemia had increased risks of postoperative MI and in-hospital mortality as well as higher comprehensive endpoints of major cardiovascular events (MACEs, including MI, cerebrovascular events, and death). This showed that pre-procedural anemia is related to poor prognosis among CAD patients hospitalized after PCI. According to the study by Reinecke et al. (15), 30 patients in the lowest hemoglobin quintile (Hb ≤12.9 g/dl) died at 2 years, corresponding to a mortality rate of 22.2%. In addition, 30 of 62 (48%) all-cause deaths and 19 of 44 (43%) cardiac deaths were in the lowest hemoglobin quintile. Sun et al. (16) retrospectively analyzed 362 esophageal cancer patients and found that the HB/RDW ratio correlated significantly with survival outcomes. The mortality of patients with low HB/RDW was 1.416-fold higher in the follow-up period than that of patients with high HB/RDW. As we all know, HB and RDW are affected by various non-cancer-related conditions, and theoretically reflect broad health information, such as nutritional status, inflammatory status, oxidative stress, and immune function. These underlying pathobiological processes have been shown to predict the outcome of cardiovascular disease (11, 17).

An investigation by Tham et al. (18) showed that the use of Hb/RDW for determining the prognosis of patients with head and neck cancer significantly affected event-free survival. This is consistent with the results of Sun et al., who demonstrated the influence of Hb and RDW on the prognosis of CAD. We hypothesized that the ratio of hemoglobin to RDW (HRR) may affect the prognosis of CAD patients and investigated the relationship between the HRR and the prognosis of CAD patients after PCI.

Methods

Study Design and Population

CAD patients who had received PCI were evaluated initially from the CORFCHD-PCI study (identifier: ChiCTR-ORC-16010153). The CORFCHD-PCI cohort is a large single-center retrospective cohort comprising 6,050 CAD patients who had undergone PCI and who were from the Clinical Outcomes and Risk Factors of Patients with CHD after PCI at the First Affiliated Hospital of Xinjiang Medical University from January 2008 to December 2016 (19). The inclusion criteria were patients with acute ST-segment elevation myocardial infarction (STEMI), non-ST-segment elevation acute coronary syndrome (NSTE-ACS), and stable angina with coronary angiography and at least one implanted stent. The exclusion criteria were malignant tumors, infectious diseases, hematological diseases, liver diseases, as well as severe heart failure, congenital, rheumatic, or valvular heart disease, and severe kidney or liver dysfunction. To further clarify the influence of the HRR on clinical results of patients with CHD after PCI, an overall 6,050 patients were assessed at first. Owing to inaccessible Hb and RDW data, we excluded 4 patients. The remaining 6,046 CAD patients who successfully received PCI were selected and divided into the HRR <10.25 (n = 2,344) and HRR ≥ 10.25 (n = 3,702) groups. As this was a retrospective cohort study, the need for patient informed consent was waived. The research protocol was approved by the ethics committee of the First Affiliated Hospital of Xinjiang Medical University and conformed to the guidelines of the Declaration of Helsinki of the World Medical Association. The flowchart of the inclusion and exclusion criteria used in the selection of participants is shown in Figure 1.

FIGURE 1
www.frontiersin.org

Figure 1. The flowchart of participants inclusion.

Clinical and Demographic Data

The patients' clinical data, including sex, age, blood urea nitrogen (BUN), creatinine (Cr), uric acid (UA), triglycerides (TGs), total cholesterol (TC), glucose (GLU), high-density lipoprotein cholesterol (HDL-C), low-density lipoprotein cholesterol (LDL-C), red blood cell specific volume (HCT), RBCs, RDW, drinking and smoking status, diabetes, hypertension, CAD family history, and medication history, were recorded and collected. The HRR was defined as Hb (g/L) divided by RDW (%), both from the same blood specimen. Hypertension was defined according to the American Heart Association recommendations (20) as a history of hypertension, the use of antihypertensive medication, or having had three resting blood pressure measurements ≥140/90 mmHg on at least two separate occasions. The diabetes diagnosis was proposed by the WHO in 1999: symptoms of diabetes, intravenous plasma glucose ≥11.1 mmol/L (200 mg/dl) at any time, fasting venous plasma glucose ≥7.0 mmol/L (126 mg/dl), and 2-h intravenous plasma glucose ≥11.1 mmol/L in an OGTT (75 g anhydrous glucose). Regarding the above criteria, diabetes could be diagnosed as long as one of the three was met, any one of the three items was measured again on the following day, and the result of the measurement also met the criteria (21). Hyperlipidemia usually refers to elevated serum cholesterol and/or TG levels, as well as various dyslipidemias, including low HDL-c (22). The assessment of smoking and drinking has been described in detail in the article by Xie et al. (23).

Endpoints

All-cause mortality (ACM) and cardiac mortality (CM) during follow-up (10 years) were the primary endpoints. The secondary endpoints were MACEs, cerebrovascular events (MACCEs), and bleeding events. MACEs included cardiac death, HF, rehospitalization, reinfarction, and target vessel revascularization (TVR). MACCEs were defined as MACEs plus stroke. Rehospitalization refers to re-admission for cardiovascular disease. All-cause death included both cardiac death and non-cardiac death. The death was classified in all-cause death if with a clear non-cardiac cause of death; otherwise, death was considered to be cardiac death. The criteria for determining bleeding events were derived from the Bleeding Academic Research Consortium standard (24). Reinfarction refers to acute MI that occurs within 28 days of an event or recurrent MI. When ST elevation is ≥0.1 mV or new pathological Q waves appear again in at least two consecutive leads, especially when ischemic symptoms persist for 20 min or more (25). Heart failure with reduced ejection fraction (HFrEF) ≤40 also referred to as systolic HF. Randomized controlled trials have mainly enrolled patients with HFrEF (26). In our study, HF also refers to systolic HF. The definitions of stroke and TVR have been explained in detail in the study by Park et al. (27).

Follow-Up

In this study, the investigators followed up with patients through telephone contact or an outpatient service. There was tracking survey for each case for 2–10 years, specifically at 1, 3, and 6 months and 1, 3, and 5 years after PCI. The mean tracking survey period registered 35.9 months.

HRR Detection

Our study used the cutoff finder developed by Budczies et al. (28) to determine the optimal cutoff point for the continuous variable HRR. In our study, cut-off values of ROC curves for HRR were 10.25. According to cutoff value of HRR. The patients were divided into two groups: CAHD patients who successfully received PCI were selected and divided into the HRR < 10.25 (n = 2,344) and HRR ≥ 10.25 (n = 3,702) groups.

Statistical Analysis

Continuous variables are presented as the means ± standard deviations and were contrasted by Student's t-test; categorical variables are presented as numbers and percentages and were contrasted by the χ-square test. The cumulative incidence of long-term follow-up results was analyzed using Kaplan-Meier analysis. The difference between the groups was compared with the logarithmic test. Multivariable analysis was performed to assess the prognostic value of the HRR and adverse outcomes after adjusting for confounders, such as sex, age, smoking, alcohol drinking, Diabetes, Hypertension, BUN, Cr, and UA, calculating the hazard ratios (HRs) and 95% confidence intervals (CIs). P < 0.05 was considered statistically significant. All data were analyzed using SPSS version 22.0.

Results

Baseline Characteristics of Patients

Patients were grouped according to their median HRR: The HRR < 10.25 (n = 2,344) group and the HRR ≥ 10.25 (n = 3,702) group. Patients showed significant differences in terms of gender, age, smoking, drinking, diabetes, hypertension, lymphocyte percentage, RBC specific volume (HCT), RDW, creatinine (Cr), UA, and BUN (all p < 0.05). Other baseline data did not differ significantly (p > 0.05) (Table 1).

TABLE 1
www.frontiersin.org

Table 1. Characteristics of participants of the two groups.

Clinical Outcomes

Primary Endpoints

All-Cause Mortality

The ACM incidence differed significantly between the HRR < 10.25 group and HRR > 10.25 group [166 (7.1%) vs. 143 (3.9%), respectively, P < 0.001] (Table 2).

TABLE 2
www.frontiersin.org

Table 2. Outcomes comparison two groups.

The survival curve describes the manifestation of the outcome event. Over time, the incidence of endpoint events gradually increases, and the survival rate gradually decreases. The number of risks is used to indicate the number of people exposed to the risk of the outcome at each point in time. The starting point of the study is the total number of people included in the study, 2,344 people in the HRR < 10.25 group and 3,702 people in the HRR ≥ 10.25 group (Figures 2A–D).

FIGURE 2
www.frontiersin.org

Figure 2. Cumulative Kaplan-Meier estimates of the time to the first adjudicated occurrence of primary endpoint and secondary endpoints. (A) ACM; (B) CM; (C) MACE; (D) MACCE.

As shown by the Kaplan-Meier survival curve and log-rank test, ACM was significantly different between the two groups (P < 0.001, Figure 2A). Univariate analysis showed that patients in the HB/RDW radio >10.25 group had a lower risk of all-cause mortality compared with the HB/RDW radio < 10.25 group (HR = 0.590, 95% CI: 0.472–0.739, P < 0.001, Table 3). The Cox analysis found the HRR, after adjustment for common risk factors, to be an independent prognostic factor for post-PCI CHD patients in the low HRR group. The incidence of ACM increased 1.47 times (HR = 1.470, 95% CI: 1.116–1.936, P = 0.006, Table 4).

TABLE 3
www.frontiersin.org

Table 3. Univariate logistic regression analysis of ACM, cardiac death, MACCEs, and MACEs.

TABLE 4
www.frontiersin.org

Table 4. Cox proportional hazards analysis of outcomes.

Cardiac Mortality

CM differed significantly between the HRR < 10.25 group and the HRR > 10.25 group [133 (5.7%) and 118 (3.2%), respectively, P < 0.001) (Table 2).

The KM curves and log-rank test demonstrated a significant difference in CM between the HRR < 10.25 group and the HRR > 10.25 (P < 0.001, Figure 2B). Univariate analysis showed that patients in the HB/RDW radio >10.25 group had a lower risk of cardiac mortality compared with the HB/RDW radio < 10.25 group (HR = 0.602, 95% CI: 0.469–0.772, P < 0.001, Table 3). After risk factor adjustment, the Cox proportional hazards model showed the HRR to be an independent prognostic factor for CAD patients after PCI in the low HRR group. The incidence of CM increased 1.33 times (HR = 1.479, 95% CI: 1.156–1.893, P = 0.002, Table 4).

Secondary Endpoints

MACCEs and MACE

We found that the incidences of MACCEs [386 (16.5%) vs. 476 (12.9%), P < 0.001], MACEs [350 (14.9%) vs. 435 (11.8%), P < 0.001], and HF [85 (3.6%) vs. 96 (2.6%), P = 0.022] differed significantly between the groups. However, the incidences of bleeding events (2.8 vs. 2.9%, P = 0.771), stroke (1.7 vs. 1.2%, P = 0.100), rehospitalization (14.5 vs. 12.9%, P = 0.070), reinfarction (3.1 vs. 3.3%, P = 0.740), and TVR (4.8 vs. 5.4%, P = 0.265) showed no significant differences (Table 2).

The Kaplan-Meier log-rank tests identified significant differences in the occurrence of MACCEs (P = 0.024, Figure 2C) and MACEs (P = 0.042, Figure 2D) between the groups. Univariate analysis model also showed that the MACCEs and MACEs were significant differences in the two groups [HR = 0.857 (0.749–0.981), P = 0.025 and HR = 0.864 (0.750–0.995), P = 0.042, Table 3]. Cox analysis was performed to evaluate the prognostic value of the HRR after adjusting for traditional risk factors, as shown in Table 1. However, MACCEs [HR = 1.162 (0.994–1.358), P = 0.060] and MACEs [HR = 1.157 (0.997–1.343), P = 0.054] were not significantly different (Table 4). HF [HR = 0.839 (0.607–1.160), P = 0.228], stroke [HR = 0.829 (0.515–1.343), P = 1.334], bleeding events [HR = 1.058 (0.756–1.480), P = 0.742], rehospitalization [HR = 0.975 (0.836–1.136), P = 0.742], reinfarction [HR = 1.065 (0.773–1.468), P = 0.700] and TVR [HR = 1.115 (0.866–1.436), P = 0.400] were not significantly different between the two groups (tables not shown).

Discussion

This retrospective study of 2,344 (HRR < 10.25) and 3,702 (HRR ≥ 10.25) CAD PCI patients at The First Affiliated Hospital of Xinjiang Medical University from January 2008 to December 2016 provides compelling evidence that the HRR, which is the ratio of Hb to RDW, is a novel and powerful indicator of the clinical outcomes of CAD PCI patients. Low levels of the HRR (HRR < 10.25) increased long-term ACM and CM by 1.470 times and 1.479 times, respectively. In order to reduce the influence of confounding factors on the prognosis of cardiovascular events, we adjusted the comprehensive factors affecting the risk of cardiovascular events to investigate the relationship between the HRR and clinical outcomes. This is the first retrospective cohort study to investigate the influence of the HRR on the prognosis of CAD PCI patients.

The RDW, indicative of variations in RBC size, is known to predict the risk of CVD morbidity and mortality (11, 29, 30). Veeranna et al. (31) selected 8,513 adult participants without CVD from the 1999-2004 National Health and Nutritional Examination Survey (NHANES) to assess the impacts of RDW and high-sensitivity C-reactive protein on future CHD mortality. After adjusting for traditional risk factors, RDW was still an independent predictor. Shah et al. (32) conducted a post-hoc analysis of the NHANES 1988-94 cohort, investigating 7,005 non-anemic individuals (aged 30–79 years) to determine the risks of cardiovascular mortality. The analysis identified 27 individuals with RDW > 14.5 (8.2%) and 206 (3.1%) with RDW <14.5 (all p < 0.001). Studies have shown that compared with traditional cardiovascular risk factors, RDW is a promising parameter for identifying individuals at risk of cardiovascular disease mortality.

In laboratory examinations, the larger the RDW is, the more the shapes and sizes of RBCs in the sample blood will differ. Exceeding the normal value indicates various anemias, hematopoiesis abnormalities, or congenital RBC abnormalities. A small distribution width indicates that the shape and size of the RBCs in the sample blood are consistent and neat. Although the detection has no obvious specificity, it can still explain the problems in the application scenarios described in the above paper. In short, the widening of the RDW after PCI is the result of uncontrolled inflammation because the outbreak of inflammation is the main factor leading to poor prognosis. Although age, sex, genetic factors, renal function, liver function, inflammation, dyslipidemia, and other factors can lead to an increase in the RDW, the increase is only in the baseline value. The exclusion criteria for this study were patients with malignant tumors, infectious diseases, hematological diseases, liver diseases, as well as severe heart failure, congenital, rheumatic, or valvular heart disease, and severe kidney or liver dysfunction, so the contributions of the above factors to sudden death among the included patients were minimal.

Numerous prospective studies have shown that baseline Hb is a strong prognostic factor for 30-day and 1-year mortality, MACEs, bleeding events, and ischemic events in PCI patients (33, 34). Poludasu et al. (35) conducted a prospective study of 3.2 years and observed an association between baseline Hb and all-cause long-term mortality. Pilgrim et al. (36) found that severe anemia caused a significant increase in the risk of stent thrombosis. Li et al. (37) enrolled a total of 584 among 677 hospitalized patients with angiographic CAD and tracked all patients for 14.3 ± 8.4 months, finding that high Hb levels were independent predictors of MACEs in CAD patients. This shows that a high hemoglobin level independently predicts the prognosis of coronary artery disease.

However, no data are available associating the HRR with CAD risk. Therefore, we explored the relationship between the HRR and prognosis in post-PCI CAD patients. We selected 6,046 CAD patients who had undergone PCI, dividing them according to the HRR median value of 10.25. We found that the HRR is related to the long-term prognosis of CAD patients. Compared with those in the high HRR value group, the incidences of ACM, AM, MACCEs, MACEs, and HF were higher in the low HRR value group. After adjustments for the confounding factors listed in Table 3, we conducted a multivariate Cox analysis. The results showed that the HRR may be an independent predictor of the risk of long-term death in post-PCI CAD patients. Patients with a low HRR have higher ACM and CM. However, it showed limited predictive power in our study [HR = 1.470 (1.116–1.936), P = 0.006; HR = 1.479 (1.156–1.893), P = 0.002]. Therefore, the result has a high degree of credibility.

However, the mechanism of this correlation is still unclear. Higher RDWs in the normal scope might imply stepped-up RBC disruption or, more often, invalid erythropoiesis (19). A higher RDW also reflects a potential inflammatory state and impaired RBC maturation and is associated with adverse clinical outcomes (38, 39). The RDW is associated with inflammatory markers such as the erythrocyte sedimentation rate and high-sensitivity CRP, interleukin-6, and fibrinogen levels (40). Inflammatory factors can change the homeostasis of RBCs and may inhibit their production and increase the RDW by impairing iron metabolism (41). In patients with higher RDWs, decreased erythrocyte deformability impairs blood flow through the microcirculation (42). In addition, proinflammatory cytokines can lead to iron metabolism disorder and reduce the production of erythropoietin and the response of bone marrow to erythropoietin, resulting in impaired hematopoietic function and increased RDW levels (4345).

Oxidative stress is another pathophysiological mechanism of RDW in addition to inflammation. An increase in RDW may be accompanied by the loss of RBC deformability and changes in erythrocyte homogeneity, which may damage the transport of RBCs through microvessels, affecting not only the oxygen transport of tissues but also the “antioxidant” function of blood vessels (46). RBCs have a high antioxidant capacity, which may shift toward pro-oxidants when exposed to an environment of high inflammation and oxidative stress, and the change in RBC size is related to oxidative stress, which may be caused by increasing the renewal rate of RBCs (47), thus further aggravating the oxidative burden and accelerating the development of atherosclerosis (46, 48, 49).

There was also a certain correlation between the TC erythrocyte membrane (CEM) level and the RDW (50). Lipid disorder will reduce the fluidity of the erythrocyte membrane, and an increase in CEM levels will lead to a decrease in the cell deformation ability. A higher CEM level will lead to the deterioration of blood flow through the microcirculation (51, 52), affect the lifespan of circulating RBCs, and then lead to greater cell renewal and a higher RDW value (53, 54).

Neutrophil to lymphocyte ratio (NLR) also can reflect the severity of systematic inflammation. NLR is a powerful outcome predictor of vascular disease and has recently been described as a predictor of mortality in patients undergoing percutaneous coronary intervention. The Tamhane study (55) showed that NLR on admission is an independent predictor of hospitalization and 6-month mortality in ACS patients. NLR can perform risk stratification and prognosis assessment for patients with ACS. Previous studies have also shown that NLR is not only a reliable marker of mortality and amputation stratification in patients with acute limb ischemia, but also an independent prognostic factor for the 30-day morbidity of ruptured abdominal aortic aneurysms (rAAA) (5658).

The hemoglobin level is the main determinant of the oxygen carrying capacity. Impaired oxygen carrying capacity and changes in viscosity or blood flow patterns associated with hemoglobin changes are considered to be the causes of CAD and CAD symptoms. The decrease in the hemoglobin value showed that oxygen delivery to the myocardium downstream of coronary artery stenosis was significantly reduced and that the tissue oxygen supply was limited. Anemia also increases myocardial oxygen demand by increasing the heart rate to maintain adequate systemic oxygen delivery. Anemia patients may show a hypercoagulable state, aggravating the occurrence of ischemic events. Anemia can also lead to ventricular remodeling and hypertrophy and higher oxygen consumption, which is very unfavorable in CHD. Inflammation is very important in CAD, and low hemoglobin levels is a vital indicator of potential inflammatory processes. Similarly, patients with low hemoglobin levels and subclinical CAD may be more prone to symptomatic heart disease (5961).

At present, it is difficult to determine the factors associated with poor prognosis, including blood lipids, iron metabolism disorder, anemia, insufficient vitamin D3, oxidative stress, inflammation, decreased deformability of the erythrocyte membrane, oxygen carrying capacity, blood viscosity, and changes in blood flow pattern. In CAD patients, the predictive utility of the RDW is that it represents the total of the negative effects of the above reasons on the erythropoiesis function of bone marrow, and the predictive utility of Hb is the sum of the decreased oxygen carrying function of hemoglobin. Therefore, the prognostic value of the HRR reflects the aggravation of these phenomena.

The results of this study have some clinical significance and advantages. Hb and the RDW can be quickly calculated based on routine blood examinations at the time of admission. Based on the HRR results, the patient's health and long-term prognosis can be assessed. Patients with a high BUN and a low HRR should be given more attention, and they may have higher incidences of ACM, MACCEs, and MACEs. This is beneficial to clinicians and lead to better decisions. This study has the following strengths: (1) the sample size was large, improving statistical reliability; (2) There was a low rate of patient loss during the long-term follow-up period. However, the study also has several limitations: (1) we collected only HRR data during the study period, and there were no relevant data in the follow-up results. Therefore, it is impossible to analyze the impact of dynamic changes in these variables; (2) the limitations of the research design require verification by further prospective studies; (3) the cutoff values of Hb/RDW varied widely across previous studies. There has been no clear consensus on the optimal cutoff and the magnitude of association with various outcomes. In addition to unclear pathophysiological mechanisms, these issues may have limited the clinical utility of this novel parameter.

Conclusion

In conclusion, our findings show the baseline HRR to be an independent predictor of adverse outcomes of post-PCI CHAD patients.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the First Affiliated Hospital of Xinjiang Medical University. Written informed consent was not required for this study, in accordance with the local legislation and institutional requirements.

Author Contributions

W-JX and Y-YZ conceptualized the current study objectives, analyzed the data, and wrote the manuscript draft. T-TW and X-GH, and YY collected and organized data. Y-TM and XX had responsibility of the final content. All authors read, approved the final manuscript, and were involved in the conception of the research plan.

Funding

This research was funded by the National Natural Science Foundation of China (81770235), Xinjiang Science and Technology Aid Project (2019E0278), and Prevention and control of major chronic Non-communicable disease Project (2018YFC1311505).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Go AS, Mozaffarian D, Roger VL, Benjamin EJ, Berry JD, Blaha MJ, et al. Executive summary: Heart disease and stroke statistics−2014 update: a report from the American Heart Association. Circulation. (2014) 129:399–410. doi: 10.1161/01.cir.0000442015.53336.12

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Mozaffarian D, Benjamin EJ, Go AS, Arnett DK, Blaha MJ, Cushman M, et al. Executive summary: Heart disease and stroke statistics−2015 update: a report from the American Heart Association. Circulation. (2015) 131:e29–e322. doi: 10.1161/CIR.0000000000000157

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Liu S, Li Y, Zeng X, Wang H, Yin P, Wang L, et al. Burden of cardiovascular diseases in China, 1990-2016: findings from the 2016 Global Burden of Disease Study. JAMA Cardiol. (2019) 4:342–52. doi: 10.1001/jamacardio.2019.0295

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Salvagno GL, Sanchis-Gomar F, Picanza A, Lippi G. Red blood cell distribution width: a simple parameter with multiple clinical applications. Crit Rev Clin Lab Sci. (2015) 52:86–105. doi: 10.3109/10408363.2014.992064

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lippi G, Plebani M. Red blood cell distribution width (RDW) and human pathology. One size fits all. Clin Chem Lab Med. (2014) 52:1247–9. doi: 10.1515/cclm-2014-0585

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Lippi G, Turcato G, Cervellin G, Sanchis-Gomar F. Red blood cell distribution width in heart failure: a narrative review. World J Cardiol. (2018) 10:6–14. doi: 10.4330/wjc.v10.i2.6

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Hu ZD. Red blood cell distribution width: a promising index for estimating activity of autoimmune disease. J Lab Precis Med. (2016) 1:4. doi: 10.21037/jlpm.2016.10.02

CrossRef Full Text | Google Scholar

8. Montagnana M, Danese E. Red cell distribution width and cancer. Ann Transl Med. (2016) 4:399. doi: 10.21037/atm.2016.10.50

PubMed Abstract | CrossRef Full Text | Google Scholar

9. van Kimmenade RR, Mohammed AA, Uthamalingam S, van der Meer P, Felker GM, Januzzi JL Jr. Red blood cell distribution width and 1-year mortality in acute heart failure. Eur J Heart Fail. (2010) 12:129–36. doi: 10.1093/eurjhf/hfp179

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Dabbah S, Hammerman H, Markiewicz W, Aronson D. Relation between red cell distribution width and clinical outcomes after acute myocardial infarction. Am J Cardiol. (2010) 105:312–7. doi: 10.1016/j.amjcard.2009.09.027

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Patel KV, Ferrucci L, Ershler WB, Longo DL, Guralnik JM. Red blood cell distribution width and the risk of death in middle-aged and older adults. Arch Intern Med. (2009) 169:515–23. doi: 10.1001/archinternmed.2009.11

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Tonelli M, Sacks F, Arnold M, Moye L, Davis B, Pfeffer M. Relation between red blood cell distribution width and cardiovascular event rate in people with coronary disease. Circulation. (2008) 117:163–8. doi: 10.1161/CIRCULATIONAHA.107.727545

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Osadnik T, Strzelczyk J, Hawranek M, Lekston A, Wasilewski J, Kurek A, et al. Red cell distribution width is associated with long-term prognosis in patients with stable coronary artery disease. BMC Cardiovasc Disord. (2013) 13:113. doi: 10.1186/1471-2261-13-113

PubMed Abstract | CrossRef Full Text | Google Scholar

14. McKechnie RS, Smith D, Montoye C, Kline-Rogers E, O'Donnell MJ, DeFranco AC, et al. Prognostic Circulation. (2004) 110:271–7. doi: 10.1161/01.CIR.0000134964.01697.C7

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Reinecke H, Trey T, Wellmann J, Heidrich J, Fobker M, Wichter T, et al. Haemoglobin-related morality in patients undergoing percutaneous coronary interventions. Eur Heart J. (2003) 24:2142–50. doi: 10.1016/j.ehj.2003.09.008

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Sun P, Zhang F, Chen C, Bi X, Yang H, An X, et al. The ratio of hemoglobin to red cell distribution width as a novel prognostic parameter in esophageal squamous cell carcinoma: a retrospective study from southern China. Oncotarget. (2016) 7:42650–60. doi: 10.18632/oncotarget.9516

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Libby P, Ridker PM, Maseri A. Inflammation and atherosclerosis. Circulation. (2002) 105:1135–43. doi: 10.1161/hc0902.104353

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Tham T, Olson C, Wotman M, Teegala S, Khaymovich J, Coury J, et al. Evaluation of the prognostic utility of the hemoglobin-to-red cell distribution width ratio in head and neck cancer. Eur Arch Otorhinolaryngol. (2018) 275:2869–78. doi: 10.1007/s00405-018-5144-8

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Zheng YY, Wu TT, Chen Y, Hou XG, Yang Y, Ma X, et al. Gamma-glutamyl transferase-to-platelet ratio as a novel predictor of long-term adverse outcomes in patients after undergoing percutaneous coronary intervention: a retrospective cohort study. Thromb Haemost. (2019) 119:1021–30. doi: 10.1055/s-0039-1681103

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Aronow WS, Fleg JL, Pepine CJ, Artinian NT, Bakris G, Brown AS, et al. ACCF/AHA 2011 expert consensus document on hypertension in the elderly: a report of the American College of Cardiology Foundation Task Force on Clinical Expert Consensus Documents developed in collaboration with the American Academy of Neurology, American Geriatrics Society, American Society for Preventive Cardiology, American Society of Hypertension, American Society of Nephrology, Association of Black Cardiologists, and European Society of Hypertension. J Am Soc Hypertens. (2011) 5:259–352. doi: 10.1016/j.jacc.2011.01.008

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Report of a WHO Consultation. 1999: Definition, Diagnosis and Classification of Diabetes Mellitus and Its Complications. Part 1: Diagnosis and Classification of Diabetes Mellitus. Geneva: World Health Organization.

Google Scholar

22. Joint Committee for the Revision of Guidelines for Prevention and Treatment of Dyslipidemia in Chinese Adults. Guidelines for the prevention and treatment of dyslipids in Chinese adults (Revised 2016). Zhong guo Xun Huan Za Zhi. (2016) 31:937–50.

Google Scholar

23. Xie X, Ma YT, Yang YN Li XM, Zheng YY, Ma X, et al. Personalized antiplatelet therapy according to CYP2C19 genotype after percutaneous coronary intervention: a randomized control trial. Int J Cardiol. (2013) 168:3736–40. doi: 10.1016/j.ijcard.2013.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Guerrero C, Garay A, Ariza-Solé A, Formiga F, Raposeiras-Roubín S, Abu-Assi E, et al. Anemia in patients with acute coronary syndromes treated with prasugrel or ticagrelor: insights from the RENAMI registry. Thromb Res. (2018) 167:142–8. doi: 10.1016/j.thromres.2018.05.024

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Thygesen K, Alpert JS, Jaffe AS, Simoons ML, Chaitman BR, White HD. Task force for the universal definition of myocardial infarction. Third universal definition of myocardial infarction. Nat Rev Cardiol. (2012) 9:620–33. doi: 10.1038/nrcardio.2012.122

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Yancy CW, Jessup M, Bozkurt B, Butler J, Casey DE Jr, Drazner MH, et al. 2013 ACCF/AHA guideline for the management of heart failure: a report of the American College of Cardiology Foundation/American Heart Association Task Force on Practice Guidelines. J Am Coll Cardiol. (2013) 62:e147–239. doi: 10.1016/j.jacc.2013.05.019

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Park JY, Choi BG, Rha SW, Kang TS. Five-year outcomes in patients with anemia on admission undergoing a coronary intervention for acute myocardial infarction in Koreans: propensity score matching analysis. Coron Artery Dis. (2018) 29:647–51. doi: 10.1097/MCA.0000000000000657

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Budczies J, Klauschen F, Sinn BV, Gyorffy B, Schmitt WD, Darb-Esfahani S, et al. Cutoff Finder: a comprehensive and straightforward Web application enabling rapid biomarker cutoff optimization. PLoS ONE. (2012) 7:e51862. doi: 10.1371/journal.pone.0051862

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Perlstein TS, Weuve J, Pfeffer MA, Beckman JA. Red blood cell distribution width and mortality risk in a community-based prospective cohort. Arch Intern Med. (2009) 169:588–94. doi: 10.1001/archinternmed.2009.55

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Zalawadiya SK, Veeranna V, Niraj A, Pradhan J, Afonso L. Red cell distribution width and risk of coronary heart disease events. Am J Cardiol. (2010) 106:988–93. doi: 10.1016/j.amjcard.2010.06.006

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Veeranna V, Zalawadiya SK, Panaich S, Patel KV, Afonso L. Comparative analysis of red cell distribution width and high sensitivity C-reactive protein for coronary heart disease mortality prediction in multi-ethnic population: findings from the 1999–2004 NHANES. Int J Cardiol. (2013) 168:5156–61. doi: 10.1016/j.ijcard.2013.07.109

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Shah N, Pahuja M, Pant S, Handa A, Agarwal V, Patel N, et al. Red cell distribution width and risk of cardiovascular mortality: Insights from National Health and Nutrition Examination Survey (NHANES)–III. Int J Cardiol. (2017) 232:105–10. doi: 10.1016/j.ijcard.2017.01.045

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Hosseini SK, Ansari MJ, Lotfi Tokaldany M, Sharafi A, Hakki Kazazi E, Poorhosseini H. Association between preprocedural hemoglobin level and 1-year outcome of elective percutaneous coronary intervention. J Cardiovasc Med. (2014) 15:331–5. doi: 10.2459/JCM.0b013e32835ec938

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Patel KV, Semba RD, Ferrucci L, Newman AB, Fried LP, Wallace RB, et al. Red cell distribution width and mortality in older adults: a meta-analysis. J Gerontol A Biol Sci Med Sci. (2009) 65:258–65. doi: 10.1093/gerona/glp163

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Poludasu S, Marmur JD, Weedon J, Khan W, Cavusoglu E. Effect of hemoglobin level on long term all cause mortality after percutaneous coronary intervention in African Americans. Am J Cardiol. (2009) 103:1078–82. doi: 10.1016/j.amjcard.2008.12.032

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Pilgrim T, Vetterli F, Kalesan B, Stefanini GG, Räber L, Stortecky S, et al. The impact of anemia on long term clinical outcome in patients undergoing revascularization with the unrestricted use of drug eluting-stents. Circ Cardiovasc Interv. (2012) 5:202–10. doi: 10.1161/CIRCINTERVENTIONS.111.965749

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Li Q, Gao YC, He JQ, Jiang TY, Ren XJ, Chen F. High hemoglobin level was associated with worse prognosis in patients with angiographic coronary artery disease. J Cardiovasc Pulmonary Dis. (2013) 32:49–52.

Google Scholar

38. Ridker PM, Rifai N, Clearfield M, Downs JR, Weis SE, Miles JS, et al. Measurement of C-reactive protein for the targeting of statin therapy in the primary prevention of acute coronary events. N Engl J Med. (2001) 344:1959–65. doi: 10.1056/NEJM200106283442601

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Sesso HD, Buring JE, Rifai N, Blake GJ, Gaziano JM, Ridker PM. C-reactive protein and the risk of developing hypertension. JAMA. (2003) 290:2945–51. doi: 10.1001/jama.290.22.2945

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Förhécz Z, Gombos T, Borgulya G, Pozsonyi Z, Prohászka Z, Jánoskuti L. Red cell distribution width in heart failure: prediction of clinical events and relationship with markers of ineffective erythropoiesis, inflammation, renal function, and nutritional state. Am Heart J. (2009) 158:659–66. doi: 10.1016/j.ahj.2009.07.024

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Vayá A, Sarnago A, Fuster O, Alis R, Romagnoli M. Influence of inflammatory and lipidic parameters on red blood cell distribution width in a healthy population. Clin Hemorheol Microcirc. (2015) 59:379–85. doi: 10.3233/CH-141862

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Emans ME, van der Putten K, van Rooijen KL, Kraaijenhagen RJ, Swinkels D, van Solinge WW, et al. Determinants of red cell distribution width (RDW) in cardiorenal patients: RDW is not related to erythropoietin resistance. J Card Fail. (2011) 17:626–33. doi: 10.1016/j.cardfail.2011.04.009

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Konijn AM. Iron metabolism in inflammation. Baillieres Clin Haematol. (1994) 4:829–49. doi: 10.1016/S0950-3536(05)80127-1

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Pierce CN, Larson DF. Inflammatory cytokine inhibition of erythropoiesis in patients implanted with a mechanical circulatory assist device. Perfusion. (2005) 20:83–90. doi: 10.1191/0267659105pf793oa

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Muzzarelli S, Pfisterer M. TIME investigators. Anemia as independent predictor of major events in elderly patients with chronic angina. Am Heart J. (2006) 152:991–6. doi: 10.1016/j.ahj.2006.06.014

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Friedman JS, Lopez MF, Fleming MD, Rivera A, Martin FM, Welsh ML, et al. SOD2-deficiency anemia: protein oxidation and altered protein expression reveal targets of damage, stress response, and antioxidant responsiveness. Blood. (2004) 104:2565–73. doi: 10.1182/blood-2003-11-3858

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Boekholdt SM, Kastelein JJ. C-reactive protein and cardiovascular risk: more fuel to the fire. Lancet. (2010) 375:95–6. doi: 10.1016/S0140-6736(09)62098-5

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Rana JS, Cote M, Després JP, Sandhu MS, Talmud PJ, Ninio E, et al. Inflammatory biomarkers and the prediction of coronary events among people at intermediate risk: the EPIC-Norfolk prospective population study. Heart. (2009) 95:1682–7. doi: 10.1136/hrt.2009.170134

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Tziakas D, Chalikias G, Grapsa A, Gioka T, Tentes I, Konstantinides S. Red blood cell distribution width: a strong prognostic marker in cardiovascular disease: is associated with cholesterol content of erythrocyte membrane. Clin Hemorheol Microcirc. (2012) 51:243–54. doi: 10.3233/CH-2012-1530

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Ercan M, Konukoglu D, Erdem T, Onen S. The effects of cholesterol levels on hemorheological parameters in diabetic patients. Clin Hemorheol Microcirc. (2002) 26:257–63.

PubMed Abstract | Google Scholar

51. Patel KV, Mohanty JG, Kanapuru B, Hesdorffer C, Ershler WB, Rifkind JM. Association of the red cell distribution width with red blood cell deformability. Adv Exp Med Biol. (2013) 765:211–6. doi: 10.1007/978-1-4614-4989-8_29

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Stuart J, Nash GB. Red cell deformability and haematological disorders. Blood Rev. (1990) 4:141–7. doi: 10.1016/0268-960X(90)90041-P

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Egberts J, Hardeman MR, Luykx LM. Decreased deformability of donor red blood cells after intrauterine transfusion in the human fetus: possible reason for their reduced life span? Transfusion. (2004) 44:1231–7. doi: 10.1111/j.1537-2995.2004.04014.x

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Most AS, Ruocco NA Jr, Gewirtz H. Effect of a reduction in blood viscosity on maximal myocardial oxygen delivery distal to a moderate coronary stenosis. Circulation. (1986) 74:1085–92. doi: 10.1161/01.CIR.74.5.1085

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Tamhane UU, Aneja S, Montgomery D, Rogers EK, Eagle KA, Gurm HS. Association between admission neutrophil to lymphocyte ratio and outcomes in patients with acute coronary syndrome. Am J Cardiol. (2008) 102:653–7. doi: 10.1016/j.amjcard.2008.05.006

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Pasqui E, de Donato G, Giannace G, Panzano C, Alba G, Cappelli A, et al. The relation between neutrophil/lymphocyte and platelet/lymphocyte ratios with mortality and limb amputation after acute limb ischaemia. Vascular. (2021) 21:17085381211010012. doi: 10.1177/17085381211010012

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Taurino M, Aloisi F, Del Porto F, Nespola M, Dezi T, Pranteda C, et al. Neutrophil-to-lymphocyte ratio could predict outcome in patients presenting with acute limb ischemia. J Clin Med. (2021) 10:4343. doi: 10.3390/jcm10194343

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Kordzadeh A, Malietzis G, Browne T, Prionidis I, Panayiotopoulos YP. Neutrophil to lymphocyte ratio (NLR) of five predicts 30-day morbidity in ruptured abdominal aortic aneurysms (rAAA): a retrospective cohort study. Int J Surg. (2015) 15:45–8. doi: 10.1016/j.ijsu.2015.01.013

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Levy PS, Quigley RL, Gould SA. Acute dilutional anemia and critical left anterior descending coronary artery stenosis impairs end organ oxygen delivery. J Trauma. (1996) 41:416–23. doi: 10.1097/00005373-199609000-00006

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Smith KJ, Bleyer AJ, Little WC, Sane DC. The cardiovascular effects of erythropoietin. Cardiovasc Res. (2003) 59:538–48. doi: 10.1016/S0008-6363(03)00468-1

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Kim TH, Koh YS, Chang K, Seo SM, Kim CJ, Park HJ, et al. Improved an emiais associated with favorable long term clinical outcomes in patients undergoing PCI. Coron Artery Dis. (2012) 23:391–9. doi: 10.1097/MCA.0b013e3283564869

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: hemoglobin-to-red-cell distribution width ratio, coronary atherosclerotic heart disease, percutaneous coronary intervention, mortality, all-cause mortality

Citation: Xiu W-J, Zheng Y-Y, Wu T-T, Hou X-G, Yang Y, Ma Y-T and Xie X (2022) Hemoglobin-to-Red-Cell Distribution Width Ratio Is a Novel Predictor of Long-Term Patient Outcomes After Percutaneous Coronary Intervention: A Retrospective Cohort Study. Front. Cardiovasc. Med. 9:726025. doi: 10.3389/fcvm.2022.726025

Received: 01 July 2021; Accepted: 17 January 2022;
Published: 16 February 2022.

Edited by:

Marat V. Ezhov, Ministry of Health of the Russian Federation, Russia

Reviewed by:

Gerald Chi, Beth Israel Deaconess Medical Center and Harvard Medical School, United States
Pasqualino Sirignano, Sapienza University of Rome, Italy

Copyright © 2022 Xiu, Zheng, Wu, Hou, Yang, Ma and Xie. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Xiang Xie, eGlhbmd4aWU5OTkmI3gwMDA0MDtzaW5hLmNvbQ==

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.