Skip to main content

ORIGINAL RESEARCH article

Front. Med., 08 September 2023
Sec. Intensive Care Medicine and Anesthesiology
This article is part of the Research Topic Assessment and Monitoring for the Immune Functional Status of Sepsis View all 5 articles

Neutrophil CD64–a prognostic marker of sepsis in intensive care unit: a prospective cohort study

Huy Minh Pham,Huy Minh Pham1,2Duy Ly Minh NguyenDuy Ly Minh Nguyen2Minh Cuong Duong
Minh Cuong Duong3*Xuan Thi PhanXuan Thi Phan2Linh Thanh TranLinh Thanh Tran2Duong Hong Thuy TrangDuong Hong Thuy Trang4Thao Thi Ngoc Pham,Thao Thi Ngoc Pham1,2
  • 1Department of Emergency and Critical Care, Faculty of Medicine, University of Medicine and Pharmacy at Ho Chi Minh City, Ho Chi Minh City, Vietnam
  • 2Intensive Care Unit, Cho Ray Hospital, Ho Chi Minh City, Vietnam
  • 3School of Population Health, University of New South Wales, Sydney, NSW, Australia
  • 4Intensive Care Unit, Nguyen Trai Hospital, Ho Chi Minh City, Vietnam

Background: Little is known about the prognostic ability of nCD64 in critically ill patients. This study aimed to assess the prognostic values of nCD64 in adult ICU patients with sepsis.

Methods: A prospective cohort study was conducted at the ICU of Cho Ray Hospital in Vietnam between January 2019 to September 2020. All newly admitted 86 septic patients diagnosed based on sepsis-3 criteria were included. An evaluation of nCD64 was performed at admission (T0) and 48 h thereafter (T48). Delta nCD64 (nCD64 T48 – nCD64 T0), %delta nCD64 [(nCD64 T48 – nCD64 T0)/nCD64 T0 x 100%], APACHE II and SOFA scores were calculated and examined. Serum procalcitonin levels and white blood cell counts were documented. Spearman’s rank correlation coefficient was used to test the correlation between nCD64 and severity scores. Receiver-operating characteristic (ROC) curve was performed to evaluate the predictive efficacy of the sepsis parameters.

Results: Patients with septic shock had significantly higher nCD64 levels than septic patients [3,568 (2,589; 5,999) vs. 1,514 (1,416;2,542) molecules/cell, p < 0.001]. nCD64 T0 and SOFA scores had a moderately positive linear correlation (R = 0.31, p = 0.004). In the survivor group, nCD64 levels significantly decreased within the first 48 h of admission (p < 0.001), while this trend was not statistically significant in the non-survivor group (p = 0.866). The area under the ROC curve (AUC) value of %delta nCD64 combined with APACHE II score (0.81) was higher than that of any other parameter alone or in combination with each other.

Conclusion: The nCD64 index may serve as a valuable biomarker for predicting the course of sepsis. Monitoring changes in nCD64 during the initial 48 h of admission can aid in predicting the prognosis of septic patients. The use of a combination of the trends of nCD64 index in the first 48 h with APACHE II score would further enhance the predictive accuracy. More studies with longer follow-ups are needed to fully understand the implications of serial trend and kinetics of nCD64 in septic patients.

Background

Sepsis is a condition in which a life-threatening organ dysfunction occurs due to the dysregulated host response to infection (1). Although sepsis is a major public health problem worldwide, the global impact of sepsis is difficult to determine because of the various, non-comparable methods used to quantify data in related studies (2). However, according to an analysis for the Global Burden of Disease Study in 2017, there were 48.9 million patients with sepsis and 11 million related deaths globally, accounting for approximately 20% of all global deaths (2). In a large meta-analysis of 170 studies conducted in Europe, North America, and Australia, the sub-analysis of 25 studies between 2009 and 2017 and 37 studies between 2011 and 2019 found that the 90-day mortality of sepsis and septic shock was 32.2 and 38.5%, respectively (3). Available data from Asian countries (including Vietnam) suggest that the overall prevalence of sepsis in intensive care units (ICUs) was 22.4%, and the in-hospital mortality rate of sepsis was 32.6% (4). It has been well documented that the prognosis and mortality of patients with sepsis are strongly influenced by the early detection of this health condition and timely treatment (57).

To improve outcomes of patients with sepsis, a reliable predictor of mortality and morbidity of this condition which helps monitor disease progression and guide timely treatment is needed (8). Indeed, several studies have been conducted to identify markers for the early identification and prognosis of sepsis (911). More recently, it has been found that the neutrophil cluster of differentiation 64 (nCD64) which is also known as the high-affinity immunoglobulin Fc-receptor I (FcγR1) (12) is a sensitive and specific marker for diagnosing sepsis caused by bacterial infections and for distinguishing sepsis from non-septic conditions (1315). Studies comparing nCD64 with C reactive protein (CRP), procalcitonin (PCT), and other common biomarkers of sepsis including white blood cell (WBC) count and interleukin-6 (IL-6) have found a superior performance of nCD64 in early detecting sepsis (14, 16, 17). However, the use of nCD64 as a prognostic marker for sepsis in critically ill patients in ICU settings remains controversial (18). Studies have found that septic patients with a high nCD64 index at ICU admission have a higher survival rate (19, 20), while others have reported that higher levels of nCD64 are associated with poorer outcomes (21, 22). It should also be noted that most existing studies about nCD64 as a predictive marker in sepsis have exclusively examined a single value of nCD64 at admission, and a few studies have evaluated the prognostic usefulness of the changes of this biomarker over time (18). In addition, given that the definition of sepsis is shifted over time (23), none of these studies concurrently examined the dynamic of nCD64 as a prognostic marker of sepsis and utilized the most current definition of sepsis - sepsis-3 criteria (1). The presenting study aimed to examine the reliability and dynamic of the nCD64 index as a prognostic marker for ICU mortality in adult patients with sepsis diagnosed based on sepsis-3 criteria by comparing the sensitivity, specificity and area under the receiver operating characteristic (ROC) curve (AUC) of nCD64 with those of the commonly used morbidity severity score and mortality estimation tools including the Sequential Organ Failure Assessment (SOFA) score and Acute Physiology and Chronic Health Evaluation (APACHE) II score (11, 24, 25). The secondary outcomes included ventilator days, ICU and hospital length of stay.

Methods

Study design and setting

A prospective cohort study was conducted at the General ICU of Cho Ray Hospital (CRH) in Ho Chi Minh City, Vietnam from January 2019 to October 2020. CRH with over 2,300 beds is the largest tertiary referral hospital located in the southern Vietnam (26). The General ICU which is among the four ICUs of CRH, has 28 beds and receives critically ill patients from the Emergency Department of CRH and other hospitals in the region. Based on our experience, the majority of patients at the General ICU are those with multitrauma, sepsis, or septic shock.

During the study period, all septic patients who had a clear source of infection and met the diagnostic criteria for sepsis in accordance with the third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3) (1) were invited to participate in the study. In detail, sepsis is defined as a life-threatening organ dysfunction caused by a dysregulated host response to infection (1). Organ dysfunction can be identified as an acute change in total SOFA score ≥ 2 points consequent to the infection (1). Patients with septic shock can be identified with a clinical construct of sepsis with persisting hypotension requiring vasopressors to maintain the mean arterial pressure (MAP) ≥65 mmHg and having a serum lactate level > 2 mmol/L (18 mg/dL) despite adequate volume resuscitation (1). Patients who were younger than 16 years old or with cancer, HIV, or end-stage disease, received immunosuppressive medications, refused to give informed consent to participate in the study, or died within 48 h of ICU admission were excluded from the study. The study was approved by the University of Medicine and Pharmacy at Ho Chi Minh City’s Ethics Committee (reference number 103/ĐHYD-HĐĐĐ). Written informed consent was obtained from either the patients or their legal surrogates when the patients’ health condition prevented them from providing informed consent.

A questionnaire was used to collect baseline information of study participants at ICU admission including demographic characteristics (age, sex, and BMI), comorbidities, clinical signs (blood pressure, respiratory rate, and pulse rate), SOFA and APACHE II scores (27, 28), sepsis stages [sepsis and septic shock (1)], laboratory tests and treatment outcomes. Laboratory tests consisted of complete blood count including WBC, coagulation test, serum lactate, PCT, and the nCD64 index. Regarding nCD64, in addition to the baseline measurement at admission (T0), it was re-measured 48 h thereafter (T48).

Measurement of the nCD64 index

Given that the flow cytometer is the currently most used method for quantifying nCD64 (17, 18), the flow cytometry BD FACS CANTO system (Becton Dickinson, San Jose, California, United States) was used to perform measurement of the nCD64 index based on regular equipment calibrations with a phycoerythrin (PE) fluorescence quantification kit (Quanti BRITE PE, Becton Dickinson) (29). Fifty μL of EDTA anticoagulated whole blood sample was collected and incubated with 5 μL anti-CD14-FITC (clone MφP9), 5 μL anti-CD64-PE (clone MD22), and 5 μL CD45PerCP (clone 2D1) at room temperature in the dark for 30 min. After lysis, all blood samples were washed and fixed using the BD Lyse/Wash Assistant. The flow cytometer settings were prepared in accordance with the manufacturer’s instructions (29). CD45/CD33-gating was used to isolate monocytes, neutrophils, and lymphocytes, and the median fluorescence intensity (MFI) of CD64 on the cells was measured. The inter-assay standardization for nCD64 quantitation was performed using Quanti BRITE PE calibration beads with known numbers of PE molecules. The MFI values for nCD64 were converted into molecules bound per cell using the BD FACS Diva software (version 6.1.3). This process has been validated elsewhere (30, 31). All laboratory tests were performed at the standardized Laboratory Department of CRH.

Our data collectors, who are qualified nurses with a Bachelor of Nursing, were consistently trained prior to the collection of blood samples. To prevent measurement errors due to prolonged storage of blood samples, nCD64 measurements were performed no later than 4 h post venipuncture as per previously studies (32, 33). In addition, given that the calibrators can be an error source caused by possible lot-to-lot variations and instability (34, 35), the internal quality control is performed daily at the Laboratory Department of our study clinic.

Sample size calculation

The total sample size was calculated using the formula based on the ROC curves (36). A previous study by Nguyen et al. (37) showed that the survival to death ratio in septic patients at CRH’s ICU was 2:1. In addition, Djordjevic et al. (21) found that the AUC of nCD64 in predicting mortality was 0.727. Hence, using MedCalc version 20.305 (38) with a power of 90%, type I error of 0.05, and default null hypothesis value of 0.5 (i.e., the default null hypothesis is that the AUC is ≤0.5), the minimum total sample size was 72 with a minimum number of survivors of 48 and a minimum number of non-survivors of 24.

For the purposes of our study, participants were classified into two groups including those with sepsis (without shock) and those with septic shock at the time of admission to examine associations between nCD64 and the severity of sepsis. Similarly, to examine the mortality predictive value of nCD64, study participants were also grouped into two other groups including survivors and non-survivors.

Statistical analysis

The R Statistical Software (version 3.6.2)1 was used to perform all statistical analyzes. To examine the performance of the changes in nCD64 values over time in predicting mortality among septic patients and to enable a quick application of nCD64 in busy clinical settings like ICUs, delta nCD64 (i.e., nCD64 T48 – nCD64 T0) and %delta nCD64 [i.e., (nCD64 T48 – nCD64 T0)/nCD64 T0 x 100%] were calculated as suggested elsewhere (39, 40). Categorical data were presented as frequencies and percentages and were analyzed using Pearson’s chi-square test. Normality of distributions of continuous data was examined using Shapiro–Wilk test. Normally distributed continuous data were presented as mean ± standard deviation (SD) and were analyzed using Student’s t test. Non-normally distributed data were presented as median (25th–75th percentile) and were analyzed using Mann–Whitney U test and Spearman’s correlation. The prognostic performance for mortality of the nCD64 index was evaluated using ROC curves. Sensitivity (Sens), specificity (Spec), positive predictive value (PPV) and negative predictive value (NPV) were calculated. The best cutoff values were identified based on maximized Youden’s index [J = max (sensitivity + specificity − 1)]. Survival curves representing mortality were constructed according to the Kaplan–Meier method and compared with the Mantel–Haenszel log-rank test. p values <0.05 was considered to be statistically significant.

Results

Demographic, clinical, and laboratory characteristics, and treatment outcomes of study participants

Among all 98 septic patients receiving treatment at the study clinic during the study period, 96 agreed to participate in the study making the recruitment rate of 98% (Figure 1). Of these 96 patients, 10 were excluded based on the exclusion criteria. Thus, a total of 86 study participants completed the study and included 54 (63%) survivors and 32 (37%) non-survivors.

FIGURE 1
www.frontiersin.org

Figure 1. Flowchart of study participants.

Among 86 study participants, the mean age was 60.5 ± 16.3 years, the mean BMI was 23.1 ± 3.2, and male accounted for 45.3% (Table 1). These 86 patients had a median PCT of 34.46 [4.95; 87.33] ng/mL, median ventilator days of 6.5 [4.0; 11.0] and median ICU length of stay of 7.0 [4.0; 13.0] days. Compared with the survivor group, the non-survivor group had significantly higher mean SOFA scores (11.3 ± 4.3 vs. 8.43 ± 3.56, p = 0.003), higher median APACHE II scores [24.0 (17.25; 29.0) vs. 19.0 (16.0; 22.25), p = 0.003], and higher median serum lactate [3.20 (2.33; 8.03) mmol/l vs. 1.95 (1.38; 3.5) mmol/l, p = 0.008] but had significantly lower WBC [11.9 (7.0; 15.1) 10^9/L vs. 15.8 (11.9; 21.1) 10^9/L, p = 0.023] and lower hospital length of stay [9.0 (6.25; 18.25) days vs. 19.0 (11.8; 30.25) days, p = 0.012]. Regarding nCD64, at T0, there was no statistically significant difference in the nCD64 index between the two groups [3,331 (2,361; 5,634) molecules/cell vs. 3,115 (1,851; 5,388) molecules/cell, p = 0.473]. However, at T48, the median nCD64 levels in the survivor group were statistically lower than those in the non-survivor group [2,129 (1,226; 3,503) molecules/cell vs. 2,778 (1,770; 4,983) molecules/cell, p = 0.041]. Therefore, compared with the non-survivor group, the survivor group had a significantly lower delta nCD64 [−1,243(−2,702; −231) molecules/cell vs. 234 (−1,328; 922) molecules/cell, p = 0.006] and lower %delta nCD64 [−35.3 (−60.1; −10) % vs. 8.0 (−32.7; 45.5) %, p = 0.002].

TABLE 1
www.frontiersin.org

Table 1. Demographic, clinical, and laboratory characteristics and treatment outcomes of 86 study participants.

Comparison of nCD64 index at T0 with APACHE II and SOFA score between patients with sepsis and those with septic shock

Among 86 patients with sepsis, 32 (37%) had septic shock (Table 2). There was a statistically significant difference between the septic and septic shock group regarding the median APACHE II scores, SOFA scores, and nCD64 values T0 (p < 0.05).

TABLE 2
www.frontiersin.org

Table 2. Distributions of APACHE II and SOFA scores and laboratory parameters in the sepsis and septic shock groups.

There was a medium positive linear correlation between nCD64 values T0 and SOFA scores (R = 0.31, 95%CI 0.10–0.49, p = 0.004) but not between nCD64 T0 values and APACHE II scores (R = 0.11, 95%CI -0.10-0.32, p = 0.31; Figure 2).

FIGURE 2
www.frontiersin.org

Figure 2. Correlations between nCD64 values at ICU admission and SOFA scores (A) as well as APHACHEII scores (B).

Dynamic of nCD64 in the first 48 h between survivor and non-survivor groups

The nCD64 levels decreased significantly over the first 48 h after ICU admission in the survivor group (p < 0.001), but this change was not statistically significant in the non-survivor group (p = 0.866; Figure 3). The survival of patients with %delta nCD64 below −1.2% was significantly higher compared to those with %delta nCD64 above −1.2% (p = 0.0011; Figure 4).

FIGURE 3
www.frontiersin.org

Figure 3. Comparison of changes in nCD64 levels over the first 48 h after ICU admission between survivor and non-survivor patients.

FIGURE 4
www.frontiersin.org

Figure 4. Kaplan–Meier overall survival analysis of septic patients with regard to the changes in nCD64 over time (%delta nCD64).

Predictive values of nCD64, SOFA and APACHE II scores and combinations of these parameters

The AUC values of %delta nCD64 (0.72) demonstrated a greater level of accuracy compared to delta nCD64 (0.7), SOFA score (0.7), APACHE II score (0.68), nCD64 T48 (0.63), and nCD64 T0 (0.53; Table 3; Figure 5). The highest AUC was achieved when %delta nCD64 was combined with the APACHE II score (0.81), which was comparable to the AUC of %delta nCD64 combined with both the APACHE II and SOFA scores (0.81). By analyzing the ROC curve using %delta nCD64 in combination with the APACHE II score, these combined parameters exhibited the ability to predict mortality with 75% sensitivity, 79.6% specificity, 68.6% PPV, and 84.3% NPV. Similarly, based on the ROC curve of using %delta nCD64 in conjunction with both the APACHE II and SOFA scores, these combined parameters displayed the capacity to predict mortality with 78.1% sensitivity, 75.9% specificity, 65.8% PPV, and 85.4% NPV.

TABLE 3
www.frontiersin.org

Table 3. ICU mortality prognostic values of nCD64, SOFA and APACHE II scores among 86 study participants.

FIGURE 5
www.frontiersin.org

Figure 5. ROC curves comparing ICU mortality prognostic abilities of %delta nCD64 and %delta nCD64 combined with SOFA score as well as APACHE II scores.

Discussion

We documented a mortality rate of 37.2% among septic patients, which is similar to the rates reported in previous studies (4, 37). In detail, a study conducted at the same ICU in 2017 reported a mortality rate of 33.3% (13/39, 95%CI 20.6–49.0%) (37). Another study conducted in 2022 at ICUs located across 22 Asian countries found that in settings that are comparable to our study context, the mortality rate was 35.5% (196/552, 95%CI 31.6–39.6%) (4). We also found that the APACHE II and SOFA scores as well as serum lactate levels of the non-survivor group were statistically higher than those of the survivor group. This reflects greater levels of severity in deceased patients through previously proven severity scores (10, 25). Similarly, several studies have shown that higher serum lactate levels are associated with an increased sepsis mortality (41, 42). Besides, in our study, the deceased group had significantly lower WBC counts than the survivor group. Indeed, a large retrospective study of 5,909 ICU patients has found that leukopenia is associated with a higher risk of mortality compared to leukocytosis (OR = 1.6, 95%CI 1.2–2.2) after adjusting for demographic characteristics and comorbidities using variates analogous to those used for sepsis-3 criteria (43). In addition, we found that the deceased group had a significantly shorter hospital length of stay than the survivor group, which may be owing to the deceased group’s severe condition leading to early mortality and thus, shorter hospital length of stay.

CD64 is a protein found on the surface of certain immune cells, such as neutrophils and monocytes (12). nCD64 expression increases once these neutrophils are stimulated by the proinflammatory cytokines granulocyte colony-stimulating factor (G-CSF) and interferon gamma (IFN-γ), which are produced in response to infection or after exposure to endotoxin (32). Therefore, the role of nCD64 in the early diagnosis of sepsis has been well reported (16, 44, 45). However, the use of nCD64 as a prognostic indicator in critically ill patients has received little attention (18). We found that the nCD64 index was associated with sepsis stages. Patients with septic shock had significantly higher nCD64 levels compared with septic patients. Our result is consistent with other available nCD64 studies (14, 32, 46, 47). In a prospective study by Hsu et al., nCD64 expression has been found to increase progressively from patients with systemic inflammatory response syndrome (SIRS) to severe sepsis and septic shock (46). It has also been well documented that nCD64 is better than PCT in differentiating SIRS from severe sepsis and septic shock (46). Similarly, Ghosh et al. have found that nCD64 levels are significantly higher in patients with septic shock compared with septic patients on days 0 (47). In a more recent study using sepsis-3 criteria like us, Yin et al. have also found that nCD64 levels increase significantly with the disease severity. Patients with septic shock exhibit higher levels of nCD64 expression compared to those with a less severe infection (14). Like another study (32), the correlations between stages of sepsis and nCD64 values documented 48 h after ICU admission as well as the changes in nCD64 values over time (i.e., delta nCD64 and %delta nCD64) were not examined in our study. This is because in clinical practice, confirming the progress of sepsis is usually important at the time when patients are admitted to the ICU. After 48 h post ICU admission, the sepsis stages are clear, and the patient’s mortality prognosis has become an important concern (48). A tool commonly used to assess the severity of sepsis is the SOFA score, which is a clinical scoring system based on an evaluation of the function of different organ systems in critically ill patients (10). In our study, we found that nCD64 levels were positively associated with SOFA scores. Indeed, it has been found that an increase in nCD64 levels due to an activation of CD64 expression in neutrophils by bacterial infection reflects the disease severity (12). Like us, several studies have shown a positive correlation between nCD64 values and SOFA scores in septic patients, suggesting that higher levels of nCD64 are associated with higher SOFA scores and worse outcomes (4951). The nCD64 index has also been found to be more closely related to the severity of sepsis than other biomarkers including PCT, CRP, IL-6, and IL-10 (52). Considering these findings, we strongly believe that the nCD64 index can be used as a valuable biomarker in estimating the severity of sepsis.

The ability of nCD64 to predict sepsis-related mortality remains controversial. A prospective study conducted on 132 ICU patients in Spain has found that septic patients who survive had a higher nCD64 index compared with deceased patients (20). This may be due to the “exhaustion” of neutrophils brought on by constant stimulation from systemic cytokines in non-survivors (20). Another prospective study conducted on 41 septic patients in an ICU in Greece has found that those with a lower and higher nCD64 index have a worse and better outcome, respectively (19). Therefore, the reduced neutrophil phagocytic activity during the first 24 h after ICU admission is a predictor of mortality (19). In contrast, other studies have showed a negative correlation between nCD64 levels and survival. Djordjevic et al. have reported that the nCD64 values on day 1 and day 2 post admission are higher in non-survivors compared with survivors (21). Especially, the difference in the nCD64 values between these two groups is more pronounced on day 2 than day 1 (21). Similarly, in a recent study with 349 septic patients, Huang et al. have showed that non-survivor patients have a higher nCD64 index than survivors (22). In another study assessing serial nCD64 measurements in septic patients over the first 8 days of ICU stay, Ghosh et al. have found that there is no significant difference in the nCD64 index on days 0 and 4 between survivor and deceased group, but the nCD64 index in deceased patients is higher on day 8 (47). In our study, the nCD64 index on day 0 (T0) was not significantly different between the two groups, but this parameter on day 2 (T48) was higher in non-survivor group compared with survivors. In addition, ROC curve analysis of the nCD64 index at T48 in predicting mortality showed an AUC of 0.63. In light of our findings, a follow-up examination of the nCD64 index at day 2 post ICU admission would enhance its accuracy in predicting mortality in septic patients.

Few studies have been conducted to examine the changes in nCD64 levels over time in relation to the prediction of mortality in septic patients (18). The clinical status of critically ill septic patients may alter in the first few days of ICU admission due to resuscitation, antibiotic use, and other treatments (18). Hence, it has been documented that when a biomarker is used for its prognostic utility in ICU settings, a serial analysis of its values over time is more reliable than a single value at admission (18). Concurring with this, we found that the AUC value in predicting ICU mortality of delta nCD64 and %delta nCD64 were 0.7 and 0.72, respectively, demonstrating a high capacity in predicting mortality of serial nCD64 examination in the first 48 h after ICU admission. The AUC of %delta nCD64 was also better than that of SOFA score and APACHE II score. We found that nCD64 values decreased significantly in the survivor group. This means the higher the value of %delta nCD64, the higher risk of mortality in septic patients. Like us, in a prospective observational study of 155 patients with longitudinal course of nCD64, De Jong et al. have found a more substantial decrease in the mean nCD64 index over time in the survivor group (53). The authors also note a decline in nCD64 values after day 3, which could be explained by either an indirect effect of antibiotics inducing restoration of the regulated immune response or a condition of neutrophil deactivation with a decreased polymorphonuclear neutrophils phagocytic function (53). Similarly, Ghosh et al. have reported that survivors have a significant decrease in nCD64 values over time (47). In a more recent study, Cui et al. have also documented an inverse association between a decline in the serial nCD64 index and in-hospital death rates (54). In light of these studies and our findings, we believe that monitoring nCD64 levels over time could be a useful tool to predict mortality in septic patients.

Given that sepsis is a highly complex immunological syndrome involving both hyperinflammation and immunosuppression (7), a single biomarker may not be able to provide a comprehensive understanding of a patient’s immune status. Thus, combining different markers has been suggested (22). Regarding the use of nCD64, in a systematic review of all published studies between 2006 and 2019, Patnaik et al. have also recommended that nCD64 should be utilized in a combination with other sepsis biomarkers for prognosis in critically ill patients, and the kinetics of serial nCD64 trend is helpful in examining different aspects of prediction (18). However, to the best of our knowledge, till now, there have only been a few studies examining nCD64 in combination with other parameters for sepsis prognostication (14, 22, 55). Qiqi Chen et al. have found that nCD64 combined with the APACHE II score has a significantly higher level of accuracy in mortality prediction compared with separate uses of these parameters (55). Yin et al. have also found that the AUC of nCD64 or PCT combined with the SOFA score is significantly higher than that of any single measure for predicting 28-day mortality in septic patients in ICU settings (14). Similarly, Huang et al. have proved that nCD64 plus CRP have a better performance in the prediction, discrimination, and reclassification of the 28-day mortality risk in septic patients (22). Although we did not examine CRP due to our study clinic’s policy, we also found that the AUC of %delta nCD64 combined with the APACHE II score (0.81) was higher than that of any other parameter alone or in combination with each other, except %delta nCD64 combined with both APACHE II and SOFA scores which was also 0.81. Therefore, given an ICU setting, to improve the predictive efficacy in septic patients, we believe that the best approach is to examine the changes in nCD64 over time in combination with using the APACHE II score.

Our study has some limitations. First, given the single-center study design, the generalizability of our data may be limited to comparable settings. Second, monitoring the nCD64 index for a longer period than 48 h may make the predictive values of this biomarker more obvious. Unfortunately, we were unable to do this due to limited resources. Third, although data on the differential leukocyte count and immunoglobulins levels provide more insight into understanding the association between the dynamic of nCD64 over time and the course of sepsis, these data were not examined in our study. Fourth, despite the performance of sample size calculation, the actual sample size is considerably small. Given that sepsis is a prevalent health condition, we believe studies with larger sample size could provide more robust and generalizable results. Our study was based on delta nCD64 and %delta nCD64 as measures to examine the performance of changes in nCD64 values over time in predicting mortality. Although the dynamic of nCD64 over time has been examined in several similar studies (32, 47, 53, 54), the methods used to quantify these changes in nCD64 have not been standardized. To the best of our knowledge, however, this is the first study in Vietnam and among the few studies worldwide to evaluate the performance of the nCD64 index in predicting mortality in Asian patients with sepsis. In addition, our study is among the first ones that used the most recent definition of sepsis (sepsis-3 criteria) in examining nCD64 (1).

Conclusion

The nCD64 index could be a reliable biomarker to predict the progress of sepsis including mortality. Monitoring the kinetics of serial nCD64 trend during the first 2 days of ICU stay is helpful in predicting the outcome of septic patients. The use of a combination of the trends of nCD64 index with the APACHE II score would further enhance the predictive accuracy. More studies with longer follow-ups are needed to fully understand the implications of serial trend and kinetics of nCD64 in septic patients including the prediction of the long-term morbidity and quality of life post-sepsis. To assist in clinical decision making, it is also important to explore more reliable parameters that help quantify the absolute risks of severe sepsis and sepsis-related mortality.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving humans were approved by University of Medicine and Pharmacy at Ho Chi Minh City (approval number 103/ĐHYD-HĐĐĐ). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

HP, DN, MD, LT, DT, XP, and TP designed the study, performed statistical analysis and drafted the manuscript. HP, DN, LT, DT, XP, and TP performed data collection. All authors contributed to the article and approved the submitted version.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Abbreviations

APACHE, Acute Physiology and Chronic Health Evaluation; AUC, Area under the ROC curve; CRH, Cho Ray Hospital; CRP, C reactive protein; FcγR1, Fc-receptor I; G-CSF, Granulocyte colony-stimulating factor; IFN-γ, Interferon gamma; ICUs, Intensive care units; MFI, Median fluorescence intensity; NPV, Negative predictive value; nCD64, Neutrophil cluster of differentiation 64; PE, Phycoerythrin; PPV, Positive predictive value; PCT, Procalcitonin; ROC, Receiver operating characteristic; Sens, Sensitivity; SOFA, Sequential Organ Failure Assessment; Spec, Specificity; SIRS, Systemic inflammatory response syndrome; Sepsis-3, Third International Consensus Definitions for Sepsis and Septic Shock; WBC, White blood cell.

Footnotes

References

1. Singer, M , Deutschman, CS , Seymour, CW , Shankar-Hari, M , Annane, D , Bauer, M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. (2016) 315:801–10. doi: 10.1001/jama.2016.0287

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Rudd, KE , Johnson, SC , Agesa, KM , Shackelford, KA , Tsoi, D , Kievlan, DR, et al. Global, regional, and national sepsis incidence and mortality, 1990-2017: analysis for the global burden of disease study. Lancet. (2020) 395:200–11. doi: 10.1016/S0140-6736(19)32989-7

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Bauer, M , Gerlach, H , Vogelmann, T , Preissing, F , Stiefel, J , and Adam, D . Mortality in sepsis and septic shock in Europe, North America and Australia between 2009 and 2019–results from a systematic review and meta-analysis. Crit Care. (2020) 24:239. doi: 10.1186/s13054-020-02950-2

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Li, A , Ling, L , Qin, H , Arabi, Y , Myatra, S , Egi, M, et al. Epidemiology, management, and outcomes of Sepsis in intensive care units among countries of differing National Wealth across Asia. Am J Respir Crit Care Med. (2022) 206:1107–16. doi: 10.1164/rccm.202112-2743OC

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Evans, L , Rhodes, A , Alhazzani, W , Antonelli, M , Coopersmith, CM , French, C, et al. Surviving Sepsis campaign: international guidelines for Management of Sepsis and Septic Shock 2021. Crit Care Med. (2021) 49:1181–247. doi: 10.1097/CCM.0000000000005357

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Kim, HI , and Park, S . Sepsis: early recognition and optimized treatment. Tuberc Respir Dis. (2019) 82:6–14. doi: 10.4046/trd.2018.0041

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Jarczak, D , Kluge, S , and Nierhaus, A . Sepsis-pathophysiology and therapeutic concepts. Front Med. (2021) 8:628302. doi: 10.3389/fmed.2021.628302

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Mohamed, AKS , Mehta, AA , and James, P . Predictors of mortality of severe sepsis among adult patients in the medical intensive care unit. Lung India. (2017) 34:330–5. doi: 10.4103/lungindia.lungindia_54_16

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Koozi, H , Lengquist, M , and Frigyesi, A . C-reactive protein as a prognostic factor in intensive care admissions for sepsis: a Swedish multicenter study. J Crit Care. (2020) 56:73–9. doi: 10.1016/j.jcrc.2019.12.009

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Liu, C , Suo, S , Luo, L , Chen, X , Ling, C , and Cao, S . SOFA score in relation to Sepsis: clinical implications in diagnosis, treatment, and prognostic assessment. Comput Math Methods Med. (2022) 2022:7870434. doi: 10.1155/2022/7870434

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Wu, R , Jiang, H , Mao, G , Ren, Y , Wang, Y , Yan, D, et al. Sepsis prognosis related scoring standards: A comprehensive review, vol. 2022 (2022). 5 p.

Google Scholar

12. Hoffmann, JJ . Neutrophil CD64: a diagnostic marker for infection and sepsis. Clin Chem Lab Med. (2009) 47:903–16. doi: 10.1515/CCLM.2009.224

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Ye, Z , Zou, H , Liu, S , Mei, C , Chang, X , Hu, Z, et al. Diagnostic performance of neutrophil CD64 index in patients with sepsis in the intensive care unit. J Int Med Res. (2019) 47:4304–11. doi: 10.1177/0300060519860677

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Yin, WP , Li, JB , Zheng, XF , An, L , Shao, H , and Li, CS . Effect of neutrophil CD64 for diagnosing sepsis in emergency department. World J Emerg Med. (2020) 11:79–86. doi: 10.5847/wjem.j.1920-8642.2020.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Jämsä, J , Ala-Kokko, T , Huotari, V , Ohtonen, P , Savolainen, ER , and Syrjälä, H . Neutrophil CD64, C-reactive protein, and procalcitonin in the identification of sepsis in the ICU-post-test probabilities. J Crit Care. (2018) 43:139–42. doi: 10.1016/j.jcrc.2017.08.038

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Yeh, C-F , Wu, C-C , Liu, S-H , and Chen, K-F . Comparison of the accuracy of neutrophil CD64, procalcitonin, and C-reactive protein for sepsis identification: a systematic review and meta-analysis. Ann Intensive Care. (2019) 9:5. doi: 10.1186/s13613-018-0479-2

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Cong, S , Ma, T , Di, X , Tian, C , Zhao, M , and Wang, K . Diagnostic value of neutrophil CD64, procalcitonin, and interleukin-6 in sepsis: a meta-analysis. BMC Infect Dis. (2021) 21:384. doi: 10.1186/s12879-021-06064-0

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Patnaik, R , Azim, A , and Agarwal, V . Neutrophil CD64 a diagnostic and prognostic marker of Sepsis in adult critically ill patients: a brief review. Indian J Crit Care Med. (2020) 24:1242–50. doi: 10.5005/jp-journals-10071-23558

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Danikas, DD , Karakantza, M , Theodorou, GL , Sakellaropoulos, GC , and Gogos, CA . Prognostic value of phagocytic activity of neutrophils and monocytes in sepsis. Correlation to CD64 and CD14 antigen expression. Clin Exp Immunol. (2008) 154:87–97. doi: 10.1111/j.1365-2249.2008.03737.x

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cid, J , García-Pardo, G , Aguinaco, R , Sánchez, R , and Llorente, A . Neutrophil CD64: diagnostic accuracy and prognostic value in patients presenting to the emergency department. Eur J Clin Microbiol Infect Dis. (2011) 30:845–52. doi: 10.1007/s10096-011-1164-7

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Djordjevic, D , Pejovic, J , Surbatovic, M , Jevdjic, J , Radakovic, S , Veljovic, M, et al. Prognostic value and daily trend of Interleukin-6, neutrophil CD64 expression, C-reactive protein and lipopolysaccharide-binding protein in critically ill patients: reliable predictors of outcome or not? J Med Biochem. (2015) 34:431–9. doi: 10.1515/jomb-2015-0002

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Huang, N , Chen, J , Wei, Y , Liu, Y , Yuan, K , Chen, J, et al. Multi-marker approach using C-reactive protein, procalcitonin, neutrophil CD64 index for the prognosis of sepsis in intensive care unit: a retrospective cohort study. BMC Infect Dis. (2022) 22:662. doi: 10.1186/s12879-022-07650-6

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Sartelli, M , Kluger, Y , Ansaloni, L , Hardcastle, TC , Rello, J , Watkins, RR, et al. Raising concerns about the Sepsis-3 definitions. World J Emerg Surg. (2018) 13:6. doi: 10.1186/s13017-018-0165-6

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Seymour, CW , Liu, VX , Iwashyna, TJ , Brunkhorst, FM , Rea, TD , Scherag, A, et al. Assessment of clinical criteria for Sepsis: for the third international consensus definitions for Sepsis and septic shock (Sepsis-3). JAMA. (2016) 315:762–74. doi: 10.1001/jama.2016.0288

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Sadaka, F , Ethmane Abou ElMaali, C , Cytron, MA , Fowler, K , Javaux, VM , and O'Brien, J . Predicting mortality of patients with Sepsis: a comparison of APACHE II and APACHE III scoring systems. J Clin Med Res. (2017) 9:907–10. doi: 10.14740/jocmr3083w

PubMed Abstract | CrossRef Full Text | Google Scholar

26. General information of Cho Ray Hospital [in Vietnamese . (n.d.). Available at: http://choray.vn/.

Google Scholar

27. Lakhani, JD . SOFA vs APACHE II as ICU scoring system for sepsis: A dilemma. J Integr Health Sci. (2015) 3:3–7. doi: 10.4103/2347-6486.239792

CrossRef Full Text | Google Scholar

28. Naqvi, IH , Mahmood, K , Ziaullaha, S , Kashif, SM , and Sharif, A . Better prognostic marker in ICU-APACHE II, SOFA or SAP II! Pak J Med Sci. (2016) 32:1146–51. doi: 10.12669/pjms.325.10080

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Sanju, S , Jain, P , Priya, VV , Varma, PK , and Mony, U . Quantitation of mHLA-DR and nCD64 by flow cytometry to study dysregulated host response: the use of Quanti BRITE™ PE beads and its stability. Appl Biochem Biotechnol. (2022) 195:5747–52. doi: 10.1007/s12010-022-03819-6

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Mitsumoto-Kaseida, F , Murata, M , Ura, K , Takayama, K , Hiramine, S , Shimizu, M, et al. The expression level of neutrophil CD64 is a useful marker of systemic inflammation associated with HIV infection. AIDS Res Hum Retrovir. (2017) 33:147–56. doi: 10.1089/aid.2016.0107

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Dimoula, A , Pradier, O , Kassengera, Z , Dalcomune, D , Turkan, H , and Vincent, J-L . Serial determinations of neutrophil CD64 expression for the diagnosis and monitoring of sepsis in critically ill patients. Clin Infect Dis. (2013) 58:820–9. doi: 10.1093/cid/cit936

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Shankar-Hari, M , Datta, D , Wilson, J , Assi, V , Stephen, J , Weir, CJ, et al. Early PREdiction of sepsis using leukocyte surface biomarkers: the ExPRES-sepsis cohort study. Intensive Care Med. (2018) 44:1836–48. doi: 10.1007/s00134-018-5389-0

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Gratama, JW , D'Hautcourt, JL , Mandy, F , Rothe, G , Barnett, D , Janossy, G, et al. Flow cytometric quantitation of immunofluorescence intensity: problems and perspectives. European working group on clinical cell analysis. Cytometry. (1998) 33:166–78. doi: 10.1002/(SICI)1097-0320(19981001)33:2<166::AID-CYTO11>3.0.CO;2-S

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Rossmann, ED , Lenkei, R , Lundin, J , Mellstedt, H , and Österborg, A . Performance of calibration standards for antigen quantitation with flow cytometry in chronic lymphocytic leukemia. Cytometry B Clin Cytom. (2007) 72:450–7. doi: 10.1002/cyto.b.20359

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Hanley, JA , and McNeil, BJ . The meaning and use of the area under a receiver operating characteristic (ROC) curve. Radiology. (1982) 143:29–36. doi: 10.1148/radiology.143.1.7063747

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Nguyen, DLM . Investigate the value of microalbuminuria in predicting acute kidney injury in sepsis patients [in Vietnamese]. [Master thesis]: Faculty of Medicine, University of Medicine and Pharmacy at Ho Chi Minh City; (2017).

Google Scholar

38. Med Calc . Med Calc Statistical Software version 20.305. Med Calc Software bv, Ostend, Belgium. (2020). https://www.medcalc.org.

Google Scholar

39. Liu, Q , Gao, Y , Ou, Q , Xu, Y , Zhou, Z , Li, T, et al. Differential expression of CD64 in patients with Mycobacterium tuberculosis infection: a potential biomarker for clinical diagnosis and prognosis. J Cell Mol Med. (2020) 24:13961–72. doi: 10.1111/jcmm.16004

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Hashem, HE , El Masry, SA , Mokhtar, AM , Ismail, EA , and Abdelaal, NM . Valuable role of neutrophil CD64 and highly sensitive CRP biomarkers for diagnostic, monitoring, and prognostic evaluations of Sepsis patients in neonatal ICUs. BioMed Res Int. (2020) 2020:6214363. doi: 10.1155/2020/6214363

CrossRef Full Text | Google Scholar

41. Villar, J , Short, JH , and Lighthall, G . Lactate predicts both Short-and long-term mortality in patients with and without Sepsis. Infect Dis. (2019) 12:2776. doi: 10.1177/1178633719862776

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Chaudhari, M , and Agarwal, N . Study of significance of serum lactate kinetics in Sepsis as mortality predictor. Indian J Crit Care Med. (2022) 26:591–5. doi: 10.5005/jp-journals-10071-23935

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Belok, SH , Bosch, NA , Klings, ES , and Walkey, AJ . Evaluation of leukopenia during sepsis as a marker of sepsis-defining organ dysfunction. PLoS One. (2021) 16:e0252206. doi: 10.1371/journal.pone.0252206

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Wang, X , Li, Z-Y , Zeng, L , Zhang, A-Q , Pan, W , Gu, W, et al. Neutrophil CD64 expression as a diagnostic marker for sepsis in adult patients: a meta-analysis. Crit Care. (2015) 19:245–54. doi: 10.1186/s13054-015-0972-z

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Pham, HM , Nguyen, DLM , Duong, MC , Tran, LT , and Pham, TTN . Diagnostic value of neutrophil CD64 in Sepsis patients in the intensive care unit: a cross-sectional study. Diagnostics. (2023) 13:1427. doi: 10.3390/diagnostics13081427

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Hsu, KH , Chan, MC , Wang, JM , Lin, LY , and Wu, CL . Comparison of Fcgamma receptor expression on neutrophils with procalcitonin for the diagnosis of sepsis in critically ill patients. Respirology. (2011) 16:152–60. doi: 10.1111/j.1440-1843.2010.01876.x

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Ghosh, PS , Singh, H , Azim, A , Agarwal, V , Chaturvedi, S , Saran, S, et al. Correlation of neutrophil CD64 with clinical profile and outcome of Sepsis patients during intensive care unit stay. Indian J Crit Care Med. (2018) 22:569–74. doi: 10.4103/ijccm.IJCCM_228_18

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Daviaud, F , Grimaldi, D , Dechartres, A , Charpentier, J , Geri, G , Marin, N, et al. Timing and causes of death in septic shock. Ann Intensive Care. (2015) 5:16. doi: 10.1186/s13613-015-0058-8

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Cortegiani, A , Marino, L , Di Benedetto, A , Virga, G , Evangelico, G , Sarno, C, et al. Use of CD64 for the diagnosis of sepsis: a case-control study. Crit Care. (2010) 14:P32. doi: 10.1186/cc8264

CrossRef Full Text | Google Scholar

50. Cortegiani, A , Russotto, V , Montalto, F , Foresta, G , Santi, P , and Raineri, M . Neutrophil CD64 as a marker of infection in patients admitted to the emergency department with acute respiratory failure. Open Access Emerg Med. (2014) 27:37–44. doi: 10.2147/OAEM.S56759

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Liu, Q , Gao, Y , Yang, T , Zhou, Z , Lin, K , Zhang, W, et al. nCD64 index as a novel inflammatory indicator for the early prediction of prognosis in infectious and non-infectious inflammatory diseases: An observational study of febrile patients. Front Immunol. (2022) 13:905060. doi: 10.3389/fimmu.2022.905060

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Livaditi, O , Kotanidou, A , Psarra, A , Dimopoulou, I , Sotiropoulou, C , Augustatou, K, et al. Neutrophil CD64 expression and serum IL-8: sensitive early markers of severity and outcome in sepsis. Cytokine. (2006) 36:283–90. doi: 10.1016/j.cyto.2007.02.007

PubMed Abstract | CrossRef Full Text | Google Scholar

53. de Jong, E , de Lange, DW , Beishuizen, A , van de Ven, PM , Girbes, AR , and Huisman, A . Neutrophil CD64 expression as a longitudinal biomarker for severe disease and acute infection in critically ill patients. Int J Lab Hematol. (2016) 38:576–84. doi: 10.1111/ijlh.12545

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Cui, W , Xu, Y , Fang, H , Tong, W , Zhu, L , Jin, D, et al. Assessment of continuous neutrophil CD64 index measurement for diagnosing sepsis and predicting outcome in a Chinese pediatric intensive care unit: a prospective study. Transl Pediatr. (2021) 10:1668–76. doi: 10.21037/tp-21-63

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Chen, Q , Shi, J , Fei, A , Wang, F , Pan, S , and Wang, W . Neutrophil CD64 expression is a predictor of mortality for patients in the intensive care unit. Int J Clin Exp Pathol. (2014) 7:7806–13.

PubMed Abstract | Google Scholar

Keywords: nCD64, sepsis, prognosis, intensive care unit, ICU

Citation: Pham HM, Nguyen DLM, Duong MC, Phan XT, Tran LT, Trang DHT and Pham TTN (2023) Neutrophil CD64–a prognostic marker of sepsis in intensive care unit: a prospective cohort study. Front. Med. 10:1251221. doi: 10.3389/fmed.2023.1251221

Received: 01 July 2023; Accepted: 29 August 2023;
Published: 08 September 2023.

Edited by:

Sebastien Gibot, Centre Hospitalier Universitaire de Nancy, France

Reviewed by:

Afzal Azim, Sanjay Gandhi Post Graduate Institute of Medical Sciences (SGPGI), India
Erika Casarotta, Marche Polytechnic University, Italy

Copyright © 2023 Pham, Nguyen, Duong, Phan, Tran, Trang and Pham. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Minh Cuong Duong, minh.duong@unsw.edu.au

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.