Prognostic performance of the NRS2002, NUTRIC, and modified NUTRIC to identify high nutritional risk in severe acute pancreatitis patients

Background: Acute pancreatitis (AP) is the most common gastrointestinal disease requiring hospital admission. AP patients are categorized as mild, moderately severe, and severe AP (SAP). For SAP patients, malnutrition increases susceptibility to infection and mortality. The Nutritional Risk Screening 2002 (NRS 2002), the Nutrition Risk in Critically Ill (NUTRIC) score and modified Nutrition Risk in Critically Ill (mNUTRIC) are nutritional risk screening tools of critically ill patients and have not been validated in patients with SAP. It is essential to evaluate the prognostic performance of these nutritional risk screening tools.

Materials and methods: A retrospective study was designed to validate the NRS 2002, NUTRIC, and mNUTRIC when applied to SAP patients. Receiver operating characteristic curves were plotted to investigate the predictive ability of clinical outcomes by comparing areas under the curve (AUC). Appropriate cut-offs were calculated by using Youden’s index. Patients were identified as being at high nutritional risk according to the calculated cut-off values. The effects of different scoring systems on mortalities were calculated using the Cox proportional hazards model. Logistic regression was used to assess the association between the energy provision and 28-day mortality.

Results: From January 2013 to December 2019, 234 SAP patients were included and analyzed. Patients categorized as high nutritional risk by the NRS 2002 (12.6% versus 1.9% for 28-day and 20.5% versus 3.7% for 90-day), NUTRIC (16.2% versus 0.0% for 28-day and 27.0% versus 0.0% for 90-day), and mNUTRIC (16.4% versus 0.0% for 28-day and 26.4% versus 0.8% for 90-day) had significant higher mortality than those categorized as low nutritional risk. The NUTRIC (AUC: 0.861 for 28-day mortality and 0.871 for 90-day mortality, both cut-off value ≥3) and mNUTRIC (AUC: 0.838 for 28-day and 0.828 for 90-day mortality, both cut-off value ≥3) showed better predictive ability of the 28- and 90-day mortality than the NRS 2002 (AUC: 0.706 for 28-day mortality and 0.695 for 90-day mortality, both cut-off value ≥5).

Conclusion: The NRS 2002, NUTRIC, and mNUTRIC scores were predictors for the 28- and 90-day mortalities. The NUTRIC and mNUTRIC showed better predictive ability compared with the NRS 2002 when applied to SAP patients.

Introduction

According to the 2012 updated revision of Atlanta Classification of acute pancreatitis (AP) (1), mild AP is the most common form with no organ failure, local or systemic complications and usually can be resolved in the first week. Most patients with mild AP are self-limited, achieving full recovery in less than a week (2, 3). Unfortunately, unlike mild AP, moderately severe, and severe AP (SAP) have rather high mortality (4, 5). SAP is defined by persistent organ failure, that is, organ failure >48 h. In patients with SAP, the oral route is often not feasible, there is inadequate nutritional supplementation, and a protein deficiency will occur after the first week of hospitalization (6). Artificial nutrition is an important treatment in patients with SAP, and many patients with SAP have suffered worse outcomes due to inadequate nutritional supplementation. It has been established that this type of patient presents a marked inflammatory response, as well as one of the highest catabolic rates, regardless of the nutritional status before the onset of the disease (7). To such descriptions, in these patients there is a significant negative impact on the nutritional status and therefore should be considered a high nutritional risk. Therefore, early identification of patients at high nutritional risk and appropriate nutrition support is very important to improving outcomes resulting from the treatment of SAP and the patient’s quality of life (8).

The present ESPEN guidelines state that patients with SAP should be considered at high nutritional risk because of the catabolic nature of the disease and the significant impact of nutritional status on disease development (9). Scoring systems such as the Nutritional Risk Screening 2002 (NRS 2002) are recommended to identify patients at high nutritional risk, but this screening tool has not been validated for the specific population of patients with SAP.

The NRS 2002 was developed by Kondrup et al. two decades ago, and this nutritional risk assessment tool has since been used in patients with different diseases and been recommended by different guidelines (10–12). Nevertheless, there are no reports investigating and validating use of NRS 2002 in patients with SAP (8).

Heyland et al. previously proposed the Nutrition Risk in Critically Ill (NUTRIC) score, which is the first nutritional risk assessment tool developed and validated specifically for intensive care unit (ICU) patients and recommend by the American Society for Parenteral and Enteral Nutrition (ASPEN)/Society for Critical Care Medicine (SCCM) guidelines (12, 13). The score contains the variables of age, co-morbidities, days from hospital admission to ICU transfer, Acute Physiology and Chronic Health Evaluation II (APACHE II), Sequential Organ Failure Assessment (SOFA), and interleukin 6 (IL6). Applicability to routine clinical assessment was further expanded by waiving the requirement for determining IL6 in the modified NUTRIC score (mNUTRIC) (14). Many patients with SAP were admitted to the ICU because of systemic complications and failure of at least one organ. In that case, we considered whether both the NUTRIC and mNUTRIC scores, which were developed based on a population of critically ill patients, would be an option for a nutritional risk assessment tool for SAP patients. Unfortunately, neither the NUTRIC nor the mNUTRIC score have been validated in this population.

Thus, the purpose of this study was to investigate and potentially validate use of the NRS2002, NUTRIC score, and mNUTRIC score as nutritional risk assessment tools in SAP patients.

Materials and methods

Study design and patient enrollment

This was a retrospective study of patients suffering from SAP who were admitted to the ICU of Ruijin Hospital (China), a multidisciplinary unit in a university-affiliated tertiary care medical center, from January 2013 to December 2019. Adult patients (over 18 years of age) admitted to the ICU and diagnosed with SAP were included. SAP was diagnosed following the criteria of the Revised Atlanta Classification (1). The exclusion criteria were as follows: (1) ICU stay of less than 48 h; (2) abdominal surgery within 7 days before admission; (3) chronic pancreatitis; and (4) incomplete data. Given the nature of this retrospective observational study, no intervention, including nutritional practices, was made to standardize care. Enteral nutrition were managed to administered via nasojejunal tube within 72 h after admission. In cases of abdominal compartment syndrome and intolerance to enteral nutrition, supplement or total parenteral nutrition were started in not more than 10 days. The clinical protocols and management of patients was determined by the clinical team looking after the patient.

Outcome measures and data collection

The primary outcomes were defined as all-cause mortality at 28 and 90 days. Secondary outcomes were use of a mechanical ventilator, renal replacement therapy, and vasoactive agents during the hospital stay; continuous (>48) use of a mechanical ventilator, renal replacement therapy, and vasoactive agents during the hospital stay; proportion of multiple-organ dysfunction syndrome (MODS); proportion of surgical intervention; and ICU length of stay. MODS was defined as the combined dysfunction of two major organ systems (1, 15).

Time from ICU admission to the start of nutrition therapy was recorded. The nutrition strategy at day 7 was also collected. If the patients died within 7 days after admission, the latest nutrition strategy was collected. The average calorie and protein intakes were calculated. The total calorie requirements were calculated as 25–30 kcal/kg/day and 1.2–1.5 g/kg/day protein as in the current guidelines (12, 16). Ideal body weight was used for obese patients with BMI > 25 kg/m². The NRS 2002 was routinely performed and recorded at the time of ICU admission according to clinical practice. The CT severity index, Acute Physiology and Chronic Health Evaluation (APACHE II) scores, Sequential Organ Failure Assessment (SOFA) scores, NUTRIC scores, and mNUTRIC scores were calculated at the time of ICU admission. All clinical and laboratory parameters for the calculation of APACHE II, SOFA, NUTRIC, and mNUTRIC scores were recorded from the day of admission to ICU. Patients were followed up until death or observed for 90 days to conduct survival analyses 28 and 90 days after ICU admission.

Statistical analysis

Continuous variables were tested for normal distribution using the Kolmogorov–Smirnov test and expressed as the mean ± standard deviation (SD) for the normally distributed data and as the median and quartiles (25th–75th) for skewed data distributions. Two-tailed Student’s t-test and Mann–Whitney test were used to analyze continuous data when appropriate. Categorical variables were presented as the number of cases. The Pearson chi-squared (χ²) test and Fisher’s exact test were used to analyze the categorical variables.

Receiver operating characteristic curves (ROC) were used to express the ability of different scoring systems for prediction of 28-day and 90-day mortalities via area under curve (AUC). Appropriate cut-offs were calculated by highest combined sensitivity and specificity using Youden’s index. Patients were identified as being at high nutritional risk according to the calculated cut-off values. Survival analyses were performed according to the Kaplan–Meier curves; all deaths were recorded as events. The log-rank (Mantel–Cox) test was used for the comparison of survival curves. Relationship between 28-day mortality and nutrition strategy in patients identified as high nutritional risk by different tools was also analyzed. The effects of different screening tools on mortalities were also calculated using the Cox proportional hazards model. The results are reported as the hazard ratio (HR) with 95% confidence interval (CI). Subgroup analyses, with Cox proportional hazards adjusted for the same covariates as in the main model, were conducted to assess the interactions between different characteristics. The following prespecified baseline characteristics were analyzed: sex (male versus female); age (>55 versus ≤55); APACHE II score (≥8 versus <8); white-cell counts (>16,000 versus ≤16,000/mm³); CT severity index (>6 versus ≤6); C-reactive protein level (>150 versus ≤150 mg/L); serum creatinine level (≥1.8 versus <1.8 mg/dl), and etiology (biliary versus non-biliary). Logistic regression was used to assess the strength of the association between the energy provision and 28-day mortality. Three logistic models including three different nutritional risk screening tools (the NRS 2002, NUTRIC score and mNUTRIC score), the energy provision and their product (interaction) were performed to assess if the nutritional risk screening tools modified the association between energy provision and 28-day mortality. Finally, the logistic models were run separately in patients categorized as low and high nutritional risk by three screening tools. The results are reported as the odds ratio (OR) with 95% CI. The statistical significance of lack of fit was tested by the Hosmere-Lemeshow goodness of fit test. The significance was assumed at a p-value <0.05. IBM SPSS Statistics software (version 25.0; Chicago, IL, United States) and GraphPad Prism 9.2 (GraphPad Software, La Jolla, CA, United States) were used for statistical analysis and plotting graphs.

Results

Patient characteristics

A total of 343 critically ill patients with SAP were initially included. Then, 49 patients were excluded for incomplete data, 26 were excluded for staying in the ICU less than 48 h, 24 were excluded for previous abdominal surgery, and 20 were excluded for chronic pancreatitis. A total of 234 patients were finally included in the analysis. The patient characteristics are presented in Table 1.

TABLE 1

Table 1. Patient characteristics.

Clinical outcomes predicted by the NRS 2002, NUTRIC, and mNUTRIC

The 28-day mortality was 7.7%, and the 90-day mortality was 12.8%. The mortality rates in SAP patients according to the NRS 2002, NUTRIC, and mNUTRIC are illustrated in Supplementary Figure S1. The predictive ability for 28-and 90-day mortality risk were analyzed by ROC, and the results are shown in Figures 1, 2. As depicted in Figures 1, 2, both the NUTRIC and mNUTRIC showed a reasonable ability to predict 28-and 90-day mortality in SAP patients. The NUTRIC and mNUTRIC performed better than the NRS 2002 in predicting both the primary and secondary outcomes.

FIGURE 1

Figure 1. Prognostic accuracy of the NRS 2002, NUTRIC, and mNUTRIC to predict 28-day mortality analyzed by receiver operating characteristic curves. The black line with cycle represents the results of the NRS 2002 (AUC = 0.706, 95% CI: 0.595–0.817, p = 0.004). The blue line with square represents the results of the NUTRIC (AUC = 0.861, 95% CI: 0.794–0.929, p < 0.001). The red line with triangle represents the results of the mNUTRIC (AUC = 0.838, 95% CI: 0.768–0.908, p < 0.001).

FIGURE 2

Figure 2. Prognostic accuracy of the NRS 2002, NUTRIC, and mNUTRIC to predict 90-day mortality analyzed by receiver operating characteristic curves. The black line with cycle represents the results of the NRS 2002 (AUC = 0.695, 95% CI: 0.604–0.787, p = 0.001). The blue line with square represents the results of the NUTRIC (AUC = 0.871, 95% CI: 0.818–0.925, p < 0.001). The red line with triangle represents the results of the mNUTRIC (AUC = 0.828, 95% CI: 0.754–0.891, p < 0.001).

The NUTRIC (AUC = 0.861, 95% CI: 0.794–0.929, p < 0.001) and mNUTRIC (AUC = 0.838, 95% CI: 0.768–0.908, p < 0.001) showed a higher predictive value than the NRS 2002 (AUC = 0.706, 95% CI: 0.595–0.817, p = 0.004), and thus better performance, in predicting 28-day mortality. In the prediction of 28-day mortality, the highest combined sensitivity and specificity of the NRS 2002 was found with a cut-off value of ≥5 (sensitivity = 88.9%, specificity = 52.1%). The NUTRIC had a cut-off value of ≥3 (sensitivity = 100%, specificity = 43.1%). The cut-off value of the mNUTRIC was also found at ≥3 (sensitivity = 100%, specificity = 42.6%). The NUTRIC (AUC = 0.871, 95% CI: 0.818–0.925, p < 0.001) and mNUTRIC (AUC = 0.828, 95% CI: 0.754–0.891, p < 0.001) also performed better than the NRS 2002 (AUC = 0.695, 95% CI: 0.604–0.787, p = 0.001) in predicting 90-day mortality. The cut-off values were the same in predicting the 28-day and 90-day mortality (≥5 for NRS 2002 and ≥3 for both NUTRIC and mNUTRIC). The results of the ROC analyses to predict the clinical outcomes are shown in Table 2.

TABLE 2

Table 2. Prognostic accuracy of the NRS2002, NUTRIC, and mNUTRIC to predict clinical outcomes analyzed by ROC.

The NUTRIC and mNUTRIC had similar performance in predicting secondary outcomes. The NRS 2002 was the least valuable scoring system for predicting the clinical outcomes. All three scoring systems had no prognostic relevance with the use or continuous use (>48 h) of renal replacement therapy in patients with SAP. A comparison of the clinical outcomes in SAP patients categorized as high nutritional risk and low nutritional risk is shown in Table 3. Other characteristics are demonstrated in Supplementary Table S1.

TABLE 3

Table 3. Comparison of clinical outcomes in SAP patients categorized as high nutritional risk and low risk by the NRS2002, NUTRIC, and mNUTRIC.

Energy intake and mortality risk analyses

Survival analyses by Kaplan–Meier (Figures 3–5) showed significant differences depending on different scoring levels. By day 28, a total of 18 (7.6%) patients had died. Of these, 16 patients were categorized as high nutritional risk according to the NRS 2002, while all 18 patients were identified as high nutritional risk according to the NUTRIC and mNUTRIC scores and the cut-off values calculated in the previous part of this study. The Cox proportional hazards regression analysis of factors associated with mortality are shown in Table 4. The SAP patients with higher NRS 2002 (HR = 2.889, 95% CI: 1.278–6.528, p = 0.011), NUTRIC (HR = 1.691, 95% CI: 1.331–2.148, p < 0.001), and mNUTRIC (HR = 1.689, 95% CI: 1.292–2.207, p < 0.001) scores had a higher risk of short-term mortality.

FIGURE 3

Figure 3. Kaplan–Meier survival analyses depending on baseline scores of low NRS 2002 0-4 (blue line, n = 107) versus high NRS 2002 5-6 (red line, n = 127); **p < 0.05, ***p < 0.001.

FIGURE 4

Figure 4. Kaplan–Meier survival analyses depending on baseline scores of low NUTRIC 0-2 (blue line, n = 123) versus high NUTRIC 3-8 (red line, n = 111); ***p < 0.001.

FIGURE 5

Figure 5. Kaplan–Meier survival analyses depending on baseline scores of low mNUTRIC 0-2 (blue line, n = 124) versus high mNUTRIC 3-7 (red line, n = 110); ***p < 0.001.

TABLE 4

Table 4. Cox proportional hazards regression model for mortalities.

Similar results were also revealed in the long-term mortality. In total, 30 (12.8%) patients had died by day 90. The NRS 2002 (HR = 2.461, 95% CI: 1.286–4.713, p = 0.007) failed to identify 4 of these, and the mNUTRIC (HR = 1.683, 95% CI: 1.359–2.083, p < 0.001) failed to identify 1 of these, whereas the NUTRIC (HR = 1.747, 95% CI: 1.441–2.118, p < 0.001) correctly categorized all patients. The results of the subgroup analyses are reported in Supplementary Figure S3 (28-day mortality) and Supplementary Figure S4 (90-day mortality). The effects of the NRS 2002, NUTRIC, and mNUTRIC were consistent across all subgroups.

All patients started enteral nutrition by nasogastric or nasojejunal feeding within 72 h after admission. During the first week after admission to ICU, the calories received were 15.4 ± 3.2 kcal/kg/day, on average. The average protein intake was 0.7 ± 0.2 g/day. If the target of calorie target is set as 25–30 kcal/kg/day, in accordance with current guidelines, only 130 (56%) patients received more than 60% of caloric adequacy. The median energy provision was 61.5 with an interquartile range from 53.1 to 68.8. Energy provision was not correlated with the NRS 2002, NUTRIC score or mNUTRIC score. Mortality generally decreased with increasing energy provision, and the Hosmere-Lemeshow goodness of fit test showed that the calibration of the model was statistically ideal (p = 0.386). Using these validation data, the logistic model estimated odds of mortality were multiplied by 0.822 (95% CI, 0.682–0.956, p = 0.015) for every 1 kcal/kg/day increase on the energy provision. Separate models confirmed the results in high nutritional risk group (high NRS 2002 group, OR = 0.808, 95% CI: 0.701–0.963, p = 0.013; high NUTRIC score group, OR = 0.826, 95% CI: 0.702–0.972, p = 0.021; and high mNUTRIC score group, OR = 827, 95% CI: 0.703–0.973, p = 0.022) while patients categorized as low nutritional risk did not show the benefits of higher energy provision rate (low NRS 2002 group: OR = 1.172, 95% CI: 0.712–1.928, p = 0.533; Models were not applicable for no patients died in low NUTRIC or low mNUTRIC group within 28 days). The test for interaction confirmed the association between energy provision and mortality is significantly modified by the NUTRIC score (test for interaction p < 0.001) and the mNUTRIC score (test for interaction p < 0.001) while the interaction was not modified by the NRS 2002(test for interaction p = 0.166). Figures 6–8 demonstrate that increased calorie intake during the first week is associated with increased short-term survival in patients categorized as high nutritional risk by the NUTRIC, or mNUTRIC. No statistical difference was found in the calories received during the first week after admission in different nutritional risk groups. The detailed results were shown in Supplementary Table S1.

FIGURE 6

Figure 6. Predicted probability of 28-day mortality versus calories received by low NRS 2002 0-4 (blue line, n = 107) versus high NRS 2002 5-6 (red line, n = 127). Blue cycles represent the low NRS 2002 cases while red triangles represent the high NRS 2002 cases. Test for interactions were assessed by a logistic model including the NRS 2002, the energy provision and their product (interaction). The NRS 2002 was found unable to modify the relationship between energy provision during first week and 28-day mortality (p = 0.166).

FIGURE 7

Figure 7. Predicted probability of 28-day mortality versus calories received by low NUTRIC 0-2 (blue line, n = 123) versus high NUTRIC 3-8 (red line, n = 111). Blue cycles represent the low NUTRIC score cases while red triangles represent the high NUTRIC score cases. Test for interactions were assessed by a logistic model including the NUTRIC score, the energy provision and their product (interaction). The test for interaction confirmed the association between energy provision and mortality is significantly modified by the NUTRIC score (test for interaction p < 0.001).

FIGURE 8

Figure 8. Predicted probability of 28-day mortality versus calories received by low mNUTRIC 0-2 (blue line, n = 124) versus high mNUTRIC 3-7 (red line, n = 110). Blue cycles represent the low NUTRIC score cases while red triangles represent the high NUTRIC score cases. Test for interactions were assessed by a logistic model including the NUTRIC score, the energy provision and their product (interaction). The test for interaction confirmed the association between energy provision and mortality is significantly modified by the mNUTRIC score (test for interaction p < 0.001).

Discussion

Unfortunately, no treatments were proven effective to suppress the powerful cascade of inflammatory factors associated with SAP (17). With this limitation, the current treatment method of SAP is primarily supportive and nutrition support is considered a major method in treating SAP patients. Nutritional risk assessment of SAP patients is an important element for outcome prediction. Many possible features can lead to malnutrition in SAP patients. Many possible features can lead to malnutrition in this population. In this study, considering that two peaks (short-term and long-term) of mortality are observed for SAP patients, we chose to investigate the prognostic accuracy of the NRS 2002, NUTRIC, and mNUTRIC in predicting the 28- and 90-day mortality of SAP patients (18–21). The NUTRIC demonstrated the highest prediction value among the three scoring systems. A similar prognostic accuracy was found for the mNUTRIC. In the absence of IL-6, the mNUTRIC can equally predict the clinical outcomes of SAP patients.

In SAP patients, early death usually occurs as a result of systemic inflammatory response syndrome (SIRS) and MODS (22). SIRS is often caused by the release of various cytokines in the first 2 weeks. Shinzeki et al. (20) reported that early death accounted for 22% (5/23) of all deaths in their study, and we observed a similar figure in our study, wherein 7 (23%) patients died during the first 2 weeks (Supplementary Figure S3) and were well identified by the NUTRIC and mNUTRIC. Acute underfeeding is a possible consequence, and it can lead to immunosuppression and to inflammatory response impairment, which may occur in SAP patients and cause early death. Furthermore, in clinical practice, determining an appropriate target for nutrient supplementation of patients at high risk of malnutrition is crucial. Similar with the previous study, identifying patients with high mNTURIC scores and supporting them with adequate nutrition during an ICU stay would be useful in improving clinical outcomes such as 90-day mortality (23). Due to the nature of the retrospective study, nutrition therapy after day 7 was not included into the analysis, due to the high heterogeneity in the nutrition intake methods. Some patients started oral food intake, and thus, the calorie intake after day 7 was not counted. Hence, we only investigated the effect of nutrition therapy during the first week after admission. In our study, the relationship between nutrition therapy in the first week and short-term mortality was revealed, showing a lower mortality with a higher calorie intake in patients at high nutritional risk. On the other hand, severe disease can also cause acute gastrointestinal injury and a decrease in calorie intake. The organs that most commonly fail in acute pancreatitis include those linked with respiratory, renal, and circulatory failure, while few studies have focused on gastrointestinal failure. Studies have shown that gastrointestinal dysfunction and failure could be an important determinant of outcome in critically ill patients, including acute pancreatitis. Sun et al. (24) suggested that gastrointestinal failure is an accurate predictor of SAP prognosis. Other studies have revealed that gastrointestinal symptoms are frequent in patients in the ICU (25, 26). A total of 62% of patients exhibited at least one gastrointestinal symptom for at least 1 day (27). There is also increasing evidence that the development of gastrointestinal problems is related to a poor outcome in critically ill patients (28). The NUTRIC and mNUTRIC do not include gastrointestinal symptoms, which could thus be a source of bias for a specific group of patients. Regardless, acute underfeeding should be considered as a major complication in SAP.

In the analyses of long-term mortality, the NUTRIC and mNUTRIC also showed better prognostic value than the NRS 2002. As a result, we determined different cut-off values for the NUTRIC and mNUTRIC than a previous study in identifying critically ill SAP patients at a high nutritional risk. According to Youden’s index, we found a cut-off value of ≥3 for both NUTRIC and mNUTRIC to be more appropriate for predicting short-term and long-term mortality. Heyland et al. and Rahman et al. utilized ≥5 (mNUTRIC) and ≥6 (NUTRIC) as cut-off values in critically ill patients when the NUTRIC and mNUTRIC were first introduced (13, 14). De Vries et al. (29) found the best discriminative ability with a mNUTRIC cut-off >4 for 28-day mortality in mechanically ventilated patients. Mayr et al. (30) determined a cut-off value of ≥6 to predict 90-day mortality and a cut-off value of ≥7 to predict 28-day mortality in cirrhotic patients (for both NUTRIC and mNUTRIC). In contrast, Jeong et al. (31) found a cut-off value ≥6 for the mNUTRIC in predicting 28-day mortality. Different cut-off values have thus been found when investigating patients suffering from different diseases. A lower cut-off value of the NUTRIC and mNUTRIC in SAP patients was found in our study in comparison to other studies focusing on different populations. This difference could result from the catabolic nature of SAP and differences in the characteristics of specific diseases. The classic cut-off values cannot well identify SAP patients at nutritional risk, especially using the NRS 2002. All patients from our study were classified as at nutritional risk by utilizing the classic NRS 2002 cut-off value ≥3.

The severity of acute pancreatitis is defined by the presence or absence of organ failure, local complications, or both (1). Local complications or the occurrence of single-organ failure in SAP patients may only result in mild systemic symptoms at the early stage of AP, which could lead to a lower score of SOFA and APACHE II at admission. Lower Glasgow coma scores were observed in SAP patients compared with other critically ill patients upon admission to the ICU. A severe complication of SAP is acute gastrointestinal injury, which cannot be well stratified by the NUTRIC and mNUTRIC. Acute gastrointestinal injury is often underestimated while it could be lethal in SAP patients. All these reasons could result in a lower cut-off value of the NUTRIC and mNUTRIC in SAP patients. Also, APACHE II score <8 at admission may be a predictive factor for the risk of death in 90 days among patients categorized as high nutritional risk by NUTRIC and mNUTRIC (interaction p < 0.05). Patients at nutritional risk with lower APACHE II score appeared to have more co-morbidity and delayed longer before admission to ICU than those without. The results for analysis of secondary outcomes were similar to those of the primary outcomes. Only the prediction ability of MODS was rather accurate, with an AUC ≥ 0.75, although the NUTRIC score still showed a better prediction ability for most secondary outcomes. Explanation for the shortcomings of the NUTRIC score is that mortality was the only consideration in the study design when it was first developed (13). Some experts claim that mortality is not the only outcome that should be assessed when determining the efficacy of a nutritional intervention, considering the numerous factors influencing ICU mortality (16). Long-term functional tests might better reflect the benefit of a nutritional intervention and should be included in the screening tools (32). The present results of our study underline the need for further studies utilizing individualized nutritional risk assessment tools based on the NRS 2002, NUTRIC, mNUTRIC or other scoring systems.

Although this study included a reasonable number of patients with SAP, and the results of this study were conclusive with statistical significance, this study has several limitations. The first is that it is a retrospective single-center study. The 28- and 90-day mortalities are defined as the primary outcomes, as there is no gold standard to judge the fitness and accuracy of a nutritional risk screening tool. The study focuses on the assessment of the NRS2002, NUTRIC, and mNUTRIC scores, which were obtained at the time of admission to ICU, whereas no further evaluation was conducted during the course of the disease in the ICU. Although the NUTRIC and mNUTRIC show good prognostic value for 90-day mortality, many other factors should be taken into consideration. Moreover, no interventions occurred during the study. Nutrition therapy after day 7 was not included in the analyses due to the heterogeneity in nutrition intake methods thereafter. The effects of the nutritional therapy on the outcomes of patients with high nutritional risk were thus not fully assessed. Further prospective interventional studies focusing on nutrition therapy based on the NRS2002, NUTRIC, or mNUTRIC are needed to support the findings.

Conclusion

In conclusion, the NUTRIC and mNUTRIC demonstrated a prognostic advantage comparison with the NRS 2002 in predicting SAP patients at high nutritional risk. Moreover, both NUTRIC and mNUTRIC scores can adequately identify SAP patients at high nutritional risk.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary material, further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving human participants were reviewed and approved by Ruijin Hospital Ethics Committee, Shanghai Jiaotong University School of Medicine. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author contributions

DC and BZ drafted and wrote the manuscript. DC, BZ, LW, and YQ collected the data. WG, XB, EC, and FJ analyzed the data. DC, BZ, and JH designed the study. EM, HS, and JH revised the manuscript and supervised the work. All authors contributed to the article and approved the submitted version.

Acknowledgments

The authors thank all the doctors, residents, pharmacists, and nurses directly involved in the management of these patients. We thank Xiaoyuan Chen, Haixia Zhang, Simin Yan, Huanyu Ni, and Yun Zhu for their valuable suggestions in manuscript drafting. We thank Xingkai Chen, Huiyan Jiang, Yanran Zhao, Xiaomin Feng, Shichao Zhang, Jiayao Luo, Zhiying Gao, Xi Cao, Youchun Chen, and Yunqi Dai for supproting our research during this pandemic in the context of such a difficult health crisis.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fnut.2023.1101555/full#supplementary-material

References

1. Banks, PA, Bollen, TL, Dervenis, C, Gooszen, HG, Johnson, CD, Sarr, MG, et al. Classification of acute pancreatitis—2012: revision of the Atlanta classification and definitions by international consensus. Gut. (2013) 62:102–11. doi: 10.1136/gutjnl-2012-302779

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Boxhoorn, L, Voermans, RP, Bouwense, SA, Bruno, MJ, Verdonk, RC, Boermeester, MA, et al. Acute pancreatitis. Lancet. (2020) 396:726–34. doi: 10.1016/S0140-6736(20)31310-6

CrossRef Full Text | Google Scholar

3. Eckerwall, GE, Tingstedt, BB, Bergenzaun, PE, and Andersson, RG. Immediate oral feeding in patients with mild acute pancreatitis is safe and may accelerate recovery--a randomized clinical study. Clin Nutr. (2007) 26:758–63. doi: 10.1016/j.clnu.2007.04.007

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Pancreatitis NICE Guideline [Internet] (2020). United Kingdom: National Institute for Health and Care Excellence. Available at: https://www.nice.org.uk/guidance/ng104/resources/pancreatitis-pdf-66141537952453 (Accessed October 1, 2022).

Google Scholar

5. van Santvoort, HC, Bakker, OJ, Bollen, TL, Besselink, MG, Ahmed Ali, U, Schrijver, AM, et al. A conservative and minimally invasive approach to necrotizing pancreatitis improves outcome. Gastroenterology. (2011) 141:1254–63. doi: 10.1053/j.gastro.2011.06.073

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Bakker, OJ, van Santvoort, HC, van Brunschot, S, Ahmed Ali, U, Besselink, MG, Boermeester, MA, et al. Pancreatitis, very early compared with normal start of enteral feeding (PYTHON trial): design and rationale of a randomised controlled multicenter trial. Trials. (2011) 12:73. doi: 10.1186/1745-6215-12-73

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Al-Omran, M, Albalawi, ZH, Tashkandi, MF, and Al-Ansary, LA. Enteral versus parenteral nutrition for acute pancreatitis. Cochrane Database Syst Rev. (2010) 2010:CD002837. doi: 10.1002/14651858.CD002837.pub2

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Roberts, KM, Nahikian-Nelms, M, Ukleja, A, and Lara, LF. Nutritional aspects of acute pancreatitis. Gastroenterol Clin N Am. (2018) 47:77–94. doi: 10.1016/j.gtc.2017.10.002

CrossRef Full Text | Google Scholar

9. Arvanitakis, M, Ockenga, J, Bezmarevic, M, Gianotti, L, Krznarić, Ž, Lobo, DN, et al. ESPEN guideline on clinical nutrition in acute and chronic pancreatitis. Clin Nutr. (2020) 39:612–31. doi: 10.1016/j.clnu.2020.01.004

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Kondrup, J, Allison, SP, Elia, M, Vellas, B, Plauth, M, Educational and Clinical Practice Committee, et al. ESPEN guidelines for nutrition screening 2002. Clin Nutr. (2003) 22:415–21. doi: 10.1016/s0261-5614(03)00098-0

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Kondrup, J, Rasmussen, HH, Hamberg, O, and Stanga, Z, Ad Hoc ESPEN Working Group. Nutritional risk screening (NRS 2002): a new method based on an analysis of controlled clinical trials. Clin Nutr. (2003) 22:321–36. doi: 10.1016/S0261-5614(02)00214-5

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Taylor, BE, McClave, SA, Martindale, RG, Warren, MM, Johnson, DR, Braunschweig, C, et al. Guidelines for the provision and assessment of nutrition support therapy in the adult critically ill patient: Society of Critical Care Medicine (SCCM) and American Society for Parenteral and Enteral Nutrition (A.S.P.E.N.). Crit Care Med. (2016) 44:390–438. doi: 10.1097/CCM.0000000000001525

CrossRef Full Text | Google Scholar

13. Heyland, D, Dhaliwal, R, Jiang, X, and Day, AG. Identifying critically ill patients who benefit the most from nutrition therapy: the development and initial validation of a novel risk assessment tool. Crit Care. (2011) 15:R268. doi: 10.1186/cc10546

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Rahman, A, Hasan, RM, Agarwala, R, Martin, C, Day, AG, and Heyland, DK. Identifying critically-ill patients who will benefit most from nutritional therapy: further validation of the “modified NUTRIC” nutritional risk assessment tool. Clin Nutr. (2016) 35:158–62. doi: 10.1016/j.clnu.2015.01.015

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Marshall, JC, Cook, DJ, Christou, NV, Bernard, GR, Sprung, CL, and Sibbald, WJ. Multiple organ dysfunction score: a reliable descriptor of a complex clinical outcome. Crit Care Med. (1995) 23:1638–52. doi: 10.1097/00003246-199510000-00007

CrossRef Full Text | Google Scholar

16. Singer, P, Blaser, AR, Berger, MM, Alhazzani, W, Calder, PC, Casaer, MP, et al. ESPEN guideline on clinical nutrition in the intensive care unit. Clin Nutr. (2019) 38:48–79. doi: 10.1016/j.clnu.2018.08.037

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Hey-Hadavi, J, Velisetty, P, and Mhatre, S. Trends and recent developments in pharmacotherapy of acute pancreatitis. Postgrad Med. (2022) in press. 13. doi: 10.1080/00325481.2022.2136390

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Buchler, MW, Gloor, B, Muller, CA, Friess, H, Seiler, CA, and Uhl, W. Acute necrotizing pancreatitis: treatment strategy according to the status of infection. Ann Surg. (2000) 232:619–26. doi: 10.1097/00000658-200011000-00001

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Buter, A, Imrie, CW, Carter, CR, Evans, S, and McKay, CJ. Dynamic nature of early organ dysfunction determines outcome in acute pancreatitis. Br J Surg. (2002) 89:298–302. doi: 10.1046/j.0007-1323.2001.02025.x

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Shinzeki, M, Ueda, T, Takeyama, Y, Yasuda, T, Matsumura, N, Sawa, H, et al. Prediction of early death in severe acute pancreatitis. J Gastroenterol. (2008) 43:152–8. doi: 10.1007/s00535-007-2131-z

CrossRef Full Text | Google Scholar

21. Tenner, S, Sica, G, Hughes, M, Noordhoek, E, Feng, S, Zinner, M, et al. Relationship of necrosis to organ failure in severe acute pancreatitis. Gastroenterology. (1997) 113:899–903. doi: 10.1016/s0016-5085(97)70185-9

CrossRef Full Text | Google Scholar

22. Rasch, S, Sancak, S, Erber, J, Wießner, J, Schulz, D, Huberle, C, et al. Influence of extracorporeal cytokine adsorption on hemodynamics in severe acute pancreatitis: results of the matched cohort pancreatitis cytosorbents inflammatory cytokine removal (PACIFIC) study. Artif Organs. (2022) 46:1019–26. doi: 10.1111/aor.14195

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Im, KM, and Kim, EY. Identification of ICU patients with high nutritional risk after abdominal surgery using modified NUTRIC score and the Association of Energy Adequacy with 90-Day mortality. Nutrients. (2022) 14:946. doi: 10.3390/nu14050946

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Sun, JK, Li, WQ, Ni, HB, Ke, L, Tong, ZH, Li, N, et al. Modified gastrointestinal failure score for patients with severe acute pancreatitis. Surg Today. (2013) 43:506–13. doi: 10.1007/s00595-013-0496-6

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Mutlu, GM, Mutlu, EA, and Factor, P. GI complications in patients receiving mechanical ventilation. Chest. (2001) 119:1222–41. doi: 10.1378/chest.119.4.1222

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Reintam, A, Parm, P, Kitus, R, Kern, H, and Starkopf, J. Gastrointestinal symptoms in intensive care patients. Acta Anaesthesiol Scand. (2009) 53:318–24. doi: 10.1111/j.1399-6576.2008.01860.x

CrossRef Full Text | Google Scholar

27. Reintam Blaser, A, Malbrain, ML, Starkopf, J, Fruhwald, S, Jakob, SM, De Waele, J, et al. Gastrointestinal function in intensive care patients: terminology, definitions and management. Recommendations of the ESICM working group on abdominal problems. Intensive Care Med. (2012) 38:384–94. doi: 10.1007/s00134-011-2459-y

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Reintam, A, Parm, P, Kitus, R, Starkopf, J, and Kern, H. Gastrointestinal failure score in critically ill patients: a prospective observational study. Crit Care. (2008) 12:R90. doi: 10.1186/cc6958

PubMed Abstract | CrossRef Full Text | Google Scholar

29. de Vries, MC, Koekkoek, WK, Opdam, MH, van Blokland, D, and van Zanten, AR. Nutritional assessment of critically ill patients: validation of the modified NUTRIC score. Eur J Clin Nutr. (2018) 72:428–35. doi: 10.1038/s41430-017-0008-7

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Mayr, U, Pfau, J, Lukas, M, Bauer, U, Herner, A, Rasch, S, et al. NUTRIC and modified NUTRIC are accurate predictors of outcome in end-stage liver disease: a validation in critically ill patients with liver cirrhosis. Nutrients. (2020) 12:2134. doi: 10.3390/nu12072134

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Jeong, DH, Hong, SB, Lim, CM, Koh, Y, Seo, J, Kim, Y, et al. Comparison of accuracy of NUTRIC and modified NUTRIC scores in predicting 28-Day mortality in patients with sepsis: a single center retrospective study. Nutrients. (2018) 10:911. doi: 10.3390/nu10070911

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Arabi, YM, and Preiser, JC. A critical view on primary and secondary outcome measures in nutrition trials. Intensive Care Med. (2017) 43:1875–7. doi: 10.1007/s00134-017-4894-x

PubMed Abstract | CrossRef Full Text | Google Scholar