Skip to main content

BRIEF RESEARCH REPORT article

Front. Med., 20 October 2021
Sec. Infectious Diseases – Surveillance, Prevention and Treatment
This article is part of the Research Topic Epidemiological Changes under the COVID-19 Pandemic: Burden of Diseases and Health Care Outcomes View all 8 articles

Impact of the COVID-19 Pandemic on Survival in the Patients With the Intra-Abdominal Infections

\nLydia Glvez-Benítez,&#x;Lydia Gálvez-Benítez1,2ngel Rodríguez-Villodres,&#x;Ángel Rodríguez-Villodres1,2Rocío lvarez-Marín,Rocío Álvarez-Marín1,2Rosa Jimnez-RodríguezRosa Jiménez-Rodríguez3Jos Antonio Lepe-Jimnez,José Antonio Lepe-Jiménez1,2Jernimo Pachn,Jerónimo Pachón2,4Younes Smani,
Younes Smani1,2*
  • 1Clinical Unit of Infectious Diseases, Microbiology and Preventive Medicine, Virgen del Rocío University Hospital, Seville, Spain
  • 2Institute of Biomedicine of Seville (IBiS), Virgen del Rocío University Hospital/CSIC/University of Seville, Seville, Spain
  • 3Department of General and Digestive Surgery, Virgen del Rocío University Hospital, Seville, Spain
  • 4Department of Medicine, University of Seville, Seville, Spain

Objective: To analyze the availability and access to the hospital for the patients with intra-abdominal infections (IAIs) by Escherichia coli (E. coli) as a result of the coronavirus disease 2019 (COVID-19) pandemic and the impact of these changes in the diagnosis and their effects on the death of these patients.

Methods: Two prospective observational cohorts of the patients with IAI by E. coli were conducted in 2016 (the pre-COVID-19, n = 108) and in 2020 (during the COVID-19, n = 96) at the University Hospital of Seville, Spain. The demographic and clinical variables of the patients were collected and analyzed. The patients were followed-up for 120 days, until the hospital discharge or death. The bivariate and multivariate analyses were performed.

Results: Both the cohorts were homogeneous according to age, sex, emergency surgery cause, immunosuppression, neutropenia, acquisition type, and previous intervention. The patients attended during the COVID-19 had significantly higher Charlson comorbidity index and the more McCabe score, required more emergency surgery, had more severe infections with the higher rates of septic shock and sepsis, and the presence of additional care support such as a nasogastric tube. They were diagnosed later; the time intervals between the symptoms onset (SO) to the first medical contact or surgical intervention (SI) and between the first medical contact to the admission or SI were significantly higher. The death rates during the COVID-19 and the pre-COVID-19 were 16.7 and 6.5%, respectively (p = 0.02). Finally, the multivariate analysis in both the cohorts together identified the patients diagnosed during the COVID-19, the longer period from SO to SI, septic shock, and the Charlson comorbidity index as the independent factors associated with death.

Conclusion: This study showed the impact of the COVID-19 pandemic on the clinical outcome and death due to IAI with an extension of the time between SO and SI.

Introduction

The coronavirus disease 2019 (COVID-19) pandemic continues to be an important threat to health due to its direct effects and the difficulties to attend to the other diseases (1). Significant reduction in the admission of patients with other diseases (cancer, cardiovascular disease, and stroke) and delay in their diagnosis has been detected in Spain and in other European, American, and Asian countries (25). Consequently, higher numbers of death in patients with these diseases have been reported during the COVID-19 pandemic (2, 4).

It is well-known that the management of patients with intra-abdominal infections (IAIs) is increasingly complicated due to the lack of the optimal therapeutic options, which boost the risk of therapeutic failure and mortality, especially in the patients with the secondary bloodstream infection, when they developed sepsis or septic shock (6).

The aim of this study was to analyze the availability and access to the hospital for the patients with IAI as a result of the COVID-19 pandemic, the impact of these changes in the diagnosis, and their effects on the death of the patients diagnosed with IAI due to Escherichia coli (E. coli), as its most frequent etiology.

Materials and Methods

Study Design, Patients, and Ethics

This is a post-hoc analysis of the two prospective observational cohorts from February 1 to November 30, 2016, and from February 1 to November 30, 2020, respectively, recruited at the Virgen del Rocío University Hospital (Seville, Spain). About 108 and 96 adult patients (≥18 years) with IAI by E. coli isolated from the intra-abdominal samples or blood cultures were selected for both the cohorts, respectively. Only the first IAI episode was included in this study during the admissions of the patient. The pathogenic role of E. coli isolated from the intra-abdominal samples, as colonization or infection, was evaluated by a member of the Infectious Disease Services and/or the intensive care unit, according to the previously defined criteria (7). The study was approved by the Ethics Committee of the Hospital Universitario Virgen Macarena and the Virgen del Rocío University Hospital (approval no. 0023-N-16 and 0088-N-20). The written informed consent was signed by all the patients before inclusion in the cohorts.

Variables

The following variables were collected from the patients: age and sex; patients admitted during the COVID-19 pandemic period; emergency surgery; bacteremia; comorbidities and severity of the chronic underlying diseases (the Charlson comorbidity index and the McCabe score) (8, 9); presence of solid or the hematological malignancies, immunosuppression, and neutropenia (<500 neutrophils/μl); acquisition type (defined as a community acquired, healthcare acquired, or hospital acquired), polymicrobial infection, sepsis, or septic shock (10); the presence of the devices (urinary catheter, transitory or permanent central venous catheter, nasogastric tube, and mechanical ventilation); and the time intervals between the symptoms onset (SO) and the surgical intervention (SI).

The Charlson comorbidity index is a score that predicts the 1-year mortality. It was calculated according to the 19 comorbid conditions of patients, including diabetes with diabetic complications, congestive heart failure, peripheral vascular disease, chronic pulmonary disease, mild and severe liver disease, hemiplegia, renal disease, leukemia, lymphoma, metastatic tumor, and acquired immunodeficiency syndrome (8, 11). The severity of comorbidity was categorized into the three grades: mild, with Charlson comorbidity index score of 1–2; moderate, with Charlson comorbidity index score of 3–4; and severe, with Charlson comorbidity index score of ≥ 5 (11).

The McCabe score is used to predict the likelihood for the survival of the patients with Gram-negative bacteremia (9). It classifies all the hospitalized patients into the three categories: nonfatal (score = 0, patient survival > 5 years), ultimately fatal (score = 1, patient survival 1–4 years), and rapidly fatal (score = 2, patient survival < 1 year).

The patients were followed-up for 120 days, until the hospital discharge or death, whichever occurred first, and the clinical decisions were made by the physicians in charge of the patients. All the data of the patients were collected from the electronic medical record and the time intervals were collected from the anamnesis of the admission fact sheet of the patient.

Microbiological Studies

The E. coli isolates were identified by using the matrix-assisted laser desorption ionization time-of-flight (MALDI-TOF) mass spectrometry (Bruker Daltonik GmbH, Leipzig, Germany). Extended-spectrum ß-lactamases (ESBLs) production was determined by using the broth microdilution synergy test according to the European Committee on Antimicrobial Susceptibility Testing (EUCAST) standards (12).

Statistical Analysis

The primary endpoint was the occurrence of death at the end of follow-up as the dependent variable. A descriptive analysis was performed for the demographics and clinical variables, with the median and interquartile range for the quantitative variables and the frequency distribution for the qualitative variables. The Fisher's exact test and the chi-squared test were used for the categorical variables and the continuous variables were analyzed by using the Mann–Whitney U-test or the Student's t-test. To examine the factors associated with death, the univariable logistic regression analysis was performed in the combined dataset of both cohorts (n = 204 patients). To identify the factors independently associated with death, the multivariable logistic regression model was built, including those variables associated with the dependent variable in the bivariate analysis (p < 0.05), after analyzing them to avoid the collinearity and their presence at the inclusion of the patients in the cohorts. With respect to the period times, this study included the days from the SO to intervention because it is the most accurate period. The goodness of fit for the logistic regression was assessed by following the Hosmer–Lemeshow test, with a chi-square of 8.3 in the last step of the regression and with p = 0.403. The survival curves were obtained by using the Kaplan–Meier method and were compared by using the log-rank tests. The differences were considered as significant at p < 0.05. All the statistical analyses were performed by using the SPPS software package (version 25.0, IBM Corporation, Armonk, New York, USA).

Results

Demographics, Clinical, and Microbiological Characteristics of the Patients With IAI in the Pre-coronavirus Disease 2019 Pandemic Period and During the COVID-19 Pandemic Period

A total of 204 patients with IAI by E. coli were included in both cohorts. The demographics and clinical features of both the cohorts were grouped together and their differences between both the cohorts are summarized in Table 1. Both the IAI cohorts were homogeneous according to the demographics (age and sex), cause of emergency surgery, immunological state (immunosuppression or neutropenia), acquisition type, and previous intervention. The patients with IAI attended during the COVID-19 pandemic had more comorbidities, with the higher Charlson comorbidity index (p < 0.001) and more frequent ultimately or the rapidly fatal McCabe score (p < 0.001). The patients during the COVID-19 pandemic required more emergency surgery (p < 0.001) and had more severe infections, with higher rates of septic shock (p = 0.001), sepsis (p < 0.001), and the presence of additional care support such as nasogastric tube (p = 0.02). In contrast, a lower percentage of the patients with bacteremia was also observed during the COVID-19 pandemic. The blood cultures were requested by the physicians only in 26% of the patients in the COVID-19 pandemic period compared with 72% of the patients in the pre-COVID-19 pandemic period. However, the rates of the positive blood cultures were similar in both the pandemic periods (15.4 and 12%, respectively).

TABLE 1
www.frontiersin.org

Table 1. Demographics, clinical, and microbiological variables of the patients with IAI in the pre-COVID-19 pandemic period and during the COVID-19 pandemic period.

The patients with IAI during the COVID-19 were diagnosed later; time intervals between the SO to the first medical contact were higher (p = 0.002) or to the SI were near two times (p < 0.001) more than for the patients with IAI of the pre-COVID-19 cohort (Table 1). Similarly, the day intervals between the first medical contact and the admission or the SI were equal or higher than the three times, respectively, for the patients with IAI in the 2020 cohort vs. for the patients with IAI in the 2016 cohort (p < 0.001 and p < 0.001, respectively, for the admission and SI). With respect to the death rates, 16.7 and 6.5% of the patients died in the 2020 and 2016 cohorts, respectively (p = 0.02). The Kaplan–Meier curves for the survival of the patients with IAI in the pre-COVID-19 pandemic cohort and during the COVID-19 pandemic cohort are shown in Figure 1. Overall, although both the curves showed different declines, these differences were not statistically significant (p = 0.07). Moreover, the rate of ESBL production was higher during the COVID-19 pandemic cohort compared to the pre-COVID-19 pandemic cohort (9.4 vs. 2.8%, respectively; p = 0.04). Although, the rate of the appropriate empirical therapy was similar in both cohorts (94.8 vs. 88.9%, respectively; p = 0.13) (Table 1).

FIGURE 1
www.frontiersin.org

Figure 1. The Kaplan–Meier plots among the patients with the intra-abdominal infections (IAI) during the pre-coronavirus disease 2019 (COVID-19) pandemic period and the COVID-19 pandemic period.

Bivariate and Multivariate Analyses of the Factors Related to Death in the Pre-COVID-19 Pandemic Cohort and the COVID-19 Pandemic Cohort Grouped Together

The analysis of the factors related to death in both the cohorts grouped together is summarized in Table 2. The bivariate analysis showed that the dead patients are older (p = 0.02); more frequently admitted during the COVID-19 pandemic period (p = 0.02); had more comorbidities (Charlson comorbidity index, p < 0.001); more frequent ultimately or the rapidly fatal McCabe score (p < 0.001); required more emergency surgery (postsurgical peritonitis and hollow viscus perforation, p = 0.02 and p = 0.01, respectively); and had more severe infections, with the higher rates of bacteremia (p < 0.001), septic shock (p < 0.001), sepsis (p < 0.001), and the presence of additional care support such as urinary catheter (p < 0.001), transitory central venous catheter (CVC) (p < 0.001), nasogastric tube (p < 0.001), and mechanical ventilation (p < 0.001). In contrast, a higher percentage of the patients with the polymicrobial infection and appropriate empirical therapy in the first 24 h was observed in the survival group (p = 0.01 and p < 0.001, respectively). With respect to the time intervals between the SO and the SI, the dead patients have diagnosed later; the time intervals between the SO to the SI and between the first medical contact and the SI were near and higher to the two times (p = 0.03 and p = 0.04) for the dead patients vs. survival patients (p = 0.03 and p = 0.04), respectively.

TABLE 2
www.frontiersin.org

Table 2. Univariate analysis of the factors related to death in a combined cohort of the pre-COVID-19 pandemic cohort and the COVID-19 pandemic cohort.

Finally, the multivariate analysis in both the cohorts grouped together identify the patients diagnosed during the COVID-19 (p = 0.02), the longer period from the SO to the SI (p = 0.01), septic shock (p = 0.03), the Charlson comorbidity index (p = 0.001) as independent factors associated with death, and the appropriate empirical therapy during the first 24 h (p = 0.001) as a protective factor for death (Table 3).

TABLE 3
www.frontiersin.org

Table 3. Multivariate analysis of the factors related to death in a combined cohort of the pre-COVID-19 pandemic cohort and the COVID-19 pandemic cohort.

Discussion

This study shows that the mortality of IAI by E. coli was higher during the COVID-19 pandemic period compared to the pre-COVID-19 pandemic period. To the best of our knowledge, this is the first study that analyzed the impact of the COVID-19 on the IAI diagnosis, treatment, and outcomes. The bivariate analysis reported that the patients with IAI during the COVID-19 pandemic had more comorbidities, required more emergency surgery, and had more severe infections. With respect to the lower percentage of the patients with bacteremia during the COVID-19 pandemic, it is due to the decrease in the blood cultures requests by the physicians and consequently less bacteremia detection in the microbiology service. According to the data, it is important to note that this study does not include bacteremia in the multivariate analysis to avoid any bias in the independent variables introduced in the analysis. Moreover, the period of time between the SO and the SI was longer for the patients with IAI during the COVID-19 pandemic period compared to the patients with IAI in the pre-COVID-19 pandemic period and it was independently associated with death.

Despite the logistical difficulties caused by the COVID-19 pandemic, no significant delay was detected between the hospital admission and the SI, a period that only includes in-hospital factors. Of note, the visit to the emergency department and the use of the operating room decreased in 2020, the COVID-19 pandemic period, in our hospital by 25 and 22%, respectively. In turn, There was an increase in the time between the SO and the first medical contact, a period that includes the prehospital and in-hospital factors and between the first medical contact and the hospital admission. Probably, these issues are owing to the time spent by the patients to go to the hospital or the primary care attention due to the necessary protection measures applied in Spain during the COVID-19 pandemic. In this study, the possible explanations for these results could be a combination of the avoidance of medical care due to the social distancing and the fear of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) hospital transmission and to the use of the telephone consultation with the physician, a process in which the physicians had no prior experience or training.

This issue seems to be suggested in our study, in which the patients with IAI avoid going to the hospitals or they go later as reflected by the high number of patients with more severe infections. In Italy, a similar observation was reported in which the urgent emergency interventions were dropped and were associated with a more severe presentation due to a diagnostic delay (13).

In addition, this study also found that the patients during the COVID-19 pandemic had more severe infections with higher rates of septic shock and sepsis. This could be explained by the fact that during the COVID-19 pandemic, the patients were admitted to the hospital in an advanced stage of the disease. The delay in the time interval between the first medical contact and the SI could be also another factor, which could imply an increase of the complications before the abdominal surgery, which can further lead to hemodynamic instability (e.g., perforations, complicated abscesses).

In this study, it is important to highlight the worrying increase in the mortality of patients with IAI during the COVID-19 pandemic. Recent epidemiological data indicate a significant increase in mortality during this period that cannot be fully explained by the patients with the COVID-19 alone (14). Lack or delay in access to the specific antimicrobial treatment also would imply an increase in the severity of infections. Thus, it may be useful that recommendation statements devote attention to the management of the patients with IAI and the other severe infections during the COVID-19 health crisis.

This study also has several limitations. The first is the small sample size used and the patients are recruited from a unicenter cohort. A large sample and multicenter cohorts would be welcomed to confirm our results. Moreover, this study has only been able to analyze the available data in the pre-COVID-19 pandemic period and during the COVID-19 pandemic period. However, this study provides some advantages. We have compared the demographic, clinical, and microbiological variables of the patients with IAI in the two periods differing only in the presence or absence of the COVID-19 pandemic situation and also identified the impact of the days before the diagnosis and surgical interventions and their effects on the death between the pre-COVID-19 pandemic period and the COVID-19 pandemic period.

Conclusion

This observational study showed the impact of the COVID-19 pandemic on the clinical outcome and death due to IAI with an extension of time between the SO and the SI.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Ethics Statement

The studies involving human participants were reviewed and approved by the Ethics Committee of the Virgen Macarena and Virgen del Rocío University Hospitals (approval no. 0023-N-16 and 0088-N-20). Written informed consent was signed by all patients before inclusion in the cohorts. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

LG-B, ÁR-V, and RÁ-M conducted the study, collected data, and analyzed the study. LG-B and YS conceived and designed the study. YS wrote the manuscript. RÁ-M, RJ-R, JL-J, and JP revised and approved the final version of the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This study has been funded by the Instituto de Salud Carlos III through the grant CP15/00132 and the project PI19/01009 (co-funded by the European Regional Development Fund/European Social Fund; A way to make Europe/Investing in your future) and by the National Plan R + D + I 2013–2016 and the Instituto de Salud Carlos III, the Subdirección General de Redes y Centros de Investigación Cooperativa, Ministry of Economy, Industry, and Competitiveness, the Spanish Network for Research in Infectious Diseases (REIPI RD16/0016/0009), co-financed by European Development Regional Fund A way to achieve Europe, Operative program Intelligent Growth 2014–2020. YS was supported by the Subprograma Miguel Servet Tipo I from the Ministerio de Economía y Competitividad of Spain (CP15/00132). ÁR-V was supported by the Subprograma Rio Hortega from the Ministerio de Economía y Competitividad of Spain (CM18/00122).

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. WHO. Coronavirus Disease (COVID-19) Dashboard. (2021). Available online at: https://covid19.who.int/ (accessed January 22, 2021).

2. Maringe C, Spicer J, Morris M, Purushotham A, Nolte E, Sullivan R, et al. The impact of the COVID-19 pandemic on cancer deaths due to delays in diagnosis in England, UK: a national, population-based, modelling study. Lancet Oncol. (2020) 21:1023–34. doi: 10.1016/S1470-2045(20)30388-0

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Rosell Ortiz F, Fernández del Valle P, Knox EC, Jiménez Fábrega X, Navalpotro Pascual JM, Mateo Rodríguez I, et al. Influence of the Covid-19 pandemic on out-of-hospital cardiac arrest. A Spanish nationwide prospective cohort study. Resuscitation. (2020) 157:230–40. doi: 10.1016/j.resuscitation.2020.09.037

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Rodríguez-Leor O, Cid-Álvarez B, Pérez de Prado A, Rossello X, Ojeda S, López-Palop R, et al. Impact of COVID-19 on ST-segment elevation myocardial infarction care. The Spanish experience. Rev Esp Cardiol. (2020) 73:994–1002. doi: 10.1016/j.rec.2020.08.002

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Liu R, Zhao J, Fisher M. The global impact of COVID-19 on acute stroke care. CNS Neurosci Ther. (2020) 26:1103–005. doi: 10.1111/cns.13442

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Alqarni A, Kantor E, Grall N, Tanaka S, Zappella N, Godement M, et al. Clinical characteristics and prognosis of bacteraemia during postoperative intra-abdominal infections. Crit Care. (2018) 22:175. doi: 10.1186/s13054-018-2099-5

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Solomkin JS, Mazuski JE, Bradley JS, Rodvold KA, Goldstein EJC, Baron EJ, et al. Diagnosis and management of complicated intra-abdominal infection in adults and children: guidelines by the Surgical Infection Society and the Infectious Diseases Society of America. Clin Infect Dis. (2010) 50:133–64. doi: 10.1086/649554

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. (1987) 40:373–83. doi: 10.1016/0021-9681(87)90171-8

PubMed Abstract | CrossRef Full Text | Google Scholar

9. McCabe WR, Jackson GG. Gram-negative bacteremia. Arch Intern Med. (1962) 110:847–55.

Google Scholar

10. Singer M, Deutschman CS, Seymour CW, Shankar-Hari M, Annane D, Bauer M, et al. The third international consensus definitions for sepsis and septic shock (sepsis-3). JAMA. (2016) 315:801–10. doi: 10.1001/jama.2016.0287

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Huang YQ, Gou R, Diao YS, Yin QH, Fan WX, Liang YP, et al. Charlson comorbidity index helps predict the risk of mortality for patients with type 2 diabetic nephropathy. J Zhejiang Univ Sci. (2014) 15:58–66. doi: 10.1631/jzus.B1300109

PubMed Abstract | CrossRef Full Text | Google Scholar

12. European Committee on Antimicrobial Susceptibility Testing. Guidelines for Detection of Resistance Mechanisms and Specific Resistances of Clinical and/or Epidemiological Importance. Växjö: European Committee on Antimicrobial Susceptibility Testing (2017).

13. Patriti A, Baiocchi GL, Catena F, Marini P, Catarci M. Emergency general surgery in Italy during the COVID-19 outbreak: first survey from the real life. World J Emerg Surg. (2020) 15:36. doi: 10.1186/s13017-020-00314-3

PubMed Abstract | CrossRef Full Text

14. Instituto de Salud Carlos III (ISCIII). Vigilancia de los excesos de mortalidad por todas las causas. Situación. (2020). Available online at: https://www.isciii.es/QueHacemos/Servicios/VigilanciaSaludPublicaRENAVE/EnfermedadesTransmisibles/MoMo/Documents/informesMoMo2020/ (accessed April 28, 2020).

Keywords: COVID-19, intra-abdominal infection, Escherichia coli, surgery, mortality

Citation: Gálvez-Benítez L, Rodríguez-Villodres Á, Álvarez-Marín R, Jiménez-Rodríguez R, Lepe-Jiménez JA, Pachón J and Smani Y (2021) Impact of the COVID-19 Pandemic on Survival in the Patients With the Intra-Abdominal Infections. Front. Med. 8:687415. doi: 10.3389/fmed.2021.687415

Received: 29 March 2021; Accepted: 20 September 2021;
Published: 20 October 2021.

Edited by:

Hiroyuki Moriuchi, Nagasaki University, Japan

Reviewed by:

Dongshan Zhu, Shandong University, China
Guillermo Burillo-Putze, European University of the Canary Islands, Spain

Copyright © 2021 Gálvez-Benítez, Rodríguez-Villodres, Álvarez-Marín, Jiménez-Rodríguez, Lepe-Jiménez, Pachón and Smani. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Younes Smani, y_smani@hotmail.com; ysmani-ibis@us.es

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.