Skip to main content

ORIGINAL RESEARCH article

Front. Med., 26 January 2023
Sec. Infectious Diseases: Pathogenesis and Therapy

The development and validation of screening tools for semi-automated surveillance of surgical site infection following various surgeries

  • 1Infection Control Unit, Meir Medical Center, Kfar Saba, Israel
  • 2Department of Epidemiology and Preventive Medicine, School of Public Health, Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel
  • 3Infectious Disease Unit, Meir Medical Center, Kfar Saba, Israel
  • 4Sackler Faculty of Medicine, Tel Aviv University, Tel Aviv, Israel

Background: Surveillance of surgical site infections (SSIs) is essential for better prevention. We developed a screening method for SSIs in adults.

Methods: The training dataset included data from patients who underwent orthopedic surgeries (N = 1,090), colorectal surgeries (N = 817), and abdominal hysterectomies (N = 523) during 2015–2018. The gold standard for the validation of the screening tool was the presence of SSI as determined by a trained infection control practitioner, via manual full medical record review, using the US Center for Disease Control and Prevention criteria. Using multivariable regression models, we identified the correlates of SSI. Patients who had at least one of these correlates were classified as likely to having SSI and those who did not have any of the correlates were classified as unlikely to have SSI. We calculated the sensitivity and specificity of this tool compared to the gold standard and applied the tool to a validation dataset (N = 1,310, years 2019–2020).

Results: SSI was diagnosed by an infection control specialist in 8.2, 5.2, and 31.2% of the patients in the training dataset who underwent hysterectomies, orthopedic surgeries and colorectal surgeries, respectively, vs. 6.2, 6.6, and 25.5%, respectively, in the validation dataset. The correlates of SSI after abdominal hysterectomy were prolonged hospitalization, ordering wound or blood culture, emergency room visit and reoperation; in orthopedic surgery, emergency room visit, wound culture, reoperation, and documentation of SSI, and in colorectal surgeries prolonged hospitalization, readmission, and ordering wound or blood cultures. Area under the curve was >90%. The sensitivity and specificity (95% CI) of the screening tool were 98% (88–100) and 58% (53–62), for abdominal hysterectomy, 91% (81–96) and 82% (80–84) in orthopedic surgeries and 96% (90–98) and 62% (58–66) in colorectal surgeries. The corresponding values for the validation dataset were 89% (67–97) and 75% (69–80) in abdominal hysterectomy; 85% (72–93) and 83% (80–86) in orthopedic surgeries and 98% (93–99) and 59% (53–64) in colorectal surgeries. The number of files needed to be fully reviewed declined by 61–66.

Conclusion: The presented semi–automated simple screening tool for SSI surveillance had good sensitivity and specificity and it has great potential of reducing workload and improving SSI surveillance.

Introduction

Surgical site infection (SSI) is a main complication following surgery, which accounts for more than 20% of hospital-acquired infections (HAI) worldwide (14). The incidence of SSI might exceed 20%, depends on the type of surgery (5, 6). SSI is associated with longer hospital stay and higher mortality rates and poses a substantial burden to the healthcare system (1, 4).

Continuous surveillance of SSI coupled with periodic feedback to surgeons is essential for the prevention and control of SSI and was shown to be effective in reducing SSI in a variety of surgical categories such as colorectal and hepatobiliary surgeries (59).

Surveillance of SSI is complicated and requires data collection from multiple sources to accurately define the presence of the infection and determine both the numerator and denominator (10). Manual surveillance is time-consuming and labor intensive, and its accuracy relies on the quality and training of infection control practitioners. Moreover, the identification of post-discharge SSIs is challenging (1114). With the development of electronic medical records (EMR), automated or semi-automated surveillance systems emerged for the monitoring and identification of HAIs, including SSIs (1013, 15) showing effectiveness of such systems in reducing time and workload from infection control teams compared to manual surveillance (1619). Despite this evidence, questions remain regarding the prediction ability of different patient or surgery characteristics, the combination of characteristics and whether it is possible to use one prediction model for all surgeries or there is need for customized models for different surgeries. Another unresolved issue is whether different models can be used with the same effectiveness in predicting SSI, allowing hospitals to develop local predicting models based on available data and not give up semiautomatic surveillance just because some variables cannot be retrieved by the hospital systems. Some gaps arising from current evidence include small sample size, a limited number of variables that were tested such as positive wound cultures (17), using variables that are specific for only some health systems such as infectious disease consultation (20), concentrating on clean surgeries with low SSI rates (21, 22) or using advanced clinical support systems which are not widely available (23).

The aim of the current study was to develop and validate a semi-automated screening tool for surveillance of SSIs in adults following various surgeries, namely abdominal hysterectomy, colorectal surgeries, spinal fusion, and joint replacements, using comprehensive yet simple demographic and clinical characteristics of the patient, surgical producers and management. Our underlying assumption was that some clinical and microbiological characteristics that can be easily obtained via collective reports might serve a good screening tool for SSIs. The rationale for the development of such a screening tool is to capture SSI events without the need to review medical records of all patients undergoing surgery, thus reducing the burden and workload on infection control teams.

Materials and methods

Study design and population

A historical cohort study was conducted among adults who underwent an abdominal hysterectomy, colorectal surgeries, spinal fusion, and joint replacements at Meir Hospital during 2015–2020.

Meir Medical Center is a secondary 780-bed university-affiliated hospital. It serves a population of about 600,000 individuals, with about 20,000 surgeries being conducted annually.

Manual surveillance of SSIs was ongoing in this center since 2008 for selected surgeries. Surveillance was carried out for in-hospital and post-discharge SSI using the data from patient’s medical records, return visits to the emergency room, readmission, reoperation, outpatient clinic visits, and a telephone interview with the patient 30 days after surgery. The ability to expand the surveillance to multiple surgery categories was compromised due to the substantial time and workload required for manual chart review. In 2014, an EMR system was introduced into the hospital’s systems, which enabled the extraction of computerized reports, including demographics and clinical data. In a pilot study, we validated a semi-automated surveillance system for SSI following a cesarean section using a dynamic report obtained from the EMR. Compared to manual surveillance, the surveillance based on the electronic report, significantly reduced the number of charts needed for review and reached a sensitivity and specificity of above 95% (19). These results were the basis of the current study.

Data collection and definition of the study variables

We utilized data from a cohort of patients who underwent an abdominal hysterectomy, colorectal surgeries, spinal fusion, and joint replacements, and were included in a local SSI manual surveillance program of our center. A trained infection control practitioner manually reviewed the medical records of all patients. Information was collected on the following independent variables: age (in years), sex, diagnosis of diabetes, receiving antibiotic prophylaxis before surgery, operation duration (in hours), ordering blood culture, ordering wound culture, the National Nosocomial Infection Surveillance (NNIS) risk index that consists of operation length, wound class (i.e., clean, clean contaminated, contaminated, or dirty), and the American Society of Anesthesiologists (ASA) score, length of hospital stay before surgery and from surgery to discharge (in days). The variable length of stay (LOS) from surgery to discharge was categorized using the 75th percentile of patients without SSI to define prolonged hospitalization, and it was specific for each surgery category.

Moreover, we collected data on returning to the emergency room of our hospital within 30–90 days, readmission or reoperation 30 or 90 days after surgery and recording SSI diagnosis in the medical record by the attending physicians.

The main dependent variable was the presence of SSI as determined by the infection control practitioner (yes or no). We collected information on the type of SSI: superficial, deep, or organ/space. SSI was defined using the using the US Center for Disease Control and Prevention criteria (24). The main outcome variable was SSI within 30 days from surgery for abdominal hysterectomies, colorectal surgeries, and superficial SSI in orthopedic surgeries, or 90 days after surgery or deep/organ space infection in joint replacement/spinal fusion. We included infections that were identified during hospitalization and after discharge from hospital.

Statistical methods

Data analysis was performed separately for each surgery category: abdominal hysterectomy; orthopedic surgery (joint replacement/spinal fusion) and colorectal surgery.

Data from the years 2015–2018 were used as the training dataset and the data from 2019 to 2020 were used as the validation dataset. We compared patient and surgery characteristics between the two datasets using the Student’s t-test for continuous variables or the Mann–Whitney test for variables that did not follow a normal distribution, and the chi square or Fisher exact where appropriate for categorical variables.

Missing data was low (0.8–1% in only 3 variables) therefore we preformed complete case analysis only.

Development of the screening tool for SSI surveillance

Initially we identified factors that were associated with the development of SSI. Using the training dataset, we compared demographic and clinical characteristics of patients who developed SSI with those who did not develop SSI using the chi square or Fisher’s exact test for categorical variables and Student’s t test for continuous variables. The Mann Whitney test was used for variables with skewed distribution. Multivariable logistic regression models were performed, in which SSI was the dependent variable. Independent variables that were associated with SSI in the bivariate analysis with a p < 0.2 were considered in the multivariable model. The selection of the final model was made using the area under the receiver operating characteristic [ROC] curve and calibration measure (Hosmer and Lemeshow test). The ROC curves were calculated using the predicted probability from the logistic regression model against the diagnosis of SSI by an infection control physician.

Next we used the independent variables that were identified in the multivariable models in developing a screening tool for SSI. The screening tool comprised a new variable that we created, in which patients who had at least one of the independent variables that were included in the multivariable model were considered as likely having SSI, while those who did not have any of these variables were considered as unlikely having SSI. We compared the classification of patients using this screening tool of SSI (likely or unlikely having SSI, a dichotomous variable), with the diagnosis of SSI by an infection control physician, which was used as the gold standard. We calculated the sensitivity, specificity, negative predictive value (NPV) and positive predictive value (PPV) and the corresponding 95% confidence intervals (CIs) of the screening tool compared to the physician’s diagnosis of SSI. The rationale of applying this strategy was to achieve maximum sensitivity, while reducing the number of medical records that should be to be fully reviewed by the infection control team in monitoring SSIs.

Validation of the screening tool of SSI

Validation of the SSI screening tool that was developed in the initial step was undertaken using the validation dataset. We fitted a logistic regression model in which SSI was the dependent variable, while the independent variables were those that we identified in the previous step of developing the screening tool. We calculated ROC curves, sensitivity, specificity, PPV and NPV as described above.

The data were analyzed using SPSS version 27 (IBM, Armonk, New York, NY, USA) and WINPEPI version 11.65 (25).

Ethical considerations

The data used in this study were collected for purposes of infection control surveillance as part of improvement program. This was a retrospective study using medical records. The study protocol was approved by the Institutional Review Board Committee of Meir Medical Center and an exemption from signing an informed consent was given, because of the retrospective study design.

Results

Description of the study sample

Data of 3,744 surgeries performed in 3,620 patients were analyzed; of these, 2,434 surgeries (2,341 patients) were conducted during 2015–2018 and included in the training dataset and 1,310 surgeries (1,279 patients) were conducted during 2019–2020 and were included in the validation dataset.

The training dataset (years 2015–2018) included 523 abdominal hysterectomies, 1,090 orthopedic surgeries and 817 colorectal surgeries. The respective patient’s median age in these surgeries was 55.0, 67.2, and 69.1 years. Overall 15.6% of the orthopedic surgeries and 35.0% of the colorectal surgeries were urgent surgeries, compared to 2.5% of the abdominal hysterectomies. General anesthesia was used in all women who underwent hysterectomy, in 87.3 and 96.1% of the patients who underwent orthopedic and colorectal surgeries, respectively. Most patients (64.5–82.9%) had low risk index (defined as NNIS risk index 0–1 scores) (Table 1).

TABLE 1
www.frontiersin.org

Table 1. Baseline characteristics of patients included in the training and validation datasets by surgery category.

The validation dataset (years 2019–2020) included 289, 609, and 412 patients who underwent abdominal hysterectomy, orthopedic surgery, and colorectal surgery, respectively. The baseline characteristics of patients who underwent abdominal hysterectomy in the training and validation datasets were comparable, except of longer hospitalization (median of 3 vs. 2 days) and longer duration operation (median of 2.5 vs. 2.3 h) in the training dataset. The validation and training datasets of patients who underwent orthopedic surgeries differed significantly in the proportion of using general anesthesia, urgent surgeries, operation duration, hospitalization duration, NNIS risk index, and wound class. Patients who underwent colorectal surgeries in the training dataset differed significantly compared with those in the validation dataset in those who had general anesthesia (96.1 vs. 99.1%), operation duration (median of 3.0 vs. 2.5 h), hospitalization duration (median of 7 vs. 6 days) and the proportion of those who received prophylactic antibiotic therapy (89.2 vs. 93.7%) (Table 1).

The training dataset included 43 (8.2%), 57 (5.2%), and 255 (31.2%) patients who developed SSI among those who underwent hysterectomy, orthopedic surgery and colorectal surgery, respectively, compared to 18 (6.2%), 40 (6.6%), and 105 (25.5%) in the validation dataset (Table 1).

Factors associated with SSI—Training dataset

A higher proportion of males was found among patients who underwent colorectal surgery and developed SSI than those without SSI (56.5 vs. 46.1% p = 0.006), but such difference was not found among patients who underwent orthopedic surgeries. Urgent surgery was more common among patients who underwent colorectal surgery and developed SSI than those who did not (46.8 vs. 28.8% p < 0.001), and the proportion of patients who received prophylaxis was lower in the SSI group (82.0 vs. 92.5%, p < 0.001). Such differences were not significant in the abdominal hysterectomy and orthopedic surgeries. Emergency room visits, readmission, ordering blood culture and wound culture, prolonged LOS, reoperation, and documentation of SSI in the medical chart were significantly more common among patients who developed SSIs than those who did not in all surgery categories. The proportion of patients who had high NNIS risk index was significantly higher among patients with SSI compared to those without SSI in the orthopedic (11.2 vs. 26.3% p < 0.001) and colorectal (22.0 vs. 34.8% p < 0.001) surgeries but not in abdominal hysterectomy. High-grade wound (contaminated/dirty) was more common in the SSI group vs. no SSI group in the colorectal surgeries only (32.2 vs. 16.0%, p < 0.001) (Table 2).

TABLE 2
www.frontiersin.org

Table 2. Factors associated with surgical site infection by surgery category; bivariate analysis by surgery category—training dataset.

A multivariable model showed that emergency room visit, having blood culture or wound culture ordered, prolonged hospitalization (more than 4 days), and reoperation were significantly associated with SSI likelihood among women who underwent abdominal hysterectomy. Another analysis of patients who underwent orthopedic surgeries showed that emergency room visit, having a wound culture ordered, reoperation, and having documentation of SSI in the medical record were significantly associated with SSI likelihood. The variables that were significantly correlated with SSI in patients who underwent colorectal surgery (overall) were emergency room visits, having a wound or blood culture ordered, prolonged hospitalization (more than 8 days) and readmission. Limiting the analysis to elective colorectal surgeries, showed that ordering a wound culture, readmission and prolonged hospitalization were the significant variables (Table 3). Similar results were found when analyzing separately patients with clean contaminated wound class.

TABLE 3
www.frontiersin.org

Table 3. Multivariable logistic regression models of factors associated with the development of SSI by surgery category—training dataseta.

A multivariable model that included only patients who underwent an urgent colorectal surgery showed that ordering wound or blood culture, prolonged hospitalizations, emergency room visit and reoperation that the significant correlates of SSI. The AUC was >90% in all these models (Table 3).

Validity of the screening tool

Using the results of the multivariable models on the correlates of SSI (Table 3), we classified patients as likely having SSI if they had at least one independent variable that were included in the final models, and unlikely having SSI if they did not have any of these variables.

In the training dataset, overall 42 patients who underwent abdominal hysterectomy were classified as likely having SSI; and 277 as unlikely having SSI, thus yielding a sensitivity of 98% (95% CI 88–100), a specificity of 58% (95% CI 53–62), PPV of 17% (95% CI 12–21), and NPV of 100% (95% CI 98–100). The corresponding numbers among patients who underwent an orthopedic surgery were 52 and 848, yielding a sensitivity and specificity of 91% (95% CI 81–96) and 82% (95% CI 80–84), respectively, and PPV and NPV of 22% (95% CI 17–28) and 99% (95% CI 99–100), respectively. Among all patients who underwent colorectal surgery, there were 204 and 350 who were classified as likely or unlikely having SSI, thus yielding a sensitivity and specificity of 96% (95% CI 92–98) and 62% (95% CI 58–66), and PPV and NPV of 53% (95% CI 49–58) and 97% (95% CI 94–98), respectively (Table 4).

TABLE 4
www.frontiersin.org

Table 4. Validity indices of the screening tool of SSI by surgery category–training dataseta.

The results of the correlates of SSI in the validation dataset were overall comparable to the results in the training dataset (Supplementary Tables 1, 2). Applying the screening tool to the validation dataset showed sensitivities of 89% (95% CI 67–97) and 85% (95% CI 72–93) for identifying SSI in patients who underwent abdominal hysterectomy and orthopedic surgeries, respectively, and 98% (95% CI 93–99) in those who underwent s colorectal surgery, compared to SSI diagnosis by an infection control practitioner. The specificity was 75% (95% CI 69–80), 83% (95% CI 80–86), and 59% (95% CI 53–64), respectively. PPV was 19% (95% CI 15–24) in abdominal hysterectomy, 26% (95% CI 22–31) in orthopedic surgeries and 45% (95% CI 42–48) in colorectal surgeries and NPV were 99% (95% CI 97–100) both in abdominal hysterectomy and orthopedic surgeries, and 99% (95% CI 96–100) in colorectal surgeries (Table 5).

TABLE 5
www.frontiersin.org

Table 5. Validity indices of the screening tool of SSI by surgery category–validation dataseta.

Applying the screening tool in all surgeries in real life would have saved the full medical chart review of 1492 (61.3%) records in the training dataset and 864 (66.0%) in the validation dataset. Assuming that an infection control practitioner spends on average 10 min reviewing each patient chart, it is estimated that our screening tool has the potential of saving 248.7 and 144 working hours, respectively.

Overall, 26 SSIs of all 3,740 surgeries were missed by applying the screening tool on both the training and validation datasets. Only two of them were deep or organ-space infections.

Discussion

We developed and validated a screening tool for the surveillance of SSIs in adults who underwent abdominal hysterectomy, colorectal surgeries, and orthopedic surgeries (i.e., spinal fusion and joint replacements). The screening tool comprised simple demographic and clinical characteristics of the patient, surgery and management. The main findings are that the screening tool displayed good validity indices, in both the training and validation datasets and can be easily integrated in semi-automated SSI surveillance systems. Moreover, the constructed screening tool showed promising potential of saving in workload, thus reducing the burden on the infection control units that results from manual chart review in the framework of SSI surveillance. Applying the screening tool to both the training and validation datasets suggested a reduction of about 60% in the number of medical records that need to be fully reviewed manually, while accurately detecting nearly all patients with SSI.

In practice, patient charts that will have one or more of the variables mentioned above will be flagged for the infection control practitioner, a summary of flagged charts can be prepared periodically. Infection control teams will review only flagged charts thus saving considerable time and workload. These activities will prompt an expedited verification and identification process of SSI in these patients. This is expected to enhance the feedback given to surgeons in the framework of SSI surveillance program, and reduce the burden associated with SSI more efficiently.

The ability of our screening tool and other similar tools (17, 19, 20, 26, 27) to accurately exclude a large amount of records from review is expected to improve the quality and extend the surveillance of SSI, which is compromised in many medical facilities due to shortage in infection control personnel and limited resources.

We found some differences across surgeries in the correlates of SSI and within colorectal surgeries, there might be also some differences between sub-categories (e.g., urgent, vs. elective). These findings suggest that surgery specific characteristics should be employed when developing screening tools for SSI. The correlates of SSI in the training dataset were similar to those found in the validation dataset, although some were not statistically significant in the latter, likely due to the smaller sample size. Despite these differences between the training the validation datasets, the screening tool was highly sensitive when it was applied on the validation dataset.

The documentation of SSI diagnosis in the medical records was low in all surgery categories thus enforcing the essential need of SSI designated surveillance system as a basis for the detection and planning prevention and control interventions.

Similar to our study, most studies on surveillance algorithms focused on one or few surgery categories. In a study from Korea focused on multiple surgeries (20) an algorithm was developed based on 3 characteristics to survey 38 surgery categories reaching high sensitivity of 96.7%: antibiotic prescribing, ordering microbiological studies and ordering consultation with an infectious disease specialist. Worth mentioning is that ordering consultation with infectious disease specialist might depend on local practices and resources, thus might not be generalizable to other settings and populations. Antibiotic treatment and microbiology tests were found to be strongly associated with SSI in other studies (28, 29), nonetheless the duration of antibiotic treatment might vary across surgeries. For instance, in a multicenter study on coronary artery bypass graft (CABG) a ≥ 9 days of antibiotic treatment had excellent prediction of SSI, while a study among women who underwent cesarean section found a threshold of ≥ 2 days of antibiotic treatment predicted SSI (28, 29).

We did not include antibiotic prescribing in the present model because our administrative data do not accurately capture this information. Our model may have performed better with accurate access to pharmacy data but even so we managed to achieve high detection rate with the available administrative, demographic and clinical data. Nevertheless, information systems in hospitals are improving constantly and information regarding antibiotic prescription or other variables can integrate into the prediction model in the future.

Surveillance of SSI in some hospitals uses positive microbiologic cultures for the detection of SSI (17). Being very specific, looking only for positive cultures might miss SSIs in patients with negative cultures or when other criteria such as radiologic evidence of infection or physician’s diagnosis, without positive culture, are fulfilled. Accordingly, we used in our screening tool the wider criteria of ordering microbiological culture and did not restrict it to only positive cultures, thus allowing for capturing nearly all SSIs in our datasets. Conversely, the specificity was lower than the sensitivity suggesting the potential for even further reduction in the number of medical records that need to be fully reviewed. From SSI surveillance perspective, which should be followed by a feedback to surgeons to improve patient’s outcomes and reduce the burden associated with SSI, we believe that a higher sensitivity is important over the specificity.

Considering ours and others’ findings (28, 29), the effort to create one prediction model or screenaing tool for all surgery categories seems to be less feasible and might be less desired taking into account the differences in patient characteristics, hospitalization practices and infection nature. Nonetheless, we showed shared correlates of SSI across surgeries and the two datasets. Collectively these findings suggest the existence of stable core characteristics that might be broadly used in SSI surveillance, although periodical testing or verification of the screening tool is likely warranted.

The ability to capture post discharge SSI became more important once LOS after surgery is significantly shortened (3033) and a larger fraction of SSIs is diagnosed post-discharge. Clinically significant SSIs often require surgical intervention such as wound reopening, surgical debridement or drainage and sometimes even major operation and antibiotic treatment. Methods to identify post-discharge SSIs include direct observation of surgical wound, telephone interviews with patients or surgeons, capturing readmissions or surgical revisions, review of pharmacy data and mixed methods (14). In our study, emergency room visits and readmissions were included to capture post-discharge SSIs.

In the last years, benchmark of hospital-acquired infections, for comparison between hospitals become an important focus. Using both standardized infection definitions and standardized detecting methods is essential to allow accurate comparisons across hospitals. In SSI surveillance and surveillance as a rule, there is a great impact of the method used on case finding (12). When applying detection algorithms, it is important to create a uniform algorithm containing variables that are easy to capture by all facilities being compared (27).

Fully automated surveillance, using machine learning, Natural Language Processing (NLP) or Bayesian network will expanse further the ability to survey wide range of surgeries and save even more time and work load but it will take a while until it will be routinely used (3436). The utilization of screening tools of SSI as described in our study will fill such an important gap.

Of note, classic risk factors such as high NNIS risk index were significantly correlated with SSI in orthopedic and colorectal surgeries but were not significant in in the final multivariable logistic regression. This might suggest that these factors are important for risk stratification but not suitable as correlates for SSI diagnosis.

Our study has some limitations, first, it is a single-center study, which might limit the generalizability of our findings. Nonetheless, the fact that this is a single center study might be considered a strength given the relatively homogenous practice. Moreover, the variables that were used in building the models to identify SSI are generic and are easily found in other hospitals of health systems. Second, there significant differences in some of the patients’ and surgeries’ characteristics between study periods. However, a close examination of these differences showed that although they were statistically significant they were mostly of small magnitude. Realizing that part of those changes are inevitable demonstrates the need for constant evaluation of HAI and SSI detection algorithms. Third, due to the COVID-19 pandemic in 2020, the number of elective surgeries was smaller than we expected in the validation period. Fourth, some SSIs that might be diagnosed and managed in the community or in other hospitals were probably missed. However, we assume that patients with clinically significant SSI will likely be referred or return to their operating surgeon and hospital more than other hospitals. Accordingly, we believe that we captured the majority of clinically significant SSIs. Our screening stool, utilizing simple variables is suitable for routine surveillance of SSI and can also be applied by other institutions.

Strengths of our study include using data spanning over a 6-year period with large sample sizes, multiple surgeries categories, the diagnosis of SSI, which was determined by trained infection control specialists using standardized accepted criteria, and the availability of a wide range of patients and surgery characteristics.

Of note, infection control practices such as improving antimicrobial prophylaxis, skin antisepsis and sterile technique implemented as necessary across both study periods. The division into test and validation datasets was arbitrary and did not necessarily correspond to those interventions.

Conclusion

We demonstrated the development of semi-automated screening tool for SSI surveillance, which had high sensitivity and fair specificity. The tool is based on simple demographic and clinical characteristics of patients and surgeries that can be easily extracted from patients EMRs. The integration of such a screening tool in the surveillance process will allow infection control team to review only flagged patient files, and has a great potential of reducing workload, saving time and improving the surveillance of SSI.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.

Ethics statement

The studies involving human participants were reviewed and approved by Institutional Review Board Committee of Meir Medical Center. Written informed consent for participation was not required for this study in accordance with the national legislation and the institutional requirements.

Author contributions

PS and KM designed the study. PS drafted the initial manuscript. KM and MC revised the manuscript critically for important intellectual content. All authors participated in the acquisition, analysis, and interpretation of the data, read, and agreed to the published version of the manuscript.

Acknowledgments

This study was conducted as Master in Public Heath (MPH) thesis of PS, at the School of Public Health, Sackler Faculty of Medicine, at Tel Aviv University, Tel Aviv, Israel. We would like to thank the infection control personnel for their work and dedication.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2023.1023385/full#supplementary-material

References

1. Badia J, Casey A, Petrosillo N, Hudson P, Mitchell S, Crosby C. Impact of surgical site infection on healthcare costs and patient outcomes: a systematic review in six European countries. J Hosp Infect. (2017) 96:1–15. doi: 10.1016/j.jhin.2017.03.004

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Magill S, Edwards J, Bamberg W, Beldavs Z, Dumyati G, Kainer M, et al. Multistate point-prevalence survey of health care–associated infections. N Engl J Med. (2014) 370:1198–208.

Google Scholar

3. Metsini A, Vazquez M, Sommerstein R, Marschall J, Voide C, Troillet N, et al. Point prevalence of healthcare-associated infections and antibiotic use in three large Swiss acute-care hospitals. Swiss Med Wkly. (2018) 148:w14617. doi: 10.4414/smw.2018.14617

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Sullivan E, Gupta A, Cook C. Cost and consequences of surgical site infections: a call to arms. Surg Infect. (2017) 18:451–4. doi: 10.1089/sur.2017.072

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Hubner M, Diana M, Zanetti G, Eisenring M, Demartines N, Troillet N. Surgical site infections in colon surgery: the patient, the procedure, the hospital, and the surgeon. Arch Surg. (2011) 146:1240–5. doi: 10.1001/archsurg.2011.176

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Paulson E, Thompson E, Mahmoud N. Surgical site infection and colorectal surgical procedures: a prospective analysis of risk factors. Surg Infect. (2017) 18:520–6.

Google Scholar

7. Haley R, Culver D, White J, Morgan W, Emori T, Munn V, et al. The efficacy of infection surveillance and control programs in preventing nosocomial infections in US hospitals. Am J Epidemiol. (1985) 121:182–205.

Google Scholar

8. Ceppa E, Pitt H, House M, Kilbane E, Nakeeb A, Schmidt C, et al. Reducing surgical site infections in hepatopancreatobiliary surgery. HPB. (2013) 15:384–91.

Google Scholar

9. Smyth E, Emmerson A. Surgical site infection surveillance. J Hosp Infect. (2000) 45:173–84.

Google Scholar

10. Sykes P, Brodribb R, McLaws M, McGregor A. When continuous surgical site infection surveillance is interrupted: the Royal Hobart Hospital experience. Am J Infect Control. (2005) 33:422–7. doi: 10.1016/j.ajic.2005.04.244

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Cato K, Cohen B, Larson E. Data elements and validation methods used for electronic surveillance of health care-associated infections: A systematic review. Am J Infect Control. (2015) 43:600–5. doi: 10.1016/j.ajic.2015.02.006

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Pop-Vicas A, Stern R, Osman F, Safdar N. Variability in infection surveillance methods and impact on surgical site infection rates. Am J Infect Control. (2021) 49:188–93.

Google Scholar

13. Lee T, Montgomery O, Marx J, Olmsted R, Scheckler W. Recommended practices for surveillance: Association for Professionals in Infection Control and Epidemiology (APIC). Inc. Am J Infect Control. (2007) 35:427–40.

Google Scholar

14. Petherick E, Dalton J, Moore P, Cullum N. Methods for identifying surgical wound infection after discharge from hospital: a systematic review. BMC Infect Dis. (2006) 6:170. doi: 10.1186/1471-2334-6-170

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Mu Y, Edwards J, Horan T, Berrios-Torres S, Fridkin S. Improving risk-adjusted measures of surgical site infection for the National Healthcare Safely Network. Infect Control Hosp Epidemiol. (2011) 32:970–86. doi: 10.1086/662016

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Klompas M, Yokoe D, Weinstein R. Automated surveillance of health care–associated infections. Clin Infect Dis. (2009) 48:1268–75.

Google Scholar

17. Knepper B, Young H, Jenkins T, Price C. Time-saving impact of an algorithm to identify potential surgical site infections. Infect Control Hosp Epidemiol. (2013) 34:1094–8. doi: 10.1086/673154

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Woeltje K. Moving into the future: electronic surveillance for healthcare-associated infections. J Hosp Infect. (2013) 84:103–5.

Google Scholar

19. Shitrit P, Mudrik R, Gottesman B, Chowers M. Validation of a semiautomated system for surveillance of surgical site infection after cesarean section. Infect Control Hosp Epidemiol. (2021) 43:1505–7. doi: 10.1017/ice.2021.264

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Cho S, Chung D, Choi J, Kim D, Kim S, Huh K, et al. Validation of semiautomated surgical site infection surveillance using electronic screening algorithms in 38 surgery categories. Infect Control Hosp Epidemiol. (2018) 39:931–5. doi: 10.1017/ice.2018.116

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Perdiz L, Yokoe D, Furtado G, Medeiros E. Impact of an automated surveillance to detect surgical-site infections in patients undergoing total hip and knee arthroplasty in Brazil. Infect Control Hosp Epidemiol. (2016) 37:991–3. doi: 10.1017/ice.2016.86

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sips M, Bonten M, van Mourik M. Semiautomated surveillance of deep surgical site infections after primary total hip or knee arthroplasty. Infect Control Hosp Epidemiol. (2017) 38:732–5.

Google Scholar

23. Streefkerk H, Lede I, Eriksson J, Meijling M, van der Hoeven C, Wille J, et al. Internal and external validation of a computer-assisted surveillance system for hospital-acquired infections in a 754-bed general hospital in the Netherlands. Infect Control Hosp Epidemiol. (2016) 37:1355–60. doi: 10.1017/ice.2016.159

PubMed Abstract | CrossRef Full Text | Google Scholar

24. National Healthcare Safety Network. Surgical site infection event (SSI). (2022). Available online at: https://www.cdc.gov/nhsn/pdfs/pscmanual/9pscssicurrent.pdf (accessed January 16, 2023).

Google Scholar

25. Abramson J. WINPEPI updated: computer programs for epidemiologists, and their teaching potential. Epidemiol Perspect Innov. (2011) 8:1. doi: 10.1186/1742-5573-8-1

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Branch-Elliman W, Strymish J, Itani K, Gupta K. Using clinical variables to guide surgical site infection detection: a novel surveillance strategy. Am J Infect Control. (2014) 42:1291–5. doi: 10.1016/j.ajic.2014.08.013

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Van Rooden S, Tacconelli E, Pujol M, Gomila A, Kluytmans J, Romme J, et al. A framework to develop semiautomated surveillance of surgical site infections: an international multicenter study. Infect Control Hosp Epidemiol. (2020) 41:194–201. doi: 10.1017/ice.2019.321

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Bolon M, Hooper D, Stevenson K, Greenbaum M, Olsen M, Herwaldt L, et al. Improved surveillance for surgical site infections after orthopedic implantation procedures: extending applications for automated data. Clin Infect Dis. (2009) 48:1223–9. doi: 10.1086/597584

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Yokoe D, Noskin G, Cunningham S, Zuccotti G, Plaskett T, Fraser V, et al. Enhanced identification of postoperative infections among inpatients. Emerg Infect Dis. (2004) 10:1924.

Google Scholar

30. Burn E, Edwards C, Murray D, Silman A, Cooper C, Arden N, et al. Trends and determinants of length of stay and hospital reimbursement following knee and hip replacement: evidence from linked primary care and NHS hospital records from 1997 to 2014. BMJ Open. (2018) 8:e019146. doi: 10.1136/bmjopen-2017-019146

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Cowper P, DeLong E, Hannan E, Muhlbaier L, Lytle B, Jones R, et al. Trends in postoperative length of stay after bypass surgery. Am Heart J. (2006) 152:1194–200.

Google Scholar

32. Kobayashi K, Ando K, Kato F, Kanemura T, Sato K, Hachiya Y, et al. Trends of postoperative length of stay in spine surgery over 10 years in Japan based on a prospective multicenter database. Clin Neurol Neurosurg. (2019) 177:97–100. doi: 10.1016/j.clineuro.2018.12.020

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Petersen P, Jørgensen C, Kehlet H, Lundbeck Foundation Center for Fast-track Hip and Knee Replacement collaborative group. Temporal trends in length of stay and readmissions after fast-track hip and knee arthroplasty. Dan Med J. (2019) 66:66.

PubMed Abstract | Google Scholar

34. Bucher B, Shi J, Ferraro J, Skarda D, Samore M, Hurdle J, et al. Portable automated surveillance of surgical site infections using natural language processing: development and validation. Ann Surg. (2020) 272:629–36. doi: 10.1097/SLA.0000000000004133

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Sohn S, Larson D, Habermann E, Naessens J, Alabbad J, Liu H. Detection of clinically important colorectal surgical site infection using Bayesian network. J Surg Res. (2017) 209:168–73. doi: 10.1016/j.jss.2016.09.058

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Suzuki H, Clore G, Perencevich E, Hockett-Sherlock S, Goto M, Nair R, et al. Development of a fully automated surgical site infection detection algorithm for use in cardiac and orthopedic surgery research. Infect Control Hosp Epidemiol. (2021) 42:1215–20. doi: 10.1017/ice.2020.1387

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: surgical site infection, semi-automated surveillance, screening tool, validation, model development

Citation: Shitrit P, Chowers MY and Muhsen K (2023) The development and validation of screening tools for semi-automated surveillance of surgical site infection following various surgeries. Front. Med. 10:1023385. doi: 10.3389/fmed.2023.1023385

Received: 19 August 2022; Accepted: 10 January 2023;
Published: 26 January 2023.

Edited by:

Nicola Petrosillo, Policlinico Universitario Campus Bio-Medico, Italy

Reviewed by:

Martina Barchitta, University of Catania, Italy
Guido Granata, National Institute for Infectious Diseases Lazzaro Spallanzani (IRCCS), Italy

Copyright © 2023 Shitrit, Chowers and Muhsen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Pnina Shitrit, www.frontiersin.org pninash64@gmail.com, www.frontiersin.org pninash@clalit.org.il

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.