Pablo March-López1,2*
Inés Arancibia Freixa3Mireia Martinez Gil3Gastón Araujo Espinoza3Lidia Ortega Polonio4Elisabeth Cecilia Paredes4Montserrat Carrasco Sanchez4Cristina Sangrador1Júlia Pardo1Jordi Nicolás1,5
Esther Calbo2,6- 1Hospital Pharmacy, Pharmacy Department, Hospital Universitari Mútua Terrassa, Barcelona, Spain
- 2School of Medicine, Universitat Internacional de Catalunya, Barcelona, Spain
- 3Hospital at Home Unit Physician, Mútua Terrassa, Barcelona, Spain
- 4Hospital at Home Unit Nurse, Hospital Universitari Mútua Terrassa, Barcelona, Spain
- 5Pharmacy Department, Universitat de Barcelona, Barcelona, Spain
- 6Infectious Diseases Unit, Hospital Universitari Mútua Terrassa, Barcelona, Spain
The ability to measure the quality of antibiotic prescription is a critical element in any antimicrobial stewardship programme. The aim of this study was to evaluate the clinimetric properties of 33 quality indicators (QIs) developed to assess Outpatient Parenteral Antimicrobial Therapy (OPAT) and to identify potential room for improvement in a hospital-at-home (HaH) unit. Study performed in a healthcare district in Barcelona, Spain with 260,657 inhabitants, nine primary healthcare centres, a 400-bed acute care teaching hospital, and an HaH unit. We studied 33 QIs on appropriate antibiotic use and classified them as qualitative or quantitative. Quantitative QIs were further categorized as measurable or non-measurable depending on the availability of data in the patients’ medical records. Data from 202 OPAT episodes in 192 patients were assessed. Adherence was found for 22 of the 24 qualitative QIs analyzed; the other two showed room for improvement. Four of the nine quantitative indicators were non-measurable. High adherence rates were achieved for QI-17 “The OPAT plan should be documented” (84.65%), QI-26 “The OPAT treatment plan should include choice, dose, frequency, duration and follow-up plan” (79.70%), and QI-33 “The team should document clinical response” (94.55%). Adverse events were documented in just 1.98% of cases (QI-32) and 92.57% patients were classified as alive on discharge (QI-24). The QIs evaluated were applicable to clinical practice and proved useful for identifying areas with room for improvement in our setting and for guiding the design of future interventions with specific objectives.
Introduction
Outpatient parenteral antimicrobial therapy (OPAT) has been defined as the provision of parenteral antimicrobial therapy in at least two doses on different days without intervening hospitalization (Tice et al., 2004). It allows patients who would typically need to be hospitalized to receive parenteral antimicrobials at home, thereby increasing the availability of hospital beds by shortening or even eliminating hospital stays (Barr et al., 2012).
Hospital-at-home (HaH) programmes originated in the United States in the mid-1970s, partly in response to gaps in medical insurance coverage that made the cost of inpatient care prohibitive for certain patients requiring intravenous antibiotic therapy (Williams et al., 2015). In Spain, the first HaH unit was created by Hospital Gregorio Marañón in Madrid in 1981. The foundation of the Spanish Society for Home Hospitalization (SEHAD) in 2006 represented an important step forward in the development of HaH programmes across the country. As of January 2021, there were 105 active HaH units in Spain (Sociedad Española de HospitalizaciónDomiciliaria, 2020).
The current COVID-19 pandemic is one of the greatest public health crises of our time (European Centre for Disease Prevention and Control, 2019; World Health Organization, 2020a), and has forced health systems worldwide to urgently find ways to relieve pressure on overstretched hospitals and increase bed availability. One outcome has been an increase in the use of HaH programmes, which have proven to be both an efficient and safe option for providing care to selected at-risk patients (Coloma and Nicolás, 2020; Moghadas et al., 2020; Pericàs et al., 2020; Shoukat et al., 2020). OPAT patients, for example, are a COVID-19 risk group because of their susceptibility to severe infections and extensive contact with the healthcare system (Mansour et al., 2020). Regardless of how suitable a patient may seem for inclusion in an OPAT program, there is always the risk of important steps being forgotten or misapplied. Choosing a regimen that is suited to the capabilities of each patient and ensuring correct education and instruction are crucial to the success of any program (Halilovic et al., 2014).
Increasing the number of patients assigned to OPAT care also provides an opportunity to improve antimicrobial stewardship (AS). OPAT-specific quality indicators (QIs), however, are needed, as the ability to measure the quality of antibiotic prescriptions is a critical element in any AS programme. There are three main types of QIs: 1) structure indicators, to assess the organization of the healthcare setting; 2) process indicators, to assess the care received and delivered; and 3) outcome indicators, to assess the consequences of a given intervention (Donabedian, 1988).
In 2019, Berrevoets et al. (Berrevoets et al., 2020) and a multidisciplinary team of international experts developed a set of 33 generic QIs for appropriate OPAT use in adults. The QIs were classified into four categories: organization, initiation, continuation, and outcome. The experts, however, recognized that these QIs first needed to be tested for applicability in different clinical practice settings. One way of doing this is to test their clinimetric properties.
The aim of this study was to assess the usefulness of the QIs developed by Berrevoets et al. (Berrevoets et al., 2020) for identifying room for improvement in OPAT use and guiding the design of strategies for enhancing AS within an HaT OPAT programme in a health district of a high-income country with a public healthcare system (Spain).
Materials and Methods
This was an observational study performed in a health district with nine primary care centers, a 400-bed acute care teaching hospital, and an HaH unit that provides active home care to patients who would otherwise need acute medical care in a hospital setting. The OPAT programme is one of the unit’s main activities. It serves a population of 260,000 inhabitants and is run by three physicians, three nurses, and a clinical pharmacist. The Spanish national healthcare system offers universal coverage to a population of 46.4 million inhabitants (2016).
QIs and Definitions
The 33 QIs on appropriate antibiotic use developed by Berrevoets et al. (Berrevoets et al., 2020) were classified as qualitative or quantitative. Indicators that could be rated as adhered to (YES) or not adhered to (NO) were classified as qualitative, while those for which the degree of adherence could be measured were classified as quantitative. Quantitative indicators were further classified as measurable or non-measurable depending on whether or not the patients medical records contained the information necessary for assessment. Of the 33 QIs evaluated, 24 were qualitative (1–16, 18–21, 27–30) and nine were quantitative (17, 22–26, 32, 33). Four of the quantitative indicators were non-measurable (22, 23, 25, 31).
For QI-17 “The OPAT plan should be documented in the discharge summary”, the patients medical records were checked to see if the discharge summary contained information on antibiotic choice, dose, frequency of administration, and duration of OPAT. Five survival status at discharge categories were analyzed for QI-24 “The survival status of patients who received OPAT should be documented”: patient alive, died of infection, died of other causes, lost to follow-up, and status unknown. The patients’ medical records were also reviewed to check adherence to QI-26 “The OPAT treatment plan should include the following items: choice, dose, frequency, duration, and follow-up plan”, QI-32 “The OPAT team should document adverse events related to devices, antibiotic use, and toxicity”, and QI-33 “The OPAT team should document clinical response to antimicrobial management”.
Study Population and Data Collection
All patients who participated in the HaH OPAT programme between July 2019 and June 2020 were included. Patients treated with an antibiotic for fewer than 2 days were excluded following the Infectious Diseases Society of America definition of OPAT (Tice et al., 2004). To characterize the demographics of the programme participants, we collected information on type of infection, duration of OPAT within HaH program, choice of antibiotics, and microorganisms isolated.
The data required to assess the clinimetric properties of the QIs were extracted from the patients electronic medical records. Clinical and laboratory data were extracted from medical and nursing records and medication charts. Antibiotic prescriptions were identified by ATC codes and infections by International Classification of Disease codes (ninth version) (MSCBS, 2014; World Health Organization, 2020b). All data were collected and processed by members of the HaH team.
Adherence to individual QIs was defined as the percentage of patients for whom the indicator was met. Potential room for improvement measures the sensitivity of a potential indicator to identify areas in which antibiotic prescription can be improved. For quantitative indicators, it was calculated as 100% minus the adherence rate in all cases except QI-24 “The survival status of patients receiving OPAT should be documented” and QI-32 “The OPAT team should document adverse events related to devices, antibiotic use, and toxicity”, where these calculations are impossible.
The patients in our cohort study all received OPAT initiated within the hospital but delivered at home, which is in line with the definition provided by Chapman et al. in the United Kingdom consensus statement on good practice recommendations for OPAT in adults (Chapman et al., 2012) and applied by Berrevoets et al. (Berrevoets et al., 2020): “a method for delivering intravenous antimicrobials in the community or outpatient setting, as an alternative to inpatient care”.
Statistical Analysis
Proportions, interquartile range, and standard deviations were used for descriptive statistics. Analyses were performed using Stata 13 (Stata Corporation, College Station, TX, United States).
Results
Between July 2019 and June 2020, the HaH unit provided care to 717 patients for 821 episodes. Over a quarter of these patients (n = 192, 26.78%) received OPAT care (202 episodes); 66.83% of the patients were men and the mean overall age was 66.65 years (SD 16.65). The mean duration of the OPAT plan was 9.39 days (interquartile range, 4–11 days).
The most common diagnoses were genitourinary and respiratory tract infections (Table 1). The most prevalent microorganisms were Gram-negative bacteria (44.06%), including Escherichia coli harboring extended spectrum beta-lactamase (15.94%) (Table 2). Ceftriaxone (39.11%) and carbapenems (34.50%) were the main antibiotics administered (Table 3).
TABLE 1. Infections treated with outpatient parenteral antimicrobial therapy.
TABLE 2. Microorganisms isolated.
TABLE 3. Outpatient parenteral antimicrobial antibiotics.
Twenty-two of the 24 qualitative QIs (1–12, 14–16, 18–21, 27, 28, 30) were adhered to and two (13, 29) showed room for improvement.
In the group of quantitative QIs, there were five measurable indicators (17, 24, 26, 32, 33) and four non-measurable indicators (22, 23, 25, 31). High adherence was observed for QI-17 “The OPAT plan should be documented in the discharge summary” (adherence rate, 84.65%), QI-26 “The OPAT treatment plan should include the following items: choice, dose, frequency, duration and follow-up plan” (79.70%), and QI-33 “The OPAT team should document clinical response to antimicrobial management” (94.55%).
Survival status at discharge was documented for all patients (QI-24); 92.57% were classified as patient alive, 4.95% as readmitted to hospital, 1.49% as died of other causes, and 0.99% as died of infection. None of the patients were classified as lost to follow-up or status unknown. Adverse events were documented for just 1.98% of patients (QI-32).
The 33 QIs, together with their classification and adherence ratings, are listed in Table 4.
TABLE 4. Quality Indicators: Classification, Adherence, and Room for Improvement.
Discussion
We have evaluated adherence and room for improvement for a set of QIs in a cohort of OPAT patients treated in Spain, a high-income country with a national public health system. Our findings highlight the importance of testing the clinimetric properties of QIs before using them in routine practice. To our knowledge, this is the first study to assess the performance properties of the QIs developed by Berrevoets et al. for appropriate OPAT use in adults (Berrevoets et al., 2020).
The QIs developed by Berrevoets et al. (Berrevoets et al., 2020) are, to our knowledge, the first set of generic QIs to be designed for OPAT units. The authors, however, did not validate the QIs or perform any clinimetric evaluations. They acknowledged this limitation and proposed that their generic set of QIs be assessed and adapted to national specificities and guidelines as needed.
Our results show high adherence to the vast majority of QIs analyzed. Just two of the qualitative indicators showed room for improvement: QI-29 “The OPAT team should monitor quality indicators for OPAT care and make these data available”, which is the purpose of this present study, and QI-13 “In case of self-administration, both the OPAT nurse specialist and patient/caregiver must be satisfied of the patient’s/ caregiver competence and this should be documented”. In this second case, based on our interviews with the OPAT team, we determined that patients receive the necessary training on self-administration but that there are no mechanisms in place for documenting satisfaction with patient/caregiver competence. The observation of low adherence to certain indicators highlights the need to improve data recording systems to detect areas with room for improvement. Inclusion of a purpose-designed form in patients’ clinical records could improve adherence.
High adherence was achieved for the five measurable quantitative QIs, indicating little room for improvement. Our analysis of QI-24 “The survival status of patients receiving OPAT should be documented” shows that most patients were discharged successfully and that mortality was very low, indicating the adequacy of the selection criteria for OPAT in our setting (stable patients with a low risk of mortality). In relation to QI-32 “The OPAT team should document adverse events (AE) related to devices, antibiotic use, and toxicity”, we detected a very low rate of adverse events (1.98%), supporting previous reports showing the effectiveness of HaH units for OPAT. It is impossible to determine the true rate of adverse events, but rates related to the use of antibiotics tend to lie between 6.0 and 18.0% (Keller et al., 2018; Sriskandarajah et al., 2018; Quintens et al., 2020). The low rate in our study is probably due to underreporting. The introduction of active pharmacovigilance to complement passive reporting would help capture a truer picture of adverse effects.
In a recent systematic review on the safety and effectiveness of OPAT, Sriskandarajah et al.24 reported a cure or treatment success rate of greater than 80% in more than 88% of the studies, with drug-related adverse events ranging from 0 to 30.2%. Considering that HaH activities are likely to continue to increase, the QIs that we have analyzed will be useful for evaluating both patient safety and OPAT outcomes. Future audits can be improved by including a specific section in the discharge summary covering information relating to the four non-measurable QIs in our series (22, 23, 25, and 31).
Our findings have added to the current evidence in several respects. To our knowledge, this is the first study to test the clinimetric properties of the set of standardized QIs developed by Berrevoets et al. using the Delphi process, conferring robustness and validity (Moghadas et al., 2020). We also believe that we are the first healthcare organization to report on the use of OPAT-specific QIs and that our findings are applicable to countries with a public health system and a similar economic situation to Spain. Finally, our results have highlighted the need for improved data recording systems and will help ensure the continued provision of high-quality OPAT at our hospital.
This study also has some potential limitations. First, the work involved in manually retrieving the data needed to assess the clinimetric properties of the QIs was a laborious, time-consuming task that would probably be unfeasible outside the scope of a research project. It may also have influenced the objectivity of our findings. Automated data systems would facilitate data collection and reduce the risk of errors and bias. Second, we were unable to measure certain QIs due to missing data in the discharge summary. Third, care should be taken when extrapolating our findings to other settings, as this was an observational study of a single HaH program run by three nurses and one clinical pharmacist at a single healthcare organization providing care to a population of 260,000 inhabitants. Finally, the study was performed during the COVID-19 pandemic. It would be interesting to perform a similar study following the pandemic to investigate its influence on the HaH OPAT programme at our hospital.
Conclusion
We have tested the applicability and feasibility of QIs for appropriate antibiotic use in a real-life HaH OPAT program. Our analysis helped identify areas with room for improvement and in particular, will enable us to improve our electronic reporting systems and maintain a high-quality OPAT program.
Data Availability Statement
The original contributions presented in the study are included in the article/supplementary material; further inquiries can be directed to the corresponding authors.
Ethics Statement
This study was approved by the Ethics Committee of Mutua Terrassa (decision number O/21–047, April 28, 2021). Informed consent was not required as per institutional and national guidelines.
Author Contributions
All authors listed have made a substantial, direct, and intellectual contribution to the work and approved it for publication.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Barr, D. A., Semple, L., and Seaton, R. A. (2012). Outpatient Parenteral Antimicrobial Therapy (OPAT) in a Teaching Hospital-Based Practice: a Retrospective Cohort Study Describing Experience and Evolution over 10 Years. Int. J. Antimicrob. Agents 39, 407–413. doi:10.1016/j.ijantimicag.2012.01.016
Berrevoets, M. A. H., Ten Oever, J., Oerlemans, A. J. M., Kullberg, B. J., Hulscher, M. E., and Schouten, J. A. (2020). Quality Indicators for Appropriate Outpatient Parenteral Antimicrobial Therapy in Adults: A Systematic Review and RAND-Modified Delphi Procedure. Clin. Infect. Dis. 70 (6), 1075–1082. doi:10.1093/cid/ciz362
Chapman, A. L. N., Seaton, R. A., Cooper, M. A., Hedderwick, S., Goodall, V., Reed, C., et al. (2012). Good Practice Recommendations for Outpatient Parenteral Antimicrobial Therapy (OPAT) in Adults in the UK: a Consensus Statement. J. Antimicrob. Chemother. 67 (5), 1053–1062. doi:10.1093/jac/dks003
Coloma, E., and Nicolás, D. (2020). Hospital at Home Units in the post-COVID 19 Era. Eur. J. Clin. Invest. 50 (11), e13390. doi:10.1111/eci.13390
Donabedian, A. (1988). The Quality of Care. JAMA 260 (12), 1743–1748. doi:10.1001/jama.1988.03410120089033
European Centre for Disease Prevention and Control (2019). COVID-19 Situation Update Worldwide, as of Week 13 2021. Available from: https://www.ecdc.europa.eu/en/geographical-distribution-2019-ncov-cases.
Halilovic, J., Christensen, C. L., and Nguyen, H. H. (2014). Managing an Outpatient Parenteral Antibiotic Therapy Team: Challenges and Solutions. Ther. Clin. Risk Manag. 10, 459–465. doi:10.2147/TCRM.S48906
Keller, S. C., Williams, D., Gavgani, M., Hirsch, D., Adamovich, J., Hohl, D., et al. (2018). Rates of and Risk Factors for Adverse Drug Events in Outpatient Parenteral Antimicrobial Therapy. Clin. Infect. Dis. official Publ. Infect. Dis. Soc. America 66 (1), 11–19. doi:10.1093/cid/cix733
Mansour, O., Keller, S., Katz, M., and Townsend, J. L. (2020). Outpatient Parenteral Antimicrobial Therapy in the Time of COVID-19: The Urgent Need for Better Insurance Coverage. Open Forum Infect. Dis. 7 (8), ofaa287. doi:10.1093/ofid/ofaa287
Moghadas, S. M., Shoukat, A., Fitzpatrick, M. C., Wells, C. R., Sah, P., Pandey, A., et al. (2020). Projecting Hospital Utilization during the COVID-19 Outbreaks in the United States. Proc. Natl. Acad. Sci. USA 117 (16), 9122–9126. doi:10.1073/pnas.2004064117
MSCBS (2014). CLASIFICACIÓN INTERNACIONAL DE ENFERMEDADES 9.a REVISIÓN, MODIFICACIÓN CLÍNICA©. Available from: https://eciemaps.mscbs.gob.es/ecieMaps/browser/index_9_mc.html. (Accessed January 2, 2020).
Pericàs, J. M., Cucchiari, D., Torrallardona-Murphy, O., Calvo, J., Serralabós, J., Alvés, E., et al. (2020). Hospital at home for the Management of COVID-19: Preliminary Experience with 63 Patients. Infection 49 (2), 327–332. doi:10.1007/s15010-020-01527-z
Quintens, C., Steffens, E., Jacobs, K., Schuermans, A., Van Eldere, J., Lagrou, K., et al. (2020). Efficacy and Safety of a Belgian Tertiary Care Outpatient Parenteral Antimicrobial Therapy (OPAT) Program. Infection 48 (3), 357–366. doi:10.1007/s15010-020-01398-4
Shoukat, A., Wells, C. R., Langley, J. M., Singer, B. H., Galvani, A. P., and Moghadas, S. M. (2020). Projecting Demand for Critical Care Beds during COVID-19 Outbreaks in Canada. CMAJ 192 (19), E489–E496. doi:10.1503/cmaj.200457
Sriskandarajah, S., Hobbs, J., Roughead, E., Ryan, M., and Reynolds, K. (2018). Safety and Effectiveness of 'hospital in the home' and 'outpatient Parenteral Antimicrobial Therapy' in Different Age Groups: A Systematic Review of Observational Studies. Int. J. Clin. Pract. 19, e13216. doi:10.1111/ijcp.13216
Tice, A. D., Rehm, S. J., Dalovisio, J. R., Bradley, J. S., Martinelli, L. P., Graham, D. R., et al. (2004). Practice Guidelines for Outpatient Parenteral Antimicrobial Therapy. Clin. Infect. Dis. 38, 1651–1671. doi:10.1086/420939
Williams, D. N., Baker, C. A., Kind, A. C., and Sannes, M. R. (2015). The History and Evolution of Outpatient Parenteral Antibiotic Therapy (OPAT). Int. J. Antimicrob. Agents 46 (3), 307–312. doi:10.1016/j.ijantimicag.2015.07.001
World Health Organization (2020b). Guidelines for ATC Classification and DDD Assignment. WHO Collaborating Centre for Drug Statistics Methodology. Available from: https://www.whocc.no/filearchive/publications/2020_guidelines_web.pdf.
World Health Organization (2020a). World Health Organization Health Topics. Available from: https://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic. (Accessed January 21, 2021).
Keywords: opat, hospital at home, antimicrobial resist ance, antibiotics, quality indicator
Citation: March-López P, Freixa IA, Gil MM, Espinoza GA, Polonio LO, Paredes EC, Sanchez MC, Sangrador C, Pardo J, Nicolás J and Calbo E (2021) Applicability of Quality Indicators for Appropriate Antibiotic use in Outpatient Parenteral Antimicrobial Therapy (OPAT): A Point Prevalence Survey. Front. Pharmacol. 12:713882. doi: 10.3389/fphar.2021.713882
Received: 24 May 2021; Accepted: 28 July 2021;
Published: 25 August 2021.
Edited by:
Michael Thiede, IUBH University of Applied Sciences, GermanyReviewed by:
Ali Qais Blebil, Monash University Malaysia, MalaysiaNatasa Duborija-Kovacevic, University of Montenegro, Montenegro
Copyright © 2021 March-López, Freixa, Gil, Espinoza, Polonio, Paredes, Sanchez, Sangrador, Pardo, Nicolás and Calbo. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Pablo March-López, bWFyY2hfbG9wZXo0QGhvdG1haWwuY29t