- 1AIXTRA — Competence Center for Training and Patient Safety, Medical Faculty, RWTH Aachen University, Aachen, Germany
- 2Department of Anaesthesiology, University Hospital RWTH Aachen, Medical Faculty, RWTH Aachen University, Aachen, Germany
- 3Institut für Notfallmedizin und Medizinmanagement (INM), Klinikum der Universität München, LMU München, München, Germany
- 4Department of Anaesthesiology and Intensive Care, University Medical Centre Schleswig-Holstein, Campus Lübeck, Lübeck, Germany
- 5Department of Anaesthesiology and Intensive Care, University of Leipzig Medical Centre, Leipzig, Germany
Background: The status of Safety Management is highly relevant to evaluate an organization's ability to deal with unexpected events or errors, especially in times of crisis. However, it remains unclear to what extent Safety Management was developed and sufficiently implemented within the healthcare system during the COVID-19 pandemic. Providing insights of potential for improvement is expected to be directional for ongoing Safety Management efforts, in times of crisis and beyond.
Method: A nationwide survey study was conducted among healthcare professionals and auxiliary staff on German Intensive Care Units (ICUs) evaluating their experiences during the first wave of the COVID-19 pandemic. Error Management and Patient Safety Culture (PSC) measures served to operationalize Safety Management. Data were analyzed descriptively and by using quantitative content analysis (QCA).
Results: Results for n = 588 participants from 53 hospitals show that there is a gap between errors occurred, reported, documented, and addressed. QCA revealed that low quality of safety culture (27.8%) was the most mentioned reason for errors not being addressed. Overall, ratings of PSC ranged from 26.7 to 57.9% positive response with Staffing being the worst and Teamwork Within Units being the best rated dimension. While assessments showed a similar pattern, medical staff rated PSC on ICUs more positively in comparison to nursing staff.
Conclusion: The status-analysis of Safety Management in times of crisis revealed relevant potential for improvement. Human Factor plays a crucial role in the occurrence and the way errors are dealt with on ICUs, but systemic factors should not be underestimated. Further intensified efforts specifically in the fields of staffing and error reporting, documentation and communication are needed to improve Safety Management on ICUs. These findings might also be applicable across nations and sectors beyond the medical field.
Introduction
Medical errors are a major threat to patient safety (1). Over the past two years, healthcare systems all over the world are confronted with an outstanding and long-lasting crisis – the COVID-19 pandemic. According to Schilling et al. (2), the first German case of COVID-19 was reported on January 27th, 2020. At the beginning of March 2020, the momentum of the worldwide pandemic spread in Germany. Up until October 2020, 152.984 cases of COVID-19 infections were reported whereof approximately 18% of cases had to be hospitalized. Among all patients who were hospitalized, 14% had to be treated on ICU whereof 23% were depending on ventilation (2). Taking all cases into account, there was a fatal course of disease in 5% of cases. On a national level, there was an excess mortality rate of 5% in comparison to 2019 (3).
It seems more relevant than ever to find out whether existing efforts were able to strengthen the organization to an extent that they are well prepared for a crisis like this. The question arises what the status of Safety Management in the critical starting phase of the crisis was and how healthcare organizations cope with a crisis such as the pandemic. Safety is referred to as the absence of unwanted outcomes such as incidents or accidents whereas the aspect of management includes regulation or control mechanisms (4). Goodman (5) states that Safety Management is related to the culture of an organization and includes organizational as well as behavioral elements of the system and its processes (5, 6). It is a concept that aims to “develop organizational policies and procedures to foster an environment where safety is so highly valued that members practice the highest safety behaviors” (5).
20 years after the institute of medicine claimed medical errors as a major issue causing up to 98.000 deaths per year within the United States (7), much has been researched about efforts on safety management, particularly regarding patient safety culture (PSC) and the detection and processing of medical errors (e.g., (8–10). Preventable adverse events (PAE) are often reported in the context of medical errors as they are defined as injuries due to a non-intercepted serious medical error (11). A systematic review of 151 international studies by the german coalition for patient safety showed PAE account for approximately 17.000 deaths in Germany per year (8). Furthermore, the economic burden is not to be neglected as patient harm causes high financial costs (12). Nevertheless, previous studies criticize existing efforts in improving safety management within the organizations as insufficient (13, 14).
The healthcare system is a complex system where errors can have severe consequences (15). Studies show that a considerable number of these serious medical errors occur in the Intensive Care Units (ICUs), with a common potential for patient harm (11, 16–18). Donchin et al. (16) estimated that 1.7 errors occur in the ICUs per patient and day. The environment of ICUs is characterized by complexity, time pressure and constantly changing conditions where decisions often need to be made without a comprehensive information base. Dealing with technical equipment is a quite common task and expected to further increase, especially when taking into consideration the rise of decision-guiding technology of artificial intelligence. Nevertheless, implementation of increasingly advanced equipment and technology does not completely eliminate medical errors regarding human factors (15). Quite the contrary, ICUs are often described as particularly prone to medical errors (19). Looking at a major event of a crisis such as the COVID-19 pandemic, which particularly affected the ICUs in an outstanding way, this part of the health organization is therefore of special interest to Safety Management efforts.
Looking closer into human errors, Reason (20) proposed two different lenses, 1) the person-approach and 2) the system-approach. The person-approach on the one hand considers human behavior as the cause of errors through unsafe actions arising from mental processes, e. g. forgetting, poor motivation. The system-approach on the other hand focuses on analyzing and changing conditions under which humans work, assuming that human nature itself cannot be changed (20). This assumption is also frequently emphasized by the quote “to err is human” (7). To support this, research shows that situations rather than individuals are error-prone (15). Causes of errors are well explored regarding fatigue, workload as well as burnout (21), therefore, the anticipation is reasonable that medical errors can derive from stress related to pandemic circumstances. Nevertheless, human errors are very unstable, hard to predict and they can only be avoided to a certain extent (15, 19). It is therefore crucial to not simply follow error prevention strategies and try to eradicate human errors because they can as well be developmental and offer enormous potential for organizational learning (15, 22). For the present study we followed the system-approach. Especially in times of a major crisis, the question needs to be raised how system adaptations can increase future organizational learning as well as organizational resilience.
In summary, it remains unclear to what extent past Safety Management efforts in improving PSC or Error Management (EM) have prepared healthcare organizations for an unexpected crisis. What is the perception of EM and PSC when asking workforces in one of the most pressured parts of the organization and at times of unprecedented change? The aim of the present study is to provide an answer to this question and improve the understanding of Safety Management within the interactions between ICUs and a broader disruptive factor of a crisis such as the COVID-19 pandemic. Therefore, we conducted a nationwide survey on German ICUs during the first wave of the COVID-19 pandemic.
Methods
Ethics
Ethical approval (Ethics Review Board document 459/20) was granted according to the ethical principles of the World Medical Association's Declaration of Helsinki (23) on 01.12.2020 by the Institutional Ethics Review Board of the University Hospital, RWTH Aachen.
Study design
We conducted a nationwide cross-sectional survey study addressing the topics of EM and PSC. The present study was based on individual reports of errors that occurred during the first wave of the COVID-19 pandemic. Individual perceptions can vary greatly from objective reportings, whereas we aimed at providing in-depth-analysis of subjective assessments rather than solely looking at quantitative data. Furthermore, studies have shown the inadequacy of voluntary error reportings to draw a complete picture of EM and PSC (18). Moreover, the first wave of the pandemic is of special interest to the present study as healthcare organizations were expected to be at the maximum of organizational change during this phase. As the COVID-19 pandemic started, no organizational learning effects were to be expected at this point of time, the staff was assumed to be in a reaction mode. Additionally, the recall of errors recalling the first wave of the pandemic was expected to be extremely high as the staff was confronted with drastic changes for the first time during the crisis.
Questionnaire design
Items in the questionnaire were not randomized to allow for coherence when filling out the survey. The questionnaire spread over 15 pages including the first page with an informed consent, an informatory page about the definition of error and a last page acknowledging participation. In total, 70 items were presented to participants on 12 pages. Due to adaptive questioning applying to some items, e. g. when asking for profession-specific further trainings, the number of items presented to each individual participant was lower than 70 and may have varied per participant depending on particular responses. Participants were not able to review and change their answers after continuing to the next screen of the questionnaire.
Sample selection process
Participants of the study included healthcare professionals as well as auxiliary staff in the fields of medicine and nursing of all hierarchical levels on German ICUs. To avoid sample selection bias and generate a study sample that contains a broad range of hospitals all over Germany, a defined selection process was conducted before participant recruitment. Therefore, we selected hospitals stratified by geographical distribution, hospital type as well as COVID-19 patient load. In terms of geographical distribution, we selected hospitals out of the north (Schleswig-Holstein, Saxony, Lower Saxony, Mecklenburg-Western Pomerania, Hamburg, Bremen, Brandenburg, Berlin, Saxony-Anhalt), the middle (Thuringia, Northrhine-Westfalia, Hesse) and the south (Baden-Württemberg, Bavaria, Rhineland-Palatinate, Saarland) of Germany equally. Hospital type ensured that university hospitals as well as specialty clinics, municipal hospitals and other hospital types were included. Upon request, the Robert Koch Institute provided us with data about COVID-19 patient load for every hospital within the registry of the German Interdisciplinary Association for Intensive Care and Emergency Medicine. These data included information about how many COVID-19 patients have been treated in the respective hospital during the first wave of the COVID-19 pandemic until the cut-off date 30th of July 2020. Hence, a balanced number of hospitals with low (< 20 patients), medium (20–59 patients) and high (> 59 patients) COVID-19 patient load was included in the study sample. Furthermore, solely hospitals that provide ICUs were included in the study sample. This process finally led to a selection of 152 out of 1.200 hospitals.
Data collection
After careful programming and design of the questionnaire with SoSci Survey (24) and publication via www.soscisurvey.de, the questionnaire was tested for coherence, technical functionality as well as time needed for completion by five colleagues by means of a pre-test. Data collection was carried out between April 6th and June 20th, 2021 through an open survey. Participation was voluntary and anonymous. Due to data restriction, neither Cookies nor IP-addresses were recorded. In the informed consent at the beginning of the questionnaire, participants were provided with information about the study and time needed for completion. First, central contact persons were identified for every selected hospital. This was either the chief medical officer (CMO) or a person named by the CMO. This person was then contacted via mail and asked to share the survey with ICU staff at their sites. Survey invitation mails and posters with QR-Codes were developed for this purpose and provided to the contact persons. In case of no response, hospitals were contacted again via mail or phone call and asked for participation. The survey was reported according to the CHERRIES checklist (25) (Table 1 in Supplementary material).
Measures
Error management
We propose EM as a concept that serves to operationalize an essential part of Safety Management. We define EM as an overarching construct bringing together an understanding of the nature and extent of errors, conditions that promote the emergence of errors as well as human behavior to prevent, mitigate errors or cope with their consequences (20, 26). We assessed EM in the proposed dimensions of Error Identification (How are medical errors detected and who detects them?), Error Documentation (How are medical errors documented?), Error Communication (How are medical errors addressed within the team?) and Error Prevention (How are medical errors prevented from happening again?). The mainly open-ended items were developed in-house to represent all the proposed thematic areas of EM (Table 2 in Supplementary material). Whereas existing literature has focused mostly on only one of these dimensions (17, 27–29), we propose them as a theoretical model that displays a full EM-cycle. Furthermore, we link EM with PSC as we believe they are mutually influencing concepts in the context of Safety Management (Figure 1). It is key to understand the types of errors and analyse them to improve the PSC within ICUs (19). The same applies the other way around with PSC influencing the way errors are perceived and handled within an organization.
Patient safety culture
PSC was measured using 8 out of 12 dimensions from the German version of the Hospital Survey on Patient Safety Culture (HSOPSC), namely: Teamwork Within Units, Organizational Learning, Feedback & Communication About Error, Communication Openness, Frequency of Events Reported, Teamwork Across Units, Staffing and Non-punitive Response to Error (30, 31). The remaining 4 dimensions (Supervisor/ Manager expectations & Actions Promoting Patient Safety, Management Support for Patient Safety, Overall Perceptions of Patient Safety, and Handoffs & Transitions) were excluded as they did not meet the study focus or target group. This is due to the fact that these dimensions were either related specifically to management views of PSC, specific procedures such as handoffs or transitions or in terms of overall perceptions of PSC too vague to draw conclusions for the target group. The questionnaire is a well-established and validated tool, developed by the United States Agency for Healthcare Research and Quality (32). Answers were given on a 5-point Likert scale ranging from 1 = Strongly disagree/Never to 5 = Strongly agree/Always.
Statistical analysis
Descriptive data analysis was performed for both EM and PSC using IBM SPSS Statistics, Version 28 (IBM Corp., Armonk, NY, USA). Overall composite percent positive scores of the HSOPSC dimensions were calculated as well as composite scores separated by profession of the participants (nursing or medicine). Therefore, the two highest (Strongly agree/ Agree and Always/ Most of the time) were combined to calculate agreement (percent positive scores) for each item on each dimension. Negatively worded items were reversely coded.
Quantitative content analysis
Quantitative Content Analysis (QCA) was performed using f4analyse software v3.3 (audiotranskription.de) for the analysis of EM related data (33). QCA is a technique for systematic evaluation of written or spoken content for example resulting from an interview or as in our case resulting from answers to open-ended questions in a questionnaire. Whenever there is an abundance of content QCA helps to structure communication content systematically, gives an objective insight into data and allows frequency analysis. In contrast to qualitative content analysis, QCA does not aim to interpret single phrases in detail by their meaning but tries to display the overall structure of answers and similarities. Nevertheless, QCA also entails slight qualitative steps to reevaluate the categorical system (34). QCA was performed as follows: First, answers to open-ended questions were briefly examined to propose categorical systems in which answers seem to be optimally clustered. In a second step, a team of three coders matched answers with the suitable category. In this step, responses were interpreted qualitatively. The categorical system was iteratively reevaluated during this process as answers might have depicted a different picture of the data. In addition, subcategories were defined whenever suitable. The category “Unclear/ Other” was used when content did not match any of the defined categories and the mention rate was too low to create a new category or when clear interpretation of the answer was not possible, e. g. due to ambiguity or misspelling. As a result, in the last step, the qualitative data could be interpreted using quantitative measures, such as calculating frequencies, proportions and percentage values.
Results
Sample characteristics
654 participants initially opened the survey link and clicked on continue at least once. In total the questionnaire was fully completed by 486 participants, which led to a completion rate of 74%. Partly completed questionnaires were used for analysis as well. Therefore, the study sample varies slightly for each item as participants dropped out of the survey in different subareas.
66 participants were excluded from the study sample due to missing data and not fitting the target group of the study. The latter is divided into participants indicating that they were neither deployed nor planned for deployment on ICUS during the first wave of the COVID-19 Pandemic as well as central contact persons that were not part of the target group. The final study sample amounts n = 588 ICU staff out of 53 hospitals (Figure 2). Figure 3 displays an overview of demographic characteristics of the study participants while.
Figure 3. Participant demographics. ICU, Intensive Care Unit; h, hours. Participants were characterized according to the duration of their ICU deployment during the first wave of the COVID-19 pandemic (column 1), the region in Germany where they worked (column 2), their weekly working hours (column 3), and the type of change in working hours during the pandemic (column 4). In addition, the proportion of those who were assigned to a ward with COVID-19 patients is shown (column 5). All response rates are given in percentage terms.
Figure 4 shows specific demographics of medical and nursing staff regarding position and further training experience.
Figure 4. Demographics of medical and nursing staff. Participants were asked about their professional group affiliation (column 1). Nursing staff was asked whether they held a leading position (column 2) and whether they had advanced specialist training in anesthesia and intensive care (column 3). Medical staff was asked about their position (column 4) and whether they had an additional training in intensive care medicine (column 5). Response rates are given in percentage terms for each item.
Error management analysis
Changes in medical errors due to COVID-19 pandemic
60.2% of the participants indicated that medical errors did not increase while 39.8% noticed an increase of errors since the start of the pandemic (n = 374). Error increases were noticed mostly in the field of medication errors (17.1%), e. g., administration of the wrong medication or its dosage to a patient. These errors were followed by errors due to lacking human resources (14.5%), e. g., time-delayed medication administration due to insufficient staffing. operator errors while handling respirators (9.4%), e. g. incorrect settings were made or alarms were ignored, were mentioned frequently as well. When asked about a specific error during the first wave of the COVID-19 pandemic, medication errors (25.1%) were mentioned most frequently. These errors were followed by treatment errors (10.3%), e. g., decubiti due to incorrect abdominal positioning of the patient, and operator errors (13.7%), e. g., mixing up of ventilation tubes.
Error identification
About every second participant (54.6%) argued that medical errors are identified by colleagues, while 41.7% of the participants stated that they are mostly identified by the person who made the error itself. QCA revealed that the person uncovers these errors through critical incident reporting systems (CIRS), reports to the chief or through communication in team meetings.
Error documentation
A large majority of participants (88.8%) stated their department provides a reporting system, but 78.0% of them did not fill out any reporting form since the beginning of the COVID-19 pandemic (n = 502). Most of the participants argued that errors were documented in logbooks (97.0%), in-house error reporting systems (88.9%) or by documenting a fictitious patient in the electronic patient record (99.2%), while CIRS (27.7%) or team meetings (36.2%) were least mentioned (n = 505).
Error communication
61.2% of the participants stated that medical errors are addressed in their department, while this is not the case for 38.8% of the participants due to low quality of error culture (27.8%), supervisors' lack of interest (16.8%), hierarchy (12.7%) and lack of time resources (11.6%). 38.0% of the participants indicated errors are mostly addressed within training courses or within meetings (9.4%) that are held or used for this purpose. Most of the participants (55.4%) experienced monthly, 27.2% annual, 13.9% weekly and 3.5% daily communication about errors (n = 287).
Error prevention
Most of the participants (55.1%) who noticed an increase in errors during the first wave of the COVID-19 pandemic, did not perceive any prevention actions being implemented. Most frequently mentioned reasons were shortage of personnel resources (20.8%), the medical system in general (14.6%) and low quality of error culture (10.4%). 44.9% of the participants reported that prevention strategies took place and mentioned personnel development (24.6%), control and safety procedures (22.8%) and communication (21.1%) as the most frequent measures. Participants' most frequently reported wishes for future prevention strategies were staff recruitment and deployment planning (27.2%), improvements of working conditions (16.0%) and personnel development (10.1 %).
Patient safety culture analysis
Descriptive analysis of the HSOPSC dimensions is depicted in Table 1. Staffing received the lowest positive response rates of all dimensions (26.7%) whereas Teamwork Within Units (58.0%) was the best rated dimension with a difference of 31.3 percentage points. Overall, both professions evaluated the dimensions in the same direction whereas medical staff tended to rate the situation on ICUs more positively regarding every dimension except for Communication Openness. Medical staff rated Teamwork within Units (63.2%) while nursing staff rated Non-punitive Response to Error (54.4%) most positive.
Table 1. Composite percent positive responses of HSOPSC dimensions overall and divided by profession.
Looking closer into the details of the staffing dimension (Table 2), all the three items concerning workload were rated comparatively low whereas the deployment of temporary staff reaches better positive response marks in both professions.
Furthermore, Table 3 displays descriptive differences between hospital types regarding patient safety measures. In almost all dimensions maximum care providers such as university hospitals achieve the lowest results except for the dimensions Teamwork across Units (28.0%), Staffing (26.9%) and Non-punitive response to error (54.8 %).
Taking a closer look into the scores divided by the region, it becomes visible that the southern part of Germany achieves the best rates in almost all dimensions except for Staffing (28.3%) (Table 4). In this dimension the middle part of Germany scores lower which can be attributed to the individual values of all the items on this dimension (Table 5).
Discussion
In the present study we argued that EM and PSC are two constructs that operationalize the framework of Safety Management within the healthcare system, specifically on ICUs. Especially in times of crisis it is important to look closely into the distinct aspects of Safety Management and their output on Human Factor. Results from this nationwide status-analysis have uncovered serious potential and a need for structural interventions for improving Safety Management on German ICUs. Despite limited generalizability to other healthcare systems in view of potential social and cultural disparities, we argue that our results care of interest beyond the German healthcare system. This goes in line with the fact that some aspects of critical care are universal among different countries and comparisons can provide useful information (35). Therefore, we believe that international comparisons may provide important insights into how differences in Safety Management translated to failing and succeeding in confronting the pandemic.
Referring to the results on EM, most of the participants did not notice an increase of errors during one of the most intensive phases of the pandemic. This might seem surprising at first but may be related to the fact that adapting to these new circumstances is accompanied by a non-linear pattern of initial acceptable performance level (36). On the other hand, increased workload and pressure could have impaired objective observation of changes in the number of errors. The observed increase in operator errors, specifically related to respirator machines, seems logical as COVID-19 is a virus that primarily affects the respiratory system (37). Thereby it becomes apparent that solely providing the healthcare system with technical devices in an attempt to support or compensate staffing requirements is insufficient. Rather, intensive training is necessary to ensure that medical processes run safely and errors are reduced to a minimum.
Furthermore, errors resulting from staff shortage were mentioned most frequently. Indeed, Staffing captures drastic potential for improvement as the worst rated dimension in the analysis of PSC. These results suggest that a lack of personnel can be a source of error which might also be applicable across nations and branches. A recent report by the Agency for Healthcare Research and Quality underlines this hypothesis with similar ratings on this dimension (38). Referring to the system-approach we followed within this study, improvements need to be made but are not limited to working conditions. With a current tendency that the shortage of skilled professionals in the medical system will be ongoing, systemic factors might even be the main reasons for errors while individual failures happen as consequence. If so, prevention strategies need to focus primarily on the system and the working conditions. In fact, PSC analysis showed that the deployment of temporary staff can be one option to improve the tense condition of staff shortage, but further and sustainable measures are needed to reduce the overall workload and create serious improvements that impact PSC. Beyond that, actions are also needed regarding the qualification of existing staff as this was one of the most mentioned strategies wished for to prevent future errors from happening.
Furthermore, the results on Error Identification shed a light on how we currently record medical errors. While the majority of errors were identified either by the person oneself or colleagues and almost all the participants stated their department provides CIRS, only few participants reported to have actively used existing reporting systems during the first wave of the COVID-19 pandemic. This is not surprising as research has already shown that it is the “human nature not to report errors” (16). Nevertheless, results show that existing efforts might have fallen too short and we need more effective ways of reporting errors to depict a realistic overview—especially in times of crisis.
In addition, with the documentation of reported errors mostly conducted through logbooks or in-house reporting systems but a high amount of people stating that these errors were not addressed, a major loss of information is conceivable. When only a few errors of an already incomplete overview of errors are addressed, potential for learning is limited. This also becomes clear when looking at a lack of interest by authorities and a low quality of error culture as reported reasons for not addressing errors. This highlights not only the importance of effective communication (16) but also addresses a need for intensified efforts in error culture. Hence, all EM dimensions have the potential to influence individual and organizational learning processes because learning from errors goes in line with preventing severe errors from happening to build individual as well as organizational resilience (20).
The results of a study prior to pandemic times by Gambashidze et al. (39) draw a similar picture of the patient safety dimensions that is relatable to our findings and underlines the importance of improving patient safety (39). The results lead to the assumption, that Safety Management has not improved greatly in the years leading up to the pandemic or the crisis has damped past efforts. Interestingly, most of the dimensions that are specifically related to errors were rated worse by our study sample which might be caused by the crisis situation. Nevertheless, the comparison of these results needs to be seen in light of some limitations as we included hospitals all over Germany which were not limited to university hospitals and our study focused on intensive care units.
In conclusion, the present status-analysis of Safety Management in times of crisis revealed some serious potential for improvement on German ICUs, especially in an international comparison (40). It outlined the necessity to not only make Safety Management and its facets an ongoing commitment throughout healthcare organizations (26) but also, to intensify and especially tailor these Safety Management measures. One way to do so might be to further integrate simulation training with EM instructions into personnel development (41). Since our results have shown that communication is a critical aspect when it comes to sufficient error reporting and addressing them in a respectful manner, we believe that intensified teaching of communication strategies, such as closed-loop communication, can be beneficial for staff development and Safety Management in general. Other ways might also include structured approaches, e. g. the concept of Circle Up, to improve communication and information flow within ICU teams (42).
Limitations
To our knowledge, this is the first study which assesses the status of Safety Management in times of crisis within the scope of a nationwide survey on German ICUs. Nevertheless, the findings of this study need to be seen in light of some limitations. First, the present status-analysis is based on a data collection at one point of time. Given the knowledge that PSC and EM are dynamic processes requiring ongoing efforts (19), it seems important to examine the development over a longer period, for example how PSC and EM evolve looking at the transition of the pandemic into an endemic state or in post-pandemic times. Furthermore, we are aware that there are relevant questions that cannot be answered by the investigation of one time point—such as differences between profession groups or regions. With our work we hope to stimulate further research activities which are hypothesis-driven and can answer these questions with sufficient certainty. Second, the current study does not claim to be exhaustive regarding subjective error reporting. As known from previous research, it is difficult to measure the occurrence and severity of errors objectively as it relies on the subjective willingness to contribute to error reporting and as it is the “human nature not to report errors” (16). A combination of qualitative and quantitative as well as subjective and objective error reportings might be helpful to extend insights. Lastly, the findings of our study should be interpreted tailored to German ICUs. The generalization to the wider population of critical care staff in Germany and beyond the German healthcare system is limited. Nevertheless, it can be assumed that results might be applicable to an international and cross-sectoral context. Future studies on Safety Management should explore the transferability of these results and test this assumption across different nations and industries. Finally, as the findings of this study are based on staff perceptions, future studies may additionally include results from CIRS to avoid overrepresentation of participants, who might have been more likely to respond to the study invitation because of strong views or particular experiences. Thus, the non-response bias should be taken into account when interpreting the study results. When participating in a survey, it is most likely that people with experiences at the far end of a scale make up a big part of the study sample whereas a great amount of people with moderate experience tend to not respond or participate in the study. This might be one reason for an unknown amount of potential study participants with moderate experiences that decided to not participate in our study. Another reason for non-response could be that reporting medical errors is a sensitive issue which may have been an obstacle for participation. Furthermore, a lack of time and personnel resources due to the pandemic might be a reason for non-response. These potential reasons may have caused non-response and eventually biased the results.
Conclusion
Human factor in High Reliability Organizations such as healthcare institutions is an everlasting concern in terms of safety culture as well as the assessment of errors. The present status-analysis highlights this importance but also urges the significance of improving systemic factors such as working conditions and staffing that need to be considered when interpreting Safety Management in the healthcare system.
Data availability statement
Study material and datasets are available from the corresponding author upon reasonable request.
Ethics statement
The studies involving human participants were reviewed and approved by the Ethics Review Board of the University Hospital RWTH Aachen (Ethics Review Board document 459/20) on 01.12.2020. Written informed consent for participation was not required for this study in accordance with the National Legislation and the Institutional Requirements.
Author contributions
MS made substantial contributions regarding study conceptualization and design, conducted the data analysis, and wrote the manuscript. SL and MK were involved in the analysis and interpretation of the data. SL, MK, ML, FJ, LT, and GH reviewed and made substantial contributions to the manuscript. SS critically reviewed the manuscript for important intellectual content, supervised the study and supported MS as senior investigator. All authors contributed to the conceptualization and design of this study, including the preparation of study material, and reviewed and revised the manuscript. All authors agree to be accountable for all aspects of this work and approve the final manuscript as submitted.
Funding
The study was partly supported by the Federal Ministry of Education and Research of the German Federal Government (Project egePan Unimed, Grant nr. 01KX2021) and by in-house funding of the project partners.
Acknowledgments
We would like to thank all medical and nursing staff who participated in the survey and thus made this study possible. We would also like to thank the hospitals that supported the project and specifically the central contact persons for their support in forwarding the survey link and information.
Conflict of interest
ML and BS declare that they received research grants from the German Federal Ministry of Education and Research (BMBF) and from Erasmus+. ML declares the immediate past presidency of the Society of Simulation in Europe (SESAM). BS declares the deployment as a trainer for medical simulation training at CATHI GmbH and a trainer for medical emergency training at Polyclinic for Dental Preservation and Periodontology and a received payment for expert testimony from M3i GmbH.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2022.988746/full#supplementary-material
Abbreviations
CIRS, Critical Incident Reporting Systems; CMO, Chief Medical Officer EM, Error Management; HSOPSC, Health Survey on Patient Safety Culture; ICUs, Intensive Care Units; PAE, Preventable Adverse Events; PSC, Patient Safety Culture; QCA, Quantitative Content Analysis.
References
1. La Pietra L, Calligaris L, Molendini L, Quattrin R, Brusaferro S. Medical errors and clinical risk management: state of the art. Acta Otorhinolaryngol Ital. (2005) 25:339–46.
2. Schilling J, Lehfeld A-S, Schumacher D, Ullrich A, Diercke M, Buda S, et al. Krankheitsschwere der ersten COVID-19-Welle in Deutschland basierend auf den Meldungen gemäß Infektionsschutzgesetz. J Heal Monit. (2017) 5:1–20. doi: 10.25646/7169
3. Corona-Pandemie führt zu Übersterblichkeit in Deutschland—Statistisches Bundesamt. Available online at: https://www.destatis.de/DE/Presse/Pressemitteilungen/2021/12/PD21_563_12.html (accessed Aug, 16 2022).
4. Hollnagel E,. Safety–I Safety–II : The Past Future of Safety Management. Safety–I Safety–II. (2018). Available online at: https://www.taylorfrancis.com/books/mono/10.1201/9781315607511/safety–i-safety–ii-erik-hollnagel doi: 10.1002/9781119443070.ch3 (accessed Aug, 23 2022).
5. Goodman GR. A fragmented patient safety concept: the structure and culture of safety management in healthcare. Hosp Top. (2003) 81:22–9. doi: 10.1080/00185860309598018
7. Kohn L, Corrigan J, Donaldson M. To Err is Human: Building a Safer Health System. National Academy Press. (2000).
8. Hoffmann B, Rohe J. Patient safety and error management: what causes adverse events and how can they be prevented? Dtsch Arztebl Int. (2010) 107:92. doi: 10.3238/ARZTEBL.2010.0092
9. Brindley PG. Patient safety and acute care medicine: lessons from the future, insights from the past. Crit Care. (2010) 14:217. doi: 10.1186/cc8858
10. Singer SJ, Vogus TJ. Reducing hospital errors: Interventions that build safety culture. Annu Rev Public Health. (2013) 34:373–96. doi: 10.1146/annurev-publhealth-031912-114439
11. Rothschild JM, Landrigan CP, Cronin JW, Kaushal R, Lockley SW, Burdick E, et al. The critical care safety study: the incidence and nature of adverse events and serious medical errors in intensive care. Crit Care Med. (2005) 33:1694–700. doi: 10.1097/01.CCM.0000171609.91035.BD
12. Slawomirski L, Auraaen A, Klazinga N. The economics of patient safety: Strengthening a value-based approach to reducing patient harm at national level. Paris OECD Health Working Papers Report No.: 96. (2017). Available online at: https://www.oecd.org/els/health-systems/The-economics-of-patient-safety-March-2017.pdf (accessed Mar 02, 2022).
13. Farley DO, Haviland A, Champagne S, Jain AK, Battles JB, Munier WB, et al. Adverse-event-reporting practices by US hospitals: results of a national survey. Qual Saf Heal Care. (2008) 17:416–23. doi: 10.1136/qshc.2007.024638
14. Noble DJ, Pronovost PJ. Underreporting of patient safety incidents reduces health care's ability to quantify and accurately measure harm reduction. J Patient Saf. (2010) 6:247–50. doi: 10.1097/PTS.0b013e3181fd1697
15. Reason J. Understanding adverse events: human factors. Qual Heal Care. (1995) 4:80–9. doi: 10.1136/qshc.4.2.80
16. Donchin Y, Gopher D, Olin M, Badihi Y, Biesky M, Sprung CL, et al. A look into the nature and causes of human errors in the intensive care unit. Crit Care Med. (1995) 23:294–300. doi: 10.1097/00003246-199502000-00015
17. Espin S, Wickson-Griffiths A, Wilson M, Lingard L. To report or not to report: A descriptive study exploring ICU nurses' perceptions of error and error reporting. Intensive Crit Care Nurs. (2010) 26:1–9. doi: 10.1016/j.iccn.2009.10.002
18. Landrigan CP, Parry GJ, Bones CB, Hackbarth AD, Goldmann DA, Sharek PJ. Temporal trends in rates of patient harm resulting from medical care. N Engl J Med. (2010) 363:2124–34. doi: 10.1056/NEJMsa1004404
19. Stockwell DC, Slonim AD. Quality and safety in the intensive care unit. J Intensive Care Med. (2006) 21:199–210. doi: 10.1177/0885066606287079
20. Reason J. Human error: models and management. BMJ. (2000) 320:768–70. doi: 10.1136/bmj.320.7237.768
21. Montgomery VL. Effect of fatigue, workload, and environment on patient safety in the pediatric intensive care unit. Pediatr Crit Care Med. (2007) 8:11–6. doi: 10.1097/01.PCC.0000257735.49562.8F
22. Armitage G. Human error theory: relevance to nurse management. J Nurs Manag. (2009) 17:193–202. doi: 10.1111/j.1365-2834.2009.00970.x
23. World Medical Association. World medical association declaration of helsinki: ethical principles for medical research involving human subjects. JAMA. (2013) 310:2191–4. doi: 10.1001/jama.2013.281053
24. Leiner DJ. SoSci Survey (Version 3.1.06). (2019). Available online at: https://www.soscisurvey.de (accessed Apr 4 2022).
25. Eysenbach G. Improving the quality of web surveys: the Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. (2004) 6:e34. doi: 10.2196/jmir.6.3.e34
26. Helmreich RL. On error management: lessons from aviation. BMJ. (2000) 320:781–5. Available online at: https://www.bmj.com/content/320/7237/781 (accessed Jan 4 2022).
27. Graf J, Von Den Driesch A, Koch KC, Janssens U. Identification and characterization of errors and incidents in a medical intensive care unit. Acta Anaesthesiol Scand. (2005) 49:930–9. doi: 10.1111/j.1399-6576.2005.00731.x
28. Van Dyck C, Baer M, Frese M, Sonnentag S. Organizational error management culture and its impact on performance: a two-study replication. J Appl Psychol. (2005) 90:1228–40. doi: 10.1037/0021-9010.90.6.1228
29. Vande Voorde KM, France AC. Proactive error prevention in the intensive care unit. Crit Care Nurs Clin North Am. (2002) 14:347–58. doi: 10.1016/S0899-5885(02)00027-8
30. Sorra J, Gray, L, Streagle, S, Famolaro, T, Yount, N, Behm, J,. AHRQ Hospital Survey on Patient Safety Culture: User's Guide. Rockville, MD: Agency for Healthcare Research Quality (2018). Available online at: https://www.ahrq.gov/sops/surveys/hospital/index.html
31. Pfeiffer Y, Manser T. Development of the German version of the hospital survey on patient safety culture: dimensionality and psychometric properties. Saf Sci. (2010) 48:1452–62. doi: 10.1016/j.ssci.2010.07.002
32. AHRQ. Hospital Survey on Patient Safety Culture: Items and Dimensions. Available online at: https://www.ahrq.gov/sites/default/files/wysiwyg/sops/surveys/hospital/hsops-items-composites.pdf (accessed Mar 14 2022).
33. audiotranskription. Marburg, Germany. (2021). Available online at: audiotranskription.de (accessed Feb 14 2022).
34. Rourke L, Anderson T. Validity in quantitative content analysis validity in quantitative content analysis. Educ Technol Res Dev. (2004) 52:5–18. doi: 10.1007/BF02504769
35. Murthy S, Wunsch H. Clinical review: International comparisons in critical care - lessons learned. Crit Care. (2012) 16:1–7. doi: 10.1186/cc11140
36. Chen G, Ployhart RE. Time for a change: Towards a theory of performance change. In: 19th Annual Conference of the Society for Industrial and Organizational Psychology. (2004).
37. Yang X, Yu Y, Xu J, Shu H, Xia J, Liu H, et al. Clinical course and outcomes of critically ill patients with SARS-CoV-2 pneumonia in Wuhan, China: a single-centered, retrospective, observational study. Lancet Respir Med. (2020) 8:475–81. doi: 10.1016/S2213-2600(20)30079-5
38. Famolaro T, Hare R, Yount ND, Fan L, Liu H, Sorra J. Surveys on Patient Safety CultureTM (SOPS®) Hospital Survey 2.0: 2021 User Database Report. Available online at: https://www.ahrq.gov/sites/default/files/wysiwyg/sops/surveys/hospital/2021-HSOPS2-Database-Report-Part-I-508.pdf (accessed Apr 21 2022).
39. Gambashidze N, Hammer A, Brösterhaus M, Manser T. Evaluation of psychometric properties of the German Hospital Survey on Patient Safety Culture and its potential for cross-cultural comparisons: a cross-sectional study. BMJ Open. (2017) 7:1–12. doi: 10.1136/bmjopen-2017-018366
40. Famolaro T, Hare R, Yount ND, Fan L, Liu H, Sorra J. Surveys on Patient Safety CultureTM (SOPS®) Hospital Survey 2.0: 2021 User Database Report. Rockville (2021). Available online at: https://www.ahrq.gov/sites/default/files/wysiwyg/sops/surveys/hospital/2021-HSOPS2-Database-Report-Part-I-508.pdf (accessed April 21, 2022).
41. Heimbeck D, Frese M, Sonnentag S, Keith N. Integrating errors into the training process: The function of error management instructions and the role of goal orientation. Pers Psychol. (2003) 56:333–61. doi: 10.1111/j.1744-6570.2003.tb00153.x
Keywords: Safety Management, human factor, medical error, patient safety culture, Intensive Care Unit (ICU), COVID-19 pandemic
Citation: Schmidt M, Lambert SI, Klasen M, Sandmeyer B, Lazarovici M, Jahns F, Trefz LC, Hempel G and Sopka S (2022) Safety management in times of crisis: Lessons learned from a nationwide status-analysis on German intensive care units during the COVID-19 pandemic. Front. Med. 9:988746. doi: 10.3389/fmed.2022.988746
Received: 07 July 2022; Accepted: 02 September 2022;
Published: 05 October 2022.
Edited by:
Yue Dong, Mayo Clinic, United StatesReviewed by:
Ali Sheidaei, Tehran University of Medical Sciences, IranAnna Camporesi, Ospedale dei Bambini Vittore Buzzi, Italy
Deborah Plana, Harvard Medical School, United States
Copyright © 2022 Schmidt, Lambert, Klasen, Sandmeyer, Lazarovici, Jahns, Trefz, Hempel and Sopka. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Michelle Schmidt, bWlzY2htaWR0JiN4MDAwNDA7dWthYWNoZW4uZGU=