Skip to main content

ORIGINAL RESEARCH article

Front. Cardiovasc. Med., 15 July 2022
Sec. Cardiovascular Epidemiology and Prevention
This article is part of the Research Topic Women in Cardiovascular Epidemiology and Prevention View all 35 articles

Assessment of Human Factors After Advanced Life Support Courses Comparing Simulated Team and Real Team Assessment: A Randomized Controlled Cohort Trial

Updated
\r\nSabine Nabecker,,,*Sabine Nabecker1,2,3,4*Sren HuwendiekSören Huwendiek5Christian SeidlChristian Seidl6Anisa HanaAnisa Hana7Lorenz TheilerLorenz Theiler8Robert Greif,,Robert Greif1,3,9
  • 1Department of Anesthesiology and Pain Medicine, Bern University Hospital, University of Bern, Bern, Switzerland
  • 2Department of Anesthesiology and Pain Management, Sinai Health System, University of Toronto, Toronto, ON, Canada
  • 3ERC Research NET, Niel, Belgium
  • 4Graduate School for Health Sciences (GHS), University of Bern, Bern, Switzerland
  • 5Department for Assessment and Evaluation, Institute for Medical Education, University of Bern, Bern, Switzerland
  • 6EMS Rescue Service of the Canton Basel-Stadt, Basel, Switzerland
  • 7Department of Intensive Care Medicine, Laurentius Hospital, Roermond, Netherlands
  • 8Department of Anesthesia, Kantonsspital Aarau, Aarau, Switzerland
  • 9School of Medicine, Sigmund Freud University Vienna, Vienna, Austria

Aim: Human factors are essential for high-quality resuscitation team collaboration and are, therefore, taught in international advanced life support courses, but their assessment differs widely. In Europe, the summative life support course assessment tests mainly adhere to guidelines but few human factors. This randomized controlled simulation trial investigated instructors’ and course participants’ perceptions of human factors assessment after two different summative assessments.

Methods: All 5th/6th-year medical students who attended 19 advanced life support courses according to the 2015 European Resuscitation Council guidelines during one study year were invited to participate. Each course was randomized to either: (1) Simulated team assessment (one instructor simulates a team, and the assessed person leads this “team” through a cardiac-arrest scenario test); (2) Real team assessment (4 students form a team, one of them is assessed as the team leader; team members are not assessed and act only on team leader’s commands). After the summative assessments, instructors, and students rated the tests’ ability to assess human factors using a visual analog scale (VAS, 0 = no agreement, 10 = total agreement).

Results: A total of 227 students participated in the 1-day Immediate Life Support courses, 196 students in the 2-day Advanced Life Support courses, additionally 54 instructors were included. Instructors judged all human factors significantly better in real team assessments; students rated leadership and situational awareness comparable between both assessments. Assessment pass rates were comparable between groups.

Conclusion: Summative assessment in real teams was perceived significantly better to assess human factors. These results might influence current summative assessment practices in advanced life support courses.

Introduction

The incidence of cardiac arrests ranges between one and five cardiac arrests per 1,000 hospital admissions (1), and 67–170 per 1,000,000 citizens (2). Cardiopulmonary resuscitation (CPR) is a key skill that all health care professionals should master in order to improve patient outcomes after cardiac arrests. Especially faster and more efficient in-hospital cardiopulmonary resuscitation and early defibrillation can improve patient outcomes significantly (13).

All health care professionals should be proficient in basic life support measures (4, 5) and should be regularly trained in small groups with a maximum instructor to participant ratio of 1:6 (6). Health care professionals who regularly treat cardiac arrests need to participate in Advanced Life Support (ALS) courses to improve their patients’ outcomes (7, 8). Those health care professionals who are infrequently involved in cardiac arrest management should at least participate in Immediate Life Support (ILS) courses (4, 9).

During a cardiac arrest, physicians usually assume the role of the team leader and need to be proficient in guiding an interdisciplinary resuscitation team through the management of a cardiac arrest. The 2015 and 2021 Guidelines of the European Resuscitation Council (ERC) emphasize that team membership and leadership training are essential (5, 911).

Prerequisites for proper team performance were identified earlier, and include: team leadership, task management, teamwork, situational awareness, decision-making, adaptability, event and mission analysis, and communication (12, 13). ERC ALS courses include training of technical skills, adherence to current resuscitation guidelines, and training of human factors focusing on team membership and leadership, task management, communication, and situational awareness (14).

Different approaches to assessing human factors in different fields were described (e.g., the ANTS framework, the Oxford NOTECHS, the Mayo High performance teamwork scale, the adapted LOSA checklist from aviation, the Queen’s Simulation Assessment Tool, etc.) (12, 1518). The paradigm shift to also include human factor training in cardiopulmonary resuscitation courses took place over the last years, however, the practical end-of-course summative assessment has remained largely unchanged and tests predominantly the participants’ ability to adhere to current resuscitation guidelines. Currently, the ERC uses simulated team assessments of one candidate during the summative practical end-of-course assessment. One instructor simulates a team, the assessed person leads this “team” through a cardiac arrest scenario test. Other organizations like the American Heart Association use real team assessments, where a group of participants forms a team. One of them is then assessed as the team leader; the team members are usually not assessed and act only on the commands of the team leader. There is currently no evidence available as to what extent different assessment methods can test human factors.

Therefore, the aim of this study was to investigate which variant of these two different summative end-of-course assessment methods is perceived as being superior in their ability to assess human factors, as judged by instructors and students. This is an evaluation of the opinions of course participants and instructors, the null hypothesis was that there is no difference between leadership skills comparing both assessment methods. The results of this study might influence the development of a different assessment approach in such cardiopulmonary resuscitation courses.

Materials and Methods

Participants and Ethics

After reviewing the protocol, the Cantonal Ethics Committee of Bern, Switzerland (Req-2017-00579, 07.08.2017) judged the study as non-human research according to the Swiss Human Research Act. After registration at clinicaltrials.gov (NCT 03381443), this randomized controlled simulation trial was performed at the University of Bern, Switzerland between December 2017 and March 2019.

All 5th-year medical students in the study year 2017/2018 took the mandatory 8-h ILS course; all 6th-year medical students the 16-h ALS course. These courses followed the 2015 ERC course structure and students earned an internationally valid certification (9). All course instructors were ERC certified ILS/ALS instructors. With written informed consent from all participants and instructors, all assessments were video recorded. Course participants participated only once, whereas most instructors participated more than once.

Procedures

The advanced life support courses ended with a mandatory summative assessment that used four different, validated ERC cardiac arrest scenario tests (19). All courses were randomized to one of two different assessment methods:

1. Simulated team assessment: One instructor mimes a whole team, and the assessed course participant acts as team leader, leading this “team” through a cardiac arrest scenario test. This is the current standard ERC ILS/ALS course assessment.

2. Real team assessment: Four course participants are together in the assessment room and form a team. However, only the predefined team leader is assessed, all other team members act as resuscitation team, but they are not allowed to help the team leader with medical decisions and act only on commands of the assessed team leader. This corresponds to the American Heart Association Advanced Cardiac Life Support course assessment.

Randomization

All participants were scheduled for their respective courses by the University of Bern, the study team had no influence on which participant attended which course. Due to the study design, each course was randomized, not the individual participant. Randomization was performed using the online software “Research Randomizer1.”

Data Analysis

Participants provided general characteristics including age, gender, primary language, experience as an instructor or real-life CPR experience, number of courses taught, and registration as Bern First Responder.

After the assessment, all course participants answered a questionnaire on their opinion to what extent the assessment was able to assess human factors such as team leadership, team membership, communication skills, team management skills, and situational awareness. They rated their self-assessed level of competence as a team member and team leader and judged their need for further training as a team member or team leader. In addition, they were asked to judge the assessment’s ability to test medical resuscitation knowledge and technical CPR-skills. All measurements used a visual analog scale (VAS) ranging from 0 to 10, where 0 meant no agreement and 10 meant total agreement. Participation in the study was voluntary and had no effect on the medical students’ grading at the university (20). All participating ILS/ALS instructors were also asked to fill out the same questionnaire, once after each assessment day, not after each individual assessment. The primary outcome parameter is the difference in team leadership assessment in participants’ and instructors’ opinions.

After 1 year, participants of the former ILS-course were asked to fill out a follow-up questionnaire before they took their 6th-year ALS-course. Participants of the original ALS-course could not take part in the follow-up, because they had already graduated from university and were not accessible to the study team.

For pass or fail ratings of the assessments, the official ERC course-grading scheme on the official ERC ALS scenario test assessment forms was used. Participants are judged for each parameter on a scale from 1 to 4 (1 = outstanding, 2 = adequate, 3 = marginal, 4 = insufficient).

Statistics

No formal sample size calculation was performed as we did not find any literature to base such a calculation on. All students of the entire study year taking these advanced life support courses were included.

Statistical analysis was performed using the software STATA version 16.0 (StataCorp LT, TX, United States). Descriptive statistics analyzed participants’ characteristics by using either a t-test or Chi-square test as applicable. Questionnaire results were non-parametric and therefore Mann–Whitney-U test was used to evaluate them. Assessment sub-items were evaluated using Chi-square tests. Data are presented as value (percentage) or mean ± SD (95% CI)—we opted to visualize our data with mean ± SD to allow for better comparability as the data was not that skewed compared to the median (interquartile range). We considered a two-sided p-value < 0.05 as statistically significant.

Results

A total of 427 medical students participated in the study (in 19 courses), and one declined participation. Figure 1 shows the Consort Flow Diagram. Four students had to be excluded from the analysis because they withdrew their consent to publication after participating in the advanced life support course and assessment. In the 1-day ILS-course, 111 students were randomized to the simulated team assessment, and 116 to the real team assessment (5 courses each). In the 2-day ALS-course, 106 students to the simulated team assessment (5 courses), and 90 to the real team assessment (4 courses). The 1-year follow-up reached 172 students, 78 from the simulated team assessment and 94 from the real team assessment.

FIGURE 1
www.frontiersin.org

Figure 1. Consort flow diagram.

A total of 54 instructors participated in the study; they were aged 39 ± 8 years; 17 (31%) were women; the primary language reported was: 51 German (94%), 2 French (4%), and 1 (2%) other; mean experience as the instructor was 4 ± 4 years; courses taught before participating in the study: 3 ± 2; 17 (31%) were registered Bern First Responders. Most instructors participated more than once.

Participating instructors judged the real team assessment overall significantly better than the simulated team assessment (p = 0.029, Table 1). All human factors were judged significantly better in the real team assessment (p < 0.01 to 0.024), and so was the ability to test CPR skills (p < 0.01). In contrast, knowledge could be tested equally well with both assessment methods (p = 0.842, Table 1).

TABLE 1
www.frontiersin.org

Table 1. Usefulness of the assessment method to assess human factors as perceived by the instructor.

Table 2 shows details of the participating students’ characteristics. Of note, even though courses were randomized, we found in the 2-day ALS course cohort in the real team assessment group significantly more women (67% vs. 38% in the simulated team assessment group, p < 0.01). Also regardless of randomization, more registered Bern First Responders were found in the 2-day ALS course assessed with the simulated team assessment method (15% vs. 2% for team assessment, p < 0.01).

TABLE 2
www.frontiersin.org

Table 2. Course participants’ characteristics.

After 1 year, in the ILS cohort, 22 students reported having resuscitated a patient in real life after passing the last year’s ILS-course (15 in the simulated team assessment group, 7 in the real team assessment group). Additional 11 students were recruited as Bern First Responders (4 in the simulated team assessment group and 7 in the real team assessment group).

Details of the students’ subjective ratings of their assessments are displayed in Table 3. Self-assessed competence as a team member was judged significantly better for the real team assessment (ILS-course p = 0.032; ALS-course p < 0.01). Real team assessment was judged consistently significantly better in the ability to assess team membership, communication skills, team management skills, and CPR skills (all p < 0.01). Situational awareness was judged only in the ILS-course cohort in favor of real team assessments (p = 0.023, Table 3).

TABLE 3
www.frontiersin.org

Table 3. Course participants self-evaluation and usefulness of the assessment method to assess human factors as perceived by the course participants.

In the 1-year follow-up, both the self-assessed competence as a team member and team leader were comparable (p = 0.194 and 0.372). The team member and team leader competences dropped for both assessment methods (all p < 0.01). All students agreed at the time of the follow-up that further training is necessary for team members and leaders (all p > 0.05).

Table 4 shows the detailed results of the assessments. ILS course participants had a first attempt cardiac-arrest simulation-test passing rate of 80–84%; whereas ALS course participants in 92-95%. The detailed results are comparable between both course types and assessments, but some items scored differently (Table 4).

TABLE 4
www.frontiersin.org

Table 4. Objective results from the official European Resuscitation Council cardiac arrest scenario teaching forms as judged by the instructors.

Discussion

Instructors of advanced life support courses judge the real team assessment overall significantly better and rate its ability to test all human factors and CPR-skills better compared to the simulated team assessment. Participating students agree that team membership and management, communication, and CPR skills were better assessed by the real team assessment. However, students rated the assessments as comparable in the following categories: the assessment in general, team leadership, and knowledge. Situational awareness was only rated better in the 1-day ILS course, whereas judged as comparable in the 2-day ALS course.

Our course participants self-assessed their competence as team members higher than as team leaders, regardless of the assessment method used. They also agreed that further training as a team leader is more important than team membership training. These findings are consistent with findings from other researchers (21, 22).

The importance of training human factors in cardiopulmonary resuscitation courses is well established (2325). Resuscitation teams who applied human factors efficiently also performed better in technical resuscitation skills (26). If a team leader performs hands-on procedures, the whole team is less effective (27). Prior participation in an advanced life support course improved the team leader’s ability to stay hands off (27). Nowadays, all courses include team leadership training, even though there is very little evidence that such specific leadership training during those courses leads to improved patient outcome (10). However, training in resuscitation skills, in general, was able to improve patient outcome (7).

It was unclear if current end-of-course summative assessments can test these human factor competences adequately. Therefore, the current study asked participants and instructors to judge subjectively two different assessment methods, the simulated team assessment, and the real team assessment. Participants found that both assessments are equally effective to test their team leadership skills. However, the included instructors who have experience with multiple course participants have a different opinions. The instructors clearly judge the real team assessment as superior in its ability to test team leadership skills. Training leadership skills prior to being involved in a real cardiac arrest is important (28, 29). Unfortunately, our data shows only the opinions of course participants and instructors. Further research is necessary to objectively assess the competences for such team leadership factors, and if one assessment approach is suitable to assess these competences in different advanced life support formats (e.g., for neonatal, pediatric, or adult resuscitation).

Participants of a qualitative analysis of human factors identified teamwork issues as most challenging during pediatric cardiac arrests (21). Our participants rated team membership competences consistently lower than team leadership competences. The real team assessment was judged to be better suitable to test team membership compared to the simulated team assessment. The lower scores for team membership compared to the other aspects of this study introduces the question if there is a need to adjust the current assessment method to allow better assessment of team membership competences. Regardless of the assessment method used, team members are not allowed to act as “real team members” during an assessment, they only act on team leaders’ commands. Assessment of team member competences is therefore not possible. In contrast, during cardiopulmonary resuscitation courses, team membership skills are trained, and course participants are encouraged to act as they would in real life and support their team leader with all their knowledge and skills.

Communication during a cardiac arrest needs to be clear, concise, brief, empathetic, and trigger a feedback loop. It needs to be targeted directly at a person and closing the loop is advisable (30, 31). ERC cardiopulmonary resuscitation courses emphasize proper communication and specifically focus on hindering factors for speaking up, which is key for success in cardiac arrest situations (29, 30). Research showed that simple and short ongoing educational interventions on leadership principles can improve team leadership and communication competences significantly (24, 32, 33). Our results show that such communication competences can be better assessed with the real team assessment compared to the simulated team assessment.

Shared situational awareness enables better teamwork (30). Both assessment methods were rated comparably by our ALS course participants. However, ILS course participants and instructors think situational awareness can be better assessed by real team assessments. The inconsistency in these findings suggests that situational awareness might depend more on the assessment setting itself, than on the assessment method.

Interestingly, over the 1 year between the initial study and the follow-up, 11 medical students (participants of the 1-day ILS course) were successfully recruited as Bern First Responders, some of them during the ILS courses (34) (A First Responder is a trained layperson or healthcare professional who is dispatched via an app to a medical emergency in addition to an ambulance). This should be considered a positive outcome given that health care professionals might get easily overwhelmed with the additional burden of being a First Responder (35).

This study has several limitations. It was a single-center study focusing on medical students as course participants in official European Resuscitation Council advanced life support courses. The University of Bern offers a large medical program with more than 340 medical students per study year. The medical students were randomly assigned by the University to their courses. There is a slight chance that medical students assessed together also worked together during course work or clinically as a team of students prior to their participation in the respective courses, therefore, we cannot exclude an effect of this on leadership and teamwork. Groups for the real team assessment were chosen randomly, and care was taken that students who had trained together during the course were not assessed together. Although there have been many study participants in this study, there are two cohorts of participants which limits the generalizability of the data, half of the study participants participated in a 1-day ILS course, and half in a 2-day ALS course. Randomization was performed for the whole course due to practical reasons and not for the individual course participant.

On the other hand, this study has several strengths as it was planned and executed as a large randomized controlled trial and each participant was only included once. Both the instructors’ and the participants’ perspectives are included.

In conclusion, instructors of advanced life support courses rated a summative course assessment in real teams significantly better regarding the ability to test team leadership, team membership, communication, team management, and situational awareness compared to simulated team assessments, which is the current European Resuscitation Council’s standard end-of-course assessment. Course participants rated team leadership and partly situational awareness as comparable between both assessment methods. These results might influence current summative assessment practices in advanced life support courses.

Data Availability Statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author with a dedicated research question and local ethics committee approval.

Ethics Statement

The studies involving human participants were reviewed and approved by Cantonal Ethics Committee of Bern, Switzerland. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SN had the idea of the study, performed data acquisition, data evaluation, first manuscript, and approved final manuscript. SH and LT contributed to data evaluation, significant contribution to manuscript, and approved final manuscript. CS and AH contributed to data acquisition, significant contribution to manuscript, and approved final manuscript. RG performed data acquisition, data evaluation, significant contribution to manuscript, and approved final manuscript. All authors contributed to the article and approved the submitted version.

Funding

This project was funded by an institutional research grant awarded to SN by the Department of Anesthesiology and Pain Medicine, Bern University Hospital, Inselspital, University of Bern, Bern, Switzerland. Open access funding was provided by the University of Bern.

Conflict of Interest

SN was a European Resuscitation Council—Instructor Educator Support Science and Education Committee (SEC-IES) member, and the current education representative of the young ERC group of the European Resuscitation Council. SN was also a Canadian Anesthesiologists’ Society (CAS) CEPD (Continuing Education and Professional Development) Committee member. RG was the European Resuscitation Council’s Board Director of Guidelines and ILCOR and Chair of the ILCOR Task Force on Education, Implementation, and Team. SN, CS, AH, and RG were currently Life Support instructors with the European Resuscitation Council.

The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

We would like to thank Fabian Schneeberg, Florian Ueltschi, Bettina Eberle (all doctoral thesis students, University of Bern), and Lisa Lüthi, Raffaela Flury, Ayla Frischknecht, Nadine Mathieu, Marius Bigler, Irina Zürrer, Jeremy Glasner, Julia Rosser, Fabian Lütolf, Barbara Keller, and Nino Räschle for their support in the performance of the study (video recording team). We would also like to thank Ferdinand Habermann and Thilo Schweizer (both doctoral thesis students at the University of Bern) for their assistance in data control and evaluation. Furthermore, we would also like to thank all advanced life support instructors of the Bern Simulation- and CPR-Center at the Bern University Hospital who performed the courses as well as the assessments. Finally, and most importantly, we thank all medical students at the University of Bern who agreed to participate in this study.

Footnotes

  1. ^ https://www.randomizer.org

References

1. Sandroni C, Nolan J, Cavallaro F, Antonelli M. In-hospital cardiac arrest: incidence, prognosis and possible measures to improve survival. Intensive Care Med. (2007) 33:237–45. doi: 10.1007/s00134-006-0326-z

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Grasner JT, Herlitz J, Tjelmeland IBM, Wnent J, Masterson S, Lilja G, et al. European resuscitation council guidelines 2021: epidemiology of cardiac arrest in Europe. Resuscitation. (2021) 161:61–79. doi: 10.1016/j.resuscitation.2021.02.007

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Perkins GD, Graesner JT, Semeraro F, Olasveengen T, Soar J, Lott C, et al. European resuscitation council guidelines 2021: executive summary. Resuscitation. (2021) 161:1–60. doi: 10.1016/j.resuscitation.2021.02.003

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Smith GB, Welch J, DeVita MA, Hillman KM, Jones D. Education for cardiac arrest–treatment or prevention? Resuscitation. (2015) 92:59–62. doi: 10.1016/j.resuscitation.2015.04.018

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Greif R, Lockey A, Breckwoldt J, Carmona F, Conaghan P, Kuzovlev A, et al. European resuscitation council guidelines 2021: education for resuscitation. Resuscitation. (2021) 161:388–407. doi: 10.1016/j.resuscitation.2021.02.016

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Nabecker S, Huwendiek S, Theiler L, Huber M, Petrowski K, Greif R, et al. The effective group size for teaching cardiopulmonary resuscitation skills - A randomized controlled simulation trial. Resuscitation. (2021) 165:77–82.

Google Scholar

7. Lockey A, Lin Y, Cheng A. Impact of adult advanced cardiac life support course participation on patient outcomes-A systematic review and meta-analysis. Resuscitation. (2018) 129:48–54. doi: 10.1016/j.resuscitation.2018.05.034

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Greif R, Bhanji F, Bigham BL, Bray J, Breckwoldt J, Cheng A, et al. Education, implementation, and teams: 2020 international consensus on cardiopulmonary resuscitation and emergency cardiovascular care science with treatment recommendations. Resuscitation. (2020) 156:A188–239. doi: 10.1016/j.resuscitation.2020.09.014

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Greif R, Lockey AS, Conaghan P, Lippert A, De Vries W, Monsieurs KG, et al. European resuscitation council guidelines for resuscitation 2015: section 10. Education and implementation of resuscitation. Resuscitation. (2015) 95:288–301. doi: 10.1016/j.resuscitation.2015.07.032

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Kuzovlev A, Monsieurs KG, Gilfoyle E, Finn J, Greif R Education Implementation and Teams Task Force of the International Liaison Committee on Resuscitation. The effect of team and leadership training of advanced life support providers on patient outcomes: a systematic review. Resuscitation. (2021) 160:126–39. doi: 10.1016/j.resuscitation.2021.01.020

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Wyckoff MH, Singletary EM, Soar J, Olasveengen TM, Greif R, Liley HG, et al. 2021 International Consensus on Cardiopulmonary Resuscitation and Emergency Cardiovascular Care Science With Treatment Recommendations: summary From the Basic Life Support; Advanced Life Support; Neonatal Life Support; Education, Implementation, and Teams; First Aid Task Forces; and the COVID-19 Working Group. Resuscitation. (2021) 69:229–311. doi: 10.1016/j.resuscitation.2021.10.040

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Fletcher G, Flin R, McGeorge P, Glavin R, Maran N, Patey R. Anaesthetists’ non-technical skills (ANTS): evaluation of a behavioural marker system. Br J Anaesth. (2003) 90:580–8. doi: 10.1093/bja/aeg112

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Gerstle CR. Parallels in safety between aviation and healthcare. J Pediatr Surg. (2018) 53:875–8. doi: 10.1016/j.jpedsurg.2018.02.002

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Cooper S, Cant R, Porter J, Sellick K, Somers G, Kinsman L, et al. Rating medical emergency teamwork performance: development of the team emergency assessment measure (TEAM). Resuscitation. (2010) 81:446–52. doi: 10.1016/j.resuscitation.2009.11.027

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Mishra A, Catchpole K, McCulloch P. The Oxford NOTECHS System: reliability and validity of a tool for measuring teamwork behaviour in the operating theatre. Qual Saf Health Care. (2009) 18:104–8. doi: 10.1136/qshc.2007.024760

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Malec JF, Torsher LC, Dunn WF, Wiegmann DA, Arnold JJ, Brown DA, et al. The mayo high performance teamwork scale: reliability and validity for evaluating key crew resource management skills. Simul Healthc. (2007) 2:4–10. doi: 10.1097/SIH.0b013e31802b68ee

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Moorthy K, Munz Y, Adams S, Pandey V, Darzi A. A human factors analysis of technical and team skills among surgical trainees during procedural simulations in a simulated operating theatre. Ann Surg. (2005) 242:631–9. doi: 10.1097/01.sla.0000186298.79308.a8

CrossRef Full Text | Google Scholar

18. Dagnone JD, Hall AK, Sebok-Syer S, Klinger D, Woolfrey K, Davison C, et al. Competency-based simulation assessment of resuscitation skills in emergency medicine postgraduate trainees - a Canadian multi-centred study. Can Med Educ J. (2016) 7:e57–67.

PubMed Abstract | Google Scholar

19. Ringsted C, Lippert F, Hesselfeldt R, Rasmussen MB, Mogensen SS, Frost T, et al. Assessment of Advanced Life Support competence when combining different test methods–reliability and validity. Resuscitation. (2007) 75:153–60. doi: 10.1016/j.resuscitation.2007.03.003

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Boileau E, Patenaude J, St-Onge C. Twelve tips to avoid ethical pitfalls when recruiting students as subjects in medical education research. Med Teach. (2018) 40:20–5. doi: 10.1080/0142159X.2017.1357805

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Walsh O, Lydon S, O’Connor P. A mixed methods evaluation of paediatric trainee preparedness to manage cardiopulmonary arrests. Eur J Pediatr. (2017) 176:1653–62. doi: 10.1007/s00431-017-3017-6

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Manser T. Teamwork and patient safety in dynamic domains of healthcare: a review of the literature. Acta Anaesthesiol Scand. (2009) 53:143–51. doi: 10.1111/j.1399-6576.2008.01717.x

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Norris EM, Lockey AS. Human factors in resuscitation teaching. Resuscitation. (2012) 83:423–7. doi: 10.1016/j.resuscitation.2011.11.001

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Hunziker S, Johansson AC, Tschan F, Semmer NK, Rock L, Howell MD, et al. Teamwork and leadership in cardiopulmonary resuscitation. J Am Coll Cardiol. (2011) 57:2381–8. doi: 10.1016/j.jacc.2011.03.017

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Fernandez Castelao E, Boos M, Ringer C, Eich C, Russo SG. Effect of CRM team leader training on team performance and leadership behavior in simulated cardiac arrest scenarios: a prospective, randomized, controlled study. BMC Med Educ. (2015) 15:116. doi: 10.1186/s12909-015-0389-z

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Peltonen V, Peltonen LM, Salantera S, Hoppu S, Elomaa J, Pappila T, et al. An observational study of technical and non-technical skills in advanced life support in the clinical setting. Resuscitation. (2020) 153:162–8. doi: 10.1016/j.resuscitation.2020.06.010

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Cooper S, Wakelam A. Leadership of resuscitation teams: “Lighthouse Leadership’. Resuscitation. (1999) 42:27–45. doi: 10.1016/s0300-9572(99)00080-5

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Cant RP, Porter JE, Cooper SJ, Roberts K, Wilson I, Gartside C. Improving the non-technical skills of hospital medical emergency teams: the team emergency assessment measure (TEAM). Emerg Med Australas. (2016) 28:641–6. doi: 10.1111/1742-6723.12643

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Andersen PO, Jensen MK, Lippert A, Østergaard D. Identifying non-technical skills and barriers for improvement of teamwork in cardiac arrest teams. Resuscitation. (2010) 81:695–702. doi: 10.1016/j.resuscitation.2010.01.024

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Jones CPL, Fawker-Corbett J, Groom P, Morton B, Lister C, Mercer SJ. Human factors in preventing complications in anaesthesia: a systematic review. Anaesthesia. (2018) 73:12–24. doi: 10.1111/anae.14136

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Ulmer FF, Lutz AM, Muller F, Riva T, Bütikofer L, Greif R. Communication patterns during routine patient care in a pediatric intensive care unit: the behavioral impact of in situ simulation. J Patient Saf. (2021) 18:e573–9. doi: 10.1097/PTS.0000000000000872

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Lee SH, Khanuja HS, Blanding RJ, Sedgwick J, Pressimone K, Ficke JR, et al. Sustaining teamwork behaviors through reinforcement of TeamSTEPPS principles. J Patient Saf. (2017) 17:e582–6. doi: 10.1097/PTS.0000000000000414

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Hunziker S, Buhlmann C, Tschan F, Balestra G, Legeret C, Schumacher C, et al. Brief leadership instructions improve cardiopulmonary resuscitation in a high-fidelity simulation: a randomized controlled trial. Crit Care Med. (2010) 38:1086–91. doi: 10.1097/CCM.0b013e3181cf7383

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Marx D, Greif R, Egloff M, Balmer Y, Nabecker S. Recruiting medical students for a first responder project in the social age: direct contact still outperforms social media. Emerg Med Int. (2020) 2020:9438560. doi: 10.1155/2020/9438560

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Nabecker S, Theodorou M, Huwendiek S, Kasper N, Greif R. Out-of-hospital cardiac arrest: comparing organised groups to individual first responders: a qualitative focus group study. Eur J Anaesthesiol. (2021) 38:1096–104. doi: 10.1097/EJA.0000000000001335

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: education, CPR, life support, European Resuscitation Council (ERC), human factors

Citation: Nabecker S, Huwendiek S, Seidl C, Hana A, Theiler L and Greif R (2022) Assessment of Human Factors After Advanced Life Support Courses Comparing Simulated Team and Real Team Assessment: A Randomized Controlled Cohort Trial. Front. Cardiovasc. Med. 9:840114. doi: 10.3389/fcvm.2022.840114

Received: 20 December 2021; Accepted: 06 June 2022;
Published: 15 July 2022.

Edited by:

Lukasz Szarpak, Maria Skłodowska-Curie Medical Academy, Poland

Reviewed by:

Gerard Bury, University College Dublin, Ireland
Stephan Marsch, University Hospital of Basel, Switzerland

Copyright © 2022 Nabecker, Huwendiek, Seidl, Hana, Theiler and Greif. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sabine Nabecker, sabine.nabecker@sinaihealth.ca

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.