Paramedics' Newborn Life Support Knowledge and Skills Before and After a Targeted Simulation-Based Educational Intervention

Objective: Resuscitation of neonates after birth in the out-of-hospital setting is challenging. Thus, we aimed to assess paramedics' newborn life support knowledge and skills before and after targeted simulation-based training.

Methods: Voluntary paramedics were recruited from a single Red Cross division. During a 1-day simulation-based educational intervention, essential aspects of neonatal resuscitation were taught and practiced. Before and after simulation-based training, we assessed (1) knowledge of current European Resuscitation Council (ERC) guidelines using a 20-item-questionnaire and (2) the quality of simulated bag-valve-mask ventilation by measuring face mask leakage, using a respiratory function monitor (Standardized Measurement of Airway Resuscitation Training [SMART], GM Instruments Ltd., United Kingdom).

Results: Forty-one paramedics participated in the initial survey and 12 took part in the simulation-based educational intervention. There was a significant increase in the number of correctly answered questions: median 62.1% (IQR 37.5–77.4%) vs. 91.7% (IQR 83.3–100%; p = 0.001). A total of 1,332 inflations were analyzed. The incidence of substantial mask leakage >75% decreased significantly after training (15.8 vs. 6.1%; p < 0.001), while median mask leakage was similar (17.0% [IQR 0.0–55.0%] vs. 18.0% [IQR 6.0–34.0%]; p = 0.414).

Conclusions: Among paramedics, theoretical knowledge of current ERC guidelines was moderate in this study. Participation in a targeted simulation-based educational intervention was associated with a significant increase in theoretical knowledge. The initially high incidence of substantial mask leakage >75% was decreased after simulation-based training using respiratory function monitoring.

Introduction

Neonatal resuscitation requiring positive pressure ventilation is rarely needed in low-risk neonates, with the incidence being as low as 6.8% (1). A Norwegian register study found high perinatal mortality (1.14%) in the sub-group of unplanned out-of-hospital births (incidence 6.8 neonates/1,000 live births) (2). Out-of-hospital neonatal death was most frequently associated with perinatal conditions and sub-optimal postnatal care (3). In a state-based retrospective cohort study, planned out-of-hospital births were also associated with significantly higher perinatal mortality compared to planned in-hospital births (3.9 vs. 1.8 deaths per 1,000 deliveries, p = 0.003) (4).

Current European Resuscitation Council (ERC) guidelines recommend that “ideally, two trained professionals should be present at all home deliveries” (5). This recommendation does not only include midwives attending planned home deliveries, but also emergency medical services personnel and emergency physicians. Besides multiple unchangeable factors like the low incidence of out-of-hospital neonatal resuscitation, limited space in the home environment as well as suboptimal medical equipment and resuscitation devices, we recognize some factors including theoretical knowledge of ERC guidelines, high stress levels, and a lack of experience in basic ventilation skills that could be improved by targeted training.

Therefore, the aim of the present study was to assess (i) paramedics' theoretical knowledge of newborn life support, (ii) their practical ventilation skills, and (iii) the effect of targeted simulation-based training. We hypothesized that targeted simulation-based training using respiratory function monitoring would result in significant improvements both in cognitive knowledge and practical (ventilation) skills.

Materials and Methods

We performed a prospective observational study. Primary outcome was theoretical knowledge of current ERC guidelines (5); secondary outcomes were practical ventilation skills measured by face mask leakage [%] and incidence of substantial mask leakage, defined as >75% (6), during non-invasive bag-valve-mask ventilation of a neonatal manikin. Parameters were assessed before and after a 1-day simulation-based educational intervention.

Participants

Active paramedics from the Red Cross division in Nestelbach near Graz, Austria, were recruited for the study during an in-house training. Participation was voluntary without financial compensation.

Assessment of Knowledge

Theoretical knowledge was assessed using a self-composed questionnaire, consisting of a general part asking for demographic information and 20 single-choice questions (for a translated English version see Supplementary Material). Questions referred to all aspects of neonatal resuscitation with a particular focus on out-of-hospital care. Wording was directly taken from the ERC guidelines' official German translation (7). The questionnaire was pretested by two medical students and two physicians of the Medical University of Graz, Austria, for clarity of language and content.

Participating paramedics were presented with the questionnaire between February 24, 2017, and April 8, 2017. They were given a maximum of 30 minutes to answer it individually and under supervision. Cognitive aids were not allowed.

Assessment of Skills

Quality of bag-valve-mask ventilation was assessed using a respiratory function monitor for training purposes (Standardized Measurement of Airway Resuscitation Training [SMART], GM Instruments Ltd., United Kingdom). This consists of a control unit connected to a flow sensor (F10L screen pneumotachograph, GM Instruments Ltd., United Kingdom) and a term neonatal manikin with leak-free airway and an integrated neonatal test lung (Draeger, Drägerwerk AG & Co. KGaA, Germany). For each inflation, peak inspiratory pressure, air flow, tidal volume and face mask leakage are displayed on a connected personal computer.

For assessment of paramedics' ventilation proficiency, the manikin was placed in supine position on a table with an anti-slip mat. Each participant was asked to “ventilate the neonate for 90 s effectively.” For this, we provided participants with the 500-ml self-inflating ventilation bag (Laerdal Silicone Resuscitator pediatric model, Laerdal Medical, Norway) and the round face mask (Neonatal Face Mask size 1, Laerdal Medical, Norway) that are used at the studied Red Cross division. Neither a PEEP valve nor a manometer was attached to the ventilation bag, while the pop-off valve was activated. No external gas flow was connected to the ventilation bag.

During assessment, participants were neither able to see the computer screen nor received any kind of instruction or feedback. The computer screen was filmed using a digital camera on a tripod to record and later manually transfer data into a Microsoft Excel database, as the first series of the SMART system does not allow direct data storage and extraction. As paramedics underwent assessment on a random basis no identifying information was stored, ensuring confidentiality of data, and anonymity of participants.

Simulation-Based Training

Training took place on April 8th, 2017, in two seminar rooms at the Red Cross headquarter in Nestelbach near Graz and was executed by the corresponding author for a total duration of seven hours. It began with a 45-minute lecture on neonatal resuscitation according to current ERC guidelines (5). Then, the first group of six people participated in a practical technical skills training on “Initial assessment and airway management” (excluding ventilation training), while the second group underwent ventilation assessment in a separate room as described above. After 30 minutes, groups were switched.

After lunch, the whole group participated in a 60-minute bag-valve-mask ventilation training, during which direct visual feedback from the SMART system was used for deliberate simulator practice. During the subsequent 90-minute algorithm training, realistic out-of-hospital neonatal resuscitation scenarios were practiced in teams of three using a low-fidelity newborn manikin (Newborn Anne, Laerdal Medical, Norway). Finally, all participants were asked to answer the questionnaire again and underwent ventilation skills assessment in the same setting as before.

Statistical Analysis

All data, including demographic information (age, additional medical training, out-of-hospital experience), questionnaire results and face mask leakage, were saved without names using consecutive numbers and analyzed in pseudo-anonymized form. Data are presented as median (minimum/maximum or interquartile range [IQR]). Analyses were performed using IBM^®SPSS Statistics 22 (Wilcoxon-rank sum-/Chi square-test) with a significance level of p < 0.05.

Results

Forty-one out of 68 paramedics (60.3%) took part in the initial survey (median age 24 years [19–74]; m:w = 29:12). Of those, seven (17.1%) had been involved in an out-of-hospital birth. None had practical experience in neonatal resuscitation. Seven paramedics (17.1%) had additional medical education as midwife, nurse, nurse assistant or paramedic with advanced emergency competence, and one (2.4%) was a medical student at the time of assessment. In the initial assessment of knowledge prior to the intervention, a median of 62.1% (IQR 37.5–77.4) of the 20 single-choice questions were answered correctly.

Twelve of the participating 41 paramedics (29.3%) underwent the 1-day simulation-based training and answered the second questionnaire. Two paramedics (16.7%) had experienced an out-of-hospital birth and, again, none had been involved in neonatal resuscitation. One of the 12 paramedics (8.3%) had received training as a nurse assistant or midwife. In the second knowledge assessment, 91.7% (IQR 83.3–100.0) of questions were answered correctly (p < 0.001). Highest improvements occurred for questions related to oxygen saturation targets after birth, intervals of heart rate assessment and indication for emergency drugs (Table 1 and Supplementary Material).

TABLE 1

Table 1. Results of the questionnaire-based knowledge assessment (correct answers for each of the 20 questions) before and after the educational intervention.

For assessment of practical (ventilation) skills, we analyzed a total of 1,332 inflations (691 before and 641 after training, respectively). Each participant delivered a median of 55.5 (IQR 48.0–70.0) inflations before and 53 (IQR 48.0–59.0) after training. There was no difference in median face mask leakage when comparing pre- and post-training data: 17.0% (IQR 0.0–55.0%) before vs. 18.0% (IQR 6.0–34.0%) after training (p = 0.414; Figure 1). Nevertheless, there was a significant reduction in the incidence of substantial face mask leakage >75% after the educational intervention (median 15.8 vs. 6.1%; p < 0.001; Figure 1).

FIGURE 1

Figure 1. Median face mask leakage [%] before (pre) and after (post) simulation-based training (boxplots, left side; p = 0.414) and incidence [%] of substantial face mask leakage >75% (column chart, right side; p < 0.001) before (pre) and after (post) simulation-based training.

Discussion

Before training, theoretical knowledge of current ERC guidelines on neonatal resuscitation and transitional support (5) was only moderate in the studied cohort. One possible explanation for this finding may be the rareness of out-of-hospital neonatal resuscitation and the consequent focus on more common medical emergencies during paramedic training. Following targeted simulation-based training, there was a significant increase in the knowledge domain, which is common after simulation-based training (8–10).

The initial quality of simulated ventilation was relatively high, according to the surrogate parameter of median face mask leakage. This is in fact interesting, as none of the paramedics had practical experience in resuscitating neonates after birth. Despite that, participation in the 1-day simulation-based educational intervention including respiratory function monitoring resulted in a reduced incidence of substantial face mask leakage >75% and, thus, improved quality of bag-valve-mask ventilation. This is consistent with other study results (11), with even short training sessions of two minutes resulting in more effective ventilation (12, 13).

Face mask leakage during respiratory support of preterm neonates in the delivery room is a common challenge even for experienced healthcare providers (6, 14). Schmölzer et al. (6) observed a median of 10 (range: 3–117) consecutive inflations with substantial mask leakage >75% delivered to preterm neonates below 32 weeks of gestation in the delivery room, while Murthy et al. (14) found a median mask leakage of 54.5% in 30 preterm neonates with a median gestational age of 30 weeks. Large face mask leakage frequently results in low expiratory tidal volumes, potentially lowering the effectiveness of respiratory support (15). Furthermore, both peak inspiratory pressure and positive end-expiratory pressure are decreased with increasing mask leakage, especially when using a self-inflating bag as in our study (16).

Besides face mask leakage, respiratory parameters such as tidal volume and peak inspiratory pressure also have significant impact on patient outcome. It has been shown that high expiratory tidal volumes (> 6 ml/kg) during postnatal stabilization are associated with development of intraventricular hemorrhage in preterm neonates (17). Barotrauma due to excessive peak inspiratory pressures is one of the contributing factors for the development of chronic lung injury (18). The choice of the ventilation device also contributes to the quality of manual ventilation, as applied tidal volumes and peak inspiratory pressures are higher when using a self-inflating bag compared to a T-piece system (19, 20). Therefore, it would have been of great interest to not only measure face mask leakage in our study, but also delivered tidal volume and peak inspiratory pressure; unfortunately this was not feasible, as these parameters are measured and displayed graphically, but are neither shown numerically on the computer screen nor saved for later analysis in the first version of the SMART system.

By offering quantitative assessment and direct visual feedback, use of a respiratory function monitor can further aid simulation-based manikin training (21). Using respiratory function monitoring does not only lead to improved ventilation quality in the simulated setting (22, 23), but also in the actual healthcare environment (24). Hence, the use of respiratory function monitoring has been recommended for neonatal intensive care (25).

Several studies have shown that skills acquired through simulation-based training can be successfully translated from the simulation laboratory to “real” patient care (26, 27). Hence, it can be assumed that the improved quality of simulated ventilation in our study may lead to improvements in out-of-hospital neonatal resuscitation.

Strengths and Limitations

We systematically assessed paramedics' knowledge and skills before and after participation in a targeted simulation-based educational intervention consisting of theoretical instruction, part-task training using respiratory function monitoring, and algorithm training with simulated scenarios. This step-wise approach and utilization of proven instructional design features such as range of difficulty, repetitive practice, interactivity, multiple learning strategies, and feedback should allow for an effective learning experience (28). To our knowledge, this is the first study using the novel SMART system both for practice and formal assessment of ventilation skills.

There are some limitations associated with our study. Firstly, in this single center prospective observational study we only assessed paramedics of one Red Cross division, which may limit generalizability of our findings. Generalizability may be further limited by potential differences in neonatal resuscitation training for paramedics in different countries. Secondly, due to the small sample size, we were not able to investigate the potential impact of participants' additional medical training on study results. Thirdly, due to anonymization of questionnaires and practical skills assessments, we were not able to compare individual results before and after the educational intervention. On the other hand, given the comparable range of participants' age and the almost identical experience in out-of-hospital birth and actual neonatal resuscitation, it can be assumed that the group of 12 paramedics who took the educational intervention and who underwent additional testing was a fair representation of the whole group of 41 study participants. At last, we looked at short-term outcome and are, therefore, not able to elaborate on skills maintenance over time.

Conclusion

Initial newborn life support knowledge among studied paramedics was moderate, while face mask leakage during pre-training assessment was relatively low. We found significant improvements in theoretical knowledge and a decrease in substantial face mask leakage >75% after participation in a targeted simulation-based educational intervention with respiratory function monitoring.

Author Contributions

LM, JG, BU, and WR made substantial contributions to the conception of the work and interpreted data, revised the manuscript critically for important intellectual content, gave final approval of the version to be published, and agree to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. LM and JG delivered the educational intervention and acquired and analyzed data for the work. LM drafted the manuscript.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

The manuscript contains data of JG's diploma thesis, which was compiled and submitted at the Medical University of Graz, Austria. This is the only form in which the content has appeared, its publication is in line with the policy of the Medical University of Graz, and the diploma thesis can be accessed online (https://online.medunigraz.at).

The authors would like to thank Dr. Nicholas Morris for his support related to language and general presentation of the manuscript.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fped.2019.00132/full#supplementary-material

References

1. Aziz K, Chadwick M, Downton G, Baker M, Andrews W. The development and implementation of a multidisciplinary neonatal resuscitation team in a Canadian perinatal centre. Resuscitation. (2005) 66:45–51. doi: 10.1016/j.resuscitation.2004.12.017

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Gunnarsson B, Smárason AK, Skogvoll E, Fasting S. Characteristics and outcome of unplanned out-of-institution births in Norway from 1999 to 2013: a cross-sectional study. Acta Obstet Gynecol Scand. (2014) 93:1003–10. doi: 10.1111/aogs.12450

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Gunnarsson B, Fasting S, Skogvoll E, Smárason AK, Salvesen KÅ. Why babies die in unplanned out-of-institution births: an enquiry into perinatal deaths in Norway 1999-2013. Acta Obstet Gynecol Scand. (2017) 96:326–33. doi: 10.1111/aogs.13067

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Snowden JM, Tilden EL, Snyder J, Quigley B, Caughey AB, Cheng YW. Planned out-of-hospital birth and birth outcomes. N Engl J Med. (2015) 373:2642–53. doi: 10.1056/NEJMsa1501738

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Wyllie J, Bruinenberg J, Roehr CC, Rüdiger M, Trevisanuto D, Urlesberger B. European resuscitation council guidelines for resuscitation 2015: section 7. Resuscitation and support of transition of babies at birth. Resuscitation. (2015) 95:249–63. doi: 10.1016/j.resuscitation.2015.07.029

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Schmölzer GM, Dawson JA, Kamlin CO, O'Donnell CP, Morley CJ, Davis PG. Airway obstruction and gas leak during mask ventilation of preterm infants in the delivery room. Arch Dis Child Fetal Neonatal Ed. (2011) 96:F254–7. doi: 10.1136/adc.2010.191171

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Wyllie J, Bruinenberg J, Roehr CC, Rüdiger M, Trevisanuto D, Urlesberger B. Die versorgung und reanimation des neugeborenen: kapitel 7 der leitlinien zur reanimation 2015 des European Resuscitation Council. Notfall Rettungsmed. (2015) 18:964–83. doi: 10.1007/s10049-015-0090-0

CrossRef Full Text | Google Scholar

8. Mundell WC, Kennedy CC, Szostek JH, Cook DA. Simulation technology for resuscitation training: a systematic review and meta-analysis. Resuscitation. (2013) 84:1174–83. doi: 10.1016/j.resuscitation.2013.04.016

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Cheng A, Lang TR, Starr SR, Pusic M, Cook DA. Technology-enhanced simulation and pediatric education: a meta-analysis. Pediatrics. (2014) 133:e1313–23. doi: 10.1542/peds.2013-2139

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Mileder LP, Urlesberger B, Szyld EG, Roehr CC, Schmölzer GM. Simulation-based neonatal and infant resuscitation teaching: a systematic review of randomized controlled trials. Klin Padiatr. (2014) 226:259–67. doi: 10.1055/s-0034-1372621

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Schilleman K, Witlox RS, Lopriore E, Morley CJ, Walther FJ, te Pas AB. Leak and obstruction with mask ventilation during simulated neonatal resuscitation. Arch Dis Child Fetal Neonatal Ed. (2010) 95:F398–402. doi: 10.1136/adc.2009.182162

PubMed Abstract | CrossRef Full Text | Google Scholar

12. van Vonderen JJ, Witlox RS, Kraaij S, te Pas AB. Two-minute training for improving neonatal bag and mask ventilation. PLoS ONE. (2014) 9:e109049. doi: 10.1371/journal.pone.0109049

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Mazza A, Cavallin F, Cappellari A, Divisic A, Grbin I, Akakpo J, et al. Effect of a short training on neonatal face-mask ventilation performance in a low resource setting. PLoS ONE. (2017) 12:e0186731. doi: 10.1371/journal.pone.0186731

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Murthy V, Dattani N, Peacock JL, Fox GF, Campbell ME, Milner AD, et al. The first five inflations during resuscitation of prematurely born infants. Arch Dis Child Fetal Neonatal Ed. (2012) 97:F249–53. doi: 10.1136/archdischild-2011-300117

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Schilleman K, van der Pot CJ, Hooper SB, Lopriore E, Walther FJ, te Pas AB. Evaluating manual inflations and breathing during mask ventilation in preterm infants at birth. J Pediatr. (2013) 162:457–63. doi: 10.1016/j.jpeds.2012.09.036

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Hartung JC, te Pas AB, Fischer H, Schmalisch G, Roehr CC. Leak during manual neonatal ventilation and its effect on the delivered pressures and volumes: an in vitro study. Neonatology. (2012) 102:190–5. doi: 10.1159/000339325

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Pahuja A, Hunt K, Murthy V, Bhat P, Bhat R, Milner AD, et al. Relationship of resuscitation, respiratory function monitoring data and outcomes in preterm infants. Eur J Pediatr. (2018) 177:1617–24. doi: 10.1007/s00431-018-3222-y

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Hayes D Jr, Feola DJ, Murphy BS, Shook LA, Ballard HO. Pathogenesis of bronchopulmonary dysplasia. Respiration. (2010) 79:425–36. doi: 10.1159/000242497

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Roehr CC, Kelm M, Fischer HS, Bührer C, Schmalisch G, Proquitté H. Manual ventilation devices in neonatal resuscitation: tidal volume and positive pressure-provision. Resuscitation. (2010) 81:202–5. doi: 10.1016/j.resuscitation.2009.10.008

PubMed Abstract | CrossRef Full Text | Google Scholar

20. do Prado C, Guinsburg R, de Almeida MF, Mascaretti RS, Vale LA, Haddad LB, et al. Manual ventilation and sustained lung inflation in an experimental model: influence of equipment type and operator's training. PLoS ONE. (2016) 11:e0148475. doi: 10.1371/journal.pone.0148475

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Schmölzer GM, Roehr CC. Use of respiratory function monitors during simulated neonatal resuscitation. Klin Padiatr. (2011) 223:261–6. doi: 10.1055/s-0031-1275696

PubMed Abstract | CrossRef Full Text | Google Scholar

22. O'Currain E, Thio M, Dawson JA, Donath SM, Davis PG. Respiratory monitors to teach newborn facemask ventilation: a randomised trial. Arch Dis Child Fetal Neonatal Ed. (2019). doi: 10.1136/archdischild-2018-316118. [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Wood FE, Morley CJ, Dawson JA, Davis PG. A respiratory function monitor improves mask ventilation. Arch Dis Child Fetal Neonatal Ed. (2008) 93:F380–1. doi: 10.1136/adc.2007.120097

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Schmölzer GM, Morley CJ, Wong C, Dawson JA, Kamlin CO, Donath SM, et al. Respiratory function monitor guidance of mask ventilation in the delivery room: a feasibility study. J Pediatr. (2012) 160:377–81.e2. doi: 10.1016/j.jpeds.2011.09.017

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Abouzeid T, Perkins EJ, Pereira-Fantini PM, Rajapaksa A, Suka A, Tingay DG. Tidal volume delivery during the anesthetic management of neonates is variable. J Pediatr. (2017) 184:51–6.e3. doi: 10.1016/j.jpeds.2017.01.074

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Barsuk JH, McGaghie WC, Cohen ER, O'Leary KJ, Wayne DB. Simulation-based mastery learning reduces complications during central venous catheter insertion in a medical intensive care unit. Crit Care Med. (2009) 37:2697–701.

PubMed Abstract | Google Scholar

27. Zendejas B, Cook DA, Bingener J, Huebner M, Dunn WF, Sarr MG, et al. Simulation-based mastery learning improves patient outcomes in laparoscopic inguinal hernia repair: a randomized controlled trial. Ann Surg. (2011) 254:502–9; discussion 509–11. doi: 10.1097/SLA.0b013e31822c6994

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Cook DA, Hamstra SJ, Brydges R, Zendejas B, Szostek JH, Wang AT, et al. Comparative effectiveness of instructional design features insimulation-based education: systematic review and meta-analysis. Med Teach. (2013) 35:e867–98. doi: 10.3109/0142159X.2012.714886

PubMed Abstract | CrossRef Full Text | Google Scholar