Branden M. Engorn1*
Christopher J. L. Newth2
Margaret J. Klein3
Elizabeth A. Bragg2
Rebecca D. Margolis1
Patrick A. Ross2- 1Department of Anesthesiology Critical Care Medicine, Children's Hospital Los Angeles, Keck School of Medicine of University of Southern California, Los Angeles, CA, United States
- 2Departments of Anesthesiology Critical Care Medicine and Pediatrics, Children's Hospital Los Angeles, Keck School of Medicine of University of Southern California, Los Angeles, CA, United States
- 3Department of Anesthesiology Critical Care Medicine, Children's Hospital Los Angeles, Los Angeles, CA, United States
Background: Pediatric Critical Care Medicine Fellowship trainees need to acquire skills to perform procedures. Over the last several years there have been advances that allowed for less invasive forms of interventions.
Objective: Our hypothesis was that over the past decade the rate of procedures performed by Pediatric Critical Care Medicine Fellowship trainees decreased.
Methods: Retrospective review at a single institution, tertiary, academic, children's hospital of patients admitted from July 1, 2007–June 30, 2017 to the Pediatric Intensive Care Unit and Cardiothoracic Intensive Care Unit. A Poisson regression model with a scale adjustment for over-dispersion estimated by the square root of Pearson's Chi-Square/DOF was applied.
Results: There has been a statistically significant decrease in the average rate of central venous lines (p = 0.004; −5.72; 95% CI: −9.45, −1.82) and arterial lines (p = 0.02; −7.8; 95% CI: −13.90, −1.25) per Fellow per years in Fellowship over the last 10 years. There was no difference in the rate of intubations per Fellow per years in Fellowship (p = 0.27; 1.86; 95% CI:−1.38, 5.24).
Conclusions: There has been a statistically significant decrease in the rate of central venous lines and arterial lines performed by Pediatric Critical Care Medicine Fellowship trainees per number of years in Fellowship over the last 10 years. Educators need to be constantly reassessing the clinical landscape in an effort to make sure that trainees are receiving adequate educational experiences as this has the potential for an impact on the education of trainees and the safety of the patients that they care for.
Introduction
Pediatric Critical Care Medicine (PCCM) Fellowship trainees need to acquire the skills necessary to provide airway support and vascular access to critically ill patients. The Accreditation of Graduate Medical Education (ACGME) and American Board of Pediatrics (ABP) expect that over 3 years of training, PCCM Fellows become proficient in: arterial and central venous catheterization; endotracheal intubation; and thoracostomy tube placement (1). However, neither the ACGME nor the ABP states a required number of successfully completed procedures to demonstrate competence, but rather relies on the individual Fellowship training program to ensure proficiency. Many Residents are performing few procedures (2, 3) and therefore the subsequent years of Fellowship training are a finite period to obtain competence. Failure to complete a procedure is associated with increased risk of patient safety events (4–7). PCCM and similar medical specialties, such as Anesthesiology and Emergency Medicine, have determined a minimum number of procedures before an expected competency (success for completing a given procedure) for a given procedure would be obtained (8–11).
The purpose of this retrospective study was to review the rate of procedures being performed by PCCM Fellow trainees in a large, tertiary academic children's hospital. Our hypothesis was that over the past 10 years the rate of procedures performed by Fellowship trainees in the Pediatric Intensive Care Unit (PICU) and Cardiothoracic Intensive Care Unit (CTICU) decreased over time at a single, academic institution. Our primary outcome was the rate of procedures per Fellow per year in Fellowship and we broke down the procedures into intubations, central venous lines (CVL), and arterial lines. Secondary outcomes included the median number of intubations, CVL, and arterial lines per Fellow per year.
Materials and Methods
After receiving institutional review board approval (Children's Hospital Los Angeles CHLA-17-00318) we reviewed all cases admitted to the PICU and CTICU from July 1, 2007–June 30, 2017. Our PICU and CTICU maintain a clinical and research database in which patient information including procedures is inserted on a real-time basis by PCCM Fellows and Attendings. Manuscripts using this database have previously been published (12). From this database all children admitted were identified and their charts retrospectively reviewed. Data abstracted included the total number of admissions, percentage of admissions that were medical and surgical, intensive care unit (ICU) length of stay (LOS), and ICU length of mechanical ventilation (LMV). The number of procedures performed was calculated by a count of the number of procedure notes (intubation, CVL, and arterial lines) documented by each Fellow during each academic year. The procedure notes include procedures performed by the Fellow in the PICU, CTICU, Emergency Department, and Inpatient Ward. This count was then collated and summed to include a combined number of individual procedures from both the PICU and CTICU for each Fellow. Pediatric risk of mortality (PRISM III) scores were abstracted for each academic year from our local Virtual Pediatric System database. The Society of Thoracic Surgeons-European Association for Cardio-Thoracic Surgery (STAT) scores were abstracted from our local database. To determine the number of Fellows per year we compared the number of Fellows per year as documented on the ABP roster and compared it with the number of Fellows documenting procedures in a given academic year. We reconciled the total Fellow count to ensure inclusion of both ACMGE accredited PCCM Fellows and non-ACGME accredited CTICU Fellows (for which our institution has 0–2 per academic year). To create the Poisson Regression models each Fellow was assigned their final year as their academic year and the rate of each procedure was calculated by dividing the total number of a given procedure by the number of years in the program. We chose to standardize the procedures performed per Fellow per years to consider Fellows participating in the Fellowship for various number of years depending on factors including completion of a 3-year critical care medicine Fellowship, 1-year CTICU Fellowship, extending Fellowship for personal or professional reasons, terminating Fellowship early, and to include fellows on both extremes of the decade as they finish or start training.
Outcomes
Primary outcome was the rate of intubations, CVL, and arterial lines performed per Fellow per years in the Fellowship program. Secondary outcomes included the median number of intubations, CVL, and arterial lines per Fellow per year.
Statistical Analysis
Data are expressed as total counts, medians (interquartile range), and percentages. Poisson regression models using a scale adjustment estimated by the square root of Pearson's Chi-Square/DOF for over-dispersion were applied (13). We chose to analyze the data with a Poisson regression to account for the count like nature of the data being skewed to the right. Model estimates originally calculated on the log scale using Poisson regression were exponentiated and converted to a multiplicative percent change for interpretation. For each type of procedure, the outcome was the total number of procedures done during Fellowship per number of years in the Fellowship program, as predicated by the final academic year of the Fellowship. To determine if the rate of procedures were decreasing over time, the effect of time was assessed at a p < 0.05 significance level. All statistical analysis was performed with consultation of a biostatistician. Data analysis and output generated using SAS software version 9.4. (Copyright2002–2012 SAS Institute Inc., Cary, NC, USA).
Results
Baseline Characteristics
Baseline characteristics of the PICU, CTICU, and Fellowship program over the course of 10 years are shown in Table 1. The PICU and CTICU were similar in terms of PRISM score, percentage of patients per STAT category, LOS, and LMV. There was an increase in the percentage of medical patients in both the PICU and CTICU over the course of the decade. The Fellowship program grew in number of Fellows per year over time, but this growth was to follow the increase in clinical volume demonstrated by a similar number of admissions per Fellow over the 10-year study period. The years are listed as academic years (ex. 2017 is July 1, 2016–June 30, 2017).
Table 1. Characteristics of the Pediatric Intensive Care Unit, Cardiothoracic Intensive Care Unit, and Critical Care Medicine Fellowship Program.
Rate of Procedures
The Poisson regression model is demonstrated in Table 2. There has been a statistically significant decrease in the average rate of CVL (p = 0.004; −5.72; 95% CI: −9.45, −1.82) and arterial lines (p = 0.02; −7.8; 95% CI: −13.90, −1.25) performed per Fellow per years in the Fellowship program over the last 10 years. There was no difference in the rate of intubations per Fellow per years in Fellowship (p = 0.27; 1.86; 95% CI: −1.38, 5.24) over the last 10 years.
Table 2. Poisson Regression Model Estimates.
Intubations, CVL, and Arterial Lines Per Fellow Per Year
The median number of intubations, CVL, and arterial lines per Fellow per year are demonstrated in Table 3. Figures 1–3 graphically shows that median intubations were unchanged over the 10-year study period while both CVL and arterial lines decreased. Figure 2 demonstrates a temporal relationship with an increase in peripherally inserted central catheters (PICC) and decrease in Fellow CVL.
Table 3. Absolute count, median and interquartile range per Fellow per year, and Rate per admission of Intubations, Central Venous Lines, and Arterial Lines.
Figure 1. Median and interquartile range of intubations per Fellow per year and admissions per Fellow year over 10 years.
Figure 2. Median and interquartile range of central venous lines per Fellow per year, total nursing PICC lines per year, and admissions per Fellow year over 10 years.
Figure 3. Median and interquartile range of arterial lines per Fellow per year and admissions per Fellow year over 10 years.
Discussion
Our findings suggest that over the last 10 years at a tertiary, academic, children's hospital there has been a statistically significant decrease in the rate of procedures per Fellow per years in Fellowship for CVL and arterial lines but not for intubations.
Advances in Critical Care Medicine have allowed for less invasive forms of procedures. For example, non-invasive ventilation has been shown to decrease the need for endotracheal intubation (14, 15). PICC lines may be decreasing the numbers of CVL being placed in the PICU (16, 17). Intraosseous lines may substitute for CVL for emergent fluid resuscitation (18). Vasoactive agents can be safely administered for short periods of time through a peripheral intravenous line (19) and recent guidelines endorse early vasoactive agents through a peripheral intravenous or intraosseous line in pediatric and neonatal shock (20). Finally, pulse oximetry is likely accurate enough to replace arterial lines for ventilator management in acute respiratory failure through use of the pulse oximetric saturation Spo2/Fio2 (SF) ratio (21–23).
Our data did not demonstrate a decrease in rates of intubation. In medical specialties that perform similar procedures to PCCM, such as Anesthesiology and Emergency Medicine, authors have described the number of intubations required to achieve competence and a mean of 44–74 tracheal intubations achieved 80–90% competency within one-two attempts (8–10). During PCCM Fellowship training a median of 26 tracheal intubations outside of the operating room were needed to achieve 90% competency within four attempts (11). However, in allowing for up to four attempts there are likely an increased patient safety events in pediatric patients (4, 7). Finally, while we saw no decline in intubations performed over the past decade the number performed is still less than was experienced in our institution in the past. In review of our Fellow's procedure logs from 1994 the average number of admissions per fellow was 108 and number of intubations was 44 intubations per Fellow per year (i.e., triple the current rate). However, we recognize this occurred in a time period with different work hours and presentation of pediatric diseases.
Our CVL data showed a decreasing rate over time. At our institution, there has been a dedicated PICC nursing team since 2012. Figure 2 demonstrates that with the increase in nursing placed PICC lines there has been a temporal relationship with a decrease in Fellow CVL. We suspect there has been a similar culture shift in other children's hospitals. Furthermore, culture at our institution has allowed for short intervals of vasoactive infusions through a peripheral intravenous line which we believe is consistent with standard practice allowing for less reliance on CVL. In the literature there is little information on number of CVL insertions needed to demonstrate competency.
Arterial lines also showed a statistically significant decrease over time. We hypothesize this is due to increasing reliance on SpO2 compared to PaO2 in acute respiratory failure (21–23) and the ubiquitous presence of non-invasive blood pressure measurements. One study demonstrated a mean of 60 arterial line insertions to achieve 84% competency third attempt success rate for first year Anesthesiology Residents (9). As the pediatric patient population has much smaller vessels it is difficult to extrapolate this number to our population.
We believe our study has implications for our PCCM trainees. It is imperative for educators to be constantly reassessing the clinical landscape in an effort to make sure that trainees are receiving adequate educational experiences. PCCM is a growing field with a recent substantial increase in positions and applicants (24). As multiple studies have shown that there is a minimum number performed procedures required prior to obtaining competency, we need to decide if Fellowship trainees are receiving enough experience. Furthermore, if the number of procedures being performed by Fellowship trainees is decreasing, such a decrease could impair the ability of academic PCCM Attendings to maintain their procedural skills.
Our study has several limitations. First, this was a single-institution fellowship program, retrospectively performed study relying on electronic database entry which may have introduced errors and bias. Although, there was no significant change in the number of weeks Fellows spent on service nor the number of admissions per Fellow per year over the decade. Furthermore, while practice at one institution may or may not reflect changes on a national scale we believe the procedures being studied follow our hypothesis with regards to the changing national culture of PCCM described in the literature. During the 10-year period most of the Fellows completed a 3-year Fellowship; however, some left Fellowship early, others extended Fellowship for personal reasons, some stayed for a 4th year as a Cardiac Critical Care Fellow. To control for this, we used number of procedures per Fellow per year. Finally, we did not design the study to look directly at competence or number of attempts in completing the procedure as previously studied. Therefore, while it is possible that although there is a decreasing number of procedures per Fellow per year, the individual Fellow may still be performing enough to obtain competence. Unfortunately, our internal database does not record whether ultrasound was used for CVL or indirect laryngoscopy for intubations. Both of these technologies may alter the number of procedures to demonstrate competence and would be important to study.
We believe that this study has implications for future areas of investigation. We would hope that our findings could be corroborated at other institutions or in other databases. As a group we need to study how best to evaluate and improve competency in procedures. Possibilities include the use of additional operating room experience in the later years of Fellowship or the use of simulation to provide the needed skills. Simulation may be a key area to address the deficiency in number of procedures. Multiple studies have shown that simulation can effectively teach procedural skills (25–27). With regards to PCCM Fellowship trainees, Nishisaki et al. described an innovative “bootcamp” which showed that simulation can be used in Fellowship trainees to improve vascular access skills (28). Fleming et al. used compliance with a checklist as an assessment tool to evaluate PCCM Fellows in a simulated CVL placement which has given promise to help evaluate trainees (29).
Conclusions
There has been a statistically significant decrease in the rate of central venous lines and arterial lines performed by PCCM Fellowship trainees per number of years in Fellowship over the last 10 years at a single institution, tertiary, academic, children's hospital. Since the literature describes a number of procedures which allow the learner to obtain competence if the current trend continues the decreasing number of procedures could lead to decreased competence in both Fellows and Attendings in PCCM. This observation has the potential for a significant impact on the education of our trainees and the safety of the patients that they care for.
Data Availability Statement
The raw data supporting the conclusions of this manuscript will be made available by the authors, without undue reservation, to any qualified researcher.
Author Contributions
BE, CN, PR conceptualized and designed the study. BE, CN, MK, PR organized the database. MK performed the statistical analysis. BE, CN, MK, EB, RM, PR analyzed and interpreted the data. BE wrote the first draft of the manuscript. BE, CN, MK, EB, RM, PR drafted and revised the manuscript, are responsible for the reported research, and have approved the manuscript as submitted.
Funding
BE receives financial support from Phillips. CN receives financial support from Phillips and Covidien.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The abstract was presented as a podium presentation at the 25th Pediatric Critical Care Colloquium. The abstract will be published in a supplement in Pediatric Critical Care Medicine.
Abbreviations
ABP, American Board of Pediatrics; ACGME, Accreditation of Graduate Medical Education; CTICU, Cardiothoracic Intensive Care Unit; CVL, Central Venous Line; ICU, Intensive Care Unit; LMV, Length of Mechanical Ventilation; LOS, Length of Stay; PICU, Pediatric Intensive Care Unit; PCCM, Pediatric Critical Care Medicine; PRISM III, Pediatric risk of mortality; STAT, Society of Thoracic Surgeons-European Association for Cardio-Thoracic Surgery Scores; UN, Unknown.
References
1. ACGME Program Requirements for Graduate Medical Education in Pediatric Critical Care Medicine (2013). Available online at: https://www.acgme.org/Portals/0/PFAssets/ProgramRequirements/323_pediatric_critical_care_medicine_2017-07-01.pdf?ver=2017-06-30-083428-177 (Accessed 20 July, 2018).
2. DeMeo SD, Katakam L, Goldberg RN, Tanaka D. Predicting neonatal intubation competency in trainees. Pediatrics (2015) 135:e1229–36. doi: 10.1542/peds.2014-3700
3. Gabrani A, Kojima T, Sanders RC, Shenoi A, Montgomery V, Parsons SJ, et al. Downward trend in pediatric resident layngoscopy participation in PICUs. Pediatr Crit Care Med. (2018) 19:e242–50. doi: 10.1097/PCC.0000000000001470
4. Stinson HR, Srinivasan V, Topjian AA, Sutton RM, Nadkarni VM, Berg RA, et al. Failure of invasive airway placement on the first attempt is associated with progression to cardiac arrest in pediatric acute respiratory compromise. Pediatr Crit Care Med. (2018) 19:9–16. doi: 10.1097/PCC.0000000000001370
5. Marraro GA, Zoja R, Delsordo S. Failure of invasive airway placement and correlated severe complications: dealing with inappropriate training and related medico-legal issues. Pediatr Crit Care Med. (2018) 19:7–9. doi: 10.1097/PCC.0000000000001379
6. Kerrey BT, Rinderknecht AS, Geis GL, Nigrovic LE, Mittiga MR. Rapid sequence intubation for pediatric emergency patients: higher frequency of failed attempts and adverse effects found by video review. Ann Emerg Med. (2012) 60:251–9. doi: 10.1016/j.annemergmed.2012.02.013
7. Lee JH, Turner DA, Kamat P, Nett S, Shults J, Nadkarni VM, et al. The number of tracheal intubation attempts matters! A prospective multi-institutional pediatric observational study. BMC Pediatr. (2016) 16:58. doi: 10.1186/s12887-016-0593-y
8. de Oliveira Filho GR. The construction of learning curves for basic skills in anesthetic procedures: an application for the cumulative sum method. Anesth Analg. (2002) 95:411–6. doi: 10.1097/00000539-200208000-00033
9. Konrad C, Schupfer G, Wietlisbach M, Gerber H. Learning manual skills in anesthesiology: is there a recommended number of cases for anesthetic procedures? Anesth Analg. (1998) 86:635–9.
10. Je S, Cho Y, Choi HJ, Kang B, Kim T, Kang H. An application of the learning curve-cumulative summation test to evaluate training for endotracheal intubation in emergency medicine. Emerg Med J. (2015) 32:291–4. doi: 10.1136/emermed-2013-202470
11. Ishizuka M, Rangarajan V, Sawyer TL, Napolitano N, Boyer DL, Morrison WE, et al. The development of tracheal intubation proficiency outside the operating suite during pediatric critical care medicine fellowship training: a retrospective cohort study using cumulative sum analysis. Pediatr Crit Care Med. (2016) 17:e309–16. doi: 10.1097/PCC.0000000000000774
12. Khemani RG, Bart RD, Alonzo TA, Hatzakis G, Hallam D, Newth CJ. Disseminated intravascular coagulation score is associated with mortality for children with shock. Intensive Care Med. (2009) 35:327–33. doi: 10.1007/s00134-008-1280-8
14. Peter JV, Moran JL, Phillips-Hughes J, Warn D. Noninvasive ventilation in acute respiratory failure–a meta-analysis update. Crit Care Med. (2002) 30:555–62.
15. Schibler A, Pham TM, Dunster KR, Foster K, Barlow A, Gibbons K, et al. Reduced intubation rates for infants after introduction of high-flow nasal prong oxygen delivery. Intensive Care Med. (2011) 37:847–52. doi: 10.1007/s00134-011-2177-5
16. Westergaard B, Classen V, Walther-Larsen S. Peripherally inserted central catheters in infants and children - indications, techniques, complications and clinical recommendations. Acta Anaesthesiol Scand. (2013) 57:278–87. doi: 10.1111/aas.12024
17. Cotogni P, Pittiruti M. Focus on peripherally inserted central catheters in critically ill patients. World J Crit Care Med. (2014) 3:80–94. doi: 10.5492/wjccm.v3.i4.80
18. Haas NA. Clinical review: vascular access for fluid infusion in children. Crit Care (2004) 8:478–84. doi: 10.1186/cc2880
19. Patregnani JT, Sochet AA, Klugman D. Short-term peripheral vasoactive infusions in pediatrics: where is the harm? Pediatr Crit Care Med. (2017) 18:e378–81. doi: 10.1097/PCC.0000000000001230
20. Davis AL, Carcillo JA, Aneja RK, Deymann AJ, Lin JC, Nguyen TC, et al. American college of critical care medicine clinical practice parameters for hemodynamic support of pediatric and neonatal shock. Critical Care Med. (2017) 45:106–93. doi: 10.1097/CCM.0000000000002425
21. Khemani RG, Thomas NJ, Venkatachalam V, Scimeme JP, Berutti T, Schneider JB, et al. Comparison of SpO2 to PaO2 based markers of lung disease severity for children with acute lung injury. Crit Care Med. (2012) 40:1309–16. doi: 10.1097/CCM.0b013e31823bc61b
22. Khemani RG, Patel NR, Bart RD, Newth CJL. Comparison of the pulse oximetric saturation/fraction of inspired oxygen ratio and the PaO2/fraction of inspired oxygen ratio in children. Chest (2009) 135:662–8. doi: 10.1378/chest.08-2239
23. Bilan N, Dastranji A, Ghalehgolab Behbahani A. Comparison of the spo2/fio2 ratio and the pao2/fio2 ratio in patients with acute lung injury or acute respiratory distress syndrome. J Cardiovasc Thorac Res. (2015) 7:28–31. doi: 10.15171/jcvtr.2014.06
24. van der Velden MG, Barrett MK, Sampadian GA, Brilli RJ, Burns JP. Pediatric critical care medicine training: 2004-2016. Pediatr Crit Care Med. (2018) 19:17–22. doi: 10.1097/PCC.0000000000001375
25. Reznick RK, MacRae H. Teaching surgical skills–changes in the wind. N Engl J Med. (2006) 355:2664–9. doi: 10.1056/NEJMra054785
26. Knudson MM, Khaw L, Bullard MK, Dicker R, Cohen MJ, Staudenmayer K, et al. Trauma training in simulation: translating skills from SIM time to real time. J Trauma (2008) 64:255–63. doi: 10.1097/TA.0b013e31816275b0
27. Soffler MI, Claar DD, McSparron JI, Ricotta DN, Hayes MM. Raising the stakes: assessing competency with simulation in pulmonary and critical care medicine. Ann Am Thorac Soc. (2018) 15:1024–6. doi: 10.1513/AnnalsATS.201802-120PS
28. Nishisaki A, Hales R, Biagas K, Cheifetz I, Corriveau C, Garber N, et al. A multi-institutional high-fidelity simulation “boot camp” orientation and training program for first year pediatric critical care fellows. Pediatr Crit Care Med. (2009) 10:157–62. doi: 10.1097/PCC.0b013e3181956d29
Keywords: pediatric critical care, medical education, fellowship, arterial line, central venous access, intubation
Citation: Engorn BM, Newth CJL, Klein MJ, Bragg EA, Margolis RD and Ross PA (2018) Declining Procedures by Pediatric Critical Care Medicine Fellowship Trainees. Front. Pediatr. 6:365. doi: 10.3389/fped.2018.00365
Received: 09 October 2018; Accepted: 12 November 2018;
Published: 30 November 2018.
Edited by:
Utpal S. Bhalala, Baylor College of Medicine, United StatesReviewed by:
Asha N. Shenoi, University of Kentucky, United StatesDerek S. Wheeler, Cincinnati Children's Hospital Medical Center, United States
Copyright © 2018 Engorn, Newth, Klein, Bragg, Margolis and Ross. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Branden M. Engorn, YmVuZ29ybkBjaGxhLnVzYy5lZHU=