Residency training programs in anesthesiology, intensive care and emergency medicine: from curriculum to practice

Residency programs in anesthesiology and intensive care (AIC), and emergency medicine (EM) continually evolve to ensure well-prepared trainees for these critical fields of healthcare. The objective of this study was to collect comprehensive feed-back from AIC and EM residents, comprising opinions and attitudes on: curriculum and structure of the residency program; scope of training environment, opportunities and complexity; training guidance and mentorship; teaching approach. An anonymous online cross-sectional survey was conducted among AIC and EM trainees during December 2023–January 2024 and June 2023–July 2023, respectively. Two hundred and thirty-five answers were collected: 137 (73/64 female/male) and 98 (55/43 female/male) respondents from the AIC and EM programs, respectively. Overall feed-back was equivalent for both residency programs, with differences related to the distinct characteristics of each medical specialty. The main issues identified across the programs were the need to improve and diversify the teaching approaches, with trainees' strong desire for more professional guidance, mentoring, and constant feed-back. The findings would inform decision-making beyond current residency programs in these critical care specialties, highlighting the need to design solutions for interactive and highly immersive educational experiences, such as simulation, augmented reality or virtual reality.

1 Introduction

Workforce-related challenges are widespread in the healthcare industry, including the fields of anesthesiology and intensive care (AIC), and emergency medicine (EM). Previous efforts aimed at enhancing retention in these specialties have addressed the staffing problem, but they resulted in mere changes rather than outright improvement (1). After a global pandemic that put major strains on AIC and EM worldwide, the two specialties are currently facing a lack of resident doctors in our country as a result of a low interest in choosing such a demanding specialty at the residency entry examination or later dropping out of the residency programs (2).

Amidst the pandemic, emergency departments (EDs) across the world served as the first line of defense being shouldered by the intensive care units (ICUs). This resulted in physicians working tirelessly, often with limited resources over extended hours and without adequate support for young doctors, with a toll on their empathy and commitment in assuming the required responsibilities (3, 4). This stress, combined with curricula or training that do not meet expectations, might be behind the declining interest in the two fields, or this trend could simply be a diversion of interest and attention from critical patients.

Research has been published on how anesthesia training is conducted in different countries (5), but there is scarcity of comparative studies to examine the structure and requirements of graduate medical education for various critical care specialties. While each field has its unique focus and expertise, there is often significant overlap in the care provided by anesthesiologists, intensivists, and emergency physicians, particularly in critical or emergency situations. Their collaboration ensures seamless patient care from the ED to the operating room and the ICU, thus enhancing patient outcomes and improving the overall healthcare delivery. These specialties involve the management and care of critically ill or injured patients. Anesthesiologists, intensivists, and emergency physicians are trained to handle high-stress situations and make rapid decisions to stabilize patients and provide appropriate treatment. They often require close collaboration with a large variety of healthcare professionals, including surgeons, nurses, respiratory therapists, and other specialists. Effective teamwork is crucial to ensure comprehensive care.

The European curriculum for anesthesiology residency places a strong emphasis on acquiring the knowledge and skills necessary for providing care to patients throughout the perioperative period. This includes conducting pre-operative assessments, managing patients during surgery, and effectively addressing post-operative pain, therefore residents undergo extensive training in anesthesia techniques, pharmacology, critical care, and pain management (6).

The Romanian curriculum for AIC residency comprises a 5-year rotation scheme in different settings, namely in ICUs across different hospitals to cover a wide range of pathologies, such as cardiovascular, respiratory, renal, digestive, neurological, trauma, burns, pediatrics, and geriatrics. The anesthesia rotations cover specific perioperative challenges from all types of surgeries: general; vascular; urology; gynecology and obstetrics; cardio-thoracic; orthopedics; ear, nose, throat; and neurosurgery. Alongside these rotations, continuous theoretical support is given to AIC residents in terms of courses and workshops on different topics, such as basic and advanced resuscitation skills, peripheral and central line insertion techniques, mechanical ventilation, difficult airway management, neuraxial techniques or peripheral nerve blocks (7).

On the other hand, EM residency programs are specifically designed to prepare physicians for the fast-paced and unpredictable ED environment. EM residents are trained to handle a wide range of acute medical conditions and trauma cases. Their curriculum focuses on developing skills in resuscitation, stabilization, diagnostic evaluation, and acute management of emergencies (8). EM is officially acknowledged as a distinct medical specialty in 16 European countries, necessitating a minimum of 5-year training. Additionally, 33 European countries have adhered to the “European Doctors' Directive” (9), either adopting a 5-year training regimen or opting for alternative programs (for example, a 4-year curriculum, and two to 3-year specialized training for EM as a supra-specialty). Furthermore, one of the main important points emphasized at the beginning of the recommendations highlights the differentiation between EM field and emergency medical care provided by practitioners in various other specialties. A different approach is seen in Australia and New Zealand, where the EM residency program takes seven years, comprising 2-year basic training, 1-year provisional training, and 4-year advanced training (10).

The Romanian curriculum for EM residency spans 5 years designed to provide a well-rounded experience. Each year of residency is structured into modules, with modules specifically focused on EM (e.g., emergency admission unit and mobile resuscitation unit) being the longest and most comprehensive. The modules covering adult and pediatric AIC take almost 17 months and are a crucial part of the emergency physician's training; therefore, right in the 1^st year of EM residency, a dedicated 5-month module is designed to enhance practical skills in resuscitation and critical patient management. Additionally, other essential modules encompass various surgical specialties (e.g., general surgery, orthopedics, thoracic surgery, plastic surgery, obstetrics, and gynecology), cardiology, pediatrics, and neonatology (11).

There is a certain degree of overlapping between AIC and EM, but it is paramount for the residency curricula to tailor the training in order to meet the distinct demands and challenges of each specialty. An analysis encompassing the residency curricula of AIC and EM can provide valuable insights and benefits. A deeper understanding of the similarities and differences between such training programs can help educators, administrators, and policymakers make informed decisions about curriculum design and resource allocation. Sharing experiences can lead to collaborative efforts in developing joint educational initiatives, interdisciplinary training, or shared resources, ultimately benefiting the healthcare services beyond these two specialties.

In the context of existing residency curricula for these two critical care specialties, the primary objective of this study was to collect comprehensive feed-back from trainees. The feed-back would comprise opinions and attitudes on: curriculum and structure of the residency program; the training environment scope, opportunities and complexity; training guidance and mentorship; teaching approach. The secondary objectives were: (a) to identify common patterns in trainees' opinions and attitudes and examine their relevance; (b) to establish the relevance of the differences and their subsequent usability/applicability in adjusting the residency programs; (c) to estimate the response rate and have a basis for designing further multicenter longitudinal analysis of post-graduate training in AIC and EM.

2 Materials and methods

2.1 Study design and participants

An online cross-sectional survey was employed for data collection: an anonymous web-based questionnaire (implemented using Google Forms) was distributed through professional channels and networks (e.g., WhatsApp groups and professional e-mail groups) to the residents of AIC and EM during December 2023–January 2024 and June 2023–July 2023, respectively. The main 11 university centers in Romania were targeted: Arad, Brasov, Bucuresti, Cluj, Constanta, Craiova, Iasi, Oradea, Sibiu, Targu-Mures, and Timisoara. Each questionnaire was closed after three consecutive days with no answer. The questionnaire, provided in full as Supplementary material of this manuscript (Supplementary file 1), is adapted after EUSEM recommendations (12); it started with information about the study's objectives and measures taken to assure the personal data protection. For each individual, actual data collection proceeded after informed consent had been granted (a required confirmation was included as the first item).

The survey covered the four areas targeted by the main objective: (a) curriculum and structure of the residency program; (b) training environment, scope, opportunities and complexity; (c) training guidance and mentorship; (d) teaching and assessment approach. They were implemented as 11 distinct sections in the questionnaire: (1) induction to the residency program, (2) overall curriculum design, (3) work environment, (4) mentorship, (5) teaching and educational activities, (6) evaluation of residents, (7) research, (8) interdepartmental support, (9) resources and infrastructure, (10) program director, and (11) overall opinion, suggestions and recommendations.

Figure 1 shows the study flow diagram.

Figure 1

Figure 1. Flow chart of study. AIC, Anesthesiology and Intensive Care; EM, Emergency Medicine; ESAIC, European Society of Anaesthesiology and Intensive Care; EUSEM, European Society for Emergency Medicine.

The questionnaire collected categorical and numerical data; 42 questions on five-point Likert-type scales probed trainees' perception of the way the residency curriculum is conveyed into practice. This paper is focused on the quantitative data; however, the last section of the questionnaire also included open-ended questions trying to capture the residents' overall opinion. The face validity of questionnaire's items (namely, their relevance to this project) was assured by a Delphi technique in the development process; no prior formal validation was conducted. All questions were compulsory.

The study was conducted in accordance with the Declaration of Helsinki, and the protocol was approved by the Ethics Committee of “Pius Branzeu” Emergency County Hospital no 432/16.01.2024.

2.2 Data analysis

Reliability of the scales' measurements was assessed based on Cronbach's alpha (the value was calculated for each sub-scale corresponding to the issues addressed by the main objective). Values of Cronbach's alpha > 0.8 were considered to indicate good internal consistency. Intraclass correlation coefficient (ICC) with 95% confidence interval (CI) was also calculated as an index of the extent to which measurements can be replicated. Values higher than 0.5 for ICC were considered as a further proof of moderate to good reliability.

For each subscale, analysis was separately conducted on each item and a subsequent composite measure was calculated as the arithmetic mean of the respective subscale indicators. This aggregated metric helped further quantitative analysis and comprehensive comparison of the two residency programs. Radar plots with the four aggregated metrics were used for data visualization.

Exploratory statistical analysis was conducted. Descriptive statistics included: the observed frequency counts and percentages for categorical variables; median with inter-quartile range (IQR) with Tukey's hinges and mean with standard deviation (SD) for numerical variables, irrespective of their distribution.

Univariate non-parametric Mann-Whitney U statistical test was applied to compare the distribution of numerical data across two groups (i.e., corresponding to the residency programs). The chi-square statistical test (either asymptotic, Fisher's exact test, or Monte-Carlo simulation with 10,000 samples) was applied to check the statistical significance of the association between the categorical variables. To explore covariance between various subscale scores, two-by-two non-parametric Spearman correlation analysis was conducted and scatter plots were used for data visualization.

The statistical analysis was conducted at 5% level of statistical significance (95% level of confidence). All reported probability values are two-tailed.

Data analysis was performed with the statistical software IBM SPSS v. 20 and R v. 4.3.1 packages (including “fmsb” v. 0.7.5 and “ggplots” v. 3.1.3).

3 Results

3.1 General characteristics of respondents

The survey gathered information from 235 trainees: 137 AIC residents and 98 EM residents. One hundred and twenty-eight were female medical doctors (73 AIC and 55 EM) and 107 were males (64 AIC and 43 EM). Answers were received from each of the 11 residency centers, with inhomogeneous geographical distribution across the two specialties. Based on residency places during the period 2019–2022 (744 AIC and 668 EM) as a reference and a 75% retention rate in residency programs (i.e., 25% drop-out in these specialties), the raw rates of feed-back return were 24.55% and 19.56% for AIC and EM, respectively. An overall response rate of approximately 20% in both specialties was inferred.

3.2 Feed-back from trainees

Table 1 shows the trainees' opinion regarding the curriculum and structure of the program they follow and their perceived efficiency of the initial orientation into the program. Although the difference in overall grade on orientation and curriculum of the residency program is statistically significant, the actual difference is less than half a point on the five-point Likert scale. However, there is a more substantial 0.6-point mean difference for the scale item regarding the clarity of the curriculum objectives in favor of the EM program. Even more, regarding the median (IQR), this difference is a full point on the five-point Likert scale. This discrepancy is apparent in the qualitative variable concerning the content of the curriculum: 42.4% of the AIC residents believe there is no specific curriculum or they do not have knowledge of such a formal structure of the residency program, in contrast with only 12.2% of the EM residents having the same opinion.

Table 1

Table 1. Opinions on curriculum and structure of the residency program.

Table 2 presents the trainees' opinion on the training environment: its scope, infrastructure, adequacy, learning opportunities, and staff preparedness or training for providing the necessary support.

Table 2

Table 2. Opinions on training environment, scope, opportunities and complexity.

There is no significant difference in the overall grade for environment adequacy, but the staff is perceived as being less supportive in the AIC specialty (0.65-point mean difference between the programs, with a full point difference between the median values). Additionally, the development of progressive responsibility is perceived by AIC trainees as being significantly less adequate, but the mean difference is < 0.4-point compared to the EM residents. This small discrepancy should be regarded in the context of the actual design and organization of the training facilities of the two residency programs: five or more distinct wards or environments for AIC, compared to two up to four in EM.

Table 3 show the opinions on training guidance, mentoring, and perceived role of the residency program's director. There is little difference between the two programs (0.33-point mean difference on the Likert scale) in the overall grade for guidance and mentorship (Table 3). The difference seems to be related to the adequacy of the available mentors' number and availability (approximately 0.5-point mean difference on the Likert scale; Table 3). The qualitative outcomes in Table 3 reveal a better perception regarding the mentoring and the role of the program director among the EM trainees, which might also be related to the number of distinct wards or training environments (i.e., a consequence of higher number of residency rotations in the AIC program).

Table 3

Table 3. Opinions on training guidance and mentorship: qualitative and quantitative outcomes.

Tables 4 and 5 reveal a mixed perception of the teaching approach and assessment methods, with their frequency and accreditation. Table 6 presents quantitative opinions and perceptions of the training approaches, including formal education activities and opportunities to engage in applied translational research.

Table 4

Table 4. Opinions on teaching approach (educational methods and instruments): qualitative outcomes.

Table 5

Table 5. Opinions on assessing methods and instruments: qualitative outcomes.

Table 6

Table 6. Opinions on teaching and assessment: quantitative outcomes.

There is no significant difference in the overall grade for teaching, and all the four items of the quantitative scale regarding this aspect are balanced (Table 6), with lower opinion of the actually received guidance and support for applied and translational research compared to the formal education (approximately 1-point mean difference on the five-point Likert scale).

On the other hand, the qualitative outcomes in Tables 4, 5 reveal significant differences regarding the actual educational activities (more workshops in AIC and more discussions in EM), evaluation or assessment methods (more OSCE in EM) and their scheduling (stricter and more clearly scheduled in AIC).

3.3 Relationship between scales. Overall feed-back

The four scales are all two-by-two correlated strongly and significantly. These findings remain consistent for both programs, as can be seen in Tables 7, 8. Figure 2 depicts the matrix with two-by-two scatter plots corresponding to the composite measures of the four issues addressed by the main objective: (a) curriculum and structure of the residency program; (b) training environment, scope, opportunities and complexity; (c) training guidance and mentorship; (d) teaching approach. Histograms depicting the distribution of the values of each composite measurement are on the diagonal of the matrix (Figure 2). Strong and significant correlation can be observed between each two aspects, for both residency programs.

Table 7

Table 7. Non-parametric Spearman correlation between the four scales for AIC residency program.

Table 8

Table 8. Non-parametric Spearman correlation between the four scales for EM residency program.

Figure 2

Figure 2. The matrix with two-by-two scatter plots corresponding to the composite measures of the four issues addressed by the main objective. AIC, Anesthesiology and Intensive Care; EM, Emergency Medicine.

The radar plots for the scales' average values corresponding to the composite measures of the four issues addressed by the main objective (Figure 3) provide further evidence of both their balanced perception across the four issues and their equivalence in the overall feed-back for AIC and EM residency programs. The areas under the two polygons are similar: 38% and 44% out of the maximum area of the rhombus for AIC and EM, respectively.

Figure 3

Figure 3. The radar plots with the average values corresponding to the composite measures of the four issues addressed by the main objective: (a) curriculum and structure of the residency program; (b) training environment, scope, opportunities and complexity; (c) training guidance and mentorship; (d) teaching approach. They visualize the comprehensive pattern in residents' feed-back from the two professional groups: (A) Anesthesiology and Intensive Care; (B) Emergency Medicine. Although neither of the two quadrilaterals is regular, they both are close to rhombi and have equivalent areas.

3.4 Open questions about trainees' opinions

Two independent researchers conducted a thematic analysis on the open-ended questions. An inductive approach was used, aimed to identify any supplementary emergent theme. Differences were resolved by consensus. The results indicate that anesthetists and EM physicians expressed similar opinions of the curriculum design, whether the curriculum was successfully covered or applied, and on what should be changed in terms of training. The results are presented in full in Supplementary file 2.

To a large extent, trainees in both programs considered their respective curriculum as being complex, detailed, and well structured. On the other hand, there were some residents who saw it as incomplete and unstructured, or thought it would benefit from more structure (23 out of 137, and 7 out of 98 respondents for AIC and EM, respectively).

Regarding the curriculum's successful application in practice, some respondents believed this target as achieved to a large extent: 32% AIC, and 16% EM trainees. The remaining respondents considered it applied to a low or very low extent or did not express any opinion. AIC trainees were in favor of having more courses, mentorship, workshops, simulations, case discussions, and more evaluations in the above-mentioned order. EM trainees thought they would benefit more from workshops, case discussions, courses and mentorship (Supplementary file 2).

4 Discussion

We conducted an anonymous cross-sectional survey with the primary objective of collecting comprehensive feed-back from AIC and EM trainees. Both fields require practitioners to stay up to date with the latest medical advances and technologies and the same should be true for the design and deployment of the training programs themselves. EM residency trains for rapid and comprehensive response to diverse and time-sensitive clinical scenarios, while AIC training focuses on mastery of complex procedures, precise monitoring, and interdisciplinary collaboration in critical and high-stress situations. The overall feed-back we received from residents of both specialties was equivalent, with differences primarily related to each particular set of professional challenges and educational strategies.

Worldwide, EDs are facing significant professional challenges. According to recent research, EDs experience higher levels of stress for physicians compared to other medical fields. This constant physical and psychological pressure in EM raises concerns about the long-term sustainability of this career for physicians (13–15).

Anesthesiology trainees tend to have higher rates of burnout compared to medical students and practitioners who have completed their training (16). Studies have shown that anesthesiology residents experience professional burnout, while academic anesthesiology faculty members generally report a significantly higher sense of wellbeing than residents (17). In a survey done by The Royal College of Anesthetists, anesthetists of all levels expressed similar sentiments regarding the factors that would contribute to a sustainable and appealing long-term career in anesthesiology (namely, flexibility, feeling valued and maintaining a good work-life balance). They specifically mentioned the benefit of more training opportunities and support for career progression (18).

Our country has little research on graduate medical education and residency training. Additionally, there is insufficient training for supervisors and mentors, and there is no nation-wide formal agreement on effective assessment approaches and instruments. It is important to note that being a skilled and competent professional does not automatically make someone an effective mentor for residents. Acquiring the abilities necessary for medical practice is quite challenging, especially in the fast-paced and highly stressful residency environment of AIC and EM. At the same time, it is vital to prioritize patient safety and ensure that learning experiences occur in a way that does not compromise it, which requires well-trained supervisors and facilitators.

Further understanding of distinctions in residency training programs can help healthcare professionals choose a path aligned with their interests, career goals, and the type of patient care they find most interesting and compelling. Both specialties play critical roles in the continuum of patient care, particularly in the management of acute and critical medical situations.

4.1 Curriculum and structure of the residency programs. Scope, opportunities and complexity of the training environment

In our study, almost half of the AIC trainees' opinions regarding the type of curricula are balanced between a European and a national one, while the remaining 42% have no idea about the curricula they are following. On the other hand, just 12% of the EM trainees are not familiar with the type of curricula, half of them thinking they follow a national one and an important number (37.85%) considered their curriculum followed the European recommendations. These observations come into contrast with the answers for the second section of the questionnaire where the overall grade for orientation and curriculum structure was 3 for both specialties.

The requirements and standards for training institutions vary among different European countries. The accreditation conditions for training centers are determined by national regulatory bodies. At the European level, there are established visiting programs and appraisal processes based on the EU Directive on Professional Qualifications and the UEMS (European Union of Medical Specialists) Charta 1997 (19). For anesthesiology, programs such as the “Accreditation of Training in Anaesthesiology and Intensive Care” (ATAIC) are collaboration between European Society of Anaesthesiology and Intensive Care (ESAIC) and European Board of Anesthesiology (EBA) (19).

The European Training Requirement (ETR) for EM underwent a thorough review and update to align with the current practices and the evolution of the specialty across Europe. Approved by the UEMS Council in April 2019, this revision builds upon the European core curriculum initially published in 2002. ETR update process initiated in January 2022 involved a comprehensive examination of the clinical practices and specialized skills within emergency medicine (20). Representatives from the UEMS section and Board for Emergency Medicine, along with EUSEM education committee and the Young Emergency Medicine Doctors' group actively participated in this collaborative effort.

The way trainees perceive their educational environment is an important factor in determining how successful the curriculum implementation is (21). The Romanian trainees also provided highly correlated feed-back on all the four rated aspects: curriculum and structure of the residency program; the training environment scope, opportunities, and complexity; training guidance and mentorship; teaching and assessment approaches. Respondents demonstrated a comparable level of agreement regarding the overall opinion on educational environment for the two specialties. Training sites are considered adequate in terms of educational content and complexity of cases encountered in the department by all residents. Overall, the relationship and the support the trainees receive on the other wards during the rotations are perceived as appropriate. However, the residents from both specialties gave lower ratings to the relationships with the faculty across departments, particularly concerning cross-departmental curriculum compliance. In contrast, there were divergent opinions on the suitable pace for progressive responsibility development between the two specialties: EM residents feel they are entrusted with more significant responsibilities compared to AIC residents (3.92 ± 1.071 vs. 3.54 ± 1.182; p = 0.014). Additionally, EM trainees believe they receive greater support from the rest of the staff in their respective department (3.43 ± 1.316 vs. 2.78 ± 1.229; p < 0.001).

4.2 Training guidance and mentorship

The literature strongly emphasizes the numerous advantages of mentorship, such as enhanced academic and personal productivity, career progression, higher retention rates among trainees, improved educational abilities, boosted self-assurance, increased grant funding, and success in academic pursuits (22–26).

According to EBA UEMS, requirements for AIC trainers include: having competence level D in the designated training area, allocating adequate time for training assignments, possessing knowledge about the UEMS ETR, maintaining a positive attitude toward clinical training, demonstrating expertise in didactic teaching, and exhibiting a clear commitment to providing theoretical instruction and practical guidance to trainees across the entire spectrum of clinical practice (19).

In Romania, a training supervisor for AIC is required to be a medical specialist with a minimum of 5 years of experience in the AIC specialty. They are responsible for overseeing a maximum of five residents (irrespective of trainees' year of residency). The supervisor monitors the residents' progress, reviews and approves the completion of the practical skills in the training curriculum, and coordinates seminars and discussions. These education sessions, lasting a minimum of 4 hours per week, cover specific topics outlined in the training curriculum, including case presentations, articles, and updates relevant to the field (27).

According to the national curriculum for EM training, the residents' progress should be monitored and they should be guided through the training modules, to ensure they learn the necessary knowledge and practical skills. Professionals in charge of training must meet certain eligibility criteria: be a consultant or specialist in EM with residency in EM or AIC, and at least 5 years of experience in ED. In addition, they must perform on-call duties within the ED where the residents are registered (8).

When asked if they had a supervisor, 80% of EM trainees gave a positive answer while 20% did not know or did not have one. More than half of the trainees had a good opinion of their mentor, considering (s)he had specific training for teaching. However, less than half of them (40%) declared having monthly meetings with their mentors for teaching sessions and progress evaluation. Just 64% of AIC trainees knew they had a mentor, and < 40% believed their mentors had previous training (any of “train the trainer” courses or didactics). In this specialty, the residents considerably missed teaching and supervision, with only 13.9% of them having monthly meetings with the mentors for assessing their progress, and < 30% of them declared having monthly meetings for teaching activities.

In a study by Craig et al. (10), most EM trainees believed they needed more direct supervision at the bedside and they valued the feed-back from their mentors and program's director. Additionally, they felt the feed-back was too much focused on negative aspects of their performance and was rarely based on their observed behavior (10).

Ergun et al. (28) studied perceptions regarding mentorship among Canadian anesthesia residents. Seventy-nine percent of surveyed residents expressed their agreement on the significance of mentorship for achieving overall success in the field of anesthesiology. Obstacles in establishing successful mentorship included ineffective connection between mentors and mentees (74% of respondents), mentors' time constraints (70% of respondents), and scarcity of mentors who actually shared similar personal and professional aspirations with the mentees (61% of respondents). Also, residents highlighted the absence of structured meetings (62% of respondents) and missing clearly defined objectives in their mentorship programs (58% of respondents) as additional barriers (28).

Trainee-centered approaches and mentor-mentee compatibility are crucial for successful mentoring, as is timely and critical evaluation of trainees' progress (29–32).

4.3 Teaching and assessment approaches

Perception of overall teaching approach had no significant differences between AIC and EM in our survey. However, when we analyzed the qualitative data, AIC trainees had more simulations and more workshops than EM residents, while case discussions and case presentations were more frequently mentioned in the EM training. Still, the frequency of formal education was low in both AIC and EM.

Research of Nunes et al. (33) emphasized the importance of in-service training during medical residency. They suggested that such training should effectively combine teaching and learning, setting a high standard for professional development. The goal is to provide medical residents with opportunities to expand their knowledge, enhance their attitudes and skills, and cultivate specific proficiencies. Students and trainees are more committed and have better performance when they can see the explicit connection between the educational activities or requirements and their future professional expertise (30, 32, 34). Lower rating for the quality of theoretical education in anesthesiology residency was reported when compared to other educational activities (30–32, 35–37). Several possible explanations have been considered, such as absence of comprehensive training programs and even mentors' qualifications (35).

The trainees in our study also suggested that more simulations, workshops and case discussions might improve their training. Although this might be a bias from the online education during the COVID-19 pandemic, we would rather see it as a consequence of these activities missing in the actual residency programs. We acknowledge that online learning can never fully replace hands-on teaching (30–32, 38–40), but the COVID-19 pandemic also brought challenges related to patient bedside learning (41).

Simulation activities go beyond just improving technical skills in a safe setting. They provide actual experiences that are highly effective in retaining knowledge and have the potential to generate behavioral changes, such as in leadership, communication, and resource management. This, in turn, enhances patient safety (37, 42), and can bridge theoretical lessons with real-world clinical practice, particularly in helping junior doctors handle emergency situations (43). Simulation programs positively impact non-technical and behavioral issues, influencing the learning process in both EM and anesthesiology (31, 44–46). Moreover, highly immersive and interactive educational solutions are emerging, such as 360-degree video training, telementoring and metaverse approaches (36, 38, 47–50).

In our analysis of scales' relationship, we noted a consistent pattern of high statistical significance in pairwise correlations across all respondents. This pattern held true for both AIC and EM curricula. From this robust pair-wise correlation we can infer that effective resident orientation and high-quality mentorship contribute to a positive perception among residents regarding the learning environment and methods.

In a study conducted by Gonzales et al. (51) on mentorship of residents in anesthesiology, residency program directors identified career planning, professionalism, and maintaining a balance between personal, career, and family commitments as crucial areas for effective training. These principles hold true for residents in EM as well, considering that with the support of residency community, young doctors can nurture resilience and mitigate the risk of burnout (52). By cultivating a culture of wellness, AIC and EM residency programs can create an environment that supports residents' physical and mental wellbeing, fosters learning, and ultimately enhances their efficiency and success throughout prolonged training periods. Creating a supportive and collegial atmosphere where residents feel comfortable seeking help and support from their peers and supervisors improves their learning experience (53–55).

The visual representations of the responses of residents from AIC and EM highlighted the similarity in opinions. The only discrepancies were minimal and rather qualitative, stemming from the specific details of the two residency programs. Based on the results, we strongly recommend improving the quality of the trainer-trainee relationship, irrespective of specialty, and employing interactive technology-based educational solutions, such as augmented reality, virtual reality, or metaverse. They would help further tailoring the training experience, particularly in the context of needed feed-back, guidance, and mentorship.

4.4 Strengths and limitations of the survey

One important strength of the study consists in collecting and processing feed-back from all the 11 Romanian centers that have residency programs in AIC and EM, thus setting a reliable basis for further longitudinal studies. Although the geographical distribution of respondents was non-uniform, and non-response bias might affect the results, the moderate response rate and having concrete effect size for the scale measurements is an important step forward toward power calculation in future studies' design.

We also acknowledge the limitation rooted in the very design of the study, which collected anonymous self-reported data, with no objective validity confirmation and no control of respondents' background. Moreover, respondents were in different years of residency and had mixed experience (some respondents might already have a medical specialty). Future studies should be stratified according to trainees' level of experience.

Common method bias (CMB) and its associated effect of common method variance (CMV) is another major concern to be acknowledged, due to the cross-sectional design and one-time single administration of the questionnaire to each professional group of residents. The survey questionnaire was designed to limit the shared variance and to control the method biases by alternating the subscales with factual questions and categorical options to be checked on the one hand and distributing the scale questions referring to the same axis/issue across the questionnaire, on the other hand.

5 Conclusions

AIC and EM residency training in Romania have national curricula aligned with European standards, but future improvement should seek better deployment in practice, particularly with regard to professional guidance, mentoring, and constant feed-back to the trainees. Benefits from this analysis also include supporting shared decision-making for integrating metaverse solutions into medical training to provide opportunities for highly immersive and interactive educational experiences, particularly valuable for critical care trainees.

In addition, with the worthwhile feed-back we received, this investigation can serve as a pilot study for further multicenter longitudinal research, such as comparative analyses of training programs across different healthcare systems.

Data availability statement

Data set is available in full on FigShare (https://doi.org/10.6084/m9.figshare.25997302.v1) and further inquiries can be directed to the corresponding author.

Ethics statement

The studies involving humans were approved by the Decision of the Local Scientific Research Ethics Commission of the County Emergency Clinical Hospital Pius Brinzeu Timisoara no. 432/16.01.2024. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.

Author contributions

CB: Conceptualization, Data curation, Investigation, Methodology, Project administration, Validation, Visualization, Writing–original draft, Writing–review & editing. AP: Conceptualization, Data curation, Methodology, Project administration, Supervision, Validation, Visualization, Writing–original draft, Writing–review & editing. DL: Conceptualization, Data curation, Formal analysis, Project administration, Software, Supervision, Validation, Visualization, Writing–original draft, Writing–review & editing. AM: Conceptualization, Data curation, Investigation, Project administration, Software, Writing–original draft, Writing–review & editing. OB: Methodology, Software, Supervision, Visualization, Writing–review & editing. MP: Investigation, Methodology, Resources, Visualization, Writing–review & editing. CT: Investigation, Resources, Software, Visualization, Writing–review & editing. MB: Data curation, Investigation, Resources, Visualization, Writing–review & editing. OM: Supervision, Validation, Visualization, Writing–review & editing. DS: Supervision, Validation, Visualization, Writing–review & editing.

Funding

The author(s) declare that no financial support was received for the research and authorship. “Victor Babes” University of Medicine and Pharmacy provided financial support for the publication of this article.

Acknowledgments

We would like to express the authors' appreciation to our anesthesia and intensive care and emergency medicine trainees for their help with the data collection and their willingness to share their opinions. Special thanks to Michael Margarson for his support and expertise through the ESAIC Mentorship Program.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fmed.2024.1386681/full#supplementary-material

References

1. Darbyshire D, Brewster L, Isba R, Body R, Basit U, Goodwin D. Retention of doctors in emergency medicine: a scoping review of the academic literature. Emerg Med J. (2021) 38:663–72. doi: 10.1136/emermed-2020-210450

PubMed Abstract | Crossref Full Text | Google Scholar

2. Romanian Health Ministry. Available residency places - 2023. Available online at: https://rezidentiat.ms.ro/20231119/loc-post-neocupat-m28.pdf (accessed January 22, 2024).

Google Scholar

3. Secosan I, Virga D, Crainiceanu ZP, Bratu T. The mediating role of insomnia and exhaustion in the relationship between secondary traumatic stress and mental health complaints among frontline medical staff during the COVID-19 Pandemic. Behav Sci. (2020) 10:164. doi: 10.3390/bs10110164

PubMed Abstract | Crossref Full Text | Google Scholar

4. Bredicean C, Tamasan SC, Lungeanu D, Giurgi-Oncu C, Stoica IP, Panfil AL, et al. Burnout toll on empathy would mediate the missing professional support in the COVID-19 outbreak. Risk Manag Healthc Policy. (2021) 14:2231–44. doi: 10.2147/RMHP.S300578

PubMed Abstract | Crossref Full Text | Google Scholar

5. Yamamoto S, Tanaka P, Madsen M V, Macario A. Comparing anesthesiology residency training structure and requirements in seven different countries on three continents. Cureus. (2017) 9:1060. doi: 10.7759/cureus.1060

PubMed Abstract | Crossref Full Text | Google Scholar

6. ESAIC - European Anesthesia and intensive care curriculum. Available online at: https://drive.google.com/file/d/1r2dlzJiPvM0SVM2hBrK6m4ZeNV1i68ue/view (accessed June 8, 2024).

Google Scholar

7. Romanian Health Ministry. Aesthesiology and intensive care residency curriculum. Available online at: https://rezidentiat.ms.ro/curricule/anestezie_si_terapie_intensiva.pdf (accessed January 23, 2024).

Google Scholar

8. Impact Assessment on Emergency Medicine: Lines of action with regard to a RIA on emergency medicine residency in Romania Ministry of Internal Affairs. Available online at: https://sgg.gov.ro/1/wp-content/uploads/2018/07/Lines-of-action_emergency-medicine-residency-in-Romania.pdf (accessed January 11, 2024).

Google Scholar

9. Eusem - European Curriculum of Emergency Medicine. Available online at: https://eusem.org/education/curriculum/european-curriculum-of-emergency-medicine (accessed January 13, 2024).

Google Scholar

10. Craig S, Braitberg G, Nicolas C, White G, Egerton-Warburton D. Assessment and feedback in emergency medicine training: Views of Australasian emergency trainees. Emerg Med Australasia. (2010) 22:537–47. doi: 10.1111/j.1742-6723.2010.01353.x

PubMed Abstract | Crossref Full Text | Google Scholar

11. Romanian Health Ministry. Emergency medicine residency curriculum. Available online at: https://rezidentiat.ms.ro/curricule/medicina_de_urgenta.pdf (accessed January 13, 2024).

Google Scholar

12. YEMD survey on EUSEM endorsed EM Curriculum. Available online at: https://www.surveymonkey.com/r/XJZDNJB (accessed January 26, 2024).

Google Scholar

13. James F, Gerrard F. Emergency medicine: what keeps me, what might lose me? A narrative study of consultant views in Wales. Emerg Med J. (2017) 34:436–40. doi: 10.1136/emermed-2016-205833

PubMed Abstract | Crossref Full Text | Google Scholar

14. Kuhn G, Goldberg R, Compton S. Tolerance for uncertainty, burnout, and satisfaction with the career of emergency medicine. Ann Emerg Med. (2009) 54:106–113. doi: 10.1016/j.annemergmed.2008.12.019

PubMed Abstract | Crossref Full Text | Google Scholar

15. Cetin M, Bicakci S, Canakci ME, Aydin MO, Bayram B. A critical appraisal of emergency medicine specialty training and resignation among residents in emergency medicine in Turkey. Emerg Med Int. (2019) 2019:1–6. doi: 10.1155/2019/6197618

PubMed Abstract | Crossref Full Text | Google Scholar

16. Dyrbye LN, West CP, Satele D, Boone S, Tan L, Sloan J, et al. Burnout among US medical students, residents, and early career physicians relative to the general US population. Acad Med. (2014) 89:443–51. doi: 10.1097/ACM.0000000000000134

PubMed Abstract | Crossref Full Text | Google Scholar

17. Adams PS, Gordon EKB, Berkeley A, Monroe B, Eckert JM, Maldonado Y, et al. Academic faculty demonstrate higher well-being than residents: Pennsylvania anesthesiology programs' results of the 2017-2018 ACGME well-being survey. J Clin Anesth. (2019) 56:60–4. doi: 10.1016/j.jclinane.2019.01.037

PubMed Abstract | Crossref Full Text | Google Scholar

18. Improving retention in anaesthesia | The Royal College of Anaesthetists. Available online at: https://www.rcoa.ac.uk/policy-communications/policy-public-affairs/anaesthesia-fit-future/improving-retention-anaesthesia (accessed January 13, 2024).

Google Scholar

19. Union Européenne des Médecins Spécialistes European Union of Medical Specialists. Association internationale sans but lucratif International non-profit organisation. Available online at: https://drive.google.com/file/d/18-Uhx8DckuBFDkLi76s-HW0bOvRXDDXO/view (accessed June 8, 2024).

Google Scholar

20. Emergency Medicine. European training requirements for Emergency Medicine. Available online at: https://www.uems-em.eu/training-and-education/european-training-requirements-for-emergency-medicine (accessed January 17, 2024).

Google Scholar

21. Aghamolaei T, Fazel I. Medical students' perceptions of the educational environment at an Iranian Medical Sciences University. BMC Med Educ. (2010) 10:1–7. doi: 10.1186/1472-6920-10-87

PubMed Abstract | Crossref Full Text | Google Scholar

22. Feldman MD, Arean PA, Marshall SJ, Lovett M, O'Sullivan P. Does mentoring matter: results from a survey of faculty mentees at a large health sciences university. Med Educ Online. (2010) 15:5063. doi: 10.3402/meo.v15i0.5063

PubMed Abstract | Crossref Full Text | Google Scholar

23. Levinson W, Kaufman K, Clark B, Tolle SW. Mentors and role models for women in academic medicine. Western J Med. (1991) 154:423.

Google Scholar

24. Sambunjak D, Straus SE, Marušić A. Mentoring in academic medicine: a systematic review. JAMA. (2006) 296:1103–15. doi: 10.1001/jama.296.9.1103

PubMed Abstract | Crossref Full Text | Google Scholar

25. Sambunjak D, Straus SE, Marusic A. A systematic review of qualitative research on the meaning and characteristics of mentoring in academic medicine. J Gen Intern Med. (2010) 25:72–8. doi: 10.1007/s11606-009-1165-8

PubMed Abstract | Crossref Full Text | Google Scholar

26. Flexman AM, Gelb AW. Mentorship in anesthesia. Curr Opin Anaesthesiol. (2011) 24:676–81. doi: 10.1097/ACO.0b013e32834c1659

PubMed Abstract | Crossref Full Text | Google Scholar

27. Romanian Health Ministry. Residency programs. Available online at: https://rezidentiat.ms.ro/legislatie/ordin_nr_833_4446_2020.pdf (accessed January 17, 2024).

Google Scholar

28. Ergun S, Busse JW, Wong A. Mentorship in anesthesia: a survey of perspectives among Canadian anesthesia residents. Can J Anaesth. (2017) 64:402–10. doi: 10.1007/s12630-017-0816-1

PubMed Abstract | Crossref Full Text | Google Scholar

29. Sng JH, Pei Y, Toh YP, Peh TY, Neo SH, Krishna LKR. Mentoring relationships between senior physicians and junior doctors and/or medical students: a thematic review. Med Teach. (2017) 39:866–75. doi: 10.1080/0142159X.2017.1332360

PubMed Abstract | Crossref Full Text | Google Scholar

30. Bastola P, Atreya A, Bhandari PS, Parajuli S. The evolution of anesthesiology education: Embracing new technologies and teaching approaches. Health Sci Rep. (2024) 7:e1765. doi: 10.1002/hsr2.1765

PubMed Abstract | Crossref Full Text | Google Scholar

31. Weismantel I, Zhang N, Burston A. Exploring intensive care nurses' perception of simulation-based learning: a systematic review and meta-synthesis. J Clin Nurs. (2024) 33:1195–208. doi: 10.1111/jocn.17016

PubMed Abstract | Crossref Full Text | Google Scholar

32. Yu H, Zhang C, He J, Xu J. Reflections on training and teaching modes for anesthesia monitoring nurses in China. Heliyon. (2024) 10:e24540. doi: 10.1016/j.heliyon.2024.e24540

PubMed Abstract | Crossref Full Text | Google Scholar

33. Nunes TPM, Michel JLM, Haddad AE. A residência médica, a preceptoria, a supervisão e a coordenação. Cad Bras Med. (2011) 7:35–40.

Google Scholar

34. Lungeanu D, Petrica A, Lupusoru R, Marza AM, Mederle OA, Timar B. Beyond the digital competencies of medical students: concerns over integrating data science basics into the medical curriculum. Int J Environ Res Public Health. (2022) 19:15958. doi: 10.3390/ijerph192315958

PubMed Abstract | Crossref Full Text | Google Scholar

35. Mottana L V, Magalhães CR, Bevilacqua Filho CT, Barone PD, Jotz GP. Anesthesiologists' perception on their residency training. Braz J Anesthesiol. (2022) 72:37–43. doi: 10.1016/j.bjane.2021.06.004

PubMed Abstract | Crossref Full Text | Google Scholar

36. Lewis KO, Popov V, Fatima SS. From static web to metaverse: reinventing medical education in the post-pandemic era. Ann Med. (2024) 56:2305694. doi: 10.1080/07853890.2024.2305694

PubMed Abstract | Crossref Full Text | Google Scholar

37. Rovati L, Gary PJ, Cubro E, Dong Y, Kilickaya O, Schulte PJ, et al. Development and usability testing of a patient digital twin for critical care education: a mixed methods study. Front Med. (2024) 10:1336897. doi: 10.3389/fmed.2023.1336897

PubMed Abstract | Crossref Full Text | Google Scholar

38. Petrica A, Lungeanu D, Ciuta A, Marza AM, Botea MO, Mederle OA. Using 360-degree video for teaching emergency medicine during and beyond the COVID-19 pandemic. Ann Med. (2021) 53:1520–30. doi: 10.1080/07853890.2021.1970219

PubMed Abstract | Crossref Full Text | Google Scholar

39. Sutoi D, Bazavan CO, Sutoi M, Petrica A, Marza AM, Trebuian CI, et al. The learning experience of Romanian medical students during the online teaching imposed by the COVID-19 pandemic. Adv Med Educ Pract. (2023) 14:1077–86. doi: 10.2147/AMEP.S418563

PubMed Abstract | Crossref Full Text | Google Scholar

40. Krishnan S V, Kunju SA, Nayak SS, Gopinathan V, Sirur FM, Kumara V, et al. Evaluating the use of e-learning in Indian emergency medicine residency programs during the COVID-19 pandemic: a national cross-sectional survey. Disaster Med Public Health Prep. (2023) 17:e491. doi: 10.1017/dmp.2023.146

PubMed Abstract | Crossref Full Text | Google Scholar

41. Lo HY, Lin SC, Chaou CH, Chang YC, Ng CJ, Chen SY. What is the impact of the COVID-19 pandemic on emergency medicine residency training: an observational study. BMC Med Educ. (2020) 20:1–8. doi: 10.1186/s12909-020-02267-2

PubMed Abstract | Crossref Full Text | Google Scholar

42. So HY, Chen PP, Wong GKC, Chan TTN. Simulation in medical education. J R Coll Physicians Edinb. (2019) 49:52–7. doi: 10.4997/JRCPE.2019.112

PubMed Abstract | Crossref Full Text | Google Scholar

43. Marker S, Mohr M, Østergaard D. Simulation-based training of junior doctors in handling critically ill patients facilitates the transition to clinical practice: an interview study. BMC Med Educ. (2019) 19:1–8. doi: 10.1186/s12909-018-1447-0

PubMed Abstract | Crossref Full Text | Google Scholar

44. Matos FM, Martins MR, Martins I. Non-technical skills progression during anesthesiology residency in Portugal: the impact of a National Pedagogical Plan. Med Educ Online. (2020) 25:1800980. doi: 10.1080/10872981.2020.1800980

PubMed Abstract | Crossref Full Text | Google Scholar

45. L'Her E, Geeraerts T, Desclefs JP, Benhamou D, Blanié A, Cerf C, et al. Simulation-based teaching in critical care, anaesthesia and emergency medicine. Anaesth Crit Care Pain Med. (2020) 39:311–26. doi: 10.1016/j.accpm.2020.03.010

PubMed Abstract | Crossref Full Text | Google Scholar

46. Kennedy CC, Cannon EK, Warner DO, Cook DA. Advanced airway management simulation training in medical education: a systematic review and meta-analysis. Crit Care Med. (2014) 42:169–78. doi: 10.1097/CCM.0b013e31829a721f

PubMed Abstract | Crossref Full Text | Google Scholar

47. Farrukh K. Metaverse in medical education: a paradigm shift. Pak J Med Sci. (2024) 40:255. doi: 10.12669/pjms.40.1.8752

PubMed Abstract | Crossref Full Text | Google Scholar

48. Seddon I, Rosenberg E, Houston SK. Future of virtual education and telementoring. Curr Opin Ophthalmol. (2023) 34:255–60. doi: 10.1097/ICU.0000000000000945

PubMed Abstract | Crossref Full Text | Google Scholar

49. Wang Y, Li C, Qu L, Cai H, Ge Y. Application and challenges of a metaverse in medicine. Front Robot AI. (2023) 10:1291199. doi: 10.3389/frobt.2023.1291199

PubMed Abstract | Crossref Full Text | Google Scholar

50. Wu TC, Ho CTB. A scoping review of metaverse in emergency medicine. Australas Emerg Care. (2023) 26:75–83. doi: 10.1016/j.auec.2022.08.002

PubMed Abstract | Crossref Full Text | Google Scholar

51. Gonzalez LS, Donnelly MJ. A survey of residency program directors in anesthesiology regarding mentorship of residents. J Clin Anesth. (2016) 33:254–65. doi: 10.1016/j.jclinane.2016.03.004

PubMed Abstract | Crossref Full Text | Google Scholar

52. Ross S, Liu EL, Rose C, Chou A, Battaglioli N. Strategies to enhance wellness in emergency medicine residency training programs. Ann Emerg Med. (2017) 70:891–7. doi: 10.1016/j.annemergmed.2017.07.007

PubMed Abstract | Crossref Full Text | Google Scholar

53. Thornton KC, Sinskey JL, Boscardin CK, Sullivan KR. Design and implementation of an innovative, longitudinal wellness curriculum in an anesthesiology residency program. A A Pract. (2021) 15:e01387. doi: 10.1213/XAA.0000000000001387

PubMed Abstract | Crossref Full Text | Google Scholar

54. Chaisirin W, Wongkrajang P, Thoesam T, Praphruetkit N, Nakornchai T, Riyapan S, et al. Evidence-based interventions that promote resident wellness from the council of emergency residency directors. Western J Emerg Med. (2020) 21:412. doi: 10.5811/westjem.2019.11.42961

PubMed Abstract | Crossref Full Text | Google Scholar

55. Saadat H, Snow DL, Ottenheimer S, Dai F, Kain ZN. Wellness program for anesthesiology residents: a randomized, controlled trial. Acta Anaesthesiol Scand. (2012) 56:1130–8. doi: 10.1111/j.1399-6576.2012.02705.x

PubMed Abstract | Crossref Full Text | Google Scholar