Solveig Giske1*
Siv M. Gamlem2Marit Kvangarsnes1,3
Bodil J. Landstad4,5Torstein Hole6,7
Berit Misund Dahl1,8- 1Department of Health Sciences in Ålesund, NTNU - Norwegian University of Science and Technology, Ålesund, Norway
- 2Department of Pedagogy, Volda University College, Volda, Norway
- 3Ålesund Hospital, Møre and Romsdal Hospital Trust, Ålesund, Norway
- 4Faculty of Health Sciences, Mid Sweden University, Östersund, Sweden
- 5Unit of Research, Education and Development, Östersund Hospital, Östersund, Sweden
- 6Medical Department, Ålesund Hospital, Møre and Romsdal Hospital Trust, Ålesund, Norway
- 7Faculty of Medicine and Health Sciences, NTNU - Norwegian University of Science and Technology, Trondheim, Norway
- 8Department of Public Health, University of Stavanger, Stavanger, Norway
Introduction: Primary care placement for nursing and medical students is vital for developing the competence to accommodate the increasing number of patients with multimorbid and complex conditions. Prior studies have suggested that interaction quality in primary care placement empowers learning. However, research mapping interaction quality in primary care placements in municipal emergency care units is lacking. This study aimed to systematically map interaction quality for nursing and medical students in primary care placement in two municipal emergency care units.
Materials and methods: This study adopted a systematic descriptive observational design. Systematic observations (n = 201 cycles) of eight nursing students (n = 103 cycles) and six medical students (n = 98 cycles) were used to map interaction quality across six learning situations between March and May 2019. Observations were coded using the Classroom Assessment Scoring System-Secondary (CLASS-S). Data were analyzed using descriptive statistics and Spearman correlations.
Results: Interaction quality is described in three domains: (I) emotional support, (II) framework for learning, and (III) instructional support, and the overall measure, student engagement. The results indicated middle-quality interactions in the emotional and instructional support domains and high quality in the framework for learning domain and student engagement. Correlations exhibited similar patterns and ranged from non-significant to strong correlations.
Conclusion: The interaction qualities indicated a generally positive and supportive learning environment contributing to nursing and medical students’ learning and active participation in work tasks related to their professional roles. Thus, this new form for primary care placement for nursing and medical students in the municipal emergency care units was found to be a positive learning arena. These results may enhance nursing and medical education programs in countries with similar health services and education. Health education, supervisors, peers, and others contributing to students’ learning should recognize which interaction qualities may affect learning and how to improve quality, thus affecting supervisors’ approach to training students. While the CLASS-S showed potential for mapping interaction qualities for nursing and medical students in primary care placement in municipal emergency care units, further studies are needed to validate the CLASS-S for use in clinical placement settings.
Introduction
Learning in clinical placement is considered vital for nursing and medical students to integrate theoretical knowledge and practical skills and form a professional identity for becoming a competent nurse or physician (1, 2). Nursing and medical education have been criticized for not adapting to societal changes involving the growing number of patients with multimorbidity and complex conditions and the transfer of healthcare services from secondary to primary healthcare. These changes have precipitated the need to develop students’ competence through primary care placements to meet the primary healthcare system’s patient care and treatment demands (3, 4). Norwegian municipalities offer emergency inpatient care for patients with somatic, substance use, and mental health challenges in municipal emergency care units1 (5). Studies have demonstrated that these units require nurses with advanced clinical competence and physicians with general medical expertise and skilled in leading complex interprofessional collaborations (6–8). Undergoing clinical placement in municipal emergency care units may contribute to preparing nursing and medical students for future work in this area. Furthermore, studies have reported that vital aspects of nursing and medical students’ learning process in primary care placement occur in interactions with supervisors, peers, interprofessional collaborations and patients (9–11). However, the quality of those interactions may influence students’ learning experiences (12, 13). Interaction quality in primary care placement in municipal emergency care units for nursing and medical students has not been studied previously. Therefore, this study aimed to map interaction quality for nursing and medical students in primary care placement in two municipal emergency care units.
Prior research has indicated that nursing and medical students in primary care placements value quality interactions that contribute to an engaging and inclusive learning environment, wherein supervisors facilitate a gradual progression in learning activities in their respective community of practice (CoP) (9, 14, 15). Further, supervisors who demonstrate an interest in students’ learning by being prepared and engaged reportedly contribute to a safe learning environment that facilitates active participation (16, 17). These results are supported by Bos et al. (18), who reported that nursing students’ motivation for learning is strongly associated with supervisory relationships and a pedagogical atmosphere. Moreover, Thyness et al. (19) found that medical students were more likely to observe rather than actively participate in learning activities when they felt unsafe.
Nursing and medical students have reported that proximity to one or two supervisors contributes to a trusting supervisor relationship that supports students’ confidence in asking questions and showing professional weakness (20, 21). Nursing and medical students have also suggested that supervisor proximity helps supervisors more accurately assess students’ knowledge and skills and assign appropriate work tasks related to their learning goals (13, 22). Additionally, proximity contributes to supervisor feedback that is timely, constructive, and adapted to students’ levels of competence and clinical performance (13, 20). Interestingly, Bates et al. (23) found that medical students interpreted critical feedback as supportive of learning—rather than challenging—when the supervisor relationship was built on trust.
Reportedly, a trustful supervisor relationship promotes opportunities for professional and ethical discussions that may further stimulate learning and encourage self-confidence and professionalism (12, 21). Studies have indicated that nursing and medical students value supervisors who ask questions, take time to listen to students’ thoughts, and show interest in their knowledge and perceptions (24, 25). Nursing students report feeling invisible, worthless, and that they are missing out on discussion opportunities when supervisors fail to engage in professional discussions (26). Further, studies have demonstrated that nursing and medical students consider their supervisors important professional role models in terms of how they interact with patients, peers, and the students themselves, thus contributing to students’ professional development (18, 21, 27). In Salminen et al. (13) study, medical students reported that supervisors who were friendly to patients were also friendly to students.
While the aforementioned literature focuses on supervisor–student interactions, nursing and medical students have also been found to value learning through interacting interprofessionally and with patients (28, 29). Studies have demonstrated that interprofessional collaboration enables students to learn about each other’s professional roles, view patients’ situations from a holistic perspective, and communicate with each other effectively and respectfully (29, 30). Additionally, professional and ethical reflections are shown to contribute to knowledge and interprofessional understanding (31).
Prior research has suggested that patients are generally optimistic about letting students practice on them (32, 33). Moreover, patients’ goodwill toward students is crucial to learning, and medical students have reported that patients who express a desire to contribute to their learning motivate the former to spend more time asking questions and conducting examinations (19).
While previous studies report on interaction qualities important for nursing and medical students’ learning in primary care placement, research that systematically maps it in placements in municipal emergency care units is lacking. Thus, this study aimed to systematically map the interaction quality for nursing and medical students in primary care placement in two municipal emergency care units and to answer the following research question:
What is the interaction quality for nursing and medical students in primary care placement in municipal emergency care units?
Materials and methods
Design
This study adopted a systematic descriptive observational research design2 (34, 35). To map interaction quality, systematic observations of nursing and medical students across six learning situations were conducted and coded using the Classroom Assessment Scoring System-Secondary (CLASS-S) (36).
Participants and setting
Eight nursing students (out of 35 eligible), four from each of two Norwegian universities, and six medical students (out of 19 eligible) from one of those universities were conveniently sampled based on fulfilling the following inclusion criteria (34): (1) fourth-semester nursing students attending medical clinical placement at a local hospital or medical center, (2) ninth-semester medical students attending medical clinical placement at a local hospital, (3) Norwegian speaking, and (4) interested in participating. The municipal emergency care units’ management recommended the number of students based on academic and structural resources. The nursing students (seven females and one male) were aged 20–41 years (median age = 22 years). The medical students (four females and two males) were aged 24–28 years (median age = 26).
The municipal emergency care units were located in two cities in mid-Norway and were chosen based on professional affiliations with the two universities. The nursing and medical students participated in a new form for clinical placement where they trained on their professional role in collaboration with each other, supervisors, other colleagues, and patients. This placement lasted 2 weeks and replaced 2 weeks of their original medical clinical placement. The students were divided into four groups, each containing two nursing students and one or two medical students. The groups took turns completing their clinical placements. Two groups were placed in each municipal emergency care unit based on geographical proximity. Based on the units’ structure, a daily step-by-step plan was developed to facilitate six learning situations: morning meetings, preparations, pre-rounds, rounds, clinical work, and afternoon meetings. Additionally, the plan also included a schedule for the systematic observations (Table 1).
Table 1. The day’s plan, characteristics of the learning situations, and schedule for the systematic observations.
Measure
The Classroom Assessment Scoring System-Secondary (CLASS-S) (36) is an observational tool designed to assess the quality of teacher–student interactions as a starting point for learning in secondary and upper secondary schools (36, 37). The CLASS-S has been validated and used for classroom research in Norway (38, 39), the USA (37, 40), and Finland (41). According to a meta-analysis of the CLASS factor structure, it represents the data effectively (42), thus verifying the CLASS-S′ efficacy as a tool for studying teacher–student interactions.
The CLASS-S measures interaction quality via three domains—namely, emotional support, classroom organization, and instructional support, and an overall measure of student engagement (36, 40). Furthermore, each domain has three–five dimensions (Table 2) that are based on developmental theory (44) and a sociocultural learning perspective (15, 45). Each dimension and the overall measure of student engagement contain custom behavioral markers forming the basis and guide the observer for scoring on a 7-point Likert scale, wherein 1–2 = low quality, 3–5 = middle quality, and 6–7 = high quality (36). However, negative climate is reversed, meaning low scores indicate rare or absent occasions of negativity (36, 38). The scores are registered on an observation form—the Secondary CLASS Score Sheet3 (43). Overall, the dimensions’ quality indicates the extent to which teacher–student interactions support learning (36). The CLASS-S manual suggests that the systematic observations are organized in 25-min cycles of 15–20 min of observation and note-taking, followed by 10 min of scoring (36, 39). However, observation cycles may be interrupted owing to unexpected circumstances, and hence, a minimum of 8 min of observational time is considered acceptable for scoring (36).
Table 2. Overview of the CLASS-S and descriptions of the dimensions and overall measure (36).
The emotional support domain highlights that students’ social and emotional functioning in the classroom contributes to school success (36, 40). This domain is theoretically based on attachment (46) and self-determination theories, which illuminate an individual’s need for belonging and autonomy (47, 48), and contains three dimensions: positive climate, teacher sensitivity, and regard for adolescent perspectives. The domain classroom organization assumes that classrooms are well organized, with teachers managing students’ behavior, time, and tasks to provide the most learning opportunities (36). This domain is founded on theories of self-regulatory skills related to students’ cognition, efforts to achieve learning goals (49), and how learning occurs in social interactions in CoPs (15). This domain encompasses three dimensions: behavior management, productivity, and negative climate. The instructional support domain highlights the difference between merely learning facts and achieving a deeper understanding, with the teacher using strategies to facilitate learning (50). This domain builds on students’ cognitive and language development, which involves how they construct and develop knowledge in a meaningful way (51), and contains five dimensions: instructional learning formats, content understanding, analysis and inquiry, quality of feedback, and instructional dialogue. The overall measure for student engagement captures students’ overall engagement levels and functioning in the classroom (36).
To the best of our knowledge, the CLASS-S has not been used to systematically map the quality of teacher–student interactions for nursing or medical students in clinical placement settings. Nor did we find studies that systematically map interaction quality in clinical placement for nursing or medical students. The CLASS-S intends to examine the quality of teacher–student interactions in the classroom; nevertheless, we used it to study the overall quality of nursing and medical students’ interactions in primary care placement in two municipal emergency care units. The measure was adapted to fit the study setting; the domain classroom organization was renamed framework for learning because the setting was in a clinical environment and not a classroom. The dimension regard for adolescent perspective was omitted because the participants were adult students (Table 2).
Data collection
Systematic observations were conducted between March and May 2019 by four of the six authors. Two and two researchers were present at the municipal emergency care units—taking turns observing a nursing or medical student across the six learning situations while interacting within the CoPs. Overall, the nursing and medical students were systematically observed 2 days per week during their two-week clinical placement. The systematic observations were coded according to the CLASS-S manual (36) and scored on individual Secondary CLASS Score Sheets4 (43).
We conducted 215 systematic observation cycles distributed among the nursing (n = 113 cycles) and medical students (n = 102 cycles). The observational time within the collected cycles ranged from 2 to 71 and 3 to 43 min for the nursing and medical students, respectively. Notably, 23 cycles exhibited <8 min of observational time, 8 of which exhibited <6 min of observation time; hence, we decided to include all cycles with a minimum observational time of 6 min. Moreover, cycles with missing data <5% were deleted listwise. After data cleaning, the number of systematic observations for analysis was 201 cycles distributed among the nursing (n = 103 cycles) and medical students (n = 98 cycles). The observational time within the collected cycles ranged from 6 to 71 and 6 to 43 min for the nursing and medical students, respectively.
Two pre-training sessions were carried out to strengthen interrater reliability, meaning the extent to which the data collectors agree and assign scores within one point to the same variable calibrated toward a master coder (36, 52). The second author, who is a certified user of the CLASS-S and thus considered a master coder, led the pre-training sessions and was responsible for the scoring in this study. The pre-training sessions resulted in calibrated scores and a coding consensus of more than 80%, which aligns with the CLASS-S manual (36). To further enhance interrater reliability during data collection, the researchers conducted daily meetings to calibrate the scores by discussing and justifying their coding.
Data analysis
Data were analyzed using IBM SPSS version 28. Based on our data being ordinal, descriptive statistics of the median, mode, minimum (Min), and maximum (Max) values used to map interaction quality across the six learning situations. In addition, we have reported the mean to facilitate comparisons with previous and any future studies. We calculated the values for the domains and the dimensions. For the dimensions, a total score was calculated based on averages for the cycles overall and separately for the nursing and medical students (i.e., Positive climate (PC): PC1 + PC2 + PC3 + …. /103 = PC).
Bivariate correlations were assessed using Spearman’s rank order correlation as this is suitable for ordinal data. It measures monotonicity, whereas the more standard Pearson correlation coefficient measures linear dependence and is more appropriate for continuous variables (53). Two-sided p < 0.05 was considered statistically significant; we did not correct for p-values for multiple testing. We classified the correlation coefficient as follows: 0.1–0.29 (weak correlation); 0.30–0.49 (medium correlation); 0.50 or higher (strong correlation) (54).
Cronbach’s alpha and mean inter-item correlation values were calculated to determine the internal consistency reliability of the CLASS-S domains and overall for the dimensions and student engagement (Table 3) (54). The alpha values for the emotional support domain ranged between 0.34 and 0.64, which means low internal consistency. The mean inter-item values ranged between 0.21 and 0.48, which indicated acceptable internal consistency. The framework for learning domain showed alpha values ranging between 0.45 and 0.72, which meant that internal consistency ranged between low to acceptable values. The mean inter-item values ranged between 0.19 and 0.51, which indicated acceptable internal consistency. The domain instructional support showed strong internal consistency with alpha values between 0.82 and 0.84 and mean inter-item values between 0.50 and 0.53. For all dimensions and overall measure student engagement, the alpha values showed strong internal consistency with values of 0.87 both overall and separately for the nursing and medical students and acceptable mean inter-item values ranging between 0.37 and 0.39.
Table 3. Cronbach’s alpha and mean inter-item correlations for the CLASS-S domains, dimensions, and overall measure for student engagement, for all students and the nursing and medical students separately.
Ethical considerations
The Norwegian Centre for Research Data (reference number 602973) approved this study. The students received oral and written information regarding the study. Following the ethical principles of the World Medical Association Declaration of Helsinki, we informed them that participation was voluntary, data would be kept confidential, and they could withdraw from the study at any time without justification or facing any adverse consequences (55). The students’ supervisors were orally informed about the study and verbally agreed to be observed while interacting with the students. The students obtained oral patient consent before the researchers observed interactions involving patients.
Results
Interaction quality across students’ learning situations is described through the CLASS-S domains, dimensions, and overall measure of student engagement.
Characteristics and distribution of the learning situations
Table 1 presents the characteristics of the learning situations. Table 4 presents an overview of the distribution of the students’ learning situations (n = 201 cycles) and those for the nursing (n = 103 cycles) and medical students (n = 98 cycles). The most frequently observed learning situation for all students and for the nursing and medical students separately was clinical work. The least observed learning situation for all students and the medical students was the morning meeting, whereas that for the nursing students was rounds.
Table 4. Overview of the distribution of the systematically observed learning situations for the nursing and medical students.
Interaction quality across learning situations overall
The overall results in the domains for the nursing and medical students presented median values in the upper-middle to high range (Table 5). The emotional support dimensions positive climate and teacher sensitivity exhibited median values in the upper-middle range. In the framework for learning domain, the dimensions of behavior management and productivity exhibited median values in the high range; negative climate (reversed scored) exhibited median values in the low range. The instructional support dimensions instructional learning formats, content understanding, analysis and inquiry, quality of feedback, and instructional dialogue exhibited median values in the upper-middle range; an exception here was analysis and inquiry, which exhibited a median value in the middle range. Finally, the overall measure of student engagement exhibited a median value in the high range.
Table 5. Descriptive statistics elucidating the CLASS-S domains, dimensions, and overall measure—for all students and the nursing and medical students separately.
All the dimensions and the overall measure for student engagement—except positive climate, behavior management, and negative climate (reversed scored)—were scored within all three ranges. While the former two were scored between the middle and high ranges, the latter was scored between the low and middle ranges. All dimensions and the overall measure for student engagement received the highest possible score (Max = 7), except negative climate (Max = 4). The dimensions of negative climate, instructional learning formats, content understanding, analysis and inquiry, and instructional dialogue received the lowest possible score (Min = 1).
Interaction quality across learning situations
The results for the nursing and medical students (separately) revealed that median values within the domains, dimensions, and overall measure for student engagement were reasonably similar (Table 5). In the dimensions, the most significant difference was found in the analysis and inquiry dimension, which exhibited a somewhat lower median value for nursing students than for medical students. Further, the minimum and maximum scores showed results that were the same as—or had a one-point difference in—the minimum scoring, except for negative climate and student engagement, which exhibited a two-point difference in the minimum or maximum scoring.
Bivariate correlations among the CLASS-S dimensions and student engagement measure
For all the students, and the nursing and medical students separately (Tables 6–8, respectively), the two strongest correlations within the dimensions were between instructional dialogue and quality of feedback and between content understanding and instructional learning formats. The weakest correlation for all students was between content understanding and negative climate. The weakest correlation was between analysis and inquiry and instructional learning formats for nursing students and between analysis and inquiry and teacher sensitivity for medical students.
Table 6. Correlation matrix of scores for the quality of interactions for the nursing- and medical students.
Table 7. Correlation matrix of scores for the quality of interactions for the nursing students.
Table 8. Correlation matrix of scores for the quality of interactions for the medical students.
Generally, the correlations within the dimensions exhibited similar patterns, but some differences were observed when comparing nursing and medical students. While negative climate exhibited no significant correlations with any dimension for the nursing students, several weak significant negative correlations were noted for the medical students. For nursing students, the results exhibited weak significant correlations between positive climate and teacher sensitivity, and positive climate and content understanding. However, these dimensions did not exhibit significant correlations for the medical students.
Moreover, correlations involving the overall measure of student engagement revealed similar results for all the students and for the nursing and medical students separately. The strongest correlations were observed with productivity and teacher sensitivity, respectively. The weakest correlations were with negative climate for all students’ results (Table 6) and with analysis and inquiry for both nursing and medical students separately (Tables 7, 8, respectively).
Discussion
This study aimed to map interaction quality for nursing and medical students in primary care placement in two municipal emergency care units. Based on the CLASS-S, systematic observations provided valuable information regarding the quality of interactions occurring while students participated in learning activities in the CoPs. The results revealed that the interaction quality was generally in the upper-middle range in the domains of emotional support and instructional support and high quality in framework for learning. We found a high degree of active student participation in the overall measure of student engagement. The correlations exhibited similar patterns for all students as well as for the nursing and medical students separately—ranging from non-significant to strong correlations.
In the emotional support domain, our results indicated that interaction quality was generally characterized by positive emotional relations and attention to students’ learning needs (36). Previous studies have demonstrated that nursing and medical students value quality interactions involving friendly and approachable supervisors, as such interactions promote a sense of belonging, trust, and safety (20, 21); otherwise, students have reported feeling ignored and unwanted, contributing to less favorable learning experiences (12, 56). Additionally, our results showed medium to strong positive correlations between the dimensions within the emotional support domain and the overall measure of student engagement. This indicates an important connection between emotional support and active student participation. These correlations concur with the studies of Lea et al. (16), O’Donoghue et al. (17), and Thyness et al. (19) suggesting that supervisors who show interest in students can improve student participation. Using the CLASS-S, we obtained information regarding the extent to which the interaction quality within the dimensions of the emotional support domain occurs in municipal emergency care units. The results provide useful information for these units to consider further development as a learning arena for nursing and medical students. Our results were in the upper-middle range, which suggests room for improvement. Supervisors and others participating in nursing and medical students’ primary care placement in municipal emergency care units should, therefore, recognize the importance of interactions that reflect a welcoming atmosphere, respectful communication, and attention to students’ learning needs.
Our results in the domain framework for learning exhibited high scores in the behavior management and productivity dimensions for all the students. According to the CLASS-S manual, high scores in these dimensions indicate that the students fulfilled behavioral expectations, were engaged, and participated actively in work tasks related to their professional roles (36). Previous studies have reported that clear expectations of work tasks and access to learning activities in CoPs contribute to active student participation, which further promotes learning on a peripheral trajectory (56, 57). By contrast, nursing and medical students have reported that being ignored or an absence of supervisor engagement in the CoP precipitates passivity and limited active participation (56, 57). In the CLASS-S manual, the degree of student participation in learning activities is examined through the overall measure of student engagement (36). Our results revealed medium positive correlations between behavior management and student engagement and strong positive correlations between productivity and student engagement, thus indicating a connection between active participation and student engagement.
For both nursing and medical students, we found generally low scores on the negative climate dimension, indicating rare or absent episodes of negativity. However, the results for the medical students exhibited a maximum score of four in one case, between the medical and nursing students themselves. Whelan et al. (58) demonstrated how negative interactions may affect medical students’ learning; they found that medical students’ experience of shame in clinical placement (related to supervisors humiliating them for lacking medical knowledge or treating them in a disrespectful way) reduces their confidence, engagement, and motivation. Additionally, Thyness et al. (19) found that medical students—when feeling unsafe—exhibit a learning style of passive observation rather than that of active participation. Similar findings have been reported in studies involving nursing students (12, 59). Despite our results indicating a low degree of negativity in the municipal emergency care units, supervisors and others contributing to nursing and medical students’ learning should avoid negative behaviors such as irritability, sarcasm, or disrespect, and be aware of how they may negatively affect student participation and learning. Based on our results, the CLASS-S seems useful for mapping the extent to which students’ active participation, related to the framework for learning domain, is facilitated in the municipal emergency care units.
Per our results regarding the instructional support domain, interaction quality was observed in the upper-middle range. Aligned with the CLASS-S, the results indicated that work tasks were generally clearly presented and that strategies were used to facilitate students’ higher-order thinking, metacognition, and deeper understanding (36). However, within this domain, we observed the lowest interaction quality in the analysis and inquiry dimension, which represents cognitive and metacognitive strategies that stimulate students’ engagement in problem-solving (36). In previous studies, nursing and medical students have reported that they derive greater educational value when supervisors challenge their knowledge by asking questions and creating space for students’ reflections, thus contributing to developing deeper knowledge, confidence, and independence (12, 21). Skaalvik et al. (26) reported that when supervisors fail to engage in professional reflections, nursing students perceive missing opportunities for knowledge development. In Giske et al. (60), medical students reported developing independent thinking skills if the supervisor facilitated student reflection before providing an answer to the challenge in question. Based on our results, nursing and medical students in municipal emergency care units had learning opportunities to reflect on patient situations and ethical dilemmas. Notably, we found middle-quality interactions, which, however, suggest possibilities for improvement; supervisors can increase their awareness regarding facilitating students’ higher-order thinking skills. Overall, the CLASS-S tool was found useful to map interaction quality related to possibilities for students’ reflections and development of knowledge.
Limitations
While the CLASS-S was developed to examine the quality of teacher–student interactions in secondary and upper secondary schools (36, 37), we used it to map the overall interaction qualities for nursing and medical students in primary care placement in two municipal emergency care units. Using the CLASS-S formed a novel approach to study interaction qualities with a new population and setting, for which the CLASS-S has not been validated. Thus, it became necessary to assess face and content validity (34, 61). To assess validity, several measures were carried out. The authors who were to systematically observe nursing and medical students, carefully studied the CLASS-S manual and Secondary CLASS Score Sheet to understand the background, content, and how quality of interactions could be scored (36, 43). In addition, the second author who is a certified user of the CLASS-S, instructed in detail about the CLASS-S domains, dimensions, procedure for observation, and scoring. The second author is a professor of pedagogy, and the third author is a professor of nursing science and pedagogy. They provided professional insight to assess whether the underlying pedagogical basis for the CLASS-S could also be suitable for adult students such as nursing and medical students, which all authors agreed.
Because the CLASS-S is intended to reflect the resources available to students and interaction qualities can be observed in groups with several teachers and students (36), we considered that the CLASS-S dimensions and overall measure could be used to study nursing and medical students’ overall quality of interactions with nurses, physicians, peers, and patients in relevant CoPs (15). However, instead of focusing on the supervisor (36), we focused on either a nursing or medical student when coding interaction behavior. In addition to observing interaction qualities in groups where students, supervisors and/or patients participated, we were open to observe interaction qualities in groups with two participants (e.g., student–student or student-patient). In this context, we realized that a supervisor would be missing, but that it might still be possible to code interaction qualities based on the CLASS-S. Based on thorough review and discussions of the CLASS-S intention, content, and planning how to adjust and use this analysis tool, we considered that the CLASS-S can be useful for studying interaction qualities in municipal emergency care unit placement for nursing and medical students and provide valid results. However, we recognize that the CLASS-S should be further tested in clinical settings for nursing and medical students to strengthen evidence of validity.
In this study, we used Cronbach’s alpha to determine the internal consistency reliability and found that the alpha values ranged between low and acceptable levels (54). In the emotional support domain, the alpha values were low and in the domain framework for learning the values were low for both professions and the nursing students, and acceptable for the medical students (Table 3). However, previous studies which have used the CLASS-S in school settings, have reported acceptable alpha values in the above-mentioned domain levels. For example, Virtanen et al. (41) calculated alpha values for emotional support at 0.83, and organizational support at 0.82. Gitomer et al. (62) calculated alpha values for emotional support at 0.83, and classroom organization at 0.75.
The low alpha values in this study can be attributed to the fact that these domains contain two and three dimensions, respectively (54, 63). Thus, reporting the mean inter-item correlation values can be a better measure of internal consistency (54). Briggs and Cheek (64) argue that the optimal mean inter-item correlation values range between 0.2 and 0.4, and if higher than 0.5, the items may be redundant. In this study, the mean inter-item correlations in the emotional support domain ranged between 0.21 and 0.48, which is acceptable, and in the framework for learning domain between 0.19 and 0.51, which is also acceptable. Further, the low alpha values in this study can be explained by the professional setting in higher education that occurs during clinical placement in municipal emergency care units for nursing and medical students. Within the emotional support domain, we observed that there was a polite and respectful atmosphere where the participants were aware of each other and where positive effects such as smiles and laughter were often unnatural. In the framework for learning domain, we observed that students met behavioral expectations and largely knew what they were supposed to do, and participated actively in learning situations, which may explain the low degree of negative climate, which is good. Negative climate should be low since it might be a hinder for quality work (36).
Although the domains emotional support and framework for learning showed low alpha values, the mean inter-item correlations showed acceptable values. We nevertheless suggest that these domains should be considered related to be used as they are in further studies in municipal emergency care units or similar settings. However, it is interesting that the framework for learning domain showed acceptable alpha and mean inter-item values for the medical students. In the instructional support domain, the alpha and mean inter-item values were within acceptable levels. This domain focus on learning activities with the aim of delivering quality in what the students are supposed to learn or do. The high alpha values indicate that this domain has a high degree of internal consistency and can be used in further studies in the same or similar settings.
While this study’s results cannot be generalized (34), they may reflect interaction qualities for nursing and medical students in primary care placement in the municipal emergency care units. The results, based on the CLASS-S, may be used to develop clinical placement arenas and supervisors’ awareness of interaction quality to support student learning. Furthermore, the results may enhance the knowledge regarding interaction quality in primary care placement, which can be transferable to nursing and medical education in all clinical placement arenas and among supervisors, students, and others involved in students learning.
The systematic observations in the cycles (n = 201) ranged from 6 to 71 min; thus, some did not align with the CLASS-S manual (36). As the observations were conducted in live clinical settings with real patients, a precise determination of when to start and stop the observation cycle was challenging. However, Vattøy and Gamlem (65) demonstrated that shorter and longer observation times within the cycles (5–15 min) can capture aspects of teacher–student interactions. Accordingly, we considered that shorter and longer observation cycles could adequately describe interaction quality. The large number of observation cycles applied herein strengthened this study’s validity. To avoid compromising validity, we decided that all observation cycles would have a minimum observation time of 6 min.
Conclusion
This study aimed to systematically map interaction quality for nursing and medical students in primary care placements in two municipal emergency care units. Based on the CLASS-S, the interaction quality indicated a generally positive and supportive learning environment contributing to students’ learning and active participation in work tasks related to their professional roles. Thus, this new form for primary care placement in the municipal emergency care units for nursing and medical students was found to be a positive learning arena. The results may enhance nursing and medical education programs in countries with similar health services and education. Health education, supervisors, peers, and others contributing to students’ learning, should recognize which interaction qualities may affect learning and how to improve the quality, thus affecting supervisors’ approach to training students. While the CLASS-S showed potential for mapping interaction quality for nursing and medical students in primary care placement in municipal emergency care units, further studies are needed to pilot and validate the CLASS-S for use in clinical placement settings.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author contributions
SG, SMG, MK, BJL, TH, and BMD contributed to the conceptualization and methodology of this study, carefully reviewed and edited the manuscript. SG, MK, BJL, and BMD collected the data. SG, SMG, and TH analyzed the data. SG wrote the first draft of the manuscript. All authors approved the final version of this manuscript.
Funding
This study was part of a Ph.D. project funded by the NTNU - Norwegian University of Science and Technology, Faculty of Medicine and Health Sciences.
Acknowledgments
We thank the nursing and medical students who participated in this study. Further, we thank all the supervisors and patients for allowing us to observe their interactions with the students. We also thank the municipal emergency care units for their cooperation and hospitality and the university staff for helping recruit students. Finally, we thank Tor Åge Myklebust for his guidance and support during data analysis.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Abbreviations
CoP, Community of Practice; CLASS-S, Classroom Assessment Scoring System-Secondary.
Footnotes
1. ^The Norwegian Directorate of Health: https://helsedirektoratet.no/Lists/Publikasjoner/Attachments/133/Kommunenes-plikt-til-oyeblikkelig-hjelp-dognopphold-veiledningsmateriell.pdf
2. ^ https://explorable.com/descriptive-research-design
References
1. Benner, P, Sutphen, M, Leonard, M, and Day, L. Educating nurses: a call for radical transformation. San Francisco, CA: Jossey-Bass (2010).
2. Cooke, M, Irby, DM, and O'Brien, BC. Educating physicians: a call for reform of medical school and residency. San Francisco, CA: Jossey-Bass (2010).
3. Frenk, J, Chen, L, Bhutta, ZA, Cohen, J, Crisp, N, Evans, T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. (2010) 376:1923–58. doi: 10.1016/S0140-6736(10)61854-5
4. World Health Organization & United Nations Children's Fund (UNICEF). A vision for primary health care in the 21st century: towards universal health coverage and the sustainable development goals. (2018). Available at: https://apps.who.int/iris/handle/10665/328065 (Accessed September 5, 2023).
5. The Norwegian Directorate of Health. Kommunenes plikt til øyeblikkelig hjelp døgnopphold. Veiledningsmateriell [Municipalities duty to provide inpatient emergency care]. Guidance Material. (2016). Available at: https://www.helsedirektoratet.no/rapporter/kommunenes-plikt-til-oyeblikkelig-hjelp-dognopphold/Kommunenes%20plikt%20til%20%C3%B8yeblikkelig%20hjelp%20d%C3%B8gnopphold.pdf/_/attachment/inline/92f525bc-b877-485e-b7bc-66670d00886f:87df71d03c450ff1bae72c213db0fb4a07b13a6f/Kommunenes%20plikt%20til%20%C3%B8yeblikkelig%20hjelp%20d%C3%B8gnopphold.pdf (Acessed December 4, 2023).
6. Hole, T, Barstad, J, Teigen, S, and Kvangarsnes, M. Øyeblikkelig hjelp-døgnopphald i seks kommunar på sunnmøre [Emergency hospitalisation in six municipalites in the Sunnmøre district]. Tidsskr Nor Laegeforen. (2015) 135:1553–7. doi: 10.4045/tidsskr.14.1619
7. Landstad, BJ, Hole, T, Strand, AMS, and Kvangarsnes, M. Nursing qualifications needed in municipal emergency inpatient units: a qualitative study. BMC Nurs. (2021) 20:223. doi: 10.1186/s12912-021-00733-w
8. Strand, AMS, Kvangarsnes, M, Landstad, BJ, Kvalsvik Teige, B, and Hole, T. Hvilke legekvalifikasjoner er det behov for ved øyeblikkelig hjelp døgnopphold i den norske kommunehelsetjenesten? [What doctor qualifications are necessary in emergency hospitalization in the Norwegian primary health care service?]. Michael. (2019) 3:293–305.
9. Dallas, A, Hiew, WGS, Kay, B, Jackson, H, Reid, K, Presser, J, et al. Medical students value-adding to general practice. Aust J Gen Pract. (2022) 51:152–6. doi: 10.31128/ajgp-03-21-5872
10. Husebø, AML, Storm, M, Våga, BB, Rosenberg, A, and Akerjordet, K. Status of knowledge on student-learning environments in nursing homes: a mixed-method systematic review. J Clin Nurs. (2018) 27:e1344–59. doi: 10.1111/jocn.14299
11. Kent, F, and Keating, JL. Interprofessional education in primary health care for entry level students-a systematic literature review. Nurse Educ Today. (2015) 35:1221–31. doi: 10.1016/j.nedt.2015.05.005
12. Laugaland, K, Kaldestad, K, Espeland, E, McCormack, B, Akerjordet, K, and Aase, I. Nursing students’ experience with clinical placement in nursing homes: a focus group study. BMC Nurs. (2021) 20:159. doi: 10.1186/s12912-021-00690-4
13. Salminen, H, Ohman, E, and Stenfors-Hayes, T. Medical students' feedback regarding their clinical learning environment in primary healthcare: a qualitative study. BMC Med Educ. (2016) 16:313. doi: 10.1186/s12909-016-0837-4
14. Lewis, R, and Kelly, S. Changing hearts and minds: examining student nurses’ experiences and perceptions of a general practice placement through a ‘community of practice’ lens. BMC Med Educ. (2018) 18:67. doi: 10.1186/s12909-018-1182-6
15. Wenger, E . Communities of practice: learning, meaning, and identity. Cambridge: Cambridge University Press (1998).
16. Lea, E, Marlow, A, Bramble, M, Andrews, S, Crisp, E, Eccleston, C, et al. Learning opportunities in a residential aged care facility: the role of supported placements for first-year nursing students. J Nurs Educ. (2014) 53:410–4. doi: 10.3928/01484834-20140620-02
17. O’Donoghue, S, McGrath, D, and Cullen, W. How do longitudinal clerkships in general practice/primary care impact on student experience and career intention? A cross-sectional study of student experience. Educ Prim Care. (2015) 26:166–75. doi: 10.1080/14739879.2015.11494336
18. Bos, E, Alinaghizadeh, H, Saarikoski, M, and Kaila, P. Factors associated with student learning processes in primary health care units: a questionnaire study. Nurse Educ Today. (2015) 35:170–5. doi: 10.1016/j.nedt.2014.09.012
19. Thyness, C, Steinsbekk, A, and Grimstad, H. Learning from clinical supervision - a qualitative study of undergraduate medical students' experiences. Med Educ Online. (2022) 27:2048514. doi: 10.1080/10872981.2022.2048514
20. Donley, C, and Norman, K. Nursing student perspectives on a quality learning environment in general practice. Prim Health Care. (2018) 28:36–42. doi: 10.7748/phc.2018.e1388
21. van der Zwet, J, Zwietering, PJ, Teunissen, PW, van der Vleuten, CP, and Scherpbier, AJ. Workplace learning from a socio-cultural perspective: creating developmental space during the general practice clerkship. Adv Health Sci Educ Theory Pract. (2011) 16:359–73. doi: 10.1007/s10459-010-9268-x
22. McInnes, S, Peters, K, Hardy, J, and Halcomb, E. Clinical placements in Australian general practice: (part 1) the experiences of pre-registration nursing students. Nurse Educ Pract. (2015) 15:437–42. doi: 10.1016/j.nepr.2015.04.003
23. Bates, J, Konkin, J, Suddards, C, Dobson, S, and Pratt, D. Student perceptions of assessment and feedback in longitudinal integrated clerkships. Med Educ. (2013) 47:362–74. doi: 10.1111/medu.12087
24. Newbronner, E, Borthwick, R, Finn, G, Scales, M, and Pearson, D. Creating better doctors: exploring the value of learning medicine in primary care. Educ Prim Care. (2017) 28:201–9. doi: 10.1080/14739879.2016.1277789
25. Peters, K, McInnes, S, and Halcomb, E. Nursing students’ experiences of clinical placement in community settings: a qualitative study. Collegian. (2015) 22:175–81. doi: 10.1016/j.colegn.2015.03.001
26. Skaalvik, MW, Normann, K, and Henriksen, N. Nursing homes as learning environments: the impact of professional dialogue. Nurse Educ Today. (2012) 32:412–6. doi: 10.1016/j.nedt.2011.03.001
27. Jack, K, Hamshire, C, and Chambers, A. The influence of role models in undergraduate nurse education. J Clin Nurs. (2017) 26:4707–15. doi: 10.1111/jocn.13822
28. Berger-Estilita, J, Merlo, S, Guttormsen, S, Fuchs, A, Greif, R, and Chiang, H. Pre-licensure medical students’ knowledge and views on interprofessional learning: a qualitative concept analysis based on real-world data. Front Educ. (2022) 7:978796. doi: 10.3389/feduc.2022.978796
29. Weller-Newton, JM, and Kent, F. Community health placements for junior medical and nursing students for interprofessional learning. J Interprof Care. (2021) 35:316–9. doi: 10.1080/13561820.2020.1760803
30. Seaman, K, Saunders, R, Dugmore, H, Tobin, C, Singer, R, and Lake, F. Shifts in nursing and medical students' attitudes, beliefs and behaviours about interprofessional work: an Interprofessional placement in ambulatory care. J Clin Nurs. (2018) 27:3123–30. doi: 10.1111/jocn.14506
31. Gudmundsen, AC, Norbye, B, Abrandt Dahlgren, M, and Obstfelder, A. Interprofessional student meetings in municipal health service - mutual learning towards a community of practice in patient care. J Interprof Care. (2019) 33:93–101. doi: 10.1080/13561820.2018.1515732
32. Henderson, M, Upham, S, King, D, Dick, ML, and van Driel, M. Medical students, early general practice placements and positive supervisor experiences. Educ Prim Care. (2018) 29:71–8. doi: 10.1080/14739879.2017.1409084
33. Suikkala, A, Koskinen, S, and Leino-Kilpi, H. Patients’ involvement in nursing students’ clinical education: a scoping review. Int J Nurs Stud. (2018) 84:40–51. doi: 10.1016/j.ijnurstu.2018.04.010
34. Johnson, B, and Christensen, LB. Educational research: quantitative, qualitative, and mixed approaches. 6th ed. Thousand Oaks, CA: SAGE Publications (2017).
35. Shuttleworth, M. Descriptive research design: explorable.com (2008). Available at: https://explorable.com/descriptive-research-design (Accessed March 17, 2022).
36. Pianta, RC, Hamre, BK, and Mintz, S. Classroom assessment scoring system - secondary manual. Charlottesville: University of Virginia (2012).
37. Allen, J, Gregory, A, Mikami, A, Lun, J, Hamre, B, and Pianta, R. Observations of effective teacher-student interactions in secondary school classrooms: predicting student achievement with the classroom assessment scoring system-secondary. School Psych Rev. (2013) 42:76–98. doi: 10.1080/02796015.2013.12087492
38. Gamlem, SM . Mapping teaching through interactions and pupils’ learning in mathematics. SAGE Open. (2019) 9:215824401986148. doi: 10.1177/2158244019861485
39. Westergård, E, Ertesvåg, SK, and Rafaelsen, F. A preliminary validity of the classroom assessment scoring system in Norwegian lower-secondary schools. Scand J Educ. (2019) 63:566–84. doi: 10.1080/00313831.2017.1415964
40. Hafen, CA, Hamre, BK, Allen, JP, Bell, CA, Gitomer, DH, and Pianta, RC. Teaching through interactions in secondary school classrooms: revisiting the factor structure and practical application of the classroom assessment scoring system-secondary. J Early Adolesc. (2015) 35:651–80. doi: 10.1177/0272431614537117
41. Virtanen, TE, Pakarinen, E, Lerkkanen, MK, Poikkeus, AM, Siekkinen, M, and Nurmi, JE. A validation study of classroom assessment scoring system–secondary in the Finnish school context. J Early Adolesc. (2018) 38:849–80. doi: 10.1177/0272431617699944
42. Li, H, Liu, J, and Hunter, CV. A meta-analysis of the factor structure of the classroom assessment scoring system (class). J Exp Educ. (2020) 88:265–87. doi: 10.1080/00220973.2018.1551184
43. Pianta, RC, Hamre, BK, and Mintz, S. Secondary class score sheets. (2012). Available at: https://store.teachstone.com/score-sheets/ (Accessed March 17, 2019).
44. Bronfenbrenner, U, and Morris, P. The ecology of developmental processes In: W Damon and RM Lerner, editors. Handbook of child psychology, vol 1: theoretical models of human development. New York, NY: John Wiley (1998)
45. Vygotskij, LS In: M Cole, V John-Steiner, S Scribner, and E Souberman, editors. Mind in society. Cambridge: Harvard University Press (1978)
47. Deci, EL, and Ryan, RM. The “what” and “why” of goal pursuits: human needs and the self-determination of behavior. Psychol Inq. (2000) 11:227–68. doi: 10.1207/S15327965PLI1104_01
48. Ryan, RM, and Deci, EL. Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. Am Psychol. (2000) 55:68–78. doi: 10.1037/0003-066X.55.1.68
49. Pintrich, PR . The role of goal orientation in self-regulated learning In: M Boekaerts, PR Pintrich, and M Zeidner, editors. Handbook of self-regulation. San Diego, CA: Academic Press (2000). 451–529.
50. National Research Council. Education for life and work: developing transferable knowledge and skills in the 21st century. Washington, DC: The National Academies Press (2012). Available at: https://nap.nationalacademies.org/catalog/13398/education-for-life-and-work-developing-transferable-knowledge-and-skills (Accessed May 16, 2022).
51. Yilmaz, K . The cognitive perspective on learning: its theoretical underpinnings and implications for classroom practices. Clearing House. (2011) 84:204–12. doi: 10.1080/00098655.2011.568989
52. McHugh, ML . Interrater reliability: the kappa statistic. Biochem Med. (2012) 22:276–82. doi: 10.11613/BM.2012.031
53. Walters, SJ, Campbell, MJ, and Machin, D. Medical statistics: a textbook for the health sciences. 5th ed. Chichester: Wiley Blackwell (2021).
54. Pallant, J . Spss survival manual: a step by step guide to data analysis using Ibm Spss. 6th ed. Maidenhead: McGraw Hill (2016).
55. World Medical Association. World medical association declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. (2013) 310:2191–4. doi: 10.1001/jama.2013.281053
56. Eggleton, K, Fortier, R, Fishman, T, Hawken, SJ, and Goodyear-Smith, F. Legitimate participation of medical students in community attachments. Educ Prim Care. (2019) 30:35–40. doi: 10.1080/14739879.2018.1563503
57. Molesworth, M . Nursing students' first placement: peripherality and marginality within the community of practice. J Nurs Educ. (2017) 56:31–8. doi: 10.3928/01484834-20161219-07
58. Whelan, B, Hjörleifsson, S, and Schei, E. Shame in medical clerkship: "you just feel like dirt under someone's shoe". Perspect Med Educ. (2021) 10:265–71. doi: 10.1007/s40037-021-00665-w
59. Courtney-Pratt, H, Pich, J, Levett-Jones, T, and Moxey, A. “I was yelled at, intimidated and treated unfairly”: nursing students' experiences of being bullied in clinical and academic settings. J Clin Nurs. (2018) 27:e903–12. doi: 10.1111/jocn.13983
60. Giske, S, Kvangarsnes, M, Landstad, BJ, Hole, T, and Dahl, BM. Medical students’ learning experience and participation in communities of practice at municipal emergency care units in the primary health care system: a qualitative study. BMC Med Educ. (2022) 22:427. doi: 10.1186/s12909-022-03492-7
61. Holden, RR . Face validity. Corsini Encycl Psychol. (2010):1–2. doi: 10.1002/9780470479216.corpsy0341
62. Gitomer, D, Bell, C, Qi, Y, McCaffrey, D, Hamre, BK, and Pianta, RC. The instructional challenge in improving teaching quality: lessons from a classroom observation protocol. Teach Coll Rec. (2014) 116:1–32. doi: 10.1177/016146811411600607
63. Taber, KS . The use of Cronbach’s alpha when developing and reporting research instruments in science education. Res Sci Educ. (2018) 48:1273–96. doi: 10.1007/s11165-016-9602-2
64. Briggs, SR, and Cheek, JM. The role of factor analysis in the development and evaluation of personality scales. J Pers. (1986) 54:106–48. doi: 10.1111/j.1467-6494.1986.tb00391.x
Keywords: classroom assessment scoring system, clinical placement, interaction quality, medical students, nursing students, primary healthcare, student placement, systematic observations
Citation: Giske S, Gamlem SM, Kvangarsnes M, Landstad BJ, Hole T and Dahl BM (2024) Mapping interaction quality for nursing and medical students in primary care placement in municipal emergency care units: a systematic observational study. Front. Med. 11:1181478. doi: 10.3389/fmed.2024.1181478
Edited by:
Lynn Valerie Monrouxe, The University of Sydney, AustraliaReviewed by:
Keri L. Heitner, Saybrook University, United StatesMobin Sokhanvar, Khoy University of Medical Sciences, Iran
Copyright © 2024 Giske, Gamlem, Kvangarsnes, Landstad, Hole and Dahl. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Solveig Giske, solveig.giske@ntnu.no