Patrea Andersen1,2,3
Patrick Broman
Jia Rong Yap
Sharon Brownie- 1Centre for Health and Social Practice, Waikato Institute of Technology–Te Pūkenga, Hamilton, New Zealand
- 2School of Nursing, Midwifery and Paramedicine, University of the Sunshine Coast, Sippy Downs, QLD, Australia
- 3School of Nursing, Midwifery and Social Science, Central Queensland University, Norman Gardens, QLD, Australia
- 4Otago Polytechnic–Te Pūkenga, Dunedin, New Zealand
- 5School of Health Science, Swinburne University of Technology, Melbourne, VIC, Australia
- 6School of Medicine and Dentistry, Griffith University, Brisbane, QLD, Australia
There is growing awareness that factors such as the growing incidence of co-morbidity and increasing complexity of patient health needs cannot be addressed by health professionals practicing in isolation. Given this, there is an increasing emphasis on preparing students in health-related programs for effective interprofessional practice. Less clear, however, are the specific skills and clinical or learning opportunities necessary for students to develop effectiveness in interprofessional practice. These factors drove a team associated with a tertiary health education provider in Hamilton, New Zealand to transform traditional clinical student experiences in the form of an interprofessional student-assisted clinic. The clinic was intended, in part, to provide students with opportunities to learn and experience interprofessionalism in practice but was hampered by limited information available regarding the specific skill requirements necessary for students in New Zealand to learn in this context. In this Delphi study, we synthesize national expert opinion on student competency indicators necessary for effective interprofessional practice. The resultant set of indicators is presented and opportunities for application and further research discussed. The paper offers guidance to others seeking to innovate health curricula, develop novel service-oriented learning experiences for students, and foster interprofessional practice competence in the future health workforce.
1. Introduction
Similar to other developed nations, the growing burden of poor population health in Aotearoa New Zealand has been well publicized (1). The Ministry of Health (MoH) records that over the last 10 years, the estimated rate of diabetes among New Zealanders has increased from 35.7 per 1,000 population in 2012 to 41.5 in 2021. Adult and child obesity are also on the rise, with 1 in 3 adults (34.3%) and 1 in 8 children (12.7%) classified as obese in 2019/2020. MoH further reports that adults and children living in socioeconomically deprived areas were 1.6 times and 2.5 times as likely to be obese as those living in the least deprived areas. The challenge of these health issues, and health disparities requires both an understanding of the principles of non-communicable disease management and control and the role of environmental factors in health and disease (2). Moreover, the increasing complexity of patient care requirements and the incidence of co-morbidity requires health and social service practitioners to collaborate in the delivery of care (3). In other words, to be effective in addressing the needs of the population, health interventions increasingly require the collective efforts of professionals from a very wide array of fields (4).
Within the educational context, this calls for curricula and programs of study which place an emphasis on interprofessional practice, known as interprofessional education (IPE) (5, 6). In one definition, IPE is understood to occur when “students from two or more professions learn about, from and with each other to enable effective collaboration and improve health outcomes” [1 p. 13, (7)]. How IPE is conceptualized and practiced can vary depending on the country and the healthcare setting. Further to this, regulations on interprofessional competencies vary across countries (8, 9). Despite this variability, some commonly described themes and elements include effective communication, mutual respect, teamwork, reflexive practice, leadership and management, and ethical considerations (10–12). While general and didactic, such competencies help to grow healthcare professionals that can share information and ideas, to negotiate and resolve conflicts, and to work effectively as part of multidisciplinary healthcare teams in the management of complex patient care. This has been shown to result in improved healthcare experiences and outcomes and reduced healthcare costs (10, 13, 14).
this background there is an urgent need for academic institutions to respond with opportunities for students to learn and demonstrate competency in an interprofessional context (5, 6) and develop competency assessment tools to accommodate assessment of students practicing in this context (15, 16). To do so, Loura et al. (11) suggest a competency-based approach, aligning interprofessional competency frameworks to learning-outcomes based curricula to ensure proper appropriation of knowledge and implementation of IPE in practice to enable learners to take more responsibility for their own learning and development (17). Grymonpre et al. (18) argue that successful implementation of IPE requires collaborative efforts at macro-, meso-, and micro- levels. For example, they suggest creating partnerships between higher education institutions, government and practice communities (macro-level), developing and revising a strategic IPE plan (meso-level), and adopting common frameworks and language (micro-level) when advancing IPE. Put together, they highlight the importance of creating authentic, experiential IPE for health professionals in training as knowledge cannot be independent of the situations where it is learned and applied (19). However, understaffing and complex workplace issues fueling the lack of clinical placements make offering students opportunities to work with other professions across the sector difficult. These circumstances call for creative curriculum delivery and create an opportunity for a more “personalized learning” model with an emphasis on heutagogical (student-driven) models of education, underpinned by real-world application of knowledge and skills that involve problem and project-based learning (20).
One approach internationally to transforming health curricula and enhancing the development of interprofessional practice has been the introduction of student-assisted or student-led clinics (21–23). One such project, He Kaupapa Oranga Tahi, based in Hamilton, New Zealand, was initiated with the aim of promoting and integrating IPE. The project undertaken by our team is funded by Trust Waikato with these overarching objectives: establish an interprofessional center of clinical training excellence preparing health professionals with a high level of clinical capability, cultural competence, and community insight. In this clinic, Waikato Institute of Technology–Te Pūkenga students from different professions (nursing, physiotherapy, occupational therapy, social work, counseling, exercise physiology, and sports science), working under the supervision of health professionals, undertake community-based clinical experience providing primary health care as a team, strongly networked to community-based health and social service provider partners. The clinic focuses on diabetes, heart disease, and mobility and falls prevention as particular healthcare needs in the local community (1, 22). The intention is for the clinic to provide an opportunity for students to come to an understanding of their professional role and that of other professionals they work with, and how collectively as a team they contribute to health care outcomes (12, 21, 22). The development of this innovative clinical and placement experience prompted consideration of suitable curricula for involved students, particularly around the skills and competencies required to operate effectively in this interprofessional environment.
In a tertiary education context, it is essential that assessment of competency requirements is consistent with the learning outcomes defined in each discipline’s program of study and meet the requirements of each discipline’s regulatory body. Although there is an identified need for more studies investigating behavior-based or competency-based outcomes of interprofessional practice (15, 16, 22), there is no consensus about what these outcomes should include, particularly for pre-registration health professionals in New Zealand. Various tools and frameworks exist internationally (24–30), and the Otago Interprofessional Education Conceptual Model (31) outlines domains of competency relevant to the New Zealand context, consistent with international literature. However, no behavioral or performance indicators were found to complement this model and no known competency tools have been found that assess pre-registration (as opposed to graduate level) interprofessional competencies across health disciplines in New Zealand. To facilitate the development of a competency assessment tool suitable for assessing practice expectations of students working in an interprofessional student-assisted clinic, this enquiry sought to determine expert consensus, from academic staff supporting the learning of students from a range of health disciplines, to the question “What knowledge, skills and behaviors do health discipline experts consider indicators of competent student interdisciplinary practice in New Zealand?’
Detailed examination of this topic in New Zealand is timely, given the health programme unification currently underway as part of the government’s wider Reform of Vocational Education (RoVE) programme. These reforms have included the merger of 16 existing local “Institutes of Technology and Polytechnics” (ITPs), and 9 industry training organizations (ITOs) into a large, unified non-university tertiary education provider–Te Pūkenga–The New Zealand Institute of Skills and Technology (32). Its predecessor organizations delivered or arranged over 2,000 programs to more than 200,000 learners across the country, including health programmes leading to registration in most fields outside of medicine and dentistry. Significant work is currently underway developing single, “unified” programs of study for the newly established entity to deliver across the country in each learning category (32). This unification of multiple programmes of study into single programmes gives further impetus for defining a collective national view of necessary competencies for effective interprofessional practice across disciplines. Understanding student practice expectations and embedding the interprofessional domains and indicators into one framework will set the foundation for genuinely responsive best practices to be cultivated, implemented, and assessed in these unified programmes.
2. Materials and methods
2.1. Study design
The study followed a Delphi methodology for determining consensus on a question of interest from experts in the field (33). This well-established technique is common in healthcare and nursing fields (34). With an underlying assumption that expert consensus is more valid than individual opinion, it involves two or more rounds of questionnaires amongst a panel of experts. Qualitative/open-ended questions aimed at identifying key factors from experts typically feature in early rounds, while later rounds are primarily quantitative, with experts indicating the extent to which they agree with various identified factors of interest (33, 35). Expert opinions are synthesized after each round and only those on which there is consensus are retained in future rounds, with the panel thus guided toward agreement. The number of rounds used is best determined by the level of consensus shown amongst expert participants.
A modified Delphi methodology was adopted as the aim was to achieve a collective consensus view of subject academics across a wide range of taught health fields/professions and institutions across Te Pūkenga–the New Zealand Institute of Skills and Technology. Unlike other group methods, a Delphi study does not require the researcher or participants to be located in proximity. In addition, it involves the blinding of participants, who work anonymously and independently from one another. This participant blinding reduces the risk of group dynamics influencing outcomes (33).
2.2. Participants
For this study, an expert was defined as a teaching staff member of a health or wellbeing-related Te Pūkenga program, with 5 + years of professional experience in their relevant field, and an interest in interprofessional education and practice. As teaching staff, each were both a health professional with an understanding of both their field and a health-related educator with experience teaching, supervising, and/or assessing healthcare students. We sought an expert sample in which each of the varied health-related fields of study currently taught within Te Pūkenga (nursing, medical imaging, paramedicine, counseling, social work, physiotherapy, osteopathy, massage, sport and exercise science, clinical exercise physiology, and occupational therapy) were represented, and with participants from a range of the 16 institutes of technology and polytechnics which at the time of data collection were undertaking a merger into Te Pūkenga–the New Zealand Institute of Skills and Technology. As a vocational (non-university) education provider, Te Pūkenga does not offer higher-level degrees in fields such as medicine or dentistry. In recognition of this fact, some IPE experts in university medical education programmes in New Zealand were also invited to participate.
The study was approved by the Wintec Human Ethics in Research Group (HERG), approval reference WTLR18170522 dated 20 May 2022, as a low-risk application. Potential participants were provided an information sheet and consent form prior to agreeing to participate, and informed consent was provided electronically via an initial survey section with agreement required prior to proceeding. Confidentiality in reporting was assured for participants and names were not collected, although some identifying information such as profession, teaching institution, and job title was asked for and is reported here by consent.
Subsequent to ethical approval, potential participant educators for the study were identified by (a) members of the research team; (b) purposive sampling of experienced staff from a list of all health programs offered by Te Pūkenga subsidiaries (identified via institutional websites); (c) snowball sampling whereby individuals asked to participate were also invited to provide details of appropriate experts. Sampling was deliberate inasmuch as at least one appropriate expert was sought from each health field taught in the Te Pūkenga network, and from a range of the 16 institutions undertaking the merger. In addition to teaching staff in Te Pūkenga-taught qualifications, several interprofessional education experts (in medicine) from the New Zealand university sector were also invited to participate, in recognition of their specific expertise in this field. The number of expert participants recruited (n = 17) aligns to the Delphi panel size of between 15 and 30 participants recommended by De Villiers et al. (36).
2.3. Data tool, collection, and analysis
In the absence of consensus in the New Zealand context around interprofessional competencies necessary for students to develop, an initial survey tool was developed comprising of a list of 78 indicators of interprofessional competencies that were collated from a range of sources (25, 26, 37–42). For the purposes of this inquiry, and guided by the literature, these were considered to group naturally into 6 key competency domains: communication; leadership; interpersonal relationships and mutual support; monitoring and situational awareness; student knowledge; and student skills. The initial (first round) survey also included an open-ended question for participants to indicate any competencies/indicators not included in the initial list.
Data collection was via three sequential survey rounds undertaken using SurveyMonkey® internet survey software (SurveyMonkey LLC, Portland, OR, USA), with invite links distributed by email. Partially completed surveys were excluded from analysis, on the assumption that partial completion reveals insight into participants’ level of engagement. To maximize rigor, the order of lists within each key category was randomized for each participant in each round. Analysis of resulting data was undertaken using Excel® (Microsoft, Redmond, WA, USA). The study comprised two rating rounds (rounds 1 and 2) where participants rated the relevance of items (interprofessional competency indicators) on a 1–100 scale and a ranking round (round 3) where participants ranked the remaining items’ importance against each other.
In (rating) round 1, consensus agreement was calculated using a combination of mean scores, indicating levels of importance, and quartile deviation, indicating the level of consensus (43). Items receiving a median score of 70 or greater and with an interquartile range of 20 or less were considered to have high consensus importance and proceeded to ranking round 3. In keeping with previous research (44), indicators in round 1 with median scores below 30 (indicating low importance) and with an interquartile range of 20 or less (indicating high consensus) were considered less important by high consensus and excluded from subsequent rounds. Items not meeting either criterion were considered uncertain and re-rated in round 2. In round 2 a median score of 70 or greater was required for items to proceed to round 3. In the final ranking round (round 3), mean rankings were calculated to indicate the collective expert view of the importance of each item (45).
2.3.1. Survey round 1
The first round was undertaken from 28 June to 10 August 2022. Initial invitations were emailed to 43 potential participants. Those of whom who did not complete were also sent a follow-up reminder email. A total of 17 experts completed the first round of the survey. For each indicator, participants were asked to show, on a 1–100 sliding scale, “the extent to which you agree the attribute, knowledge or skill is required for students to learn and demonstrate developing safe interprofessional practice.” The initial round also included a number of questions regarding participants’ general characteristics, including professional role, number of years in profession and their teaching institution.
2.3.2. Survey round 2
The second round was undertaken from August 14 to 10 September 2022. A total of 15 of the 17 participants of the first survey round completed this round, which asked them to reassess and indicate on a 1–100 scale the level of importance they attached to competency indicators retained from the initial list (consensus on high or low importance not having been achieved) and to do the same for additional indicators not included in the initial list but mentioned by one or more participants in the open-ended question of round 1. The similar scores achieved for retained indicators in this round compared to the first survey round suggested that further rating surveying would not result in significant further clarity and, therefore, results from the current and previous round were taken to provide a conclusive list of relevant competencies and indicators in New Zealand context.
2.3.3. Survey round 3
The final survey round was undertaken 10 October to 18 November 2022 and was completed by 12 of the 17 participants who had completed the earlier rounds. This round asked experts to rank, within each of the 6 key competency domains, the 73 important indicators agreed as relevant from earlier rounds, from most to least important. There is consensus within the literature that the number of items individuals can reasonably rank against each other is around 20 (46, 47). Here, the number of indicators retained to be ranked in the 6 key competency domains varied from 7 (in the knowledge competency domain) to 18 (in the leadership and interpersonal relationships and mutual support competency domains). This round was intended for experts to collectively determine the relative importance of each of the indicators, as an important corollary of identifying the indicators themselves.
3. Results
3.1. Participant characteristics
Table 1 shows participants’ general characteristics, as indicated in the first survey round. Of the 17 expert participants, fifteen represented six of the 16 predecessor Institute of Technology and Polytechnics (ITPs) of Te Pūkenga. They were from the New Zealand university sector and in roles explicitly related to interprofessional health education. Although no New Zealand-based educator in the field of paramedicine was successfully recruited (only one such program of study exists within Te Pūkenga), a New Zealand clinical educator of paramedicine currently associated with an Australian university was approached and agreed to participate.
Table 1. Expert panel characteristics (n = 17).
Regarding participants’ working experience, the shortest and longest time participants had been registered/practiced/taught in their professional field was 5 and 42 years, respectively. The average (mean) number of years of working experience was 25.2 years. Response rates are an important consideration for expert consultation, being an indication of the level of enthusiasm and engagement in the research amongst experts (34). Forty-three (43) experts were initially invited to participate, of whom 17 (40%) completed an initial survey. Subsequent recovery rates were relatively high, with 15 (88%) of the 17 initial participants completing the second round and 12 (71%) completing the third.
3.2. Rating rounds–interprofessional competency indicators
Consensus agreement was indicated in the first round by a median rating of 70 or greater and with a quartile deviation of 20 or less. Amongst the 17 experts who completed the first round, there was consensus agreement around the relevance or importance of 36 of the 78 interprofessional competency indicators included in the initial survey instrument. Three items in the initial survey were identified by consensus as unimportant (i.e., had a median score of less than 30 and an interquartile range of 20 or less). These were the leadership competency indicator helps manage co-location, and the skills competency indicators education skills and counseling.
There was uncertainty around 39 of the indicators in the primary survey (those having received a median score between 30 and 70 and/or a quartile deviation over 20). These indicators were re-rated in the second round. Also rated in the second round were 8 additional indicators mentioned by 6 participants in the open-ended question included in the first round. These were avoiding bullying/antisocial behavior (actively anti-bullying/speaking up) which was characterized in later rounds as an “interpersonal relationships and mutual support” competency; reflection, active listening skills, self-awareness, cultural safety/competency to work with difference and followership–the ability to take direction well which were characterized as “student skill” competencies, and understanding interprofessional values and ethics and having ability to work to strengths, which were both characterized as indicators in the “student knowledge” competency domain. An overview of all competencies and indicators included in the study is provided in Table 2.
Table 2. Overview of interprofessional competencies and indicators.
In the second-round participants (n = 15) were asked to rate again the importance of the 38 indicators where no consensus had been achieved and the additional 8 indicators identified by experts. In this round, a median rating of 70 (of 100) was required, a somewhat lesser requirement than the first round where the requirement for high consensus agreement (indicated by the interquartile range) was also included. Further rating rounds would increase the response burden on participants and were considered unlikely to offer significant further clarity. Of the 38 indicators retained from the earlier round, 31 met criteria for inclusion in the final list, although the relatively low consensus around these indicators compared to those that achieved consensus agreement (indicated by the low interquartile range) in the first round should be noted. Of the 8 additional indicators added by participants,’ all 8 achieved consensus agreement for inclusion in the final set of indicators, with median ratings of between 78 (for “reflection”) and 98 (for “understanding interprofessional values and ethics”).
Following rounds 1 and 2, consensus agreement was established around the importance of 73 core indicators or skills necessary for students preparing for interprofessional practice. This final set of indicators are grouped within the higher-level competencies, which could also be thought of as competency domains (24) or core competencies (48) of communication (n = 11), leadership (n = 15), interpersonal relationships and mutual support (n = 18), monitoring and situational awareness (n = 11), student knowledge (n = 7), and student skills (n = 11). Of the higher-level competencies, the highest levels of consensus agreement were shown for the indicators characterized in the “Interpersonal relationships and mutual support” domain. Of the 18 indicators included in this domain, 16 achieved consensus for inclusion in the first survey round. This compares with only 2 of 14 indicators in the monitoring and situational awareness domain that achieved consensus in the first round.
3.3. Ranking agreed interprofessional competencies
Following the two-round rating and indicator identification exercise of rounds 1 and 2, experts (n = 12) ranked the final consensus set of 78 indicators within each of their 6 competency domains. The aim was for panel experts, given their experience and judgment, to determine the relevance and importance of indicators relative to each other, with obvious implications for the structure and focus of future healthcare training programs. The results of this exercise, with mean ranking scores (lower mean scores indicating higher rankings) are provided as Table 3.
Table 3. Indicators of interprofessional competency (n = 73), ranked within competency domains.
Asked to rank-order indicators to establish priorities amongst items, experts placed the greatest priority on communicates respectfully within all members of the healthcare team within the “Communication” competency domain, on understands the team structure within the “Leadership” domain, models effective teamwork within the “Interpersonal relationships and mutual support” domain, prioritizes actions within the “Monitoring and situational awareness” domain, understands interprofessional values and ethics within the “Student knowledge” domain and self-awareness within the “Student skills” domain. The last two were both indicators identified by experts in the first round, not having been included in the original survey instrument.
4. Discussion
The aim of this study was to reach expert agreement on the IPE competencies necessary for students, and more specifically students in an New Zealand public health promotion and interdisciplinary context. A modified Delphi study sought the opinions of 17 expert academic staff teaching in health and social service programs in Te Pūkenga–New Zealand Institute of Skills and Technology, the primary national vocational education provider in New Zealand, and in medical training programmes in the local university sector. In two initial rating rounds, experts agreed with a high consensus on the importance of 73 interprofessional competency indicators. Indicators were initially derived from the literature on interprofessional practice/education, with additions nominated by experts. In the third-round, experts ranked the relative importance of indicators within each of the six domains.
At a high level, experts implicitly agreed, via their consensus view of the importance of 73 indicators as important for students to demonstrate in interprofessional practice, that competency in this area for New Zealand students cannot be distilled easily into one skillset, statement, or competency. This finding aligns with a consensus view in the literature that interprofessional practice is both complex and multifaceted (49–51). Expert opinion was generally supportive of the indicators obtained from the literature, which may not be surprising given that the experts were highly experienced teaching staff with an interest in the field. They were likely to be familiar with the literature on interprofessional competency and influenced by it. The alignment and agreement shown by local experts to indicators derived from existing literature do indicate the local relevance of global work in IPE, much of which originates in the United States and the United Kingdom (52, 53). As Green and Johnson (54) point out, all health (and education) systems within which future health care workers must be trained to work together exist in a local context.
One finding of note was that while the higher-level indicator Promotes own disciplinary perspective within the team was rated by experts as an important skill within the “communication” domain, more discipline-specific knowledges and skills (e.g., Medication/pharmacology knowledge, Counseling, and Vital signs etc.) were not recognized by the panel as important in an explicitly interprofessional context. While such discipline-specific knowledges are clearly important for relevant disciplines to be educated in and facilitate promoting one’s own disciplinary perspective within a team, it is assumed the panel did not consider competency in these indicators as vital to all members of healthcare teams aspiring to effective interprofessional practice. This highlights how interprofessional learning outcomes are specific and focused and differ from core disciplinary skills. As O’Keefe et al. (27) suggest, “it can be argued that many interprofessional learning activities comprise core disciplinary competencies that are being taught in an interprofessional context rather than addressing specific interprofessional learning competencies per se” (p. 463). Educators should differentiate carefully between developing disciplinary skills or identity and developing interprofessional skills.
A number of higher-order competency indicators related to policy development and monitoring were not rated as important for students by the expert panel. For example, Collaborates with the health team to generate new knowledge for the betterment of peoples’ lives, communities and wider society and Collaborates with the interprofessional team to develop policies and guidelines informed by best available evidence and Collaborates with the interprofessional team to monitor and update policies and guidelines informed by best available evidence did not achieve consensus. This may be attributed to the practice-oriented nature of the survey and the fact panelists were asked to rate and rank necessary competencies for students of their disciplines. Such higher-order competency indicators as those may not be considered realistic to expect of health or social service students, or indeed novice practitioners, and may have been considered by the experts as important or relevant interprofessional competencies, though for advanced practitioners. There appears to be limited research exploring how interprofessional competencies develop over time, as practitioners progress from novice through to advanced clinicians. Interprofessional competency is not static and will dynamically evolve over a student’s, and later a clinician’s, time in practice. Panelists in the current study were invited to rank indicators as indicative of student level attainment. However, like practitioners’ progress from novice to more advanced levels of practice, there are graded levels of attainment for students too. For example, exposure, engagement, immersion and mastery of competency indicators might develop over a programme, as suggested in the Otago Interprofessional Education Conceptual Model (31). This level of distinction was not sought in the current study and could be beneficial to investigate in future research. For example, investigating which competencies are mastered earlier or later across a range of health programmes, or exploring if the competency indicators for first year nursing students are comparable with the competency indicators for first year occupational therapy students? The list of interprofessional competency indicators in the current study were found to represent a starting point, or baseline level of competency, from which further development in this area can proceed.
Panel experts identified the indicator understands interprofessional values and ethics as a clear oversight in the original survey instrument, perhaps not surprisingly given the ubiquity of reference to interprofessional values and ethics in the literature over time (24, 29), though more frequently framed as an overarching competency domain than indicator (24, 55, 56). When noting additional skills or competencies experts may not have differentiated between domain and indicator, and familiarity with the terms may have led to consensus more than questioning at what level interprofessional values and ethics are demonstrated. The degree of consensus agreement and high ranking of this indicator in subsequent rounds illustrates the extent to which experts agree that the explicit teaching of this content was essential. Effective interprofessional practice requires an understanding of differences in values and beliefs between disciplines (57). Exposure to IPE can promote proficiency for students in balancing views and understanding ethical dilemmas from different standpoints (58).
Of note is that the skill of followership arose as a significant indicator. Not originally included in the survey, followership was identified by experts in the first round and its importance reinforced in subsequent rounds. Followership can be defined as “the willingness to cooperate in a coordinated way to accomplish shared goals while engaging in collaborative teamwork” (59) (p. 82). McKimm and Vogan (60) argue that in developing teamworking and leadership skills, “learning how to be an authentic leader as well as a “proactive” follower can lead to more effective interprofessional teamworking and ultimately an improvement in health outcomes” (p. 41). While leadership-oriented research is historically more prominent, this is an increasing focus in healthcare scholarship that addresses followership, including acknowledging the need for health care clinicians to be “flexible in switching between leader and follower roles as appropriate to advance patient care” (61) (p. 3308). The relationship between followers and leaders is interdependent, followership can potentially reduce burnout, and followers can play a significant role in impacting successful outcomes in the work environment (62). Followership is therefore an important skill for students to develop when planning for an agile workforce and executing public health directives (62).
An additional indicator identified by experts in the first round, and reinforced in later rounds, was that of cultural safety/competency to work with difference. Cultural safety is a term that originated from nursing practice in New Zealand (63). As this nation becomes increasingly multicultural, and given its significant ethnic disparities in health, cultural competence must be reflected in healthcare practice. Broadly, this requires practitioners to recognize diverse contexts within and between cultural groups, and the impact of their own culture on their professional practice and interaction with clients (64) and how they work with other health professionals. Practitioners should therefore be able to function respectfully and effectively with people from different backgrounds and contribute positively to quality healthcare and achieving health equity. This is a moral and ethical obligation that is also grounded in New Zealand legislation and manifests in regulatory body requirements reinforcing the role of health practitioners in reducing ongoing inequalities in health status and outcomes, particularly for Māori.
Increasing awareness of this dynamic in the local healthcare context likely played a role in the experts in this panel to identify this as necessary for effective interprofessional practice, though it is anticipated this would have arisen as essential for any interprofessional activity in New Zealand, regardless of the domain of focus. New Zealand is far from the only nation to experience health inequities and with recent social movements (such as Black Lives Matter) fore-fronting greater awareness of inequities, notions of cultural safety and responsiveness have attained international traction (65–67). While there is limited recognition of these concepts in explicitly IPE literature, it is possible that this field is just “catching up.” Taken as a whole, findings from this study seem to illustrate an expert belief that public health initiatives need to be interprofessional and culturally responsive by design; it is at this intersection that positive health outcomes can be achieved and sustained (68, 69).
4.1. Limitations
Limitations of this study must be noted. As a modified Delphi method, the study relied primarily on a preliminary list of competencies and indicators drawn from the literature. While this approach minimizes response burden and simplifies the approach, and opportunity was provided for participants to add any items not included to the list for subsequent rounds, this approach does raise the prospect that providing a predetermined list may introduce some level of conformity bias (70, 71). In addition, and although the study included multidisciplinary perspectives from health disciplines taught across in a national context, it only included staff from Te Pūkenga–the New Zealand Institute of Skills and Technology and interprofessional education staff from the New Zealand university sector. It cannot claim to be representative: participants were self-selected, and the sample size relatively low. Some fields (such as social work and sport science) were not represented in the latter rounds of the study. It should also be noted that participants and therefore expert perspectives presented here are exclusively those of academic teaching staff from the various health fields, not those currently engaged in health care practice. Whether these perspectives differ, and the implications for IPE and public health, are matters for further research.
5. Conclusion
Given interprofessional collaboration is increasingly required for effective public health services and initiatives, there is a clear need to train and assess health and social practice students in these domains. This modified Delphi study identifies a key set of 73 important interprofessional competency indicators for students in New Zealand, as rated and ranked by experts from a range of health and social service programs. Followership was an unexpected competency indicator that was identified by experts in the first round of this study, aligns with emerging literature and is worthy of further investigation. While identification of cultural competence in the New Zealand context was not unexpected there is a need to determine indicators in this area as they relate to interprofessional practice. This will provide direction for educators and ensure learners can be supported in their development as competent, culturally safe follower-leaders.
The high level of engagement from experts in this study confirms there was a need to clarify expectations of students’ performance in interprofessional practice. Further work is indicated, including the development of a structured student assessment tool based on findings and completing necessary validation to ensure its rigor across a range of students and disciplines, learning providers, and placement settings (72). Nevertheless, the agreed domain and indicator framework presented here provides a local starting point for best practice “interprofessionalism” to be cultivated, implemented, and assessed.
Data availability statement
The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving human participants were reviewed and approved by the Wintec Human Ethics in Research Group Approval Ref: WTLR18170522. The patients/participants provided their written informed consent to participate in this study.
Author contributions
All authors contribution to study conception and design, data collection, analysis and interpretation of results, and manuscript preparation and reviewed the results and approved the final version of the manuscript.
Funding
This research was supported by a Trust Waikato Community Impact Grant.
Acknowledgments
The authors acknowledge Dr. Marrin Haggie, Dr. Angela Beaton, Lauren Bennett, Dr. Oliver W. A. Wilson, and Greg Smith for their helpful contributions to this work, and express deep gratitude to expert panel participants for their time and input.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Ministry of Health. NZ Health Statistics. (2022). Available online at: https://www.health.govt.nz/nz-health-statistics (accessed November 30, 2022).
2. World Health Organisation [WHO]. Health Workforce. (2022). Available online at: https://www.who.int/health-topics/health-workforce#tab=tab_1 (accessed November 30, 2022).
3. Gillam S, Rodrigues V, Myles P. Public health education in UK medical schools-towards consensus. J Public Health. (2016) 38:522–5. doi: 10.1093/pubmed/fdv069
4. Ravishankar N, Lewis M, Mujja A, Nair S, Sreekumaran N. Complexity in public health interventions – stakeholders’ perspective: a qualitative analysis. Clin Epidemiol Glob Health. (2015) 3:72–6. doi: 10.1016/j.cegh.2014.08.002
5. National Academy of Sciences. Educating for the Health Team: Report of the Conference on the Interrelationships of Educational Programs for Health Professionals. Kathmandu: Institute of Medicine (1972).
6. Rifkin S. Alma Ata after 40 years: primary health care and health for all-from consensus to complexity. BMJ Glob Health. (2018) 3:e001188.
7. Ford J, Gray R. Interprofessional Education Handbook. Fareham: Centre for the Advancement of Interprofessional Education (2021).
8. Steven K, Howden S, Mires G, Rowe I, Lafferty N, Arnold A, et al. Toward interprofessional learning and education: mapping common outcomes for prequalifying healthcare professional programs in the United Kingdom. Med Teach. (2017) 39:720–44. doi: 10.1080/0142159X.2017.1309372
9. Girard M. Interprofessional education and collaborative practice policies and law: an international review and reflective questions. Hum Resour Health. (2021) 19:9. doi: 10.1186/s12960-020-00549-w
10. Grymonpre R, Bainbridge L, Nasmith L, Baker C. Development of accreditation standards for interprofessional education: a Canadian Case Study. Hum Resour Health. (2021) 19:12. doi: 10.1186/s12960-020-00551-2
11. Loura D, Arriscado A, Kerkstra A, Nascimento C, Félix I, Guerreiro M, et al. Interprofessional competency frameworks in health to inform curricula development: integrative review. New Trends Qual Res. (2021) 6:63–71. doi: 10.36367/ntqr.6.2021.63-71
12. MacDonald M, Bally J, Ferguson L, Lee Murray B, Fowler-Kerry S, Anonson J. Knowledge of the professional role of others: a key interprofessional competency. Nurse Educ Pract. (2010) 10:238–42. doi: 10.1016/j.nepr.2009.11.012
13. Barr H. Interprofessional Education: the Genesis of a Global Movement. Hampshire: Centre for the Advancement of Interprofessional Education (2015).
14. Gilbert J. The status of interprofessional education in Canada. J Allied Health. (2010) 39:216–23.
15. Shrader S, Farland M, Danielson J, Sicat B, Umland E. A systematic review of assessment tools measuring interprofessional education outcomes relevant to pharmacy education. Am J Pharm Educ. (2017) 81:119. doi: 10.5688/ajpe816119
16. El-Awaisi A, Jaam M, Wilby K, Wilbur K. A systematic review of the use of simulation and reflection as summative assessment tools to evaluate student outcomes following interprofessional education activities. J Interprof Care. (2022) 36:882–90. doi: 10.1080/13561820.2022.2026899
17. Weller J, Naik V, San Diego R. Systematic review and narrative synthesis of competency-based medical education in anaesthesia. Br J Anaesth. (2020) 124:748–60. doi: 10.1016/j.bja.2019.10.025
18. Grymonpre R, Ateah C, Dean H, Heinonen T, Holmqvist M, MacDonald L, et al. Sustainable implementation of interprofessional education using an adoption model framework. Can J High Educ. (2017) 46:76–93. doi: 10.47678/cjhe.v46i4.186571
19. Johnson A, Woltenberg L, Heinss S, Carper R, Taylor S, Kuperstein J. Whole person health: using experiential learning and the ICF model as a tool for introductory interprofessional collaborative practice. J Allied Health. (2020) 49:86–91.
20. Conn C, Nayar S, Williams M, Cammock R. Re-thinking public health education in Aotearoa New Zealand: factory model to personalized learning. Front Educ. (2021) 6:636311. doi: 10.3389/feduc.2021.636311
21. Broman P, Tokolahi E, Wilson O, Andersen P, Brownie S. Patient outcomes from student-run health services: an integrative review. J Multidiscip Healthc. (2022) 15:641–4. doi: 10.2147/JMDH.S348411
22. Brownie S, Smith G, Broman P, Tokolahi E, Haggie M, Pearce A, et al. He Kaupapa Oranga Tahi: Working in Partnership to Grow the Health Workforce Through Delivery of Tauira/Student Assisted Clinics. Hamilton: Wintec (2021).
23. Tokolahi E, Broman P, Cooke C, Andersen P, Longhurst G, Brownie S. Student-led clinics in Aotearoa New Zealand: a scoping review with stakeholder consultation. J Multidiscip Healthc. (2021) 14:2053–66. doi: 10.2147/JMDH.S308032
24. Interprofessional Education Collaborative Expert Panel. Core Competencies for Interprofessional Collaborative Practice: 2016 Update. (2016). Available online at: https://ipec.memberclicks.net/assets/2016-Update.pdf (accessed November 25, 2022).
25. McLaney E, Morassaei S, Hughes L, Davies R, Campbell M, Di Prospero L. A framework for interprofessional team collaboration in a hospital setting: advancing team competencies and behaviours. Healthc Manage Forum. (2022) 35:112–7. doi: 10.1177/0840470421106358
26. Rogers G, Thistlethwaite J, Anderson E, Abrandt-Dahlgren M, Grymonpre R, Moran M, et al. International consensus statement on the assessment of interprofessional learning outcomes. Med Teach. (2017) 39:347–59. doi: 10.1080/0142159X.2017.1270441
27. O’Keefe M, Henderson A, Chick R. Defining a set of common interprofessional learning competencies for health profession students. Med Teach. (2017) 39:463–8. doi: 10.1080/0142159X.2017.1300246
28. Brewer M, Jones S. An interprofessional practice capability framework focusing on safe, high-quality, client-centred health service. J Allied Health. (2013) 42:45–9.
29. Canadian Interprofessional Health Collaborative. A National Interprofessional Competency Framework. Vancouver, BC: University of British Columbia (2010).
30. Maddock B, Kumar A, Kent F. Creating a collaborative care curriculum framework. Clin Teach. (2019) 16:120–4. doi: 10.1111/tct.12796
31. Centre for Interprofessional Education. A Curriculum and Quality Framework for Interprofessional Education at Otago: Strategic Plan 2020-2024 - Statement of Policy Recommendations. Otago: University of Otago (2019).
32. Te Pūkenga. A New Kind of Organisation – Learning with Purpose, Creating our Futures. Hamilton: New Zealand Institute of Skills and Technology (2022).
33. Donohoe H, Stellefson M, Tennant B. Advantages and limitations of the e-Delphi technique. Am J Health Educ. (2012) 43:38–46. doi: 10.1080/19325037.2012.10599216
34. Shi C, Zhang Y, Li C, Li P, Zhu H. Using the Delphi method to identify risk factors contributing to adverse events in residential aged care facilities. Risk Manag Healthc Policy. (2020) 13:523–37. doi: 10.2147/rmhp.S243929
35. Thangaratinam S, Redman C. The Delphi technique. Obstet Gynaecol. (2005) 7:120–5. doi: 10.1576/toag.7.2.120.27071
36. de Villiers M, de Villiers P, Kent A. The Delphi technique in health sciences education research. Med Teach. (2005) 27:639–43. doi: 10.1080/13611260500069947
37. Cannon-Bowers J, Tannenbaum S, Salas E, Volpe C. Defining competencies and establishing team training requirements. In: R Guzzo, E Salas editors. Team Effectiveness and Decision-Making in Organizations. Mahwah, NJ: Lawrence Erlbaum Associates (1995). p. 333–80.
38. McIntyre R, Salas E. Measuring and managing for team performance: emerging principles from complex environments. In: R Guzzo, E Salas editors. Team Effectiveness and Decision Making in Organizations. Mahwah, NJ: Lawrence Erlbaum Associates (1995). p. 194–203.
39. Cannon-Bowers J, Salas E. Teamwork competencies: the interaction of team member knowledge, skills, and attitudes. In: H O’Neil Jr. editor. Workforce Readiness: Competencies and Assessment. Mahwah, NJ: Lawrence Erlbaum Associates (1997). p. 151–74.
40. King H, Battles J, Baker DP, Alonso A, Salas E, Webster J, et al. TeamSTEPPS™: team strategies and tools to enhance performance and patient safety. In: K Henriksen, J Battles, M Keyes editors. Advances in Patient Safety: New Directions and Alternative Approaches. (Vol. 3), Rockville, MD: Agency for Healthcare Research and Quality (2008).
41. Johnson J, Hermosura B, Price S, Gougeon L. Factors influencing interprofessional team collaboration when delivering care to community-dwelling seniors: a metasynthesis of Canadian interventions. J Interprof Care. (2021) 35:376–82. doi: 10.1080/13561820.2020.1758641
42. Hoge M, Morris J, Laraia M, Pomerantz A, Farley T. Core Competencies for Integrated Behavioral Health and Primary Care. Washington, DC: SAMHSA–HRSA Center for Integrated Health Solutions (2014).
43. Latif R, Dahlan A, Mulud Z, Nor M. The Delphi technique as a method to obtain consensus in healthcare education research. Med Educ. (2017) 9:89–102. doi: 10.21315/eimj2017.9.3.10
44. Metzelthin S, Rostgaard T, Parsons M, Burton E. Development of an internationally accepted definition of reablement: a Delphi study. Ageing Soc. (2022) 42:703–18. doi: 10.1017/S0144686X20000999
45. Holey E, Feeley J, Dixon J, Whittaker V. An exploration of the use of simple statistics to measure consensus and stability in Delphi studies. BMC Med Res Methodol. (2007) 7:52. doi: 10.1186/1471-2288-7-52
46. Schmidt R. Managing delphi surveys using nonparametric statistical techniques. Decis Sci. (1997) 28:763–74. doi: 10.1111/j.1540-5915.1997.tb01330.x
47. Strasser A. Delphi method variants in information systems research: taxonomy development and application. Electron J Bus Res Methods. (2017) 15:120–33.
48. Albarqouni L, Hoffmann T, Straus S, Olsen N, Young T, Ilic D, et al. Core competencies in evidence-based practice for health professionals: consensus statement based on a systematic review and Delphi survey. JAMA Netw Open. (2018) 1:e180281. doi: 10.1001/jamanetworkopen.2018.0281
49. Flood B, Smythe L, Hocking C, Jones M. Interprofessional practice: the path toward openness. J Interprof Care. (2022) 36:635–42. doi: 10.1080/13561820.2021.1981264
50. Larsen B, Hean S. The significance of interprofessional and interagency collaboration in reintegration after prison: a qualitative study exploring Norwegian frontline workers’ views. J Comp Soc Work. (2021) 16:109–34. doi: 10.31265/jcsw.v16i1.366
51. Becker H, Timmerman G, Delville C, Seo E. A multifaceted model to evaluate interprofessional education in clinical nurse specialist programs. Clin Nurse Spec. (2017) 31:243–51. doi: 10.1097/nur.0000000000000320
52. Fransworth T, Seikel J, Hudock D, Holst J. History and development of interprofessional education. J Phonet Audiol. (2015) 1:101. doi: 10.4172/2471-9455.1000101
53. Hammick M, Freeth D, Koppel I, Reeves S, Barr H. A best evidence systematic review of interprofessional education: BEME guide no. 9. Med Teach. (2007) 29:735–51. doi: 10.1080/01421590701682576
54. Green B, Johnson C. Interprofessional collaboration in research, education, and clinical practice: working together for a better future. J Chiropr Educ. (2015) 29:1–10. doi: 10.7899/jce-14-36
55. Madigosky W, Colarelli M, Nordon-Craft A, Basha E, Franson K. Promoting interprofessional team development in team-based learning (TBL) through coaching and the team development measure (TDM). Med Sci Educ. (2020) 30:621–3. doi: 10.1007/s40670-019-00888-x
56. Watzak B. Commentaries on truth, trust, and team play. Ann Behav Sci Med Educ. (2015) 21:47. doi: 10.1007/BF03355312
57. Glen S. Educating for interprofessional collaboration: teaching about values. Nurs Ethics. (1999) 6:202–13. doi: 10.1177/096973309900600303
58. Chou F, Kwan C, Hsin D. Examining the effects of interprofessional problem-based clinical ethics: findings from a mixed methods study. J Interprof Care. (2016) 30:362–9. doi: 10.3109/13561820.2016.1146877
59. Bastardoz N, Van Vugt M. The nature of followership: evolutionary analysis and review. Leadersh Q. (2019) 30:81–95. doi: 10.1016/j.leaqua.2018.09.004
60. McKimm J, Vogan C. Followership: much more than simply following the leader. BMJ Lead. (2020) 4:41–4. doi: 10.1136/leader-2019-000162
61. Alanazi S, Wiechula R, Foley D. Followership in health care clinicians: a scoping review protocol. JBI Evid Synth. (2021) 19:3308–14. doi: 10.11124/jbies-20-00246
62. Honan D, Lasiuk G, Rohatinsky N. A scoping review of followership in nursing. Nurs Leadersh. (2022) 35:69–78. doi: 10.12927/cjnl.2022.26749
63. Wepa D. Cultural Safety in Aotearoa New Zealand. 2nd ed. Cambridge: Cambridge University Press (2015).
64. Heke D, Wilson D, Came H. Shades of competence? a critical analysis of the cultural competencies of the regulated-health workforce in Aotearoa New Zealand. Int J Qual Health Care. (2018) 31:606–12. doi: 10.1093/intqhc/mzy227
65. Geia L, Baird K, Bail K, Barclay L, Bennett J, Best O, et al. A unified call to action from Australian nursing and midwifery leaders: ensuring that Black lives matter. Contemp Nurs. (2020) 56:297–308. doi: 10.1080/10376178.2020.1809107
66. Lee A, Haskins N. Toward a culturally humble practice: critical consciousness as an antecedent. J Couns Dev. (2022) 100:104–12. doi: 10.1002/jcad.12403
67. Cox L, Best O. Clarifying cultural safety: its focus and intent in an Australian context. Contemp Nurs. (2022) 58:71–81. doi: 10.1080/10376178.2022.2051572
68. Oelke N, Thurston W, Arthur N. Intersections between interprofessional practice, cultural competency and primary healthcare. J Interprof Care. (2013) 27:367–72. doi: 10.3109/13561820.2013.785502
69. Broughten R, Hearst M, Dutton L. Developing a framework for interprofessional collaborative practice, cultural fluency, and ecological approaches to health. J Interprof Care. (2021) 35:3–8. doi: 10.1080/13561820.2021.1981837
70. Nasa P, Jain R, Juneja D. Delphi methodology in healthcare research: how to decide its appropriateness. World J Methodol. (2021) 11:116–29. doi: 10.5662/wjm.v11.i4.116
71. Bhandari S, Hallowell M. Identifying and controlling biases in expert-opinion research: guidelines for variations of Delphi, nominal group technique, and focus groups. J Manag Eng. (2021) 37:04021015. doi: 10.1061/(ASCE)ME.1943-5479.0000909
Keywords: interprofessional education, competencies, assessment, curriculum transformation, Delphi, health workforce education, New Zealand
Citation: Andersen P, Broman P, Tokolahi E, Yap JR and Brownie S (2023) Determining a common understanding of interprofessional competencies for pre-registration health professionals in Aotearoa New Zealand: A Delphi study. Front. Med. 10:1119556. doi: 10.3389/fmed.2023.1119556
Received: 14 January 2023; Accepted: 13 March 2023;
Published: 24 March 2023.
Edited by:
Ray Samuriwo, University of Bradford, United KingdomReviewed by:
Jill Thistlethwaite, University of Technology Sydney, AustraliaPatricia Bluteau, Coventry University, United Kingdom
Copyright © 2023 Andersen, Broman, Tokolahi, Yap and Brownie. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Patrick Broman, patrick.broman@wintec.ac.nz