Barriers and facilitators to implementation of developmental screening and early intervention in Canadian organizations following completion of a training and coaching model: a thematic analysis

Introduction: Developmental delay affects approximately 1 in 4 children under 6 years old. Developmental delay can be detected using validated developmental screening tools, such as the Ages and Stages Questionnaires. Following developmental screening, early intervention can occur to address and support any developmental areas of concern. Frontline practitioners and supervisors must be trained and coached to organizationally implement developmental screening tools and early intervention practice. No prior work has qualitatively investigated the barriers and facilitators to implementing developmental screening and early intervention in Canadian organizations from the perspectives of practitioners and supervisors who have completed a specialized training and coaching model.

Methods and Results: Following semi-structured interviews with frontline practitioners and supervisors, thematic analysis identified four themes: cohesive networks support implementation efforts, implementation success is dependent on shared perspectives, established organizational policies increase implementation opportunities, and COVID-19 guidelines create organizational challenges. Each theme encompasses sub-themes that describe implementation facilitators: strong implementation context, multi-level multi-sectoral collaborative partnerships, adequate and collective awareness, knowledge, and confidence, consistent and critical conversations, clear protocols and procedures, and accessibility to information, tools, and best practice guidelines.

Discussion: The outlined barriers and facilitators fill a gap in implementation literature by informing a framework for organization-level implementation of developmental screening and early intervention following training and coaching.

1. Introduction

In Canada, approximately 1 in 4 children are reaching school age with measurable vulnerabilities in multiple areas of development, including overall wellbeing, cognitive development, emotional maturity, communication skills, and general knowledge (1). The first 5 years of life are a critical period when programs that support early childhood development can have an impact on lifelong trajectories of physical and mental health, academic success, employment stability, and financial literacy (2, 3).

During this critical early period, young children are highly responsive to external influences that can shape their developmental trajectory. External influences can include programs that support childhood development, otherwise known as early intervention. Evidence shows that early intervention, particularly within the child's first year of life, predicts more positive lifelong outcomes, and can positively affect physical skills, cognition, social-emotional well-being, academic success, social independence, and caregiver-child interactions (4–6).

While early intervention has key benefits to development, not all children are able to receive these services. Eligibility for early intervention services is contingent on several factors, including availability and accessibility of services. Accessing early intervention services often depends on developmental screening to determine which of the child's abilities may benefit from additional support, as well as the level of support required. Developmental screening tools are generally brief and evaluate a child's risk for developmental delay in one or more domains (7). Although screening tools are not diagnostic (8), they are still beneficial because any trained service provider can identify developmental vulnerabilities in a time- and resource-efficient manner (9).

Multiple factors influence and perpetuate developmental vulnerabilities. For example, socioeconomic status, social and physical environments, trauma, and adverse experiences are all determinants of long-term health outcomes. Notably, it has been found that adverse childhood experiences have a graded, continuing relationship with overall lifetime well-being that begins in the early years (10).

However, while there are various risk factors for negative developmental trajectories, there are also protective factors for the development of disadvantaged children as well, such as strong child-caregiver attachment (11), and high-quality childcare (4, 12). High-quality childcare depends on competent, trained childcare practitioners that are able to recognize and address early developmental needs and areas of developmental concern. Recognizing and addressing need can be accomplished by administering developmental screening and providing early intervention services. Well-trained early childhood practitioners have been found to have positive impact on child outcomes, such as school readiness (13), academic performance (2), and enriched cognitive and social-emotional development (14).

Practitioners who work with young children and want to provide high-quality childcare can benefit from training and coaching related to early child development. Early childhood service provider training has been shown to increase awareness and knowledge related to infant and early mental health and development (15), as well as confidence and understanding (16). However, while training is beneficial to shift awareness, knowledge, confidence, and understanding regarding early developmental need, training alone may not be sufficient for practitioners to commit consistently to screening and early intervention practices (17, 18).

Coaching following training has been demonstrated to be an essential aspect of professional development to ensure practitioners embed new skills into routine practice (19). Coaching allows for practitioners to be assisted in the learning process, as coaches can offer support and feedback- key factors to guided behaviour change (20, 21). In fact, practitioners who only received training were found to provide lower quality childcare practice (19, 22), have slower skill acquisition (23), and lower likelihood of successful skill implementation that is sustained long-term (20, 23), than those who also took part in professional development coaching.

Although there is substantial evidence that early intervention supports typical developmental trajectories for children in different contexts (24–26) and training and coaching on early intervention practice supports implementation (27), there is inconsistent implementation of developmental screening and early intervention in Canadian organizations that provide care to children under the age of 6 (28, 29).

There are two key benefits to identifying and evaluating barriers and facilitators to implementation of early intervention tools in community-based organizations that work directly with children under the age of 6 years. First, the information gained can be used to promote learning and capacity-building to address and overcome identified challenges (30, 31). Second, understanding the factors that enable successful implementation of screening tools and early intervention practice can reinforce the current training and coaching model, or provide insight to effectively modify this model (32). Understanding the barriers and facilitators to implementation of new practices at the organizational level can provide insight into the steps necessary to bolster programs that support early identification and intervention in young Canadian children.

2. Methods

2.1. Infant and early mental health promotion training and coaching

Infant and Early Mental Health Promotion (IEMHP), a program of the Hospital for Sick Children in Toronto, Ontario, partnered with the Knowledge Institute for Child and Youth Mental Health and Addictions to institute a Care Pathways pilot project. At the time of data collection, this project partnered with three Ontario communities to: (1) support families by working with service providers to increase communication and transparency between sectors, (2) train practitioners on developmental screening initiatives, (3) identify gaps in organizational policies, and (4) produce data on early mental health prevalence and program efficacy.

Between October 2020 and September 2021, 458 individuals completed the training and coaching model. The training was divided into two separate streams: Stream 1 for organization supervisors, and Stream 2 for frontline practitioners. The participants were categorized into one of 7 identified sectors based on their primary professional affiliation: (1) Early Learning and Care (e.g., Drop-in Centres), (2) Education (e.g., Kindergarten), (3) Child Mental Health, (4) Public Health, (5) Child Welfare, (6) Primary Health Care, and (7) Rehabilitation.

The IEMHP training and coaching model evaluated in this study consisted of the following, completed in the order listed: (1) a 5-h asynchronous introductory webinar series on infant and early mental health, completed at the individual user's pace, (2) a 2-h asynchronous virtual introduction to the Ages and Stages Questionnaires (ASQs), completed at the individual user's pace, (3) a 1.5-h online synchronous coaching session with an IEMHP group facilitator and up to 10 trainees from various community organizations, focused on use and application of the ASQs, (4) a 1.5-h asynchronous introductory webinar series on creating and implementing Developmental Support Plans (DSPs), completed at the individual user's pace, (5) a 1.5-h virtual synchronous coaching session with an IEMHP facilitator on use and application of the DSP, (6) five 1.5 h virtual coaching sessions allotted for each community organization to attend with an IEMHP facilitator to answer questions, provide clarity, and further coach the participants in the understanding of infant and early mental health, developmental screening, and early intervention.

2.2. Implementation study

To provide impactful training and coaching on infant and early mental health (IEMH), as well as early intervention practice, it is essential to gain insight into practitioner and supervisor experiences of: (1) learning through a training and coaching model and, (2) implementing early intervention practice. The objective of this qualitative study was to better understand the barriers and facilitators of implementing the Ages and Stages Questionnaire-3 (ASQ:3), Ages and Stages Questionnaire Social-Emotional:2 (ASQ:SE-2), henceforth referred to as “ASQs”, and Developmental Support Plans (DSPs), following completion of the training and coaching model on IEMH and early intervention practice described above. The present study focused on the experiences of practitioners in Ontario-based organizations working directly with children under the age of 6, as well as the experiences of the organization supervisors.

2.3. Study design

The Promoting Action on Research Implementation in Health Services (PARIHS) framework was used to inform this study (33–35). The PARIHS framework emphasizes the dynamic relationship between three essential implementation elements: evidence, context, and facilitation, including their respective sub-elements (34, 36). Successful implementation is reported as equally dependent on the quality of evidence, the context in which the evidence is introduced, the skill of the facilitators involved in implementation, and the method by which it is implemented (37).

The PARIHS framework is flexible and allows users to only include elements and sub-elements that address their target concerns, questions, and objectives (38, 39). This study held a main focus on the element of “context”, and a minor focus on the element of “facilitation”, as well as their respective sub-elements.

The PARIHS framework element of “context” and “facilitation”, and the affiliated sub-elements, guided the creation of the semi-structured interview guide, as well as data coding and interpretation. The primary researcher conducted semi-structured interviews to collect information on the barriers and facilitators to implementation of early intervention in child-centered organizations. Interviews were conducted with both supervisors and practitioners who contributed to implementation within their organizations.

2.4. Recruitment

Participants were recruited from the cohorts of practitioners and supervisors who had completed IEMHP's training and coaching model between October 2020 and September 2021. A mass e-mail invitation was sent out by IEMHP to participants using CVENT, a virtual event management and participant engagement tool. Participants who accepted the invitation to take part in the study had one-on-one virtual semi-structured interviews with the primary researcher (KP-K). See Table 1 for Participant Demographics.

TABLE 1

Table 1. Participant demographics^a.

2.5. Procedure

All procedures were reviewed and approved by the Queen's University Health Sciences Research Ethics Board. Participants were provided with a letter of information (LOI) and consent form at least 1 day prior to the one-on-one interview to ensure they had adequate time to review the materials. At the beginning of the one-on-one meeting, prior to the commencement of the interview, the interviewer confirmed the participant had read and understood the LOI and consent form and obtained informed verbal consent to take part in the study, including publication and presentation of deidentified quotes. The interviews were recorded to enable verbatim transcription. At the end of the one-on-one interview, the participants were asked if they had any questions, if there was any clarification needed, or if there was any more information they would like to share. Participants were also given the option to receive a verbatim transcript following completion of the interview and transcription process. Each interview ranged from 45 to 60 min.

2.6. Data analysis

The primary researcher employed a Codebook thematic analysis approach (40–42) to engage with the data, identify themes, and encompass the barriers and facilitators of implementation that the practitioners and supervisors experienced. The initial Codebook was guided by the PARIHS framework and the research question and included: Barriers, Facilitators, Training, Coaching, Context, Leadership, and Facilitation. Participants were given pseudonyms to ensure anonymity, and the recorded interviews were transcribed verbatim for further analysis.

The primary researcher first read through each transcript fully, without coding or note-taking. The primary researcher then re-read each transcript sequentially, at this point beginning to code using the initial Codebook, take initial notes, and reflexive journaling. Reflexivity in qualitative research is a process of constantly and critically self-examining internal judgements, biases, and positionality in order to acknowledge that the researcher's subjectivity and personal experiences are inseparable from the data interpretations (43).

The initial notes focused on the tone of the participant's responses, (e.g., whether an experience appeared to be associated to positive or negative feelings), as well as perceived participant perspective. The reflexive journaling included the researcher's coding strategy, as well as initial interpretations based on the researcher's thought process throughout review and analysis of the transcripts.

Through integration with the data, the primary researcher identified that the initial Codebook was not sufficiently capturing the concepts discussed by all participants. At this stage, the primary researcher inductively coded using NVIVO 12 [for an in-depth resource review, see Dhakal (44)]. Following initial coding, the primary researcher noted initial themes, organizing codes into rudimentary themes. The themes were then reviewed by the primary researcher and re-organized. Theme re-organization continued until the primary researcher felt themes were clearly and comprehensively defined. A secondary researcher (CP) independently read through 3 of the transcripts and developed initial notes. The secondary researcher's initial notes focused on noticeable patterns. Following this step, the secondary researcher re-read the same three transcripts and generated a first draft of themes. Next, the secondary researcher coded the three initial transcripts in NVIVO 12, before coding the rest of the transcripts. The secondary researcher refined the themes throughout the process. The secondary researcher modified their “Codebook” to include initial codes, sub-codes, and descriptions for each code. At this stage, the primary researcher and secondary researcher met to discuss and compare codes and themes. During the meeting, the two researchers modified their Codebooks to reflect the shared understanding and interpretations that emerged throughout the discussion. Following the discussion, the primary researcher incorporated the elaborated understandings and interpretations when re-coding and re-interpreting the data. In this fashion, themes seen as “shallow” were discarded or refined, and substantial, meaningful themes were developed in their place.

Once themes were deemed appropriately meaningful, the primary researcher contacted the participants to request a follow-up meeting to discuss the synthesis of the analyzed data in order to enhance the trustworthiness of the findings, otherwise known as “member checking”. Member checking is a method of rigor to promote the accurate representation of participant perspectives and reduce researcher bias (45). Seven of the eleven participants agreed to a follow-up meeting with the primary researcher. One participant cancelled their meeting with the researcher and did not reschedule to a later date. The primary researcher thus met with the 6 participants who agreed to a follow-up discussion. Each meeting lasted approximately 60 min. Reflexivity occurred at this step as well, through mutual collaboration in a co-operative dialogue between researcher and participants (46). The primary researcher walked through all themes with each individual participant, taking notes on all clarification, elaboration, and feedback. Themes were discussed until the participants felt satisfied with the interpretations, at which point the interviews would conclude.

3. Results

3.1. Thematic analysis

A combination of deductive and inductive coding in a “Codebook” thematic analysis approach revealed 4 themes. Three themes had two sub-themes each. One theme did not contain sub-themes. In-text quotes from participants include their pseudonym, sector, and role, to provide context to their experiences.

Theme 1: Cohesive networks support implementation efforts (see Table 2 for practitioner and supervisor quotes).

TABLE 2

Table 2. Practitioner and supervisor quotes related to theme 1.

Sub-theme: Strong implementation context.

Participants expressed that successful implementation context was dependent on their organizational culture and leadership. Strong implementation context was reported as including:

(1) Clear roles and responsibilities. Participants reported that knowing who was doing an ASQ and DSP helped implementation efforts within and across organizations.Several practitioners reported feeling “confused” regarding “who does the ASQ” within their organization when multiple staff members had been trained without explicit responsibility distinction. Additionally, practitioners reported struggling with including the screening tool in their workload if they felt that developmental screening was not appropriately aligned to their role.Role clarity reduced confusion by minimizing the possibility of “duplicate services” (Jessica, Public Health, Practitioner) within and across organizations, defaulting screening tasks to specific people, and by providing team members with an explicit contact for ASQ and DSP support.

(2) Shared values. Participants cited that a common value of the work across the organization helped drive the implementation efforts and strategies.Practitioners felt that supervisors valued the use of the screening tools when they “asked us if we would be interested” (Beatrice, Education, Practitioner), “offered” the training, and “encouraged” them to complete it (Amy, Public Health, Practitioner). Both Pat (Child Welfare, Supervisor) and Yara (Primary Health Care, Supervisor) reported that a common value system amongst their staff helped to motivate team members to drive organizational-level implementation.Practitioners and supervisors alike felt discouraged when valuing early intervention was not shared across the agency. Participants reported “struggling” when their colleagues did not value the training, coaching, and/or early intervention practice, as colleagues who did not share these values would “put it to the back” (Sloane, Child Welfare, Supervisor).

(3) Strong leadership. Practitioners described feeling supported by supervisors that “understand the importance” of early intervention, and who were “huge proponents of early development” (Yara, Primary Health Care, Supervisor). Strong leadership was described by three participants as being supported in any way possible to ensure that practitioners were able to focus efforts on implementation, such as supporting practitioner capacity, family engagement, training, and team meetings.Practitioners felt unsupported by leadership when they were not encouraged to take on the training and coaching (Rebecca, ELC, Practitioner). Beatrice (Education, Practitioner) noted that training was only offered to select roles within her organization, and anyone else interested had to “personally ask” to take the training.Practitioners felt unable to promote ASQ and DSP implementation within their organizations when leadership was not supportive “because if they're not open to hearing, then we can say all we want” (Betty, Child Mental Health, Practitioner). Further, several practitioners felt disconnected from the implementation process due to a lack of leadership-led information dissemination. Gillian (Child Welfare, Practitioner) was not aware of organization-wide implementation because she was “not a supervisor”. Likewise, Betty (Child Mental Health, Practitioner) felt unable to drive implementation amongst her colleagues because only leadership “makes that decision.”

(4) Teamwork. Practitioners felt “comfortable and confident” (Pat, Child Welfare, Supervisor) when they had colleagues to whom they could refer to for ASQ and DSP support.Rebecca (ELC, Practitioner) expressed that she would validate her ASQs and DSPs with other staff members (“This is what I saw, this is what I observed, this is what I’m thinking the answer should be, but what do you guys think?”), Beatrice (Education, Practitioner) reported that other staff members had encouraged her to work as a team (“They approached me and said they would support me as much as I needed”), and Pat (Child Welfare, Supervisor) stated that her staff have team members to support ASQ use and DSP creation (“Team leads can also go with the staff, to mentor or to act as a bit of a coach”).However, several practitioners reported working alone when using an ASQ or creating a DSP. Working alone was reported by three participants as a consequence of insufficient organization-wide training. Yara (Primary Health Care, Supervisor) noted that working alone in her role was “just hard sometimes”.

(5) Overarching interest in early intervention. Participants that were interested in early intervention and IEMH sought out training that would fulfill their drive for knowledge. For instance, Rebecca (ELC, Practitioner) stated, “that stuff just piqued my interest… I was just like, I need to know more”, and Pat (Child Welfare, Supervisor) reported: “I know that from the completion of the ASQ and DSP, it’s also generated interest in membership in the early mental health practice leads group. It’s generated some interest in further training […] since then we've received more requests from other departments to receive the training.”As well, a common interest in early intervention was felt to be beneficial because practitioners and supervisors understood that they were “being trained so that we can help these families” (Rebecca, ELC, Practitioner). Participants described interest in early intervention leading to “really great ideas” (Beatrice, Education, Practitioner) and “increased attention to infant and early mental health” (Wanda, Public Health, Supervisor), as well as actual changes with behaviour, as reported by Yara (Primary Health Care, Supervisor): “the nurse practitioners have consulted me more often, have referred families to me more often.”

3.2. Sub-theme: multi-level, multi-sectoral collaborative partnerships and trusting relationships

Participants felt confident in organizational implementation of the ASQs and DSPs when there were established relationships between themselves, their colleagues and supervisor, their community partners, and the caregivers with whom they were working. Relationships often led to collaboration partnerships. For instance, (Betty, Child Mental Health, Practitioner) expressed feeling more confident because she knew there was a network of “people you can connect with and know that you’re a part of this together”. Building networks contributed to a “supportive understanding of each other” which allowed for practitioners to “reach out to a colleague or another agency” (Betty, Child Mental Health, Practitioner) in instances when they felt unsure in the implementation process.

Participants reported that the coaching sessions held by IEMHP were beneficial to both relationship-building within and across sectors and organizations. The coaching sessions offered the opportunity for practitioners from different regions, organizations, and sectors to come together and “hear how other people were implementing it” (Rebecca, ELC, Practitioner), as well as “know there's a support network in my community” (Betty, Child Mental Health, Practitioner).

Relationship-building in and across organizations drove implementation efforts by:

(1) increasing trust. Introducing early intervention tools to a family with whom the practitioner had a “trusting relationship” was described as “very easy” (Amy, Public Health, Practitioner). Practitioners who could “reassure moms” perceived caregivers as more trusting, reducing hesitancy towards developmentally screening (Jessica, Public Health, Practitioner). In comparison, practitioners who lacked a trusting relationship with the family were hesitant to introducing a parent-reported screening tool, describing that caregivers “may not see something that the child is able to do” (Wanda, Public Health, Supervisor), parents may inadvertently withhold important developmental information because “it’s not something most parents will tell you” (Rebecca, ELC, Practitioner), parents may purposefully withhold information due to “trust issues” (Sloane, Child Welfare, Supervisor), or parents may “decide that [they don’t] know me well enough” and refuse the screening (Beatrice, Education, Practitioner).

(2) reducing service duplication. Participants reported struggling with implementation when they felt there was no cohesive developmental screening tool policy between organizations. This struggle was described as “problematic” due to the risk of “duplication of information in different places” (Frankie, Child Welfare, Practitioner). Participants felt hesitant to introduce more information to families that accessed services from multiple organizations, reporting that parents were already feeling “tired” (Jessica, Public Health, Practitioner) and “not hearing that we’re talking the same language” (Pat, Child Welfare, Supervisor). Wanda (Public Health, Supervisor) noted that service duplication was more likely when organizations did not substantially communicate with each other. Wanda further reported that a lack of collaboration between organizations was perpetuated by “territoriality” as practitioners would often see their work as existing in isolation “rather than recognizing that everybody has a responsibility to work together on behalf of the child.”

(3) offering and receiving support. Both offering and receiving screening and practice support within and between organizations relieved worries surrounding the possibility of “incorrect” practice. Beatrice (Education, Practitioner) noted that she was “not worried” that she was going to “to mess up in some way and throw this whole family off” when practitioners in her organization would work together to review an ASQ or DSP. Betty (Child Mental Health, Practitioner) expressed that supportive partnerships reduced parent resistance to having their child screened. However, a lack of support within organizations was described as a consequence of insufficient information sharing between teams and departments by both Frankie (Child Welfare, Practitioner) and Jessica (Public Health, Practitioner).

Several practitioners noted that collaborative partnerships were often led by their supervisors. Supervisors that drove collaborative partnerships were described as assisting in developing and sustaining multi-level, multi-sectoral relationships, as well as being involved in infant and early mental health initiatives in which the teachings could be disseminated amongst staff.

“[The supervisor] is involved in a lot of different things in sort of the agency, the community, so [she] brings that back to us; and just wants to have sort of a positive work environment so [she] does try to create good relationships.” (Gillian, Child Welfare, Practitioner)

Theme 2: Implementation success is dependent on shared perspectives (see Table 3 for practitioner and supervisor quotes).

TABLE 3

Table 3. Practitioner and supervisor quotes related to theme 2.

3.3. Sub-theme: individuals involved in implementation require adequate and collective awareness, knowledge, and confidence

Participants expressed how implementation of ASQs and DSPs was facilitated by the network of professionals having a common level of awareness, knowledge, and confidence in early intervention practice. These shared characteristics were described as created and sustained through several methods:

(1) Training. The standardized training allowed for all participants, regardless of sector or position, to learn the same information. However, when supervisors and practitioners did not undertake the same, or any, training, participants described obstacles to implementation. Beatrice (Education, Practitioner), Gillian (Child Welfare, Practitioner), and Wanda (Public Health, Supervisor) noted that untrained service providers lacked necessary understanding of early identification and early intervention practice to drive implementation efforts. Amy (Public Health, Practitioner) described collaborating with untrained coworkers and community partners as “a work in progress”.Practitioners were reported to be less likely to complete IEHMP training because “it seems onerous” (Frankie, Child Welfare, Practitioner), because “it might be a little bit overwhelming” (Amy, Public Health, Practitioner), and because they “didn’t think it was super relevant to [their] job title” (Gillian, Child Welfare, Practitioner).

(2) Coaching. If participants felt they did not fully understand the learned topics following training completion, they reflected that the coaching sessions were opportunities to standardize their understanding. Betty (Child Mental Health, Practitioner) noted that “it just allowed me to be able to practice it, see what other, and hear what other, people have been using it in their agencies”. Jessica (Public Health, Practitioner) expressed that learning from other experienced professionals was “really helpful”. Sloane (Child Welfare, Supervisor) saw the coaching sessions as opportunities to listen to the struggles of “different people from around the province that took the training” to plan for solutions in the event that her team was struggling with comparable issues.Following coaching sessions, several participants reported increased feelings of confidence in early intervention practice, screening skills, and family engagement skills. Sloane (Child Welfare, Supervisor) reported that, prior to coaching, a lack of confidence in screening skills had been a setback for her organization because “people get stumped on and don’t want to do is the scoring.”Practitioners particularly felt confident engaging families if caregivers had a shared awareness and knowledge of early intervention practice. While some practitioners “didn’t experience any challenges” engaging families who were familiar with the ASQs (Betty, Child Mental Health, Practitioner), other participants described the use of the ASQs and DSPs as “not well-understood or accepted” by caregivers unfamiliar with the ASQs (Gillian, Child Welfare, Practitioner). Several participants felt that a lack of parental awareness and knowledge had the potential to negatively impact their ability to implement the ASQ with particular families. Betty (Child Mental Health, Practitioner) stated:

“I think the biggest piece is that we can do all this training and all of the ASQs… if we don’t have buy-in from the parents, then it doesn’t make any difference. We need to somehow educate the families as well.”

Sloane (Child Welfare, Supervisor) also asserted that “we have to educate them”, indicating that caregiver awareness and knowledge on the use of the ASQs and DSPs would reduce parental reluctance.Educating caregivers on early intervention practice was cited as allowing both parties to move forward with a shared level of understanding: “When people know about the ASQ, it’s easier to implement” (Amy, Public Health, Practitioner).

(3) Facilitator engagement. Practitioners felt aware and knowledgeable following continuous communication with the Facilitator (the IEMHP staff member conducting the coaching sessions). Betty (Child Mental Health, Practitioner) reported that communicating with the Facilitator in the coaching sessions gave her “that opportunity to really feel I understood it, and how to implement it before I went off to try it.” The support from the Facilitator was highly valued by the participants, who reported that “knowing I can shoot an e-mail if I’m not sure and have a personal response” helped build and maintain their confidence with the implementation of the ASQs and DSPs (Amy, Public Health, Practitioner).

3.4. Sub-theme: consistent and critical conversations on implementation strategies and follow-up

When participants were confident in their understanding of infant and early mental health and early intervention practice, they would begin to increasingly include these topics in conversations with colleagues, parents, and other professionals in the field. These conversations helped those participating to develop and maintain shared awareness, knowledge, interest, and confidence.

Discussions focused on implementation of developmental screening tools and early intervention practice were championed by:

(1) A dedicated IEMH group. Several organizations had “IEMH Groups”: an internal group focused on “ongoing conversations” and disseminating information. Staff members from various departments would attend the groups and “take that information back to our team” (Frankie, Child Welfare, Practitioner). For example, Pat (Child Welfare, Supervisor) discussed how the IEMH group at her organization included practitioners from multiple departments, allowing for the knowledge gained from the training to be disseminated throughout the organization. Knowledge dissemination in this fashion was viewed as important because other departments “might not have thought about infant mental health before” (Sloane, Child Welfare, Supervisor).

(2) Regular meetings including IEMH and implementation topics. Sloane (Child Welfare, Supervisor) described that regular inter-departmental meetings “made staff aware about infant mental health” and were helpful to practitioners who required guidance with implementation. Wanda (Public Health, Supervisor) reported that regular team meetings were a space for her staff to assist each other by offering advice or sharing lived experience.Frankie (Child Welfare, Practitioner) reported that her team would meet “on a monthly basis” to “talk about ways that we can encourage interventions”. Similarly, Sloane (Child Welfare, Supervisor) noted that her team's monthly meetings were used to “go over the ASQ together” and work as a group to “rectify” any “problems” with the implementation of the ASQs and DSPs. Jessica (Public Health, practitioner) spoke about how meeting “every six weeks or so” to discuss the ASQs and DSPs promoted her organization's “strong focus” on early intervention.However, several organizations did not incorporate IEMH, the use of early intervention tools, or implementation strategies into their intra- or inter-departmental meetings. In some instances, including a focus on implementation strategies and follow-up in team meetings was either scarce or excluded entirely (Yara, Primary Health Care, Supervisor).

(3) Communication with trained colleagues and providers. When participants were in spaces that included trained practitioners, many felt emboldened to discuss the information they had gathered, listen to the experiences of others, and ask for clarification.Gillian (Child Welfare, Practitioner) reported that she would collaborate with a trained professional in a different role from her own to discuss and learn from each other's experiences. Rebecca (ELC, Practitioner) noted that two staff members who carpooled to and from work would “share information back and forth” to remain informed with the organization's implementation process. Amy (Public Health, Practitioner) similarly reported “sharing” and “brainstorming” with trained colleagues when she was confused with the next steps in the implementation strategy.When communication was poor or scarce, participants experienced feelings of frustration. Jessica (Public Health, Practitioner) felt hindered in her organization's implementation efforts due to “challenges” of “connecting” with other trained professionals. Wanda (Public Health, Supervisor) described insufficient communication as a “barrier” to service coordination that would streamline implementation efforts.

Theme 3: Established organizational policies increase implementation opportunities (see Table 4 for practitioner and supervisor quotes).

TABLE 4

Table 4. Practitioner and supervisor quotes related to theme 3.

3.5. Sub-theme: clear protocols and procedures incorporating screening tool use

Practitioners felt inclined to use the ASQs and create the DSPs when these tasks were explicitly incorporated into their daily workload. Several factors needed to be considered when implementation of the ASQs and DSPs was meant to be routine practice:

(1) Staff capacity. All practitioners felt that their capacity to modify their workloads to accommodate the ASQs and the DSPs was bolstered when there was adequate time and staff available. Supervisors were cited as enabling this capacity building by advocating for their staff (Jessica, Public Health, Practitioner), ensuring “there’s enough staff to cover” (Rebecca, ELC, Practitioner), and allocating resources to ensure practitioners can freely “take the time” to be trained, engage families, practice screening skills, use the ASQs, and create the DSPs (Amy, Public Health, Practitioner).However, several participants struggled to complete training, regularly use the ASQs, and create DSPs when their regular workload had not been accommodated to include additional tasks. Practitioners expressed that implementation efforts suffered because the “job is already full as it is” (Gillian, Child Welfare, Practitioner), staff are “booked so solid” (Yara, Primary Health Care, Supervisor), and staff were instructed to “take it on top of your regular workload” (Frankie, Child Welfare, Practitioner). Yara (Primary Health Care, Supervisor).

(2) Organizational expectations. Implementation efforts were driven when practitioners were expected to complete the training and coaching and implement the ASQs and DSPs. Amy (Public Health, Practitioner) described the implementation of the ASQs as “a part of the expectation that this is what the nurses will do since we got the official training”. Sloane (Child Welfare, Supervisor) had encouraged her entire team to be trained, describing an “expectation” for practitioners to “do the ASQ or at least offer it to the family”. This expectation was reinforced by supervisors who viewed the training and coaching as essential to policy and professional development. Pat (Child Welfare, Supervisor) described “ongoing expectations” of her team to attend coaching sessions to improve organizational screening procedures. Similarly, Wanda (Public Health), expected her staff to complete the training and coaching as a method of establishing organization-wide best practice.

(3) Organizational policy. Practitioners who were mandated to use ASQs were persistent in their implementation efforts. Persistent implementation efforts were driven by previously established organizational guidelines (Jessica, Public Health, Practitioner), long-standing organizational screening tool use and early intervention practice (Betty, Child Mental Health, Practitioner), and the need to meet ministry standards (Amy, Public Health, Practitioner).When the ASQ and DSPs were not embedded in organizational policies, practitioners would focus attention on first completing tasks that were mandated, as work “goes in priority” (Beatrice, Education, Practitioner). ASQs and DSPs were not considered high priority when alternative early intervention practice had been a part of the staff's routine tasks for a long time (Gillian, Child Welfare, Practitioner), other early intervention practice was ministry-required (Frankie, Child Welfare, Practitioner), or other job requirements were considered more important (Gillian, Child Welfare, Practitioner).

3.6. Sub-theme: accessibility to early intervention information, tools, and best practice guidelines

Access to early intervention information, tools, and best practice guidelines was essential for participants to successfully implement the ASQs and DSPs. Accessibility was improved through:

(1) Technology. Several participants stressed the importance of technology as a way of streamlining implementation efforts. The use of technology, such as “virtual and phone” (Betty, Child Mental Health, Practitioner), facilitated implementation by reducing scheduling and transportation barriers. Working with families “over the phone” was described as “easier” by both Yara (Primary Health Care, Supervisor) and Gillian (Child Welfare, Practitioner). Both practitioners felt they were better able to accommodate the caregiver's needs when they offered phone screenings, specifically referring to comfort (Yara, Primary Health Care, Supervisor) and scheduling (Gillian, Child Welfare, Practitioner).When technology was inaccessible, in-person sessions were described as a “barrier” due to possible difficulties of transporting young children to the organization (Betty, Child Mental Health, Practitioner), and scheduling conflicts (Gillian (Child Welfare, Practitioner).Technology was also considered a useful tool to accessing early intervention information and best practice guidelines. Rebecca (ELC, Practitioner) reported that she “did every one” of the training modules because she was able to access them from her home. Gillian (Child Welfare, Practitioner) had received partial training in-person but acknowledged that the virtual training positively influenced her screening tool use: “I can say that I really didn’t do many ASQs until I had the more recent virtual training”.Two practitioners felt challenged when there was a lack of organizational technology use, including lack of an electronic ASQ available on a Canadian server, as the current virtual ASQ houses all data in the United States. Accessing the paper version of the ASQ was reported as not “user-friendly” and “problematic” (Wanda, Public Health, Supervisor). Frankie (Child Welfare, Practitioner) expressed that it was “very challenging” and “discouraging” to access the paper version of the ASQ, reducing her motivation to implement the tool within her organization.Wanda (Public Health, Supervisor) reported that an electronic ASQ would simplify the referral and information-sharing processes between organizations. Wanda also emphasized that “you need electronic tools” when practitioners were working remotely or offering virtual services, as the inconvenience of using paper tools was felt to outweigh the risk of using no screening tool at all.

(2) Administration space. Yara (Primary Health Care, Supervisor) found that working in a location with a dedicated space to screen children improved her capability to “incorporate the ASQs”. Several practitioners reported that inaccessibility to an appropriate space to conduct ASQs and create DSPs negatively impacted their implementation efforts. Gillian (Child Welfare, Practitioner) described an “issue” with working in a physically small organization, due to a lack of dedicated screening administration areas. Two practitioners conducted ASQs when visiting family homes, but described these circumstances as “distracting” due to a lack of privacy. Similarly, Frankie (Child Welfare, Practitioner) would attempt to conduct ASQs virtually by using a scanned version of the ASQ at family residences but often struggled with the lack of suitable space: “There’s not a surface to set your computer on to be typing”.

(3) Funding. Participants reported obstacles to implementation when financial resources were limited. Adequate funding was necessary to designate enough staff to the responsibilities within the organization to ensure the ASQs and DSPs were able to be completed. Wanda (Public Health, Supervisor) reported that the cost of staff to use the ASQs with families at their residences included “mileage and time”, increasing organizational expenses, and lowering leadership motivation to send staff out on these home screening visits.“Insufficient funds” was further reported as a problem for resourcing required to minimize or eliminate waitlists (Wanda, Public Health Supervisor). Waitlists are a significant issue when attempting to implement development screening tools for children, as children may age out of the developmentally-appropriate screening age range.Families also faced access barriers to receiving developmental services when the developmental screening tools were beyond parental literacy levels, or not provided in the caregiver's native language. Despite multiple published translations of the ASQ, each language version is sold separately and, thus, may not be financially feasible for the organization to purchase.

(4) Parental literacy and language. Rebecca (ELC, Practitioner) noted that she could not assume that all caregivers are capable of reading at the 4- to 6th- grade level in which the ASQs are written. She expressed that low parental literacy “makes it a little harder” to use the ASQ as a parent-completed tool. Jessica (Public Health, Practitioner) reported that she “struggles” when she is working with “a family that doesn’t speak English”, as her organization does not have access to other-language ASQs. Jessica would attempt to overcome these barriers by utilizing a translation service over the phone but noted that this process was “really difficult” due to the cumbersome nature of speaking through a “language line” to work through the ASQs and DSP.

Theme 4: COVID-19 guidelines create organizational challenges (see Table 5 for practitioner and supervisor quotes).

TABLE 5

Table 5. Practitioner and supervisor quotes related to theme 4.

The global coronavirus disease (COVID-19) pandemic impacted working conditions for early childhood practitioners and supervisors.

(1) Reduced opportunity for in-person screening. Several practitioners preferred to complete an ASQ with the parent and the child present, as “observing the child” was felt to be crucial to ensuring an accurate score on the screening tool and “face-to-face fosters more relationship building” (Yara, Primary Health Care, Supervisor). Jessica (Public Health, Practitioner) reported struggling when in-home visits were indefinitely restricted, stating that “it was a challenge to complete them” when her organization shifted away from in-person service delivery. Wanda (Public Health, Supervisor) reported that her staff felt that it was “really hard to do it virtually”, describing “too many distractions for the parents” when practitioners were not sitting with them face-to-face to complete the tool.

(2) Shifting roles and responsibilities. Participants experienced role and responsibility changes within their organizations, and/or partner organizations, in response to the global pandemic. Betty (Child Mental Health, Practitioner) and Yara (Primary Health Care, Supervisor) felt disheartened by the shifted roles in their partner organizations, both reporting that COVID-19 regulations shut down organizations to which they would have referred families: “Why would we refer our struggling families to somewhere that isn’t even operating right now?” (Yara, Primary Health Care, Supervisor)

(3) COVID-19 guidelines reduced communication. Several practitioners reported that they were connecting less frequently with internal colleagues and external community partners. Betty (Child Mental Health, Practitioner) used to collaborate in-person with Early On centres to engage families and conduct early intervention practice but was unable to continue this partnership during the global pandemic. Two participants reported that colleagues no longer working in a shared space due to COVID-19 regulations negatively impacted cooperation on implementation efforts. Sloane (Child Welfare, Supervisor) expressed that she felt her team members would be more supportive if they were “in the office like they used to be, in one room together”, reporting that “if we weren’t in COVID there might be more collaborative work”. Pat (Child Welfare, Supervisor) described her team working in separate areas as “the biggest barrier”, as colleagues were no longer able to “bounce ideas” off each other, nor were they able to “converse with themselves as they’re doing the training”.

(4) Disrupted training. IEMHP's training and coaching was offered in-person pre-pandemic and shifted to a virtual model during the pandemic. The interruption in training caused a practitioner to start over from the beginning, increasing total time spent on the model (Gillian, Child Welfare, Practitioner). Other practitioners were unable to begin or complete the training and coaching model because they were re-deployed to respond to COVID-19 needs: “the only reason that a Public Health Nurse isn’t trained is because they’re still in COVID response” (Wanda, Public Health, Supervisor). Wanda unsuccessfully advocated for re-deployed staff members to be involved in the training and coaching: “I have somebody’s who’s deployed right now who I tried to get back for this last training and they weren’t released” (Wanda, Public Health, Supervisor).Other practitioners felt their learning process throughout the virtual training and coaching was disrupted due to factors outside of their control, such as sound issues, poor internet connectivity, and struggles “learning from home” (Beatrice (Education, Practitioner).

4. Discussion

Implementation is a complex, multi-dimensional process that intentionally translates knowledge gained from research into practice (47). Evidence-based interventions are created and utilized in community-based organizations to produce observable and measurable change (48). However, research outputs often face challenges mobilizing into practical application at the population-level (49, 50), community-level, or organization-level (51). It is estimated that nearly two-thirds of attempts to organizationally implement novel practice fail (52). Through semi-structured interviews with practitioners and supervisors who work directly with children under the age of 6, this study characterized current barriers and facilitators to implementing the Ages and Stages Questionnaires and Developmental Support Plans at the organizational level following completion of a training and coaching model.

The first theme presented in this paper supports prior research that indicates implementation of new knowledge into health services practice is positively influenced by organizational context that is inclusive of organizational culture and leadership (53). The findings of this study further align with Paynter et al. (54) results that indicate organizational culture is directly related to increased evidence-based practice, as well as Glisson's (55) work that suggests organizational context and culture are linked to service adoption and delivery. This study adds to the current literature by identifying specific elements of organizational culture and leadership that influence the implementation efforts of supervisors and practitioners working with children under the age of 6. This study also adds to the current literature on implementation of developmental screening tools and early intervention by including supervisor perspectives, as research in this area has largely focused on provider and parent experiences (56–59). In this study, practitioners and supervisors alike felt supported in their implementation efforts when there was a cohesive network of trained professionals and leaders that valued the use of developmental screening tools and early intervention practice, had explicitly defined roles and responsibilities, were interested in early intervention practice, and with whom they could work as a team to use and review the developmental screening tools and developmental support plans. All the factors listed above were reported to be influenced by sufficient information sharing between teams and departments.

Previous research has also highlighted the importance of parent-provider relationships in driving implementation of early intervention (60, 61). While relationship-building and community teamwork have been found to positively contribute to implementation effectiveness (62, 63), this study emphasizes the importance of multi-level, multi-sectoral partnerships that, while including the parent-provider relationship, also detail the necessity for trusting relationships between practitioners, supervisors, and external community partners. This study expands on past work by outlining key factors to creating and sustaining intra- and inter-organizational collaborative partnerships. In particular, this study highlights that increasing trust, reducing service duplication, and both offering and receiving support with developmental screening tasks and implementation strategies are critical pieces to positive relationship-building in and across organizations.

Further, prior research notes that leadership support is essential to developmental screening and early intervention implementation success (53, 64). This study elaborates on this concept by summarizing the behaviours of a supportive leader that drive implementation, such as building relationships intra- and inter-organizationally, encouraging and promoting professional development through training and coaching, supporting staff capacity to incorporate developmental screening and early intervention into routine practice, and ensuring adequate funding.

The second theme presented in this study addresses the importance of shared perspectives between parents, practitioners, and supervisors in developmental screening and early intervention implementation. While shared perspectives and attitudes have been noted as influencing successful implementation of other health services innovations (65, 66), this study's focus on multi-level, multi-sectoral shared perspectives with regards to developmental screening and early intervention helps to fill a gap in early intervention implementation literature. Shared perspectives, in the context of this paper, are inclusive of collective awareness, knowledge, and confidence. A lack of collective knowledge, as reported in this theme, is supported by past work that indicates lack of provider and parental knowledge are barriers to implementation of developmental screening (59, 67). This study further identifies that, in addition to inadequate practitioner knowledge, a lack of supervisor/leadership knowledge negatively influences the uptake of developmental screening by practitioners, as organizational training is often dependent on supervisor understanding and support.

The second theme also supports previous research that has reported a lack of training (56, 68, 69), and a lack of information regarding screening tools (70), as barriers to adequate capacity to support developmental screening implementation. This study adds to the current literature by providing an account of facilitators that may mitigate barriers caused by insufficient training and knowledge. First, practitioner and supervisor implementation efforts were facilitated when the implementation process, developmental screening tools, and early intervention were a focus of regular conversation within teams, across departments, and between community partners. Regular conversations dedicated to developmental screening, infant and early mental health, and implementation facilitated knowledge translation and dissemination, helping to build a common level of awareness, knowledge, and confidence. Regular conversations were facilitated by coaching sessions, dedicated organizational infant and early mental health groups, and routine inter-departmental meetings that explicitly incorporate discussions on developmental screening tool use and implementation strategies. This finding is supported by Simpson and Dansereau (71) study that suggests established, high quality discussions, as well as informal, clear communications, positively affect implementation effectiveness.

Confidence also plays an important role as a facilitator in implementation efforts. Previous work identified that a practitioner's lack of confidence in developmental screening skills is a barrier to implementation (72, 73). In this study, practitioners reported feeling discouraged implementing the ASQs and DSPs when they, and/or their colleagues, were not confident in their screening and parent engagement skills. This study illuminates three distinct facilitators to increase confidence to bolster implementation efforts: coaching sessions, implementation support from a facilitator, and caregiver knowledge on developmental screening and early intervention. Therefore, confidence to drive developmental screening and early intervention implementation may be strengthened by collective practitioner and caregiver knowledge. This collective knowledge can be supported through educational opportunities, such as coaching, that are openly offered to practitioners and caregivers alike, or practitioner-led knowledge dissemination to caregivers. Suggestions for practitioner-led knowledge dissemination strategies include handing out pamphlets when meeting families, distributing a webinar to families by e-mail, or discussing developmental screening and early intervention at childcare pick-up or drop-off.

The third theme presented in this paper suggests that a lack of established organization policies negatively impacts implementation of developmental screening tools and early intervention. Previous work has documented that insufficient time, staff, and physical environments, as well as competing priorities, are barriers to routine screening (57, 66, 74). This study expands on this knowledge by evaluating practitioner experiences when workloads were not modified to accommodate additional tasks, and by identifying possible mitigating factors to overcome the aforementioned barriers. Practitioners experienced frustration and discouragement with the incorporation of the developmental screening and early intervention practice into their daily workload when no, or few, accommodations were made to account for the time, physical space, staff, and resources necessary to complete the ASQs and DSPs. Practitioners also felt less motivated to use the ASQs and create the DSPs when access to the tools were cumbersome due to insufficient technology, resources, or funding. However, practitioners felt compelled to incorporate the ASQs and DSPs into their practice when the use of the tools was organizationally expected, and ministry mandated. While previous research (65) suggests providers are more susceptible to new practice inclusion when there are specific written organizational policies, this study underscores that explicit leadership-led expectations of routine practice, as well as accessibility to essential information and resources, are concurrently critical to successful organization-level implementation.

Finally, the fourth theme presented in this paper focuses on the role of the COVID-19 global pandemic as a barrier to developmental screening and early intervention implementation. The COVID-19 global pandemic impacted implementation efforts by introducing regulations intended to slow down transmission of the virus, such as virtually converting, or indefinitely suspending, in-person services. Remote service delivery decreased communication between colleagues, diminished collaboration opportunities between organizations, and reduced ease of ASQ use with families. The COVID-19 regulations also shifted practitioner roles and responsibilities, deploying staff who would otherwise have been trained and coached on the ASQs and DSP, thus reducing the number of staff who could have implemented the tools.

The theme of COVID-19 creating organizational challenges is consistent with additional studies that have found practitioners struggled with the transition from in-person to virtual or phone screening (75). Additional barriers to implementation of evidence-based practice during the pandemic included lack of privacy, technological obstacles, and preference for in-person services (76). Literature on the impact of COVID-19 on implementation of developmental screening tools and early intervention is currently limited. To the author's knowledge, this study is the first to contribute to the growing body of developmental screening and early intervention implementation literature by providing accounts of practitioner and supervisor experiences of training, coaching, and implementation during a global pandemic.

4.1. Key implications

This qualitative study can inform the implementation efforts, strategies, and process of practitioners and supervisors providing developmental screening and early intervention to children under the age of 6. The thematic analysis presented in this paper can be used to inform future framework development for organization-level implementation of developmental screening tools and early intervention. Prior to formal framework development, individuals seeking to successfully implement developmental screening tools within their organizations may utilize the themes and sub-themes presented in this paper as a guide to proactively address barriers and promote facilitators by identifying their organization's readiness status for implementation.

For example, prior to implementation, those involved in the implementation process should identify whether their organizational culture is supportive of implementation (e.g., is there a strong leader? Is there role clarity? Are values shared across the organization?), as well as whether there are collaborative partnerships available to leverage (e.g., are there any other staff members that could help administer the tools? Do staff, supervisors, and caregivers share levels of knowledge and confidence?), whether there are opportunities for consistent implementation conversations (e.g., is there time during weekly meetings to add implementation strategies to the agenda?), and whether policies or procedures must be developed to outline the routine use of developmental screening tools and early intervention services (e.g., is there a designated administration space in the organization?).

Identifying the organization's readiness status for implementation in relation to this paper's themes and sub-themes will help to identify areas that require development or strengthening prior to implementation. Once areas of need have been identified, strategies to meet needs should be undertaken.

For instance, if an organization has identified that practitioners and caregivers do not share the same level of knowledge regarding developmental screening tools and early intervention, they may strategize to build shared knowledge through several methods. First, one service provider and one supervisor from each department within the organization may complete the training and coaching model. The service providers and supervisors can then bring the learned information to team meetings and become internal learning facilitators. Second, caregiver knowledge could be strengthened through dissemination of educational resources such as videos or brochures, or organizations may invite caregivers to participate in information sessions where practitioners share what they learned in the developmental screening and early intervention training and coaching sessions. As well, if an organization has identified they do not have sufficient collaborative partnerships, leadership may seek out potential partners within their community that have a shared vision for improving developmental outcomes and establish formal memorandums of understanding to clarify roles and responsibilities, ensure accountability, and facilitate the sharing of resources and information.

Organizations that utilize the themes and sub-themes presented in this paper may find that they experience a more seamless implementation process, as they will be able to recognize and respond to organizational-level implementation gaps before beginning the implementation process. Future work should include a focus on formalizing these themes, sub-themes, questions, and strategies into an organizational-level implementation framework.

4.2. Strengths and limitations

This study helps to fill a gap in current understanding of the challenges faced by early childhood service providers and supervisors when attempting to implement developmental screening and early intervention services in their organizations. Organizations who wish to implement developmental screening and early intervention in practice may use the themes and sub-themes presented in this paper as a guide to recognize and address the barriers they may face, and the facilitators they must promote, prior to, and throughout, the implementation process.

Further, to the author's knowledge, this is the first study identifying barriers and facilitators to implementing developmental screening tools and early intervention in organizations working with children under the age of 6, following training and coaching that has occurred during a global pandemic. As such, the barriers and facilitators described provide a useful starting point for implementation of early intervention practice during typical practice, as well as possible future pandemics.

Finally, this paper is the first known research to identify barriers and facilitators to developmental screening following training and coaching in the Canadian context. The authors believe that the understanding gained from this study is not unique to the Canadian context and can be applied to any organization in countries that have similar childcare organization infrastructure and resources. Thus, this paper can provide guidance to supervisors and practitioners intending to implement early intervention practice with families within their organizations.

There are also several notable limitations to this study. First, the semi-structured interviews were held with practitioners and supervisors who work in Canada. As such, it cannot be assumed that the barriers and facilitators highlighted by these discussions can be generalizable to countries that are infrastructurally dissimilar to Canada, as early intervention practice and guidelines vary across countries. Further, the sample size in this study (7 practitioners, 4 supervisors) may not be representative of all perspectives held within and across organizations that have completed IEMHP's training and coaching model. A larger sample that consists of an equal number of practitioner and supervisor perspectives across all sectors involved in IEMHP's training and coaching model may provide deeper insight to the barriers and facilitators faced. Further, primary caregiver characteristics were included as both barriers and facilitators identified by practitioners and supervisors; however, primary caregivers were not included in the participant sample. As such, direct insight into the barriers and facilitators that primary caregivers experience was not included in this study. Future research should expand the participant sample to include primary caregivers to broaden the general understanding of the barriers and facilitators to implementation of developmental screening and early intervention. Moreover, while several sectors were included in this analysis, themes were not isolated to specific sectors, and the barriers and facilitators to implementation may, in some cases, be sector-specific (e.g., parent reluctance was commonly discussed with participants working in the Child Welfare sector, whereas this topic was not as salient with the other sectors). Future research should focus on identifying sector-specific barriers and facilitators to early intervention practice implementation, utilizing a larger sample size across all Canadian provinces.

4.3. Reflexivity statement

The researchers involved in this project have attempted to present each practitioner and supervisor's narrative appropriately, and to the fullest extent possible as outsiders to their work. The first author (KP-K) is a doctoral candidate whose project focuses on the implementation of developmental screening tools in organizations that work with children under the age of 6, in partnership with the Infant and Early Mental Health Promotion group that created and runs the training and coaching the participants completed. The first author has no first-hand experience introducing and using ASQs and DSPs with families. The secondary coder (CP) is a doctoral student studying rehabilitation science and does not have first-hand experience using developmental screening tools or early intervention practice. The analysis presented in this paper has been co-produced by the first and second authors' interpretations and the practitioners and supervisors who generously gave their time, insight, and feedback to offer and validate the perspectives on barriers and facilitators to implementation.

4.4. Conclusion

Training and coaching supervisors and practitioners to administer developmental screening tools and create developmental support plans can positively impact the developmental trajectories of the children with whom they engage in early intervention. Organization-level barriers and facilitators to developmental screening administration and developmental support plan creation should be recognized and addressed prior to, and throughout, the implementation process. Additional research is needed to identify individual-level and systems-level strategies to reduce barriers and promote facilitators. Future quantitative research is also necessary to determine if strategies to reduce implementation barriers and promote implementation facilitators influences the number of practitioners administering the ASQs, the number of children screened, and the number of families utilizing early intervention services.

Data availability statement

The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation upon request to the corresponding author.

Ethics statement

The studies involving human participants were reviewed and approved by Queen's University Health Sciences and Affiliated Teaching Hospitals Research Ethics Board. The participants provided their written informed consent to participate in this study.

Author contributions

CK and NT designed the training and coaching model. NT facilitated the coaching sessions. KP-K and JR designed the study. KP-K wrote the semi-structured interview guide. CK and NT reviewed and edited the semi-structured interview guide. NT sent out the recruitment e-mail. KP-K conducted all initial and follow-up interviews. KP-K transcribed the interviews. KP-K did the primary coding and CP acted as secondary coder of transcript data. KP-K completed the thematic analysis. All authors discussed the results. KP-K wrote the manuscript. All authors contributed to the article and approved the submitted version.

Funding

Funding for the project was provided by Kids Brain Health Network.

Acknowledgments

We would like to express our gratitude to the practitioners and supervisors who gave their time, shared their experiences, and provided feedback throughout this project.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Canadian Institute of Child Health. Areas of vulnerability among children vulnerable in at least one area of development, age 5, Canada (by percentage), 2014 – The Health of Canada’s Children and Youth (2014). Available at: https://cichprofile.ca/module/8/section/8/page/areas-of-vulnerability-among-children-vulnerable-in-at-least-one-area-of-development-at-age-5/.

2. Mervis J. Past successes shape effort to expand early intervention. Science. (2011) 333(6045):952–6. doi: 10.1126/science.333.6045.952

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Enns J, Brownell M, Janus M, Guhn M. Early childhood development in Canada: current state of knowledge and future directions: current state of knowledge and future directions [PDF file] (2019). Available at: https://edi-offordcentre.s3.amazonaws.com/uploads/2019/10/Early-Childhood-Development-in-Canada_EN_20190918.pdf.

4. Government of Canada. Investing in our future: national progress report on early learning and child care (2017 to 2018). Employment and social development Canada (2022). Available at: https://www.canada.ca/en/employment-social-development/programs/early-learning-child-care/reports/2019-national-progress.html (Accessed October 28, 2022).

5. Hwang AW, Chao MY, Liu SW. A randomized controlled trial of routines-based early intervention for children with or at risk for developmental delay. Res Dev Disabil. (2013) 34(10):3112–23. doi: 10.1016/j.ridd.2013.06.037

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Love JM, Kisker EE, Ross C, Raikes H, Constantine J, Boller K, et al. The effectiveness of early head start for 3-year-old children and their parents: lessons for policy and programs. Dev Psychol. (2005) 41(6):885–901. doi: 10.1037/0012-1649.41.6.885

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Glascoe FP. Screening for developmental and behavioral problems. Ment Retard Dev Disabil Res Rev. (2005) 11(3):173–9. doi: 10.1002/mrdd.20068

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Johnson S, Marlow N. Developmental screen or developmental testing? Early Hum Dev. (2006) 82(3):173–83. doi: 10.1016/j.earlhumdev.2006.01.008

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Semrud-Clikeman M, Romero RAA, Prado EL, Shapiro EG, Bangirana P, John CC. Selecting measures for the neurodevelopmental assessment of children in low-and middle-income countries. Child Neuropsychol. (2017) 23(7):761–802. doi: 10.1080/09297049.2016.1216536

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Centre for Disease Control and Prevention. Adverse childhood experiences (ACEs) (2020). Available at: https://www.cdc.gov/violenceprevention/childabuseandneglect/acestudy/index.html.

11. Walsh E, Blake Y, Donati A, Stoop R, Von Gunten A. Early secure attachment as a protective factor against later cognitive decline and dementia. Front Aging Neurosci. (2019) 11:161. doi: 10.3389/fnagi.2019.00161

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Halpern R. Early intervention for low-income children and families. In: Shonkoff JP, Meisels SJ, editors. Handbook of Early Childhood Intervention Cambridge, New York, Melbourne, Madrid, Cape Town, Singapore, São Paulo, Delhi: Cambridge University Press (2000). p. 361–86.

13. Domitrovich CE, Gest SD, Gill S, Bierman KL, Welsh J, Jones D. Fostering high-quality teaching with an enriched curriculum and professional development support: the head start REDI program. Am Educ Res J. (2009) 46(2):567–97. doi: 10.3102/0002831208328089

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Felitti VJ, Anda RF, Nordenberg D, Edwards V, Koss MP, Marks JS. Relationship of childhood abuse and household dysfunction to many of the leading causes of death in adults the adverse childhood experiences (ACE) study. Am J Prev Med. (1998) 14(4):245–58. doi: 10.1016/S0749-3797(98)00017-8

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Collis E. Nurturing the seed: a collaborative journey to infant mental health and wellness: phase one. Centre for neuroscience studies graduate theses (2019). Available at: https://qspace.library.queensu.ca/handle/1974/28073.

16. Dyment JE, Davis JM, Nailon D, Emery S, Getenet S, McCrea N, et al. The impact of professional development on early childhood educators’ confidence, understanding and knowledge of education for sustainability. Environ Educ Res. (2013) 20(5):660–79. doi: 10.1080/13504622.2013.833591

CrossRef Full Text | Google Scholar

17. Burchinal MR, Cryer D, Clifford RM. Caregiver training and classroom quality in child care centers. Appl Dev Sci. (2002) 6:2–11. doi: 10.1207/S1532480XADS0601_01

CrossRef Full Text | Google Scholar

18. Sandefur SJ, Warren AR, Gamble AB, Holcombe JM, Hicks HK. Coaching: it’s not just for little league. In: Neuman SB, Kamil ML, editors. Preparing teachers for the early childhood classroom: Proven models and key principles. Baltimore, MD: Paul H. Brookes Publishing Co (2010). p. 87–103.

19. Neuman SB, Cunningham L. The impact of professional development and coaching on early language and literacy instructional practices. Am Educ Res J. (2009) 46(2):532–66. doi: 10.3102/0002831208328088

CrossRef Full Text | Google Scholar

20. Fixsen DL, Naoom SF, Blase KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa, FL: University of South Florida, Louise de la Parte Florida Mental Health Institute, The National Implementation Research Network (2005).

21. Shidler L. The impact of time spent coaching for teacher efficacy on student achievement. Early Child Educ J. (2009) 36(5):453–60. doi: 10.1007/s10643-008-0298-4

CrossRef Full Text | Google Scholar

22. Koh S, Neuman SB. The impact of professional development in family child care: a practice-based approach. Early Educ Dev. (2009) 20(3):537–62. doi: 10.1080/10409280902908841

CrossRef Full Text | Google Scholar

23. Rusby JC, Jones LB, Crowley R, Smolkowski K, Arthun C. Predictors of home-based child care providers’ participation in professional development workshops and coaching. Child Youth Care Forum. (2013) 42(5):439–55. doi: 10.1007/s10566-013-9209-y

CrossRef Full Text | Google Scholar

24. Burchinal MR, Campbell FA, Brayant DM, Wasik BH, Ramey CT. Early intervention and mediating processes in cognitive performance of children of low-income African American families. Child Dev. (1997) 68(5):935–54. doi: 10.1111/j.1467-8624.1997.tb01972.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Broeren S, Muris P, Diamantopoulou S, Baker JR. The course of childhood anxiety symptoms: developmental trajectories and child-related factors in normal children. J Abnorm Child Psychol. (2012) 41(1):81–95. doi: 10.1007/s10802-012-9669-9

CrossRef Full Text | Google Scholar

26. Wetherby AM, Woods J, Guthrie W, Delehanty A, Brown JA, Morgan L, et al. Changing developmental trajectories of toddlers with autism spectrum disorder: strategies for bridging research to community practice. J Speech Lang Hear Res. (2018) 61(11):2615–28. doi: 10.1044/2018_jslhr-l-rsaut-18-0028

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Fox L, Hemmeter ML, Snyder P, Binder DP, Clarke S. Coaching early childhood special educators to implement a comprehensive model for promoting young children’s social competence. Topics Early Child Spec Educ. (2011) 31(3):178–92. doi: 10.1177/0271121411404440

CrossRef Full Text | Google Scholar

28. Cressman CJP. Governance of child health policy: the Canadian context for developmental screening (Order No. 27546582). ProQuest Dissertations & Theses Global (2425007283) (2020). Available at: https://proxy.queensu.ca/login?url=https://www.proquest.com/dissertations-theses/governance-child-health-policy-canadian-context/docview/2425007283/se-2.

29. Underwood K, Frankel EB. The developmental systems approach to early intervention in Canada. Infants Young Child. (2012) 25(4):286–96. doi: 10.1097/IYC.0b013e3182673dfc

CrossRef Full Text | Google Scholar

30. Paynter JM, Keen D. Knowledge and use of intervention practices by community-based early intervention service providers. J Autism Dev Disord. (2015) 45(6):1614–23. doi: 10.1007/s10803-014-2316-2

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Makombe CBT, Shabalala N, Viljoen M, Seris N, de Vries PJ, Franz L. Sustainable implementation of early intervention for autism spectrum disorder through caregiver coaching: south African perspectives on barriers and facilitators. Pediatr Med. (2019) 2:39. doi: 10.21037/pm.2019.07.08

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Registered Nurses’ Association of Ontario. Knowledge-to-action framework. RNAO.ca. (2022). Available at: https://rnao.ca/leading-change-toolkit/knowledge-to-action.

33. Rycroft-Malone J. Ingredients for change: revisiting a conceptual framework. Qual Saf Health Care. (2002) 11(2):174–80. doi: 10.1136/qhc.11.2.174

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Rycroft-Malone J. The PARIHS framework—a framework for guiding the implementation of evidence-based practice. J Nurs Care Qual. (2004) 19(4):297–304. doi: 10.1097/00001786-200410000-00002

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Kitson AL, Rycroft-Malone J, Harvey G, McCormack B, Seers K, Titchen A. Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges. Implement Sci. (2008) 3(1):1. doi: 10.1186/1748-5908-3-1

PubMed Abstract | CrossRef Full Text | Google Scholar

36. Helfrich CD, Damschroder LJ, Hagedorn HJ, Daggett GS, Sahay A, Ritchie M, et al. A critical synthesis of literature on the promoting action on research implementation in health services (PARIHS) framework. Implement Sci. (2010) 5(1):82. doi: 10.1186/1748-5908-5-82

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Kitson A, Harvey G, McCormack B. Enabling the implementation of evidence based practice: a conceptual framework. Qual Saf Health Care. (1998) 7(3):149–58. doi: 10.1136/qshc.7.3.149

CrossRef Full Text | Google Scholar

38. Doran DM, Sidani S. Outcomes-focused knowledge translation: a framework for knowledge translation and patient outcomes improvement. Worldviews Evid Based Nurs. (2007) 4(1):3–13. doi: 10.1111/j.1741-6787.2007.00073.x

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Conklin J, Stolee P. A model for evaluating knowledge exchange in a network context. Can J Nurs Res Arch. (2008) 40(2):116–25. https://cjnr.archive.mcgill.ca/article/view/2126

Google Scholar

40. Braun V, Clarke V. Conceptual and design thinking for thematic analysis. Qual Psychol. (2022) 9(1):3. doi: 10.1037/qup0000196

CrossRef Full Text | Google Scholar

41. Crabtree BF, Miller WF. A template approach to text analysis: developing and using codebooks. Crabtree BF, Miller WL, editors. Newbury Park, CA: Sage Publications (1992).

42. Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. (2006) 5(1):80–92. doi: 10.1177/160940690600500107

CrossRef Full Text | Google Scholar

43. Meyer K, Willis R. Looking back to move forward: the value of reflexive journaling for novice researchers. J Gerontol Soc Work. (2019) 62(5):578–85. doi: 10.1080/01634372.2018.1559906

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Dhakal K. NVivo. J Med Libr Assoc. (2022) 110(2):270–2. doi: 10.5195/jmla.2022.1271

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Birt L, Scott S, Cavers D, Campbell C, Walter F. Member checking: a tool to enhance trustworthiness or merely a nod to validation? Qual Health Res. (2016) 26(13):1802–11. doi: 10.1177/1049732316654870

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Finlay L. “Outing” the researcher: the provenance, process, and practice of reflexivity. Qual Health Res. (2002) 12(4):531–45. doi: 10.1177/104973202129120052

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Nilsen P. Making sense of implementation theories, models, and frameworks. Implement Sci. (2020) 10:53–79. doi: 10.1007/978-3-030-03874-8_3

CrossRef Full Text | Google Scholar

48. Embry DD. Community-based prevention using simple, low-cost, evidence-based kernels and behavior vaccines. J Community Psychol. (2004) 32(5):575–91. doi: 10.1002/jcop.20020

CrossRef Full Text | Google Scholar

49. Bull FC, Pratt M, Shepherd RJ, Lankenau B. Implementing national population based action on physical activity-for action and opportunities for international collaboration. Promot Educ. (2006) 13(2):127–32. doi: 10.1177/10253823060130020107

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Koh HK, Oppenheimer SC, Massin-Short SB, Emmons KM, Geller AC, Viswanath K. Translating research evidence into practice to reduce health disparities: a social determinants approach. Am J Public Health. (2010) 100(S1):S72–80. doi: 10.2105/AJPH.2009.167353

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Krainer K. Implementation as interaction of research, practice, and policy. Considerations from the Austrian initiative IMST. ZDM. (2021) 53(5):1175–87. doi: 10.1007/s11858-021-01300-y

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Burnes B. Emergent change and planned change – competitors or allies? Int J Oper Prod Manag. (2004) 24(9):886–902. doi: 10.1108/01443570410552108

CrossRef Full Text | Google Scholar

53. Shahidullah JD, Forman SG, Norton AM, Harris JF, Palejwala MH, Chaudhuri A. Implementation of developmental screening by childcare providers. Infants Young Child. (2020) 33(1):21–34. doi: 10.1097/iyc.0000000000000158

CrossRef Full Text | Google Scholar

54. Paynter JM, Ferguson S, Fordyce K, Joosten A, Paku S, Stephens M, et al. Utilisation of evidence-based practices by ASD early intervention service providers. Autism. (2017) 21(2):167–80. doi: 10.1177/1362361316633032

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Glisson C. The organizational context of children’s mental health services. Clin Child Fam Psychol Rev. (2002) 5(4):233–53. doi: 10.1023/A:1020972906177

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Pinto-Martin JA, Dunkle M, Earls M, Fliedner D, Landes C. Developmental stages of developmental screening: steps to implementation of a successful program. Am J Public Health. (2005) 95(11):1928–32. doi: 10.2105/AJPH.2004.052167

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Schonwald A, Horan K, Huntington N. Developmental screening: is there enough time? Clin Pediatr. (2009) 48(6):648–55. doi: 10.1177/0009922809334350

CrossRef Full Text | Google Scholar

58. Honigfeld L, Chandhok L, Spiegelman K. Engaging pediatricians in developmental screening: the effectiveness of academic detailing. J Autism Dev Disord. (2012) 42(6):1175–82. doi: 10.1007/s10803-011-1344-4

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Morelli DL, Pati S, Butler A, Blum NJ, Gerdes M, Pinto-Martin J, et al. Challenges to implementation of developmental screening in urban primary care: a mixed methods study. BMC Pediatr. (2014) 14(1):16. doi: 10.1186/1471-2431-14-16

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Lovett J, Palamaro Munsell E, McNamara K, Doyle O. Friend, foe or facilitator? The role of the parent-service provider relationship in the early implementation of a family-based community intervention. Community Psychol Glob Perspect. (2016) 2(1):52–72. doi: 10.1285/i24212113v2i1p52

CrossRef Full Text | Google Scholar

61. Saïas T, Lerner E, Greacen T, Emer A, Guédeney A, Dugravier R, et al. Parent-provider relationship in home visiting interventions. Child Youth Serv Rev. (2016) 69:106–15. doi: 10.1016/j.childyouth.2016.08.004

CrossRef Full Text | Google Scholar

62. Edmondson AC, Bohmer RM, Pisano GP. Disrupted routines: team learning and new technology implementation in hospitals. Adm Sci Q. (2001) 46(4):685–716. doi: 10.2307/3094828

CrossRef Full Text | Google Scholar

63. Safran DG, Miller W, Beckman H. Organizational dimensions of relationship-centered care. Theory, evidence, and practice. J Gen Intern Med. (2006) 21:S1. doi: 10.1111/j.1525-1497.2006.0210s1001_2.x

CrossRef Full Text | Google Scholar

64. King TM, Tandon SD, Macias MM, Healy JA, Duncan PM, Swigonski NL, et al. Implementing developmental screening and referrals: lessons learned from a national project. Pediatrics. (2010) 125(2):350–60. doi: 10.1542/peds.2009-0388

PubMed Abstract | CrossRef Full Text | Google Scholar

65. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. (2004) 6(2):61–74. doi: 10.1023/B:MHSR.0000024351.12294.65

PubMed Abstract | CrossRef Full Text | Google Scholar

66. McNeely J, Kumar PC, Rieckmann T, Sedlander E, Farkas S, Chollak C, et al. Barriers and facilitators affecting the implementation of substance use screening in primary care clinics: a qualitative study of patients, providers, and staff. Addict Sci Clin Pract. (2018) 13:1. doi: 10.1186/s13722-018-0110-8

PubMed Abstract | CrossRef Full Text | Google Scholar

67. Earls MF, Hay SS. Setting the stage for success: implementation of developmental and behavioral screening and surveillance in primary care practice—the North Carolina assuring better child health and development (ABCD) project. Pediatrics. (2006) 118(1):e183–8. doi: 10.1542/peds.2006-0475

PubMed Abstract | CrossRef Full Text | Google Scholar

68. Sices L. Developmental screening in primary care: the effectiveness of current practice and recommendations for improvement. Commonwealth Fund. Retrieved from http://www.commonwealthfund.org/usr_doc/1082_Sices_developmental_screening_primary_care.pdf (2007).

69. Miller J. Screening children for developmental behavioral problems: principles for the practitioner. Prim Care Clin Prac. (2007) 34(2):177–201. doi: 10.1016/j.pop.2007.04.011

CrossRef Full Text | Google Scholar

70. Golnik A, Ireland M, Borowsky IW. Medical homes for children with autism: a physician survey. Pediatrics. (2009) 123(3):966–71. doi: 10.1542/peds.2008-1321

PubMed Abstract | CrossRef Full Text | Google Scholar

71. Simpson DD, Dansereau DF. Assessing organizational functioning as a step toward innovation. Perspect Biol Med. (2007) 3(2):20. doi: 10.1151/spp073220

CrossRef Full Text | Google Scholar

72. Allen SG, Berry AD, Brewster JA, Chalasani RK, Mack PK. Enhancing developmentally oriented primary care: an Illinois initiative to increase developmental screening in medical homes. Pediatrics. (2010) 126(Supplement_3):S160–4. doi: 10.1542/peds.2010-1466K

PubMed Abstract | CrossRef Full Text | Google Scholar

73. Mazurek MO, Kuhlthau K, Parker RA, Chan J, Sohl K. Autism and general developmental screening practices among primary care providers. J Dev Behav Pediatr. (2021) 42(5):355–62. doi: 10.1097/DBP.0000000000000909

PubMed Abstract | CrossRef Full Text | Google Scholar

74. Fulcher-Rood K, Castilla-Earls A, Higginbotham J. What does evidence-based practice mean to you? A follow-up study examining school-based speech-language pathologists’ perspectives on evidence-based practice. Am J Speech Lang Pathol. (2020) 29(2):688–704. doi: 10.1044/2019_AJSLP19-00171

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Komesidou R, Feller MJ, Wolter JA, Ricketts J, Rasner MG, Putman CA, et al. Educators’ perceptions of barriers and facilitators to the implementation of screeners for developmental language disorder and dyslexia. J Res Read. (2022) 45(3):277–98. doi: 10.1111/1467-9817.12381

PubMed Abstract | CrossRef Full Text | Google Scholar

76. Palinkas LA, De Leon J, Salinas E, Chu S, Hunter K, Marshall TM, et al. Impact of the COVID-19 pandemic on child and adolescent mental health policy and practice implementation. Int J Environ Res Public Health. (2021) 18(18):9622. doi: 10.3390/ijerph18189622

PubMed Abstract | CrossRef Full Text | Google Scholar