Jessica Nieder
Patricia Nayna Schwerdtle1,2
Sandra Barteit- 1Heidelberg Institute of Global Health (HIGH), Faculty of Medicine and University Hospital, Heidelberg University, Heidelberg, Germany
- 2Nursing and Midwifery, Faculty of Medicine, Nursing and Health Science, Monash University, Clayton, VIC, Australia
Background: Massive Open Online Courses (MOOCs) have the potential to improve access to quality education for health care workers (HCWs) globally. Although studies have reported on the use of MOOCs in low- and middle-income countries (LMICs), our understanding of the scope of their utilization or access barriers and facilitators for this cohort is limited. We conducted a scoping review to map published peer-reviewed literature on MOOCs for HCW education in LMICs. We systematically searched four academic databases (Scopus, Web of Science, PubMed, ERIC) and Google Scholar, and undertook a two-stage screening process. The analysis included studies that reported on MOOCs relevant to HCWs' education accessed by HCWs based in LMICs.
Results: The search identified 1,317 studies with 39 studies included in the analysis, representing 40 MOOCs accessed in over 90 LMICs. We found that MOOCs covered a wide range of HCWs' including nurses, midwives, physicians, dentists, psychologists, and other workers from the broader health care sector, mainly at a post-graduate level. Dominant topics covered by the MOOCs included infectious diseases and epidemic response, treatment and prevention of non-communicable diseases, communication techniques and patient interaction, as well as research practice. Time contribution and internet connection were recognized barriers to MOOC completion, whilst deadlines, email reminders, graphical design of the MOOC, and blended learning modes facilitated uptake and completion. MOOCs were predominantly taught in English (20%), French (12.5%), Spanish (7.5%) and Portuguese (7.5%). Overall, evaluation outcomes were positive and focused on completion rate, learner gain, and student satisfaction.
Conclusion: We conclude that MOOCs can be an adequate tool to support HCWs' education in LMICs and may be particularly suited for supporting knowledge and understanding. Heterogeneous reporting of MOOC characteristics and lack of cohort-specific reporting limits our ability to evaluate MOOCs at a broader scale; we make suggestions on how standardized reporting may offset this problem. Further research should focus on the impact of learning through MOOCs, as well as on the work of HCWs and the apparent lack of courses covering the key causes of diseases in LMICs. This will result in increased understanding of the extent to which MOOCs can be utilized in this context.
Introduction
The ongoing COVID-19 pandemic has underlined the importance of well-trained health care workers (HCWs) in a functioning health care system (1, 2). However, there is a growing global concern regarding the availability of HCWs, as the World Health Organization (WHO) predicts a shortfall of 18 million HCWs by 2030, most of whom will be missing in low-income and middle-income countries (LMICs), especially in rural areas (1, 3). In particular, these countries are faced with a triple burden of disease through the maintained burden of infectious diseases, as well as non-communicable diseases and health impacts through climate change which are likely to negatively affect weak health systems even more (4). Inadequate resources and infrastructure, such as training facilities, educators, and financing for continued professional development (CPD), all contribute to the shortage of HCW in LMICs (5–7). Scaling up and increasing access to quality HCW education is critical to increasing the number of qualified HCWs needed to provide sufficient health care in LMICs.
Over the past two decades, Massive Open Online Courses (MOOCs) have emerged as a mode of electronic learning (e-learning) (8, 9), fostered by steadily increasing internet access (10). MOOCs are courses that can be taken by a theoretically unlimited number of participants (massive), without cost or formal admission (open), that are accessible via the internet (online) whilst following a structured learning plan (course) (11). Due to the capacity of MOOCs to simultaneously reach a large number of learners regardless of geographical location, their open-access nature, and their attraction to students from diverse educational backgrounds, MOOCs may provide a means to increase access to quality education for HCWs (12–14). Since the introduction of the MOOC concept in 2008 (15), interest has increased over the years, reflected in rising course offerings and a continuous high volume of learners (16). MOOCs are now offered by over 950 institutions including many prestigious universities and accessed by over 180 million learners from all parts of the world (16). Overall, MOOCs cover a wide range of topics and in 2020, 7.7% of all available MOOCs covered the field of health and medicine (16).
Several case studies have reported on the successful use of MOOCs for HCWs' education specifically in LMICs. For example, the World Health Organization (WHO) uses the openWHO platform to provide MOOCs that aim to quickly spread knowledge about responses to emerging diseases such as the Plague, Diphtheria, Ebola (17), and COVID-19 (18) to a large number of people. Evaluations on the reach of these courses show high uptake within outbreak countries (17, 18). Similarly, the Latin American Nephrology community has developed a MOOC on kidney immunopathology, targeting all HCWs involved in kidney transplantation in Latin America and concluded that MOOCs are a potential tool for health workers' professional development and reduce heterogeneity in their access to training resources (19). Following a review on the global use of MOOCs for nurses and other health care workers, Longhini et al. (20) concluded that massive open online education may be suitable when face-to-face education is not possible or to reach a broad audience in a short period of time, supporting the notion that MOOCs may be used in HCWs' education to support existing structures by making education more readily available (21). In contrast, Rowe et al. (22) concluded that there is insufficient evidence to advocate their usage for educating medical students. In addition to these findings, we found limitations in the current literature on differences in MOOC use across high- and low- and middle-income countries, as no reviews have differentiated between the use of MOOCs in high and low-and middle income countries. Facilitators and barriers of MOOCs and their capacity to address the educational needs of HCWs in LMIC settings remain unclear. Therefore, to map the state of evidence regarding how MOOCs are used for HCWs' education in these countries and to address the question of the extent to which MOOCs can support the education of HCWs there, we limited the scope of this review to MOOCs accessed by HCWs in LMICs to understand:
• What are the characteristics of MOOCs for health care workers in low- and middle-income countries?
• In which low- and middle-income countries were MOOCs for health care workers accessed by learners?
• What are the content topics covered by MOOCs?
• What are facilitators and barriers to educating health care workers with MOOCs in low- and middle-income countries?
• How MOOCs are evaluated?
Methods
Due to the broad scope of the research questions and the aim to include all types of studies, a scoping literature review seemed most adequate (23). This scoping review was underpinned by the methodological framework developed by Arksey and O'Malley (19) and advanced by Levac et al. (24). Accordingly, the review underwent five stages, iteratively: (1) Identify the research question, (2) Identify relevant studies, (3) Select relevant studies, (4) Chart the data, (5) Collect, summarize, and report results (19). The review is reported in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis – Scoping Review (PRISMA-ScR) (25) framework.
Search Strategy
We systematically searched four academic databases, namely Web of Science, Scopus, PubMed, and Eric. Web of Science and Scopus were chosen for their broad coverage, whilst PubMed and Eric were chosen for their subject-specific focus on health, medicine, and education, respectively. To identify gray literature and any articles not included in the academic databases, we also searched Google Scholar and screened the first 1,000 search results (26).
We developed the search strategy, with the assistance of a university-based librarian, from the two core concepts; “MOOCs” and “health professional education” without specifying level of income or country to ensure the search was as inclusive as possible. We identified synonyms and Medical Subject heading (MeSH) terms and further keywords based on test searches and adapted the final search string to fit the syntax requirements of each database (see Table 1 for the search string conducted in Scopus as an example and Supplementary Appendix 1 for detailed search strings and search queries for the respective databases).
Table 1. Search string for Scopus.
Study Selection and Eligibility
Relevant studies were selected using a two-step procedure: (1) title and abstract screening, (2) full-text screening, using Covidence software (27). To reduce bias, articles were screened individually by two reviewers (JN, PNS), full-text screening was conducted only by the first author, as is common practice for scoping reviews (28). Any conflicts were resolved by a third reviewer (SB). If additional information was required for the study selection, we contacted the first author via email.
Inclusion and Exclusion Criteria
The screening process was guided by inclusion and exclusion criteria which we developed using the adapted population-exposure-outcome (PEO) framework (see Table 2). Studies were included if they reported on a MOOC relevant to HCWs' education. Participants included HCWs (but may have included other participants, i.e., if the MOOC was relevant to other groups), and at least one participant was from an LMIC as defined by the World Bank (29, 30). For the purpose of this review, we define HCWs to include all those whose primary professional aim is to maintain or improve the health of others (31, 32). We interpreted this to include those who provide direct care for patients including nurses, midwives, physiotherapists, psychologists, and physicians. As community health workers play an important role in providing health care in LMICs (33), we did not exclude these even though they may lack formal education. Family carers, social workers, life science professionals, and administrative staff were excluded. As we aim to look at HCWs' education we extended the definition to include those in specialty training. Education for HCWs refers to any education relevant to HCWs, pursued at any level of their career including undergraduate, postgraduate, and CPD. Relevance for HCWs was determined either when the target audience was defined in the article and aligned with our inclusion criteria or if it covered content (knowledge, attitudes, or skills) deemed by the authors as relevant to HCWs' education. We included topics such as patient communication, skill improvement, and disease perception, as well as research for implementation of clinical trials or updating professional skills and excluded courses on management, healthful behavior and lifestyle, mental health management for HCWs, and research not directly applicable to patient care. Finally, LMICs included all countries defined as low-income- (LICs), lower-middle-income-(LMI), or upper-middle-income countries by the World Bank in January 2021 (29, 30, 34). As the term “MOOC” was coined in 2008 (15), and the full search was conducted on 9th December 2020, studies published before 1st January 2008 and after 9th December 2020 were excluded. We did not include pre-prints (i.e., articles that had been accepted for publication but were not yet published). Our search results included two thesis documents. As we only considered original data, secondary and synthesis research were excluded. No studies were excluded based on their study design and only full-text articles were included (see Table 2).
Table 2. Inclusion and exclusion criteria based on the population-exposure-outcome framework.
Charting the Data
Extraction codes were created mostly a priori and in accordance with the study objectives; however, some changes were made during the extraction process to accommodate additional important findings. We extracted the author, title, and year of publication as well as characteristics of MOOCs, including the country the MOOC was developed in, course length, hosting platform, teaching language, topic, and targeted audience; the number of participants from LMICs; and any evaluative factors, facilitators, and barriers (see Table 3 for a full list of extraction criteria and their description and Supplementary Appendix 2 for summary extraction sheet).
Table 3. Full list of extraction criteria and their description.
Results
The systematic search of the databases returned 1,813 articles. Following title and abstract screening and removal of duplicates, 332 studies were included in the full-text review; 39 met the inclusion criteria and were included in the scoping review analysis. The main reasons for exclusion were learner location not reported or not clearly stated, MOOC not targeted at HCWs, and publications that did not include original data (Figure 1). The 39 included studies reported on 40 different MOOCs, a summary of the extracted data is available in Supplementary Appendix 2.
Figure 1. PRISMA flow diagram.
Characteristics of Included MOOCs
Most MOOCs were developed by institutions from either higher income (n = 14, 35%) or upper middle income countries (n = 9, 22.5%). Four MOOCs (10%) were developed by the WHO, and seven (15.5%) were multi-country efforts with participation from HICs (for details see Table 4).
Table 4. MOOC characteristics of included studies.
The teaching language was reported for 20 MOOCs (20%) and was most often (n = 10, 25%) English followed by French (n = 6, 15%), Spanish (n = 3, 7.5%) and Portuguese (n = 3, 7.5%). Three MOOCs (7.5%) used subtitles in languages other than English and one (2.5%) had English subtitles.
EdX and Coursera were the most frequent MOOC platforms, hosting six (15%) and five (12.5%) of the included MOOCs respectively. This was followed by openWHO with four (10%), FutureLearn with three (7.5%), and iversity, Fun MOOC, and icourse163 with one (2.5%) MOOC each. Six MOOCs (15%) were hosted on other online platforms. For the remaining 14 MOOCs (35%), the specific online platform was not reported.
Five (12.5%) MOOCs were embedded in blended learning approaches, providing MOOC participants with the option of attending face-to-face sessions. Two (5%) were specifically developed to be part of a university degree, while another MOOC (2.5%) was suggested within a university degree but was not developed specifically for this context.
By definition, all MOOCs should be open access, however, only 26 (65%) studies specifically reported being free of cost for participants and two (5%) reported access barriers in the form of registration fees (36) and access by invitation only (40). Though the majority of courses were free to audit, completion certificates often required a fee. To receive a certificate, learners typically had to pass a number of assignments. Four MOOCs (10%) offered CPD credits and 18 (45%) offered some kind of completion certificate.
Overall, the time investment for learners varied greatly, whilst one MOOC comprised a single module that could be completed in 1 h (17), others included up to 13 modules to be taken over 16 weeks (61). Direct comparisons of time investment could not be made due to differences in reported details.
LMICs in Which MOOCs for HCWs' Education Are Accessed
Documentation of learners' location varied. Eleven articles (28.2%) reported the location of all learners and 17 (43.58%) reported the number of learners from the top participating countries only. Included MOOCs were accessed in 98 LMICs (see Figure 2), of these 21 were LICs, 32 lower-middle-income countries, and 36 upper-middle income countries. The countries with the highest representation of learners were Mexico (n = 57,248 learners across all included MOOCs), Brazil (n = 16,743 learners across all included MOOCs), and India (n = 11,294 learners across all included MOOCs). Although most of the MOOCs accessed by learners from LMICs are developed in HICs (see Table 3), there are more learners from LMICs attending MOOCs developed by a multinational team or even upper-middle income countries than HICs (Figure 3).
Figure 2. Map of LMICs Learners' location. Includes data from 28 included articles.
Figure 3. Number of learners in MOOCs from different income groups.
HCWs Targeted by MOOCs
The majority of MOOCs (n = 22, 56%) were aimed at postgraduates and although no pre-requisite knowledge on the topic was required, some knowledge or experience in the broader field was assumed. For example, the MOOC on physiotherapy for spinal cord management did not assume any knowledge of spinal cord treatment but targeted learners with physiotherapy experience (39, 70, 71). In addition to the MOOCs for postgraduates, nine (22%) were directed toward HCWs in training, and nine (22%) were aimed at the general public whilst relevant to HCWs. Overall, MOOCs targeted a wide range of HCWs including nurses, midwives, dentists, psychologists, and physicians to all those working in the broader health care sector. Five (7.5%) MOOCs were HCW unspecific, targeting those interested or involved in the topic (36, 37, 49, 64). For example, a MOOC on breast cancer detection targeted health promoters, nurses, general physicians, and medical students (64), and a MOOC on antimicrobial resistance targeted physicians of different specialties, nurses, and biomedical and clinical scientists (36). Fricton et al. (49) found it difficult to strike a balance acceptable for such a diverse audience and Medina-Presentado et al. (36) reported that the nurses in their course felt that the assessments did not benefit them as they focused on medication prescription, which they were not accredited for.
Health-Related Topics Covered by MOOCs
Twenty-one MOOCs (52.5%) focused on specific diseases or injuries and their treatment. Of these, 11 (27.5%) focused on infectious diseases and were predominantly developed as part of an epidemic response (18, 38, 50, 65), eight (20%) focused on the treatment and prevention of non-communicable diseases, including diabetes (68), chronic pain (49), undernutrition (51), dentistry (58), and dementia (46, 72), and two (5%) on the treatment of injuries (39, 57). Communication techniques and patient interaction was the focus of five MOOCs (12.5%) (43, 55, 59, 60, 66), four (10%) focused on research practice, three (7.5%) on responding to emergencies (37, 61, 62), and two (5%) on evaluating and managing quality care (40, 52). Seven MOOCs (17.5%) could not be categorized, as these covered the topics of global health (67) and global health experiences (41), climate change and health (42), teacher training (47), neurobiology (63), and health informatics (56) (see Table 5 for an overview).
Table 5. Facilitators and barriers of learning by MOOC.
We analyzed the MOOC learning objectives according to their level of complexity and specificity by extracting the action verbs using Bloom's taxonomy as a framework (73). To do this we extracted the action verb and assigned it to a level within the framework using the “Pragmatic Master List of Action Verbs for Bloom's Taxonomy” (74) as guidance.
This analysis was limited by the fact that only 11 (27.5%) articles reported the learning objectives. Within these, 10 (25%) MOOCs included objectives associated with knowledge transfer, that is remembering (37, 39, 40, 45, 49, 52, 64, 70) (level 1) and understanding (18, 45, 54, 56, 64) (level 2) concepts, ideas, and treatments. Five MOOCs (12.5%) included applying (44, 64) (level 3), analyzing (44, 52, 56) (level 4), evaluating, justifying (40, 44, 54) (level 5), or creating (40, 44, 70) (level 6) treatment plans or research (see Figure 4 for an overview).
Figure 4. Level of learning across 10 MOOCs according to Blooms' taxonomy.
Facilitators and Barriers Described by MOOC Learners in LMICs
Facilitators and barriers to using MOOCs were reported in 11 studies (27.5%) and were identified through online post-course surveys, discussion groups, and completion rates, course uptake, and reported satisfaction. Of these 11 studies, nine (22.5%) specified those for learners from LMICs, and are the ones reported here. We used the categories developed by Henderikx et al. (75, 76) to structure facilitators and barriers into six groups: social interaction, academic skills, content-related issues, technical factors, situational issues, and individual motivation (see Table 6).
Table 6. Overview of the health-related content areas covered by the included MOOCs.
Social interaction with other learners was identified both as a barrier and a facilitator. Some learners indicated that they enjoy, profit from, and seek (70, 71) interaction with other learners, others perceived it to be a burden and reported it as their least favorite part of the course (36, 70). In addition, interaction with facilitators (40, 44) and the availability of a local facilitator (52) assisted course completion. Likewise, blended learning options that combined online phases with face-to-face sessions, in which participants living in the same region had the opportunity to meet regularly to discuss the content, were identified as factors that promoted retention and course completion (52, 61, 64, 67). Warugaba et al. (67) found that the number of in-person sessions attended was correlated with successful MOOC completion and Jia et al. (61) found that blended learners learned more when compared to “social learners.”
Academic skills in terms of difficulty were not mentioned by HCWs, but language was reported as a barrier by Scott et al. (52) as the MOOC was not available in the local languages French or Kinyarwanda (mainly spoken in Rwanda). Similarly, some studies assumed the availability of different languages facilitated course uptake (36, 38) based on increased uptake after the addition of different languages (18).
Course update was especially rapid in MOOCs established as part of an epidemic response, such as the MOOC developed in response to the Ebola outbreak in Africa as reported by Evans et al. (50) and the MOOC on Cholera contamination (65). In both cases, the MOOCs were perceived to be very “useful” (50) and “educational” (65) in the affected regions. Similarly, integration into ongoing local initiatives was reported to facilitate uptake (52).
Technical problems in terms of internet problems including fluctuating internet connection were frequently mentioned (38, 40, 52, 67). Providing access to course media such as video content in lower resolution and downloading course materials for offline usage in places with a better connection were reported as viable solutions to this problem (52, 67). Digital skills were reported as an issue for older learners who lacked digital literacy by Magaña-Valladares et al. (65). This study also reported that the issue could be overcome by face-to-face peer support. On the other hand, a functional and easy to handle instructional design that facilitated learning (65) was reported as a facilitator to learning.
The endorsement of the course by employers and the local government through involvement and promotion was reported as a facilitator (52, 64, 65), as was the promotion of courses through trusted sources such as UNICEF (51) or professional networks (36, 39, 51). Furthermore, the learners' individual situation was mentioned as a barrier in terms of time availability caused by short deadlines (40) or conflicts of priorities between work, family responsibilities, and learning (36, 40, 52). In contrast to this, regular deadlines and email reminders (39, 51, 52) were reported to facilitate timely completion of the course. Finally, a single study reported that the voluntary nature of the course was a barrier to learners (52).
MOOC Evaluation Criteria
We identified a total of six criteria that were used to describe success in the included studies: completion rate, reach, learner evaluation, attitude, knowledge, and action (Table 7 for an overview).
Table 7. Six criteria used to define success of MOOCs identified in included studies*.
Success of the MOOC in terms of reaching a broad audience and remote learners was not predefined but reported for five (7.5%) MOOCs, all of which concluded success based on reaching a diverse audience including learners from remote locations.
Completion rate was reported for 28 MOOCs (70%) and ranged greatly from 1 (42) to 100% (71) (Mean = 32.62, SD = 28.04). However, definitions of completion varied: one reported the number of active learners (68), some reported the number receiving a certificate or completing the final module (52), and others used Google Analytics (39, 70) as a point of reference. Completion rate was considered successful in some cases when retention was higher than the 10% typically reported in the literature (50) and was usually highest in those courses that were embedded or promoted in a formal structure such as a university course or blended learning (52, 61, 64) and lowest when there were few promotional efforts (42). However, there were exceptions to this rule for example the MOOC on understanding dementia had a completion rate of 42% without reporting promotional efforts (72).
Acceptance and learner evaluations were reported in 22 studies (56.41%). In post-course evaluations, mostly questionnaires, learners provided feedback (n = 7, 17.9%), rated the MOOC (n = 3, 7.79%), or answered statements about the MOOC on a Likert scale (n = 14, 36%). In some studies, learners suggested changes, but overall, feedback was predominantly positive (50, 53, 57), with learners reporting high levels of satisfaction and usefulness, as well as achievement of personal learning goals. Chan et al. (37) collected feedback from dropouts and found time management issues rather than disliking the course to be the predominant reason.
An assessment of knowledge in the form of regular quizzes or final assessments was included in 30 MOOCs (75%). The results of these assessments were reported in 15 studies (38.5%), whereby nine (23%) included pre- and post-knowledge assessments that showed an increase in knowledge for all studies (36, 38–41, 52, 59, 71). Six studies (15.4%) included post-MOOC assessments (53, 57, 60, 64, 67, 68) and four studies (9.75%) compared MOOC learning to other teaching modalities such as self-regulated online learning (71), face-to-face learning (62) supported by MOOCs (63) or MOOCs embedded in a blended format (61).
One study looked at attitude and found that learners' attitude toward dementia, the topic of the MOOC, did not significantly change after the course (46).
The impact of MOOCs on HCWs' behavior and patient care was investigated by nine studies using quantitative measures (23%). Of these, seven (18%) reported on impact and behavior change collected in post-course surveys. For example, learners participating in a MOOC on diabetes reported having learned something they felt they could implement at work (68). Fricton et al. (49) observed that 85% (n = 300) of HCWs taking the MOOC on managing chronic pain intended to modify their patient care. A follow-up investigation of self-reported behavior change was reported by two studies (5%) (36, 48). Both found that less than half of those study participants responding had acted on commitments to change (36, 48).
Discussion
We found 40 MOOCs relevant to HCWs education that were accessed by learners in over 90 LMICs. and although overall feedback of study participants was positive, some regions and countries such as Central Africa were not represented, and key causes of diseases were not addressed. Most importantly we found that we were often unable to distinguish between outcomes by cohort due to inconsistent reporting of MOOC characteristics which restricted summarizing of results and conclusions.
MOOCs covered a wide range of health-related content over several health disciplines, with the diagnosis and treatment of diseases, particularly infectious diseases, being the most prevalent and their use in disseminating information to HCWs as part of an epidemic or pandemic response being notable. Communication and patient interaction learning aims were incorporated in a few MOOCs, which has been found to be lacking in medical education in some African countries (77). However, we removed articles on other topics such as palliative care (78). Other reviews on MOOCs for HCWs education have retrieved more studies (13, 20) indicating that many courses are not accessed by learners from LMICs. Furthermore, other relevant topics such as cardiovascular disease, maternal and neonatal diseases, or HIV (79) were not yet covered by included MOOCs, suggesting a possible discrepancy that should be explored. In the case of HIV, significant learning needs for HCWs have been reported (80) and it would be of interest why MOOCs are not used to fill this learning gap. Such research may also expand understanding on the limitations on the use of MOOCs for HCWs in LMICs. In addition to covering a broad range of topics, included MOOCs also targeted a broad range of HCWs, and in many cases were not focused on HCWs specifically. This could imply that MOOCs enable interprofessional education and potentially encourage interprofessional cooperation and communication, which could lead to improved patient care (81).
The learning objectives of included MOOCs centered mostly on remembering and understanding, referring to low levels of Bloom's taxonomy (73). This seems to indicate that MOOCs appear to be better suited to encourage knowledge transfer and comprehension (72). Furthermore, it may be that some MOOCs “provide more sound pedagogy that develops higher order thinking, whereas others do not” (82). Bali (82) also argues that the benefit of MOOCs may lie in the engagement between learners made possible through the course. This notion is supported by our finding that some learners reported the exchange with other learners to be particularly helpful (70, 71). Two studies implemented a “flexible pathway” of their MOOC within a blended learning environment, in which the MOOCs taught on theoretical aspects and in-person workshops were used to practice application of the learned material (64) or discuss possibilities for local implementation (52). Blended learning as a teaching and learning format is showing promising results in medical education regarding learner satisfaction and learning gain (83). Another engaging, interactive method are “virtual patients,” which train clinical decision-making skills on simulated patient cases (54, 55). More research is needed to better understand how MOOCs might be used to support skills training for HCWs in LMICs, possibly in combination with other digital learning tools such as virtual reality scenarios using head-mounted devices (84).
We found that the literature does not distinguish facilitators and barriers by learner cohort but rather reports on generic barriers reported by all included learners. Nonetheless, because the majority of included studies reporting on facilitators and barriers were targeted at specific regions and only included learners from LMICs, we can be sure that those identified are experienced by learners from LMICs. However, this means that the identified barriers are likely biased toward MOOC implementations that have taken particular precautions to facilitate uptake in LMICs. Future research should therefore focus on regional barriers experienced by MOOCs with a global audience. Despite these limitations, we found that the facilitators and barriers we identified for learners in LMICs can be compared to those reported elsewhere. Time and internet connection were the main barriers to learning with a MOOC (75, 85). Time constraints related to competing obligations around work, family life, and learning were concerns for some learners (36, 40, 52). Deadlines for assignments (43, 51) and teaching and learning modes such as blended learning approaches (52, 67) were mentioned as effective strategies for overcoming these challenges. Goal setting and contextual structuring, such as deadlines and timeframes, are likely to assist online self-regulated learning (OSRL). This is in line with previous research that has found that OSRL through goal setting is a frequently used strategy in MOOC learning and that students with high OSRL report higher satisfaction (86, 87). Limited internet connection is one of the most widely cited issues related to MOOCs and e-learning (20, 75), and are particularly relevant in the context of LMICs. Internet access continues to be a central issue, particularly in African countries where access is often still comparably expensive (10) and may be a reason for the lack of utilization in central sub-Saharan African countries. Therefore, it is essential to assure that HCWs in LMICs have access to online training materials, either by providing alternative internet access options or by providing course content offline as well, so learners can synchronize content once and then learn offline. The importance of developing an interface that is intuitive for users is highlighted by a study finding that digital literacy was a barrier whilst functional and easy to handle instructional design was identified as a facilitator (65). No barriers in terms of the content being irrelevant or too difficult were mentioned by HCWs, though nurses in an interprofessional MOOC mentioned that not all assessed content applied to them (36). On the other hand, local relevance and integration into a pan- or epidemic response were reported as factors that promote MOOC uptake. This is unsurprising and in line with the Technology Acceptance Model (88), which postulates that technology must have local relevance to be adopted. Relatedly, government and employer endorsement were concluded to be facilitators which is in line with previous research identifying lack of perceived employer support as a barrier to uptake (76). In addition, local promotion may increase awareness for MOOCs amongst potential learners leading to increased uptake, as awareness is a significant factor and has been identified as a key reason for not learning by MOOC (85).
Finally, although the language people learn in greatly impacts learning ease (89), language was not discussed much within the included articles. Further research on the extent to which language is a factor in learning through MOOCs may be useful (90) to support the choices in language options made by MOOC developers.
E-learning has been introduced in many African countries to improve HCW education (91). The fact that MOOCs are currently readily available, typically free, and often appropriate for use in diverse countries makes them a strong contender for inclusion in HCW strengthening strategies. However, the findings of our review suggest that simply the availability of MOOCs is not sufficient, rather to achieve optimal effect, they should be integrated into existing educational structures and endorsed by stakeholders and top management. For example, MOOCs could be formally included in curricula as a partial requirement, this would strengthen MOOCs' credibility in the respective countries as a serious learning and teaching tool (91). Overall, it is of note that only 11 of the included studies reported on facilitators and barriers faced by learners; also these facilitators were not formally assessed or evaluated in the included studies. Instead, they were deduced by respective authors based on experience. Although this generates valuable insights, formal research in this area would be necessary to make these findings more credible. Although barriers are more formally investigated through post course surveys, studies rarely use empirical approaches to assess barriers. A better understanding of factors that support online MOOC learners in LMICs is needed to identify how MOOCs may align with national education and training strategies for HCWs' education.
The evaluations were overwhelmingly positive and though only a few reported on barriers to taking the MOOC, there were no reports of the MOOC failing. This may be due to a response bias of learners with a positive experience being more likely to complete the evaluation (92) or publication bias of interventions evaluated as successful (93). A key finding within the evaluations is that only one study (68) reported on cohort specific evaluations indicating that learners from developing countries experienced a higher benefit from the MOOC compared to learners from developed countries. Thus the available data does not allow us to conclude whether learners in LMICs achieve similar positive outcomes as the average learners. As learners from HICs often make out the greater share, it is possible that greater usefulness or even unsuccessful participation for a sub-cohort was missed. Furthermore, included evaluations, focused mainly on short term impacts, such as learner satisfaction and knowledge gain. However, as theoretical knowledge and understanding of a procedure are not always sufficient to ensure changes in clinical practice and patient care (90, 91), these evaluations do not allow for deductions of MOOCs effectiveness in improving the quality of care. Nor do they show whether gained understanding can be retained over time.
We identified two key factors in the available literature that limited the extent to which conclusions can be drawn and summarized for our target cohort learners in LMICs. Firstly, only few articles described outcomes such as facilitators and barriers or evaluation criteria by cohort. This is likely a result of the inclusive nature of MOOCs, however, by only reporting on overall findings, conclusions for specific cohorts cannot be drawn making it difficult to suggest this teaching method to specific cohorts. Secondly, we found large heterogeneity in what MOOC characteristics the included articles reported on which impacts the extent to which conclusions can be drawn and generalized. For example, learning objectives were only reported for 25% of the MOOCs; the geographical location of learners was reported by 28% of included studies, and the delivery language was reported for 45% of MOOCs. The development and use of reporting guidelines for MOOC-based research, or research on e-learning in general, could foster progress in this field. Based on this review, the reporting guidelines for mobile health interventions (94) and the guidelines for reporting evidence-based practice education and teaching (95), we suggest that evaluations should include basic characteristics of the MOOC such as the institution or company who developed the MOOC, the teaching language including subtitles, the target audience, and learning objectives (also in respect to Bloom's taxonomy), as well as basic demographic characteristics of all learners to enable synthesis research to summaries which populations may benefit most from which characteristics. Finally, reports should include details on their evaluation (method, duration, objective, sample size, outcomes) and success criteria (rationale, evaluation methods of measuring success) where appropriate.
Limitations
Although the search strategy was comprehensive, it is always possible that relevant studies were missed. For example, any barriers that are relevant for learners from LMICs generally but were identified in MOOCs not relevant to HCWs will have been missed as will those identified in studies addressing barriers to MOOCs without studying a MOOC. We aimed to overcome this barrier by comparing the barriers we identified to those found in the broader scientific literature. Moreover, due to our own capabilities, we were only able to include studies published in English, although this is the lingua franca in research (96), some articles written in local languages may have been excluded. Additionally, we did not search country-specific databases; therefore, it is possible that organizations that have published reports of interventions used at a local level, were missed. It must be kept in mind that in line with the methodological framework of a scoping review, no quality checks were conducted which may have impacted the quality of our reported findings. However, in using this methodology we were able to capture a broad range of studies including those that might otherwise have been missed (23).
Furthermore, we were only able to analyze data from MOOCs where evaluations have been published; thus, MOOCs and learner experiences that have not been published are not reflected in this review. The reporting of basic characteristics between studies is very heterogenous, oftentimes conclusions of included studies were based on a small number of studies. Many evaluations only reported on the location of learners from the most represented countries causing many countries with fewer participating learners not to be mentioned and their experience to be lost. Finally, we were not always able to distinguish between the feedback given by learners from LMICs to those from HICs which may have skewed the data.
Conclusion
We found that MOOCs relevant to HCWs education are accessed by learners from over 90 LMICs and that these are evaluated positively in terms of learner satisfaction and learning gain for all learners in these courses. Insufficient internet connectivity and time constraints were the most commonly reported barriers, whilst support from the government and employer as well as promotion through academic sources were identified as facilitators. Included MOOCs covered a range of topics, with management and treatment of infectious diseases being the most common. However, we also identified two key limitations within the literature. Firstly, the large amount of heterogeneity between the characteristics that are reported on limits our analysis. Secondly, as only few studies reported on cohort specific findings, we were limited in the extent to which we could draw cohort specific conclusions. Therefore, we suggest the development and application of reporting guidelines for future studies.
Finally, we identified gaps in the literature including a lack of research on the actual impact of MOOCs on HCWs' practice and the subsequent benefits for patients and a mismatch between the topics covered by MOOCs and the largest burden of diseases present in LMICs.
Our findings suggest that MOOCs constitute a supplementary tool to strengthen the quality and coverage of HCW education in LMICs. While current MOOCs primarily focus on lower levels of learning (remembering and understanding) future MOOCs could strive to build on this with higher levels of learning (apply, analyze, evaluate, create).
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Author Contributions
The objective and research question were developed by JN, PN, and SB. The first round of data screening was conducted by JN and PN. The second round was conducted by JN. Data extraction, analysis, and interpretation were conducted predominantly by JN with support from PN and SB. JN wrote the manuscript draft. SB, PN, and RS all contributed to further manuscript revision. The final version of the manuscript was approved by all authors.
Funding
This study was part of a research unit funded by the German Research Foundation (DFG). The DFG supported this research but was not involved in study design, collection, management, analysis or interpretation of data, neither in the writing of this report or in any decision to submit this report for publication.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We wish to thank the German Research Foundation (Deutsche Forschungsgemeinschaft) for supporting this study as part of a Deutsche Forschungsgemeinschaft–funded research unit (Forschungsgruppe). For the publication fee we acknowledge financial support by Deutsche Forschungsgemeinschaft within the funding programme Open Access Publikationskosten as well as by Heidelberg University.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpubh.2022.891987/full#supplementary-material
Abbreviations
CPD, continued professional development; DALYs, disability adjusted life years; e-learning, electronic learning; HCW, Health Care Worker; HICs, High Income County; LMICs, low- and middle-income country; MOOCs, Massive Open Online Courses.
References
1. WHO. Global strategy on human resources for health: Workforce 2030 [Internet]. (2016). Available online at: https://apps.who.int/iris/bitstream/handle/10665/250368/9789241511131-eng.pdf?sequence=1 (accessed November 10, 2020).
2. Moreno-Serra R, Smith PC. Does progress towards universal health coverage improve population health? Lancet. (2012) 380:917–23. doi: 10.1016/S0140-6736(12)61039-3
3. Soucat A, Scheffler R. The Labor Market for Health Workers in Africa: A New Look at the Crisis. Herndon, VA: World Bank Publications (2013), p. 384. doi: 10.1596/978-0-8213-9555-4
4. Salas RN, Jha AK. Climate change threatens the achievement of effective universal healthcare. BMJ. (2019) 366:l5302. doi: 10.1136/bmj.l5302
5. Mack HG, Golnik KC, Murray N, Filipe HP. Models for implementing continuing professional development programs in low-resource countries. MedEdPublish. (2017) 6:18. doi: 10.15694/mep.2017.000018
6. Frenk J, Chen L, Bhutta ZA, Cohen J, Crisp N, Evans T, et al. Health professionals for a new century: transforming education to strengthen health systems in an interdependent world. Lancet. (2010) 376:1923–58. doi: 10.1016/S0140-6736(10)61854-5
7. Mills A. Health care systems in low- and middle-income countries. N Engl J Med. (2014) 370:552–7. doi: 10.1056/NEJMra1110897
8. Zhu M, Sari AR, Lee MM. A comprehensive systematic review of MOOC research: research techniques, topics, and trends from 2009 to 2019. Educ Technol Res Dev. (2020) 68:1685–710. doi: 10.1007/s11423-020-09798-x
9. Liu C, Zou D, Chen X, Xie H, Chan WH. A bibliometric review on latent topics and trends of the empirical MOOC literature (2008–2019). Asia Pac Educ Rev. (2021) 22:515–34. doi: 10.1007/s12564-021-09692-y
10. Individuals using the Internet (% of population) - Sub-Saharan Africa | Data [Internet]. Available online at: https://data.worldbank.org/indicator/IT.NET.USER.ZS?locations=ZG (accessed January 17, 2022).
11. Blackmon S, Major C. Wherefore art thou MOOC: defining massive open online courses. Online Learn J. (2017) 21:195–221. doi: 10.24059/olj.v21i4.1272
12. Bendezu-Quispe G, Quijano-Escate R, Hernández-Vásquez A, Inga-Berrospi F, Condor DF. Massive open online courses for continuing education for nursing professionals in Peru. Rev Lat Am Enfermagem. (2020) 28:1–7. doi: 10.1590/1518-8345.3803.3297
13. Liyanagunawardena TR, Williams SA. Massive open online courses on health and medicine: review. J Med Internet Res. (2014) 16:e191. doi: 10.2196/jmir.3439
14. Goldberg LR, Bell E, King C, O'Mara C, McInerney F, Robinson A, et al. Relationship between participants' level of education and engagement in their completion of the Understanding Dementia Massive Open Online Course. BMC Med Educ. (2015) 15:60. doi: 10.1186/s12909-015-0344-z
15. Downes S. Places to go: connectivism & connective knowledge. Innov J Online Educ. (2008) 5:6. Available online at: https://nsuworks.nova.edu/cgi/viewcontent.cgi?article=1037&context=innovate/ (accessed July 7, 2021).
16. Shah D. By The Numbers: MOOCs in 2020 — Class Central [Internet]. (2020). Available online at: https://www.classcentral.com/report/mooc-stats-2020/ (accessed June 12, 2021).
17. Rohloff T, Utunen H, Renz J, Zhao Y, Gamhewage G, Meinel C. OpenWHO: Integrating online knowledge transfer into health emergency response. In: Dimitrova V, Praharaj S, Fominykh M, Drachsler H, editors. EC-TEL Practitioner Proceedings 2018: 13th European Conference on Technology Enhanced Learning. Leeds: CEUR-WS (2018). p. 1–14.
18. Utunen H, Ndiaye N, Piroux C, George R, Attias M, Gamhewage G. Global reach of an online covid-19 course in multiple languages on openwho in the first quarter of 2020: Analysis of platform use data. J Med Internet Res. (2020) 22. doi: 10.2196/preprints.19076
19. Arksey H, O'Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol Theory Pract. (2005) 8:19–32. doi: 10.1080/1364557032000119616
20. Longhini J, Rossettini G, Palese A. Massive open online courses for nurses' and healthcare professionals' continuous education: a scoping review. Int Nurs Rev. (2021) 68:108–21. doi: 10.1111/inr.12649
21. Reich, J, Ruipérez-Valiente JA. The MOOC pivot. Available online at: https://www.science.org/doi/full/10.1126/science.aav7958?casa_token=_YlQcZzxzmUAAAAA:6lUssooxcCBVnNyEld-Zd6XoSgkhqyVRhU2FafyT26ZTk9Bi7UHis8mUfvM-Xy-KBDxVXsswv33sQh8 (accessed March 29, 2022).
22. Rowe M, Osadnik CR, Pritchard S, Maloney S. These may not be the courses you are seeking: a systematic review of open online courses in health professions education. BMC Med Educ. (2019) 19:356. doi: 10.1186/s12909-019-1774-9
23. Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. (2018) 18:143. doi: 10.1186/s12874-018-0611-x
24. Levac D, Colquhoun H, O'Brien KK. Scoping studies: advancing the methodology. Implement Sci. (2010) 5:1–9. doi: 10.1186/1748-5908-5-69
25. Tricco AC, Lillie E, Zarin W. O KK, Colquhoun H, Levac D, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. (2018) 169:467–73. doi: 10.7326/M18-0850
26. Haddaway NR, Collins AM, Coughlin D, Kirk S. The role of google scholar in evidence reviews and its applicability to grey literature searching. PLOS ONE. (2015) 10:e0138237. doi: 10.1371/journal.pone.0138237
27. Covidence, [Internet],. Veritas Health Innovation. Available online at: www.covidence.org (accessed December 6, 2020).
28. Pham MT, Rajić A, Greig JD, Sargeant JM, Papadopoulos A, Mcewen SA, et al. Scoping review of scoping reviews: advancing the approach and enhancing the consistency. Res Synth Methods. (2014) 5:371–85. doi: 10.1002/jrsm.1123
29. Low- and middle-income countries [Internet]. Available online at: https://wellcome.org/grant-funding/guidance/low-and-middle-income-countries (accessed January 1, 2022).
30. World Bank. World Bank Country and Lending Groups [Internet]. Available online at: https://data.worldbank.org/indicator/IT.NET.USER.ZS?locations=ZG-GH-ZA (accessed February 14, 2021).
31. International Labour Office,. International Standard Classification of Occupations Structure, group definitions correspondence tables [Internet]. Vol. 1 (2012). Available online at: https://www.ilo.org/public/english/bureau/stat/isco/docs/publication08.pdf (accessed January 14, 2021).
32. WHO. The World Health Report 2006. Working together for health [Internet]. Geneva: WHO (2006). Available online at: https://www.who.int/workforcealliance/knowledge/resources/whreport_2006/en/ (accessed March 28, 2022).
33. WHO. What do we know about community health workers? A systematic review of existing reviews [Internet]. Geneva: WHO (2020). (Human Resources for Health Observer Series). Report No.: 19. Available online at: https://www.who.int/publications-detail-redirect/what-do-we-know-about-community-health-workers-a-systematic-review-of-existing-reviews (accessed March 28, 2022).
34. Low & middle income | Data [Internet]. Available online at: https://data.worldbank.org/country/XO (accessed May 20, 2022).
35. WHO. The World Health Report 2006. Working together for health [Internet]. Geneva: WHO (2006). Available online at: https://www.who.int/workforce
36. Medina-Presentado JC, Margolis A, Teixeira L, Lorier L, Gales AC, Pérez-Sartori G, et al. Online continuing interprofessional education on hospital-acquired infections for Latin America. Braz J Infect Dis. (2017) 21:140–7. doi: 10.1016/j.bjid.2016.11.003
37. Chan MM, Barchino R, Medina-Merodio JA, de la Roca M, Sagastume F. MOOCs, an innovative alternative to teach first aid and emergency treatment: a practical study. Nurse Educ Today. (2019) 79:92–7. doi: 10.1016/j.nedt.2019.05.008
38. Margolis A, Gonzalez-Martinez F, Noboa O, Abbud-Filho M, Lorier L, Nin M. et al. Online Continuing medical education for the Latin American Nephrology Community. Stud Health Technol Inform. (2015) 216:372–5. doi: 10.3233/978-1-61499-564-7-372
39. Harvey LA, Glinsky J. v, Lowe R, Lowe T. A Massive Open Online Course for teaching physiotherapy students and physiotherapists about spinal cord injuries. Spinal Cord. (2014) 52:911–8. doi: 10.1038/sc.2014.174
40. Hooley C, Baumann AA, Mutabazi V, Brown A, Reeds D, Cade WT, et al. The TDR MOOC training in implementation research: evaluation of feasibility and lessons learned in Rwanda. Pilot Feasibility Stud. (2020) 6:66. doi: 10.1186/s40814-020-00607-z
41. Jacquet GA, Umoren RA, Hayward AS, Myers JG, Modi P, Dunlop SJ, et al. The Practitioner's Guide to Global Health: an interactive, online, open-access curriculum preparing medical learners for global health experiences. Med Educ Online. (2018) 23:1503914. doi: 10.1080/10872981.2018.1503914
42. Barteit S, Depoux A, Sié A, Yé M, Sauerborn R. Massive open online courses (MOOCs) on climate change and health: Teaching a global audience. In: Azeiteiro U, Filho WL, Aires L, editors. Climate Literacy and Innovations in Climate Change Education. Climate Change Management. Cham: Springer (2018). doi: 10.1007/978-3-319-70199-8_10
43. Costa T, Arnaoutoglou NA, Gargot T, Sidorova O, Liu-Thwaites N, Moorey S, et al. The first massive open online course of the European Psychiatric Association on cognitive and behavioural therapy. Handicap 2020 Technol Pour L'autonomie L'inclusion 2020 Paris France. St. Joseph: MO: PsychArchives (2020).
44. Dalsgaard A, Chaudhari V, Littlejohn A. Professional learning in open networks: how midwives self-regulate their learning in massive open online courses. Littlejohn A, Jaldemark J, Vrieling-Teunter E, and Nijland F, editors. In: Networked Professional Learning. Berlin: Springer (2019), p. 15–36. doi: 10.1007/978-3-030-18030-0_2
45. Clarke M. The development assessment of an online course to teach healthcare professionals to identify fungal infections using microscopy histology (Masters Thesis). University of Manchester, Manchester, United Kingdom. (2017). Available online at: https://www.research.manchester.ac.uk/portal/files/84028594/FULL_TEXT.PDF (accessed February 3, 2022).
46. Robertshaw D, Kotera Y. Changing attitudes with a MOOC on dementia. Eur J Open Distance E-Learn. (2019) 22:27–39. doi: 10.2478/eurodl-2019-0008
47. Rodrigues V. Clinical Supervision with Confidence: The role of interprofessional and social learning in a FutureLearn Massive Open Online Course (MOOC). Netw Educ Healthc NET 2016. Cambridge. (2016).
48. Sneddon J, Barlow G, Bradley S, Brink A, Chandy SJ, Nathwani D. Development and impact of a massive open online course (MOOC) for antimicrobial stewardship. J Antimicrob Chemother. (2018) 73:1091–7. doi: 10.1093/jac/dkx493
49. Fricton J, Anderson K, Clavel A, Fricton R, Hathaway K, Kang W, et al. Preventing chronic pain: a human systems approach-results from a massive open online course. Glob Adv Health Med. (2015) 4:23–32. doi: 10.7453/gahmj.2015.048
50. Evans DP, Luffy SM, Parisi S, del Rio C. The development of a massive open online course during the 2014–15 Ebola virus disease epidemic. Ann Epidemiol. (2017) 27:611–5. doi: 10.1016/j.annepidem.2017.07.137
51. Stark CM, Pope J. Massive open online courses: how registered dietitians use MOOCS for nutrition education. J Acad Nutr Diet. (2014) 114:1147–51. doi: 10.1016/j.jand.2014.04.001
52. Scott KW, Dushime T, Rusanganwa V, Woskie L, Attebery C, Binagwaho A. Leveraging massive open online courses to expand quality of healthcare education to health practitioners in Rwanda. BMJ Open Qual. (2019) 8:e000532. doi: 10.1136/bmjoq-2018-000532
53. France K, Hangorsky U, Wu CW, Sollecito TP, Stoopler ET. Analysis of the oral cavity: portal to health and disease, a massive open online course in oral medicine. Oral Surg Oral Med Oral Pathol Oral Radiol. (2020) 659–66. doi: 10.1016/j.oooo.2020.08.036
54. Stathakarou N, Scully ML, Kononowicz AA, Henningsohn L, Zary N, McGrath C. MOOC learners' engagement with two variants of virtual patients: a randomised trial. Educ Sci. (2018) 8:44. doi: 10.3390/educsci8020044
55. Berman AH, Biguet G, Stathakarou N, Westin-Hägglöf B, Jeding K, McGrath C, et al. Virtual patients in a behavioral medicine massive open online course (MOOC): a qualitative and quantitative analysis of participants' perceptions. Acad Psychiatry. (2017) 41:631–41. doi: 10.1007/s40596-017-0706-4
56. Koch S, Hagglund M. Mutual learning and exchange of health informatics experiences from around the world–evaluation of a massive open online course in ehealth. Stud Health Technol Inform. (2017) 245:753–7.
57. Fremont P, Schneider K, Laroche A, Emery C, Yeates K. Could a massive open online course be part of the solution to sport-related concussion? Participation and impact among 8368 registrants. BMJ Open Sport Exerc Med. (2020) 6:e000700. doi: 10.1136/bmjsem-2019-000700
58. Garrido D, Huanca CM, Oliveira AE, Morita MC, Haddad AE. Feminisation of dentistry in Brazil from the perspective of a MOOC-type distance course - a short report. J Int Soc Telemed EHealth. (2019) 7:e6. doi: 10.29086/JISfTeH.7.e6
59. Borges FR, Costa LCS, Avelino CCV, Nogueira DA, Kirner C, Goyatá SLT. Educational strategy on home visits based on massive open online courses. Rev Min Enferm. (2017) 21:e-1038. doi: 10.5935/1415-2762.20170048
60. Canavese D, Motta I, Marinho MMA, Rodrigues JB, Benicio LA, Signorelli MC, et al. Health and sexual rights: design, development, and assessment of the massive open online course on Lesbian, gay, bisexual, transgender, and intersex health promotion in Brazil. Telemed E-Health. (2020) 26:1271–7. doi: 10.1089/tmj.2019.0232
61. Jia M, Gong D, Luo J, Zhao J, Zheng J, Li K. Who can benefit more from massive open online courses? A prospective cohort study. Nurse Educ Today. (2019) 76:96–102. doi: 10.1016/j.nedt.2019.02.004
62. Zhou T, Huang S, Cheng J, Xiao Y. The distance teaching practice of combined mode of massive open online course micro-video for interns in emergency department during the COVID-19 epidemic period. Telemed E-Health. (2020) 26:584–8. doi: 10.1089/tmj.2020.0079
63. Li X, Li Z. The application of information technology in neurobiology education. (2017), p. 310–3.
64. Magaña-Valladares L, González-Robledo MC, Rosas-Magallanes C, Mejía-Arias MÁ, Arreola-Ornelas H, Knaul FM. Training primary health professionals in breast cancer prevention: evidence and experience from Mexico. J Cancer Educ. (2018) 33:160–6. doi: 10.1007/s13187-016-1065-7
65. Magaña-Valladares L, Rosas-Magallanes C, Montoya-Rodríguez A, Calvillo-Jacobo G, Alpuche-Arande CM, García-Saisó S. A MOOC as an immediate strategy to train health personnel in the cholera outbreak in Mexico. BMC Med Educ. (2018) 18:1–7. doi: 10.1186/s12909-018-1215-1
66. Fife MA,. The influence of video lectures on student engagement in the university of cape town's first massive open online course (Master's thesis). University of Cape Town, Cape Town, South Africa. (2016). Available online at: https://open.uct.ac.za/bitstream/handle/11427/22800/thesis_hum_2016_fife_mary_ann%20%281%29.pdf?sequence=1&isAllowed=y (accessed February 4, 2021).
67. Warugaba C, Naughton B, Hedt-Gauthier B, Muhirwa E, Amoroso CL. Experience with a massive open online course in rural Rwanda. Int Rev Res Open Distance Learn. (2016) 17:222–31. doi: 10.19173/irrodl.v17i2.2401
68. Albrechtsen NJW, Poulsen KW, Svensson LO, Jensen L, Holst JJ, Torekov SS. Health care professionals from developing countries report educational benefits after an online diabetes course. BMC Med Educ. (2017) 17:1–8. doi: 10.1186/s12909-017-0935-y
69. Milligan C, Littlejohn A. How health professionals regulate their learning in massive open online courses. Internet High Educ. (2016) 31:113–21. doi: 10.1016/j.iheduc.2016.07.005
70. Harvey LA, Glinsky J. v, Muldoon S, Chhabra HS. Massive open online courses for educating physiotherapists about spinal cord injuries: a descriptive study. Spinal Cord Ser Cases. (2017) 3:17005. doi: 10.1038/scsandc.2017.5
71. Hossain MS, Shofiqul Islam M, Glinsky JV, Lowe R, Lowe T, Harvey LA. A massive open online course (MOOC) can be used to teach physiotherapy students about spinal cord injuries: a randomised trial. J Physiother. (2015) 61:21–7. doi: 10.1016/j.jphys.2014.09.008
72. Eccleston C, Doherty K, Bindoff A, Robinson A, Vickers J, McInerney F. Building dementia knowledge globally through the understanding dementia Massive Open Online Course (MOOC). Npj Sci Learn. (2019) 4:1–6. doi: 10.1038/s41539-019-0042-4
73. Krathwohl DR. A revision of bloom's taxonomy: an overview. Theory Pract. (2002) 41:212–8. doi: 10.1207/s15430421tip4104_2
74. Newton PM, Da Silva A, Peters LG. A pragmatic master list of action verbs for bloom's taxonomy. Front Educ. (2020) 5:107. doi: 10.3389/feduc.2020.00107
75. Henderikx M, Kreijns K, Kalz M. A classification of barriers that influence intention achievement in MOOCs. Lect Notes Comput Sci Subser Lect Notes Artif Intell Lect Notes Bioinforma, Vol. 11082. Cham: Springer (2018) LNCS:3–15. doi: 10.1007/978-3-319-98572-5_1
76. Henderikx M, Kreijns K, Xu KM, Kalz M. Making barriers to learning in MOOCs visible. A factor analytical approach. Open Prax. (2021) 13:143–59. doi: 10.5944/openpraxis.13.2.124
77. Odongo CO, Talbert-Slagle K. Training the next generation of Africa's doctors: why medical schools should embrace the team-based learning pedagogy. BMC Med Educ. (2019) 19:403. doi: 10.1186/s12909-019-1845-y
78. Tieman J, Miller-Lewis L, Rawlings D, Parker D, Sanderson C. The contribution of a MOOC to community discussions around death and dying. BMC Palliat Care. (2018) 17:31. doi: 10.1186/s12904-018-0287-3
79. GBD Compare | IHME Viz Hub. Available online at: http://vizhub.healthdata.org/gbd-compare (accessed January 17, 2022).
80. Alshouibi EN, AlAlyani WS. Human immunodeficiency virus related discrimination in general dentistry. Saudi Med J. (2018) 39:1148–53. doi: 10.15537/smj.2018.11.23394
81. Reeves S, Perrier L, Goldman J, Freeth D, Zwarenstein M. Interprofessional education: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. (2013) CD002213. doi: 10.1002/14651858.CD002213.pub3
82. Bali, M MOOC pedagogy: gleaning good practice from existing MOOCs. J Online Learn Teach. (2014) 10:44–55.
83. Makhdoom N, Khoshhal KI, Algaidi S, Heissam K, Zolaly MA. ‘Blended learning' as an effective teaching and learning strategy in clinical medicine: a comparative cross-sectional university-based study. J Taibah Univ Med Sci. (2013) 8:12–7. doi: 10.1016/j.jtumed.2013.01.002
84. Barteit S, Lanfermann L, Bärnighausen T, Neuhann F, Beiersmann C. Augmented, mixed, and virtual reality-based head-mounted devices for medical education: systematic review. JMIR Serious Games. (2021) 9:e29080. doi: 10.2196/29080
85. Garrido M, Koepke L, Anderson S, Mena AF, Macapagal M, Dalvit L. The Advancing MOOCs for Development Initiative: An Examination of MOOC Usage for Professional Workforce Development Outcomes in Colombia, the Philippines, & South Africa. Technology & Social Change Group (2016).
86. Ceron J, Baldiris S, Quintero J, Garcia RR, Saldarriaga GLV, Graf S, et al. Self-regulated learning in massive online open courses: a state-of-the-art review. IEEE Access. (2021) 9:511–28. doi: 10.1109/ACCESS.2020.3045913
87. Rabin E, Kalman YM, Kalz M. An empirical investigation of the antecedents of learner-centered outcome measures in MOOCs. Int J Educ Technol High Educ. (2019) 16:14. doi: 10.1186/s41239-019-0144-3
88. Lee Y, Kozar KA, Larsen KRT. The technology acceptance model: past, present, and future. Commun Assoc Inf Syst. (2003) 12:50. doi: 10.17705/1CAIS.01250
89. Borghini G, Hazan V. Listening effort during sentence processing is increased for non-native listeners: a pupillometry study. Front Neurosci. (2018) 12:152. doi: 10.3389/fnins.2018.00152
90. Ruipérez-Valiente JA, Staubitz T, Jenner M, Halawa S, Zhang J, Despujol I, et al. Large scale analytics of global and regional MOOC providers: differences in learners' demographics, preferences, and perceptions. Comput Educ. (2022) 180:104426. doi: 10.1016/j.compedu.2021.104426
91. Barteit S, Jahn A, Banda SS, Bärnighausen T, Bowa A, Chileshe G, et al. E-learning for medical education in Sub-Saharan Africa and low-resource settings: viewpoint. J Med Internet Res. (2019) 21:e12449. doi: 10.2196/12449
92. Bacon DR, Johnson CJ, Stewart KA. Nonresponse bias in student evaluations of teaching. Mark Educ Rev. (2016) 26:93–104. doi: 10.1080/10528008.2016.1166442
93. Song F, Parekh S, Hooper L, Loke YK, Ryder J, Sutton AJ, et al. Dissemination and publication of research findings: an updated review of related biases. Health Technol Assess. (2010) 14:1–220. doi: 10.3310/hta14080
94. Agarwal S, Lefevre AE, Lee J, L'engle K, Mehl G, Sinha C, et al. Guidelines for reporting of health interventions using mobile phones: mobile health (mHealth) evidence reporting and assessment (mERA) checklist. BMJ. (2016) 352:1174. doi: 10.1136/bmj.i1174
95. Phillips AC, Lewis LK, McEvoy MP, Galipeau J, Glasziou P, Moher D, et al. Development and validation of the guideline for reporting evidence-based practice educational interventions and teaching (GREET). BMC Med Educ. (2016) 16:1–10. doi: 10.1186/s12909-016-0759-1
Keywords: Massive Open Online Course, health care workers, education, low- and middle-income countries, health professions education, medical education
Citation: Nieder J, Nayna Schwerdtle P, Sauerborn R and Barteit S (2022) Massive Open Online Courses for Health Worker Education in Low- and Middle-Income Countries: A Scoping Review. Front. Public Health 10:891987. doi: 10.3389/fpubh.2022.891987
Received: 08 March 2022; Accepted: 01 June 2022;
Published: 12 July 2022.
Edited by:
Lynette Ruth Goldberg, University of Tasmania, AustraliaReviewed by:
Ines Fronteira, Universidade NOVA de Lisboa, PortugalJernej Zavrsnik, University of Alabama, United States
Kathleen Doherty, University of Tasmania, Australia
Copyright © 2022 Nieder, Nayna Schwerdtle, Sauerborn and Barteit. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jessica Nieder, jessica.nieder@uni-heidelberg.de