Rachya Kayastha1,2
Sonja Mueller1*
Punam Yadav3Ilan Kelman1,2Andrei Boscor1
Naomi Saville2Abriti Arjyal4
Sushil Baral4Maureen Fordham5Gareth Hearn3
Patty Kostkova1- 1UCL Centre for Digital Public Health in Emergencies (dPHE), Institute for Risk and Disaster Reduction, University College London, London, United Kingdom
- 2Institute for Global Health, University College London, London, United Kingdom
- 3Centre for Gender and Disaster, Institute for Risk and Disaster Reduction, University College London, London, United Kingdom
- 4Health Research and Social Development Forum (HERD International), Kathmandu, Nepal
- 5Hearn GeoServe, Ltd., Worthing, United Kingdom
In Low and Middle Income Countries (LMIC), one of the causes of maternal and child mortality is a lack of medical knowledge and consequently the inability to seek timely healthcare. Mobile health (mHealth) technology is gradually becoming a universal intervention platform across the globe due to ubiquity of mobile phones and network coverage. MANTRA is a novel mHealth intervention developed to tackle maternal and child health issues through a serious mobile game app in rural Nepal, which demonstrated a statistically significant knowledge improvement in rural women. This paper explores the perceptions and usability of the MANTRA app amongst rural women and Female Community Health Volunteers (FCHVs) in Nepal. Despite the challenges of a target user group with limited educational levels and low smartphone experience, all participants viewed the MANTRA app with approval and enthusiasm. They were willing to engage further with the mHealth intervention and to share their experience and knowledge with fellow community members. Participants also showed an increase in awareness of danger signs enabling them to make better informed health decisions in the future. FCHVs viewed the app as a validation tool providing and support for greater impact of their efforts in rural Nepal. Growing mobile ownership, network coverage and availability of smartphones along with acceptance of the prototype MANTRA app in rural communities suggest encouraging prospects for mHealth interventions to be incorporated in the national health infrastructure in Nepal and other LMICs.
Introduction
“Ensuring healthy lives and promoting well-being for all” is the United Nation's third sustainable development goal (1). It helps to focus efforts to improve maternal health outcomes through novel technological interventions that combat the causes of maternal, neonatal and child deaths, which are concentrated in low and middle-income countries (LMICs) of Asia and Africa (2). Thaddeus and Maine's [(3). p.1096–7] “three delay model” identifies “delay in deciding to seek [medical] care” due to lack of awareness about risk conditions and pregnancy complications as significant in creating complications.
Neonatal deaths are widely caused by premature births, infections, and birth asphyxiation (4) while post-partum hemorrhage, hypertension and sepsis are the major causes of maternal mortality (5). Though such conditions are preventable, lack of access and knowledge of antenatal, delivery and post-partum care may hinder timely delivery of life-saving interventions (6).
Health education around the world is being transformed by the introduction of new technologies for aiding communication and knowledge sharing. Mobile health (mHealth), defined as “mobile computing, medical sensor, and communications technologies for healthcare” (7) is a novel tool which is effective in improving health outcomes. mHealth may empower people in LMICs by helping communities, and especially women, to access knowledge about health seeking, which in turn may lead to improved health behaviors. Thus, mHealth may have potential to alleviate maternal and neonatal mortality (8, 9).
Nepal is a LMIC where maternal and neonatal mortality is still prevalent, with a neonatal mortality rate of 21 per 1,000 live births and a maternal mortality ratio of 239 deaths per 100,000 live births (10, 11). Female Community Health Volunteers (FCHVs) are the primary healthcare education frontline workers established by the Nepalese government in 1988 (12). FCHVs offer maternal health education, encourage antenatal, delivery and postpartum care seeking, provide birth preparedness counseling, identify danger signs in newborns and postpartum women during postpartum visits, and refer on to appropriate health facilities as needed (13). Due to the shortage of skilled health workers (14), FCHVs play an important support role as health educators and mHealth could be an opportunity for further health mobilization in Nepal.
The University College London (UCL) Centre for Digital Public Health in Emergencies (dPHE) developed an intuitive educational mobile app as a learning tool for rural women in Nepal. Maternal and Newborn Technology for Resilience in Rural Areas (MANTRA) was established to bring awareness of risk factors through a serious gaming application (app) pertaining to maternal, child health and geo-hazards. Serious games are digital games designed for education, outreach and training purposes and not just for entertainment (15). The key element of MANTRA was to educate women regarding different risks during pregnancy by enabling them to understand which problems present high risk and what level of care to seek for different problems. It offered FCHVs preliminary hands-on experience with a new technological intervention to improve their maternal and neonatal health knowledge and support overall resilience. Mueller et al. (16) describes the MANTRA mobile app and its development in detail.
The research question and key objectives of this study are to understand the attitudes of women about mobile games, understand the acceptability and usability of the prototype MANTRA intervention by women and FCHVs and to explore their perceptions of knowledge change brought about by the mHealth gaming application. In this paper, we present the study background and context of Nepal (section Background), methodology and data sources (section Methodology), results (section Findings), discussion of the results (section Discussion), and conclusions (section Conclusions).
Background
Conceptualization of mHealth
mHealth stems from the evolution of information and communications technology (ICT) creating a unique feature of personalization through mobile devices. It is one of the four pillars of ICT in the healthcare domain (17) and a major focus in the current boom of digital health (18). mHealth is defined as “medical and public health practice supported by mobile devices, such as mobile phones, patient monitoring devices, personal digital assistants, and other wireless devices” (19), mHealth is patient-centric and benefits governments by decreasing healthcare expenditures by delivery of efficient and cost-effective services (20). There are a number of eHealth serious games in the domain of health improving user knowledge and health outcomes (21).
mHealth promotes innovation, stimulating a global strategy for improving maternal and child health while directing nations to integrate such technologies into their national health infrastructure (22). mHealth's role is vital in LMICs for effective utilization of affordable health promotion, education, emergency medical response, treatment compliance and disease management (23, 24).
mHealth in LMICs is mainly applied for training health workers, remote data collection, raising awareness, education and remote monitoring etc. (25). However, organizations render various service elements under the broad umbrella of mHealth. WHO mHealth and ICT framework for reproductive, maternal, newborn and child health (RMNCH) classify their structure under 12 common applications such as short message service (SMS), behavior change communication, Interactive Voice Response, and provider-to-provider communication (26), aiming to provide information and care across the full continuum of maternal health (adolescent through postpartum) and child health (postnatal newborn through childhood).
Mobile Technology in Nepal
Nepal Telecommunications Corporation (NTC), a government-owned subsidiary established in 1975 (27), launched the first Global System for Mobile communication (GSM) service in 1999 (28). The monopoly of NTC ended in 2004, opening telecommunications to the private sector. Currently NTC and Ncell Private Limited are the key providers of voice telephony services in Nepal (27). World Bank's 2016 data (Figure 1) ranks Nepal as having the third highest mobile subscriptions in South Asia with ~110 subscriptions per 100 people (29).
Figure 1. Mobile Cellular Subscriptions in South Asia in 2016. Data used under CC BY-4.0 www.creativecommons.org/licenses/by/4.0 (29).
Nepal Telecom Authority (NTA), the regulatory governing body for the telecommunications sector in 2018 reported more than 37 million subscriptions (defined as the number of active SIM cards) of mobile telephony services, increasing yearly since 2009 (Figure 2) (30). Based on Nepal's current population estimate of 29 million (31). Figure 2 suggests there may be individuals who own multiple SIMs (32).
Figure 2. Mobile subscriptions data extrapolated from NTA Reports 2009–2018 [modified from NTA (30)].
The map of Nepal's network coverage (Figure 3) shows network signal scattered across the country with the strongest signal across urban cities and a majority in the more accessible southern plains belt. However, the northern mountain region lacks full coverage (33). Despite this incomplete coverage, smartphone availability is growing with affordable Chinese brands being introduced in the market (34).
Figure 3. Opensignal 2G/3G/4G coverage map of Nepal (33).
Serious Games for Health
Mobile learning is an emerging tool attracting interest in all fields of learning and education (35). Games have transformed from a purely entertainment view-point to a concept of serious games that bring change in a player's knowledge, attitude and health by creating attraction from its recreational element (36). An increase in ubiquity and personal ownership of mobiles has led to the introduction of numerous serious gaming apps through various mobile platforms (37). For instance, to educate learners (38–41), train healthcare professionals (42), inform citizens about health (43–45), rehabilitation (46) and management of illness (47, 48).
Urturi et al. (38) mobile app aimed to improve the quality of life of individuals with Autism Spectrum Disorder (ASD). The instructional videos and writing taught participants new ways of dealing with first aid situations. The pilot study tested 10 participants with ASD who reported enjoyment and ease in using the app. Some described having no affinity for games or smartphones. Another observational analysis of 15 participants who played an app aimed at raising awareness about Alzheimer's disease and its effects on families showed behavioral change in participants. The pre- and post- survey evaluations suggest an increase in awareness and new learning of Alzheimer's symptoms (44). However, the sample size of both studies was very small indicating the need for further research to evaluate serious games.
Orjuela et al. (42) study designed a gaming app allowing medical students to practice Cardio-Pulmonary Resuscitation on phones rather than on conventional mannequins. Some students perceived the app as difficult to use, while some preferred the traditional method of teaching using dummies. However, most students found the app related well with their lectures and practical classes, perceiving it as a complementary tool for learning. The eBug project (49, 50) illustrated the opportunities that serious games represent for child learning but also highlighted the challenges of developing such educational initiatives in a low literacy group. This project was expanded by the edugames4all initiative and explored usability challenges for game designers developing games aimed at children (51).
Another example of an interactive game in mHealth is UnderControl, aimed at promoting birth control practices and STI prevention mechanisms for reproductive health. Eleven game testers performed surveys on player experience in difficulty, playability and visual aesthetics. Though participants reviewed the game as engaging, it required adjustments to set challenges based on players' skill levels. The author states, “educational games on reproductive health are very limited on mobile platforms” (43) highlighting the need and potential for such gaming apps.
mHealth Maternal Interventions in LMICs
There are many mHealth interventions on RMNCH in LMICs (20). Various countries use mHealth as a mode of case management starting from client registration, home visit scheduling, counseling and for follow-up reminders (52–54), with the most common medium being through text or audio. For example, regarding antenatal care (ANC) visits or for sending educational messages (55–58). However, there has been limited research on the educational aspects of mHealth in South Asia (59, 60).
In Jharkhand, India “Mobile for Mother” (MFM) app was launched to aid community health workers (CHWs) and to improve information, data collection systems and increase women's knowledge and health-seeking behaviors. CHWs found MFM to be a systematic source for information, leading to better performance of maternal health-related tasks and building their confidence. However, they perceived mobile phones to bring knowledge change in women but not amongst CHWs (54).
In Ethiopia, researchers provided three mobile phones to each facility with preloaded apps which sent reminders to health-workers regarding scheduled ANC visits, delivery and postnatal care and educational messages on danger signs. Results show the mobile reminders motivated the health-workers to call pregnant women for their scheduled visit assisting in better case management. Their knowledge of danger signs and common illnesses may have also increased because of the weekly educational messages. The app was associated with an increase of ~20% more hospital deliveries and postnatal care in the intervention group compared to the control group (57).
MOTECH program in Ghana focused on improving pregnant and postpartum women's knowledge and awareness of health information. The app also sent automated educational voice messages to pregnant women's mobile phones. This intervention was successful in improving knowledge, awareness and utilization of RMNCH services. The rates of active listening were higher on information of danger signs during pregnancy and post-partum care than on infant care, nutrition and postpartum family planning (60). This suggests women were keen to learn about danger signs or lacked such knowledge, resulting in their interest to learn. If women are able to recognize danger signs, they are more likely to take appropriate healthcare seeking actions (61).
mHealth in Nepal
The challenging mountainous terrain, limited mobile coverage and widespread poverty of rural populations make mHealth projects challenging in Nepal, but in recent years there have been a number of successes. In collaboration with UNFPA and USAID, Nepal's Ministry of Health (MOH) launched a serious gaming app “Khulduli” in Nepalese language, promoting adolescent sexual and reproductive health awareness. The program is yet to be evaluated, yet the app is the first step toward integrating mHealth into Nepal's health infrastructure. This was a key message in UNFPA's global strategy for women's, children's and adolescent's health (62).
Use of mobile technology for health interventions is relatively new in Nepal. The oldest published study of 2008 describes the use of mobile phones as a primary communication method during medical emergencies (63). Nepal's Demographic and Health Survey carried out in 2011 used tablet PCs for the first time, making substantial improvement in data quality and reduction in data collection time (64). An observational study regarding the role of ICT in medical education elucidates how students enrolled in teaching hospitals use mobile phones for learning by enhancing knowledge through interfaces like Google (65). Kathmandu Medical College Teaching Hospital used mobiles as a hospital management information system. Free-to-use apps like Viber and Dropbox improved their efficiency through instant communication, decision making and cross-country knowledge exchanges (66).
Style et al. (67) on the implementation of an Electronic Data Capture system in rural plains of Nepal sheds light on the technological and social challenges of mHealth. The study enlisted community women with limited education as nutrition mobilisers to run women's groups providing them with pictorial apps on ‘low-spec' smart phones to record information about women's groups and home visits. More educated data collectors also used smart phones to collect detailed data about women and their babies during pregnancy and after birth. In a few cases nutrition mobilisers' spouses misused the phones, replacing the operating system and wiping memory cards for personal use. Challenges such as scarcity of electricity for charging and limited phone signal also somewhat affected implementation. However, despite the challenges, the intervention made large-scale trial data collection faster and less error-prone.
SafeSIM intervention is the WHO's RMNCH full continuum of care intervention. It uses mobile phones for registration during pregnancy until postnatal counseling visits and is aimed at reducing maternal mortality. It is used to register births and sends FCHVs SMS reminders about when to visit patients for counseling and health education, and expected date of delivery. FCHVs perceived the app to be helpful in simplifying their job. It resulted in an increase in timely ANC visits, treatments and increased awareness on the importance of ANC, which is expected to improve the health status of pregnant women. Providing FCHVs with phones to establish personal ownership, reduced misuse by other family members (68) which was a social challenge in Style et al. (67) study.
Most mHealth interventions focus on using mobiles for Data Entry (69) and communication (70). Some data collecting apps have been used to assist in diagnosis of medical conditions like epilepsy (71), assessing the prevalence of blindness, cataract surgical coverage (72) and collecting clinical data (73). MOH in collaboration with WHO also used mobile phones to monitor measles-rubella vaccination campaigns (74).
Almost all interventions use mobile phones to expand the reach of health care services in remote areas across Nepal's hilly terrain, overcoming some of the challenges of limited infrastructure to access some health services. The above studies provided user's positive opinions on mHealth and demonstrated its potential for improving data quality and security. Problems such as electrical outages and unreliable networks do not signify drawbacks of the interventions but rather the infrastructural deficits in Nepal, which are rapidly being overcome as the demand for mobile phone usage increases.
mHealth Opportunities in Nepal
In light of the increasing ownership of smartphones together with increasing mobile subscriptions and network coverage across Nepal (30, 33, 34), mHealth may emerge as an effective tool in Nepal's healthcare development. The annual increase in mobile subscriptions and network coverage of more than two-thirds of the nation suggests great potential for new digital interventions in the future. However, some of the increase in subscriptions may be due to individuals having multiple SIM registrations or subscriptions which are non-active today.
Previous studies describe conflicting responses on the accessibility of mobile networks (67, 73, 74), reflecting variability depending on remoteness and network coverage. In spite of this concern, apps like MANTRA can work without an internet connection so only need a connection for the downloading of the app itself. This is similar to Gupta's study where the app data was uploaded when network connection was available (69).
The availability of cheaper brand smartphones, yearly increase in subscriptions and established network coverage may aid mHealth interventions to cover substantial areas of the underserved populations. An increase of mobile projects by numerous organizations in collaboration with Nepal's MOH (62, 68, 74) is an encouraging indicator of mHealth gaining popularity and incorporating such interventions in the national health infrastructure.
Although the literature describes various interventions designed for RMNCH in LMICs, there is sparse research exploring women's experiences and perception of apps designed to tackle maternal or child health in rural Nepal. Additionally, their attitude toward mHealth technology as a means of empowerment and education about health has not been studied yet. We aim to fill these gaps by understanding users' attitudes toward the MANTRA app in rural Nepal and its feasibility, while exploring the extent that participants experienced change in knowledge through the intervention.
Methodology
Study Design
MANTRA aimed to increase maternal and child health resilience before, during and after disasters, using mobile technology (75). The MANTRA serious mobile game project was carried out in Nepal after the 2015 earthquakes, with the serious mobile game component led by UCL-IRDR dPHE Centre. The MANTRA project investigated the hazards and risk perceptions with an aim to provide useful information and communication through mobile phones to contribute to maternal and newborn health resilience. The MANTRA team aimed to use culturally appropriate images on a user-friendly interface suitable for all audiences incorporating visuals pertaining to geo-hazards, maternal and child healthcare modules (76). The MANTRA study was approved by University College London Ethics Committee in London, United Kingdom [10547/001], and the Nepal Health Research Council in Kathmandu, Nepal [Reg. No. 105/2017].
Field tests took place in open community spaces, making a single user study difficult. However, this in-situ evaluation provided valuable insights into how participants might actually use a serious game (77, 78).
Study Sites
The data was collected from three locations of the Central Development Region of Nepal and Kathmandu in 2017. Chyamrangbesi and Chandenimandan Village Development Committees (VDCs) in Kavrepalanchok district were the main study areas, while Siddhipur and Imadol in Kathmandu valley, were chosen for field tests of the app, before conducting focused field tests in the two VDCs.
Study Recruitment and Participants
The field evaluation study comprised 72 participants: 30 FCHVs, 31 women and 11 men. This paper is based on the analysis of nine Focus Group Discussions with the 61 participants that were women and FCHVs. This paper focuses on women's perception of the intervention, although one focus group discussion with men was carried out to gain insight into men's perception of the MANTRA app.
The research participants were recruited using the chain-referral method, or “referrals made among people who share or know of others who possess some characteristics that are of research interest” [(79). p. 141]. Health Research and Social Development Forum (HERD International), the local affiliated NGO, asked contacts in the villages to invite FCHVs and other community members to participate. All participants provided informed written consent.
Data Collection Method
Each field test comprised a preliminary assessment of participant's understanding of learning objectives, establishing a baseline for knowledge assessment, followed by 10–30 min of gameplay, immediately followed by a post-game knowledge assessment and a focus group discussion (FGD) and interviews. The data collection concluded with a post-assessment of the learning objectives identical to that used at the beginning. These assessments of knowledge change from playing the game are described in Mueller et al. (80).
All FGDs and interviews were facilitated by HERD International researchers, conducted in Nepali using a topic guide, and were audio recorded for transcription and translation into English (16, 80). The topic guide created by the researchers is published in Mueller et al. (16) and includes elements on perceptions, attitudes, user experience, and how the women might use a resource like the MANTRA app (16). Also, details of the co-development process of the game artwork and image pictograms iteratively co-authored with HERD researchers and the local women end users to ensure local appropriateness and understanding is described in detail in Soriano et al. (76).
Data Analysis Method
Data were analyzed using a qualitative approach to explore participants' subjective experiences (81). Although the main study collected multiple datasets, this paper focuses on nine FGDs with female respondents only as the study focuses on understanding women's perspective on the prototype reproductive and child health app. The FGD method provides the researcher with group interaction dynamics, allowing elaborative and thorough data to be generated (82) but also allows everyone to speak freely “in the safe and familiar context of their own turf” (82).
HERD International researchers were mainly responsible for organizing fieldwork, facilitation, transcription and translation. dPHE researchers were mainly responsible for analysis of data related to the MANTRA serious mobile game app. Reporting was a collaborative effort among the authors.
FGD transcripts were translated into English from Nepali and analyzed using NVivo software (https://www.qsrinternational.com/nvivo-qualitative-data-analysis-software/home/) (83). We used Thematic Analysis to identify themes generated from the organized data (84). This involved “detailed readings of raw data to derive concepts, themes, or a model through interpretations made from the raw data” (85). It provided comprehensive interpretation of the data (86) resulting in a rich understanding of participants' perceptions and their engagement with the app.
We read the transcripts multiple times for familiarization, ensuring the findings reflected participants' perceptions accurately. Transcripts were manually coded into meaningful segments using Nvivo software and basic themes were generated. Emerging relationships and patterns were organized into a mind map (Figure 4) and classified into organizing themes, which led to the emergence of global themes, the principal meanings of the data (87).
Figure 4. Mind Map to organize data.
Findings
Demographics of Participants in Target Audience
Demographic information about participants in the target audience are summarized in Table 1. A total of 61 women participated in nine FGDs comprising 30 FCHVs and 31 community members, ranging from 20 to 60 years of age. Nineteen participants had no education while 42 had some education. Twenty-seven participants owned smartphones, 28 owned basic mobile phones, while 6 did not own phones. Thirty participants were comfortable using smartphones, 24 had previously used apps, and 16 had experienced gaming apps.
Table 1. Demographics of participants in target audience.
Thematic Analysis Results
Through the thematic analysis, 24 basic themes emerged from the NVivo codes which were classified into nine organizing themes (see Table 2). The underlying factors and themes led to the identification of the following global themes: Knowledge from mHealth, Potential of mHealth & Perception of mHealth. The column titled Number of Quotes Found indicates the collective expression of basic themes.
Table 2. Themes derived from the data.
Knowledge From mHealth
The participants went through a process of change in acquiring information and understanding various scenarios, leading to two organizing themes, decision making and knowledge gain.
Decision Making
After using the game, the participants were able to identify relevance of certain types of health problem (cases) as “we were able to learn about which cases we are supposed to give the highest priority. We would be able to identify the health condition of the child in question…We would even consider the cases which need to be taken to the hospital immediately in the ambulance” (FGD 7-P3). It helped them to prioritize and classify urgency in deciding necessary actions for medical assistance.
Knowledge Gain
The app's culturally appropriate images helped in correlating imagery while “we learnt the different indicators of danger. You could say that we were able to differentiate the dangerous conditions with the help of this game” (FGD 7-P1). The user-friendly interface and interactive nature aided in understanding scenarios easily “Actually we only knew about the danger symptoms in pregnant women from the paper picture. We understood more clearly from the game” (FGD 4-P3). Relating scenarios to corresponding actions signifies an advantage of mobile education in comparison to printed images on posters or paper, as reflected in the statistical analysis of knowledge gain presented by Mueller et al. (80). Finally, an in-depth analysis of women's knowledge retention throughout the game, when the same images are being presented in more complex levels, is presented by Mueller et al. (88).
Potential of mHealth
The majority of participants, even the FCHVs, stated the practical possibilities and positive prospects of using the gaming app in their day-to-day life. From this, assisting community, teaching assistance and validation emerged from the global theme.
Assisting Community
The participants thought of how they could disseminate the acquired new information within their communities as “Even though we cannot always be around our friends who know little about these things they will be able to learn about the things that they are supposed to do by looking at the pictures” (FGD 2-P2). This offers an opportunity for numerous community members to learn essential maternal and child health information and share their learning with others.
Teaching Assistance
The FCHV's believe the app “. would be really good. That would make it very easy for us. We had not seen things in the mobile phone. It was a new and interesting approach” (FGD 1-P6). Perceiving the phones to be easily accessible compared to paper-based RHMNC materials, the app is considered a novel, innovative and efficient method for teaching as “The thing is that it increases the speed of the work that we are already doing” (FGD 4-P1). The mobile app comes in handy especially in rural areas to increase FCHV's efficiency and effectiveness to promote awareness regarding health issues.
Validation
FCHV's gained confidence as “we were able to learn about the different ways to get certain things done. It is not a given that the procedure that we follow to do somethings is always correct. And then, we can learn a new or better alternative from the game. So, that also helped us recall different works that we have done or are doing right now” (FGD 2-P3). Their ability to verify the diagnosis and re-learn information heightens their zeal and vigor. While “Some of the local people would not believe the things that we would tell them. So, if they could see the same things in the mobile itself then they would know that we are telling them the right things. So, this would help them trust us more” (FGD 7-P2). Gaining trust of community members, especially women, is essential for dispersal of knowledge, thus the information offered from a third party source such as the MANTRA app reaffirms FCHVs' efforts while boosting their morale to relate with individuals having pre-notions of certain maternal health issues.
Perception of mHealth
Most of the participants viewed the gaming app as a tool for improving RMNCH while a few had diverging opinions. Four organizing themes of gratification, familiarity, general impression and hurdles emerged from the global theme.
Gratification
Playing the app game heightens the gamers' interest leading toward better retention of knowledge as “we got awareness along with the fun of playing the game. We learnt about the things that we are supposed to do” (FGD 5-P2). Thus, the participants were able to learn complex ideas while enjoying the game, which increased their willingness to play repeatedly and strengthen their knowledge. This was also informally observed at the end of the gaming session by participants stating to each other that they did not want to finish.
Familiarity
FCHVs “.realized that all the things that are there in this game are the works that we have actually been doing” (FGD 2-P1). They perceived the app's relevance to their existing and past work, and found it reassuring “… we are female community health volunteers, we find maternal and neonatal health easier to understand” (FGD 8-P2). Thus, reaffirming their ability and interests to comprehend new technological interventions.
General Impression
After playing “it was easier for us to understand by the medium of pictures. I used to think these games are only meant to be child's play, but today I feel happy to gain this information through game” (FGD 8-P6). It transformed women's negative views and created curiosity to learn “we had never seen that mobile game before. But we gradually learnt what we are supposed to do and where we are supposed to go in that game” (FGD 1-P6). Some believe “there are some old people who would say that this is something that is unnecessary. The people with old beliefs say such things” (FGD 2-P3), which makes the older generation hesitant to try new technological interventions. On the other hand, some were optimistic about their elders response: “. the village is not the same as it was before. They also show interest in learning about these things now” (FGD 9-P2) suggesting even the older generation may be open to such interventions through awareness and encouragement from their younger family members who have experienced such games.
Such information is vital as “… Family member are responsible to take care of the patient and they must be aware of all these things. They are the ones to take the patient to the hospital. It is better if the family understand” (FGD 4-P3). Individuals from the community, especially men, need to acquire such knowledge of danger-signs to take pre-emptive actions. After all, it is generally the husband or family member's responsibility to care for the mother during pregnancy and after birth. “They would also realize that they have a role to play in the issue of health care in their community. I think that they would develop such feelings.” (FGD 5-P3) Through dissemination of knowledge from the app amongst a broad group of community members, a collective attitude and communal support system could be built, which would raise awareness within the community and aid in various maternal and child health scenarios.
Positive suggestions for modifications were provided by participants to improve future interventions. For example: “if we had such audio guidance then it would be definitely easier. The people who are not clear about things will also understand about the things that they are supposed to do in this game. Even the illiterates would be able to play this game” (FGD 2-P3). Incorporating other relevant health issues as suggested by participants like nutrition, family planning, feminine hygiene etc. in the future would help the app to reach a more of the community. Also, incorporating not only Nepali text but also audio features would help in reaching people across all ages and cultural groups even if they have low literacy.
Hurdles
Some participants“. feel that the pictures need to be clearer for us to understand better.” (FGD 2-P1). Others expressed that “It is not that it is difficult. It is simply because we are not used to it.” (FGD 4-P1). For some, lack of experience with mobile games hindering their clear understanding of the app and cognitive processing of the information. For some women, the mobile was an unfamiliar object since they didn't own- or know how to use- one and they worried about damaging the phone.
Discussion
Our findings suggest that participants perceived our MANTRA mHealth serious game app intervention as an effective RMNCH tool for healthcare education. Most participants exhibited positive responses to the game. They found it an encouraging opportunity for strengthening the healthcare infrastructure and broadening mHealth reach and awareness in Nepal. A serious game programme has potential of being a constructive device for FCHVs to connect with rural communities through the mode of teaching, community learning and for validation purposes. The MANTRA app provides opportunities for players to acquire information and gain knowledge to make informed decisions in the future. This section discusses the findings in detail, highlighting the significant responses pertaining to the research objective questions.
Attitudes About MANTRA
Our first objective was to explore the attitudes of women regarding the app. The interactive nature of MANTRA resulted in participants' optimistic response to mHealth. Visual imagery supports ease of comprehension, stimulation of thinking and improves the environment for learning (89). We found similar ease of understanding and constructive engagement with the MANTRA app due to its pictorial nature.
After using the app, women from the communities expressed confidence in processing their health needs. This suggests that the app has potential to help them build independence in handling situations without the assistance of FCHVs and cope without external advice. A reduced need for communication, might raise concerns about misinterpretation of information leading to wrong diagnosis, which could increase the chances of complications and risks.
FCHVs revealed that the MANTRA mobile app aided them to recall their prior knowledge. This is similar to Shorey et al. (78) about utilizing the information in the app for recalling and repeating information. The MANTRA intervention strengthened their confidence in approaching communities and was validating of their existing knowledge and skills. The app had potential to help them develop stronger connections with community members, though the pilot was too short for such benefit to be realized during the study. Similarly, Ilozumba et al. highlighted the importance of strong connections and trust between health workers and communities (54). Recommendations provided by participants included covering additional modules like feminine hygiene, nutrition and family planning, eventually encompassing a larger range of health interventions to correspond with the continuum-of-care approach.
In the male-dominated society of rural Nepal (90), female participants stressed the importance of involving male family members. They believed that it is men's responsibility to look after them during pregnancy and after childbirth.
Although most participants responded positively to the app, a few people from the older generation were less positive, although some respondents over 55 years were open to the new intervention. This correlates with Parker et al. study where some older individuals with limited prior use of mHealth were equally willing to try such methods as younger people (91). This suggests the potential for exploring new approaches to attract older generations to novel interventions. Future research should attempt to understand the perceptions of different generations in order to design and develop an effective mobile intervention.
Acceptability and Usability
Exploration of participants' acceptability of the MANTRA app and its usability in Nepal was the second objective of this research. Participants identified mHealth as a useful tool in acquiring new knowledge and in encouraging dissemination of the knowledge with others. Prior to mHealth, primary health education and care was predominantly being conducted by FCHVs in women's groups and during health care visits. Tools like the MANTRA app help to increase community awareness and also encourage new members to participate in future interventions. Incorporation of new modules could aid in appealing to male family members to participate and show to concern for their wife and child's health.
Ilozumba et al. (58) use of an effective SMS-based intervention may not be applicable if illiteracy is common, as is the case amongst rural Nepali woman. The interactive approach of MANTRA's visual imagery may have higher chances of significant impact, although participants would have preferred the addition of audio material. Visual imagery aids in the ease of understanding by all, regardless of their educational background. Molnar and Kostkova (41) found that dispersal of information through mobile games led to higher knowledge gain compared to SMS texts. However, a formal usability study was not conducted at the time due to the challenges of women naturally working together rather than individually.
A health intervention dispersed messages of danger signs that led to knowledge increase in community women but not CHWs (54). In the case of MANTRA, both the community women and FCHVs gained knowledge and in addition, FCHVs found the app useful to practice and reaffirm their knowledge. Sharma et al. showed that FCHVs' efforts in improving ANC through the use of mobile phones resulted in an improvement of pregnant women's health (68). Contributing to this broad aim, MANTRA helped community women to develop their personal capacity in identifying risks associated with different scenarios, complementing the FCHVs activities in the community. There is a scarcity of health workers in Nepal (14), which heightens the prospective benefits of mHealth reaching a larger population through mobile devices. However, we also need to consider possible misinformation and misunderstanding by users that may have a negative impact on the women. In a teaching environment, it is possible that some participants might learn the wrong message. This risk could be mitigated in future by FCHVs or other trainers discussing the game and answering participants' questions, further game development to improve clarity, and implementing the game as part of group sessions facilitated by a health worker.
The MANTRA study did not directly encounter some issues and consequences noted in other studies that implemented digital interventions, most probably because the team lent smartphones to participants for the short duration of the field evaluation sessions. User engagement and retention, often being an issue with games interventions studied by Molnar and Kostkova (51) and Molnar and Kostkova (92), was not observed in this study due to the novelty of the smartphone technology to the women and the controlled study set up.
Digital interventions illuminate barriers and social problems. Several barriers from the literature include expense, risk of theft, privacy concerns, limited mobile networks, limited electricity infrastructure, as well as social problems like restrictions on mobile, possibly resulting in difficulties for end users, their households, and the effective implementation of an intervention (10, 64, 78). Mueller et al. (16) discuss some of these considerations as part of the development and localization process of the MANTRA serious mobile game. Several points are particularly relevant to the FGD analysis in this study.
Social and cultural constraints may impede the effectiveness of mHealth interventions in LMICs where patriarchal societal structures affect women's decision-making (93). One possible barrier is the older generation not accepting mobile phones and games among their younger family members and community. Some people may have pre-established negative notions about mobile phones and games having detrimental effects on the community, though this is unlikely in light of the increasing mobile phone usage in Nepal.
Previous studies have described erratic power surges in Nepal as a primary limitation (64, 73). In contrast, MANTRA's participants did not raise concerns on such matters. Rather, they expressed their fears of breaking the phone or not knowing how to use it. Perhaps out approach of lending of phones for a limited period meant that participants were not concerned about recharging phones or other technical problems. Offering RMNCH apps for free could also help eliminate financial concerns of purchasing apps, however limited network coverage or electricity supplies and lack of phone ownership amongst the poorest people may hamper its accessibility.
The issues and unintended consequences discussed are important to consider for larger scale testing of the MANTRA serious game app and implementing similar digital interventions.
Perception of Knowledge Change
The last objective was to identify women's perception of knowledge change. Our findings suggest that all participants experienced knowledge gain, stating their decisions would now vary depending upon the situations. This finding is further supported by a statistical analysis of the MANTRA app showing statistically significant knowledge improvement in mean scores of the group of participants (75, 80). Identification of danger signs through the app was easy and participant's affinity toward the game was positive. Similar to LeFevre et al. (60), participants showed more interest in acquiring information about danger signs during pregnancy than postpartum.
Although the app incorporated visuals and provided audio cues for right and wrong answers, some women may still interpret scenarios inaccurately. This could delay their decision to seek care when a health problem arose. FCHVs' role as mediators becomes important to clarify scenarios and highlight the importance of gaining correct knowledge. For this reason, mHealth should not replace primary health care workers.
The material in MANTRA that stressed the importance of ambulances, women's awareness to identify emergency situations, and differentiation between health post and hospitals is similar to Sharma et al. (68) which showed an increase of awareness about the importance of care during pregnancy. RMNCH related educational provisions and awareness of risks may lead to an increase in an individual's knowledge, but not necessarily result in behavior change.
The three basic conditions for behavior change are capability, opportunity and motivation. Incorporated with the COM-B model, the Behavior Change Wheel (BCW) (94) describes education as one of the features of intervention, aiding in the formulation of national and international policies for bringing behavior change in individual or communities. Our findings suggest knowledge gain of danger signs could be a motivating factor for women to seek healthcare, but the participant's capacity to make a decision independently may be constrained by social factors. In rural communities, decision-makers are usually elderly males or the mother-in-law (95). A family may also have the motivation to seek care, but the scarcity of health facilities, geographical barriers and economic constraints may hinder their timely action to seek care.
A key element of gaming apps is “fun” which stimulates one's interest and involvement (96) and may result in enhancement of behavior change. Addressing our last objective we found that mHealth brought knowledge change, which could lead to informed decision making. Whilst we hope that this may result in behavior change amongst the participants in the future, assessment of behavior change was beyond the scope of this study. A future study, building on the MANTRA app, should aim to evaluate this.
Implication and Future Research
MANTRA is the first mixed methods study evaluating a new and open app targeting RMNCH in Nepal. Our study provides new insight on understanding women's perspectives about mHealth and explores the feasibility of mHealth interventions in a rural setting.
Future research may involve continued development of the MANTRA serious game app, as well as a larger study, such as a randomized controlled trial, allowing findings to represent a larger populace. Such research could incorporate individuals across generations and genders while randomly selecting participants from various regions should be implemented for a longer time period with a larger sample size in a non-controlled environment with additional modules. Additionally, the study must examine the linkage between knowledge gain and behavior change of participants incorporating the BCW model or another model of behavior change.
Interventions like MANTRA create positive perceptions of women toward mHealth, can bring knowledge change on RMNCH issues, and support the potential for positive change at an individual level in improving the health outcome of communities. Ultimately, lessons and insights from the MANTRA serious game app may be transferable to other LMIC settings with similar mHealth interventions and support the use of mHealth interventions in innovative and progressive national health agendas.
Conclusions
This study aimed to understand women's perspectives of the MANTRA serious game app, including attitudes, acceptability and usability using a qualitative approach. The data provide insights on Nepal's use of mobile technologies, mHealth interventions, and challenges. Expanding network coverage and increasing mobile phone subscriptions across Nepal suggest that mHealth apps have great potential to connect with communities in remote terrains. The study highlights women's positive perceptions of mHealth, contextualizes participant's knowledge gain of maternal and child health and increases awareness on informed decision making during maternal and neonatal health problems. Furthermore, MANTRA's utility as an effective teaching and learning tool for FCHVs and rural women supports the use of mHealth interventions and technology to access and learn health information in LMICs.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by University College London Ethics Committee and Nepal Health Research Council. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
RK contributed to the design, analysis, interpretation, and drafting of the work. SM contributed to design of the work and drafting of the work. IK contributed to the analysis, interpretation, and drafting of the work. AB contributed to design of the serious game. NS contributed to the conception and design of the work, particularly perinatal health messages, as well as acquisition of field data. AA contributed to the acquisition of field data. MF and SB contributed to conception of the work. AA, NS, and SB assisted to contextualize the content of the game. GH contributed to conception and design of the work and particularly geohazard messages. PY contributed to the interpretation and revising critically for content. PK contributed to conception, design, analysis, interpretation, and drafting of the work. All authors contributed to the article and approved the submitted version.
Funding
This work was supported by the United Kingdom Research Councils Grand Challenges Research Fund [Project 538621 Award: 173142] NERC Reference: NE/P016103/1.
Conflict of Interest
GH was employed by the company Hearn Geoserve, Ltd.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We thank the participants in rural and peri-urban communities who took part in the field evaluation sessions of the game and those who participated in the qualitative research to develop its content. This includes reproductive age women, Female Community Health Volunteers, health workers, and men in the communities in Nepal who welcomed us and gave their time to work with us. The authors are grateful to The Natural Environment Research Council (NERC), the Arts & Humanities Research Council (AHRC) and the Economic & Social Research Council (ESRC) Global Challenge Research Fund (GCRF) for providing funding for the project (NERC Reference: NE/P016103/1). Delphine Soriano developed the pictograms and contributed to design of the serious game and evaluations.
References
1. UN. Sustainable Development Goals- Health. (2015). Available online at: https://www.un.org/sustainabledevelopment/health/ (accessed March 25, 2018).
2. Bhutta ZA, Black RE. Global maternal, newborn, and child health - so near and yet so far. N Engl J Med. (2013) 369:2226–35. doi: 10.1056/NEJMra1111853
3. Thaddeus S, Maine D. Too far to walk: Maternal mortality in context. Soc Sci Med. (1994) 38:1091–110. doi: 10.1016/0277-9536(94)90226-7
4. Fottrell E, Osrin D, Alcock G, Azad K, Bapat U, Beard J, et al. Cause-specific neonatal mortality: analysis of 3772 neonatal deaths in Nepal, Bangladesh, Malawi and India. Archives of disease in childhood. Fetal and neonatal edition. BMJ Publishing Group. (2015) 100:F439–47. doi: 10.1136/archdischild-2014-307636
5. Say L, Chou D, Gemmill A, Tunçalp Ö, Moller AB, Daniels J, et al. Global causes of maternal death: a WHO systematic analysis. Lancet Global Health. (2014) 2:e323–33. doi: 10.1016/S2214-109X(14)70227-X
6. Liu L, Oza S, Hogan D, Perin J, Rudan I, Lawn JE, et al. Global, regional, and national causes of child mortality in 2000-13, with projections to inform post-2015 priorities: an updated systematic analysis. Lancet. (2015) 385:430–40. doi: 10.1016/S0140-6736(14)61698-6
7. Istepanian RSH, Jovanov E, Zhang YT. Introduction to the special section on M-health: beyond seamless mobility and global wireless health-care connectivity. IEEE Transact Inform Technol Biomed. (2004) 8:405–14. doi: 10.1109/TITB.2004.840019
8. Lawn JE, Cousens S, Zupan J. 4 million neonatal deaths: When? Where? Why?. Lancet. (2005) 365:891–900. doi: 10.1016/S0140-6736(05)71048-5
9. Mechael N. The case for mhealth in developing countries. Innovations: Technology, Governance, Globalization. MIT Press. (2009) 4:103–18. doi: 10.1162/itgg.2009.4.1.103
10. Ministry of Health Nepal New ERA ICF. Nepal Demographic and Health Survey 2016. Ministry of Health, Nepal (2017).
11. Yadav P, Saville N, Arjyal A, Baral S, Kostkova, Fordham M. A feminist vision for transformative change to disaster risk reduction policies and practices. Int J Disaster Risk Reduct. (2021) 54:102026. doi: 10.1016/j.ijdrr.2020.102026
12. Glenton C, Scheel IB, Pradhan S, Lewin S, Hodgins S, Shrestha V. The female community health volunteer programme in Nepal: Decision makers' perceptions of volunteerism, payment and other incentives. Soc Sci Med. (2010) 70:1920–7. doi: 10.1016/j.socscimed.2010.02.034
13. Kc NP, Kc A, Sharma N, Malla H, Thapa N, Aryal K, et al. State of maternal, newborn and child health programmes in Nepal: what may a continuum of care model mean for more effective and efficient service delivery?. J Nepal Health Res Counc. (2011) 9:92–100.
14. Simkhada B, Van Teijlingen E, Porter M, Simkhada. Major problems and key issues in Maternal Health in Nepal. Kathmandu University Med J. (2006) 4:258–63.
15. Stokes B. Videogames have changed: time to consider “Serious Games? J Dev Educ Assoc. (2005) 11:12.
16. Mueller S, Soriano D, Boscor A, Saville N, Arjyal A, Baral S, et al. MANTRA: development and localization of a mobile educational health game targeting low literacy players in low and middle income countries. BMC Public Health. (2020) 20:1171. doi: 10.1186/s12889-020-09246-8
17. Bashshur R, Shannon G, Krupinski E, Grigsby J. The taxonomy of telemedicine. Telemed e-Health. (2011) 17:484–94. doi: 10.1089/tmj.2011.0103
18. Kostkova. Grand challenges in digital health. Front Public Health. (2015) 3:134. doi: 10.3389/fpubh.2015.00134
19. WHO. mHealth New horizons for health through mobile technologies. Glob Observatory eHealth Series. (2011) 3:5–6. Available online at: https://apps.who.int/iris/handle/10665/44607
20. Istepanian RSH, Woodward B. M-health : Fundamentals and Applications. Hoboken, NJ: Wiley-IEEE Press (2017).
21. Kostkova P, Farrell D, De Quincey E, Weinberg J, Lecky D, McNulty C. eBug - teaching children hygiene principles using educational games. Studies in health technology and informatics. IOS Press. (2010) 160:600–4. doi: 10.3233/978-1-60750-588-4-600
22. EWEC. The Global Strategy for Women's and Children's Health (2016-2030). New York. (2015). Available online at: http://globalstrategy.everywomaneverychild.org/pdf/EWEC_globalstrategyreport_200915_FINAL_WEB.pdf (accessed June 25, 2018).
23. Mechael P, Batavia H, Kaonga N, Searle S, Kwan A, Goldberger A, et al. Barriers and Gaps Affecting mHealth in Low and Middle Income Countries: Policy White Paper. New York. (2010). Available online at: http://www.globalproblems-globalsolutions-files.org/pdfs/mHealth_Barriers_White_Paper.pdf (accessed June 17, 2018).
24. Abaza H, Marschollek M. mHealth application areas and technology combinations: A comparison of literature from high and low/middle income countries. Methods Inf Med. (2017) 56:e105–22. doi: 10.3414/ME17-05-0003
25. UN Foundation and Vodafone Foundation. mHealth for Development. The Opportunity of Mobile Technology for Healthcare in the Developing World. Washington, D.C. (2009). Available online at: http://www.globalproblems-globalsolutions-files.org/unf_website/assets/publications/technology/mhealth/mHealth_for_Development_full.pdf (accessed July 2, 2018).
26. Labrique AB, Vasudevan L, Kochi E, Fabricant R, Mehl G. mHealth innovations as health system strengthening tools: 12 common applications and a visual framework. Global Health Sci Pract. (2013) 1:160–71. doi: 10.9745/GHSP-D-13-00031
27. Gautam DK. NTC and ncell: telecommunication and strategies. South Asian J Business Manage Cases. (2016) 5:126–33. doi: 10.1177/2277977916634254
28. NTC. Milestones. (2017). Available online at: https://www.ntc.net.np/pages/view/milestones (accessed June 14, 2018).
29. World Bank. Mobile Cellular Subscriptions (per 100 people) | Data. (2016). Available online at: https://data.worldbank.org/indicator/IT.CEL.SETS.P2?end=2016&locations=NP-AF-MV-IN-BT-BD-LK-1W&start=2016&view=bar (accessed March 26, 2018).
30. NTA. MIS Report. Baishakh, 2075 (13 April, 2018−14 May 2018). Kathmandu. (2018). Available online at: https://nta.gov.np/wp-content/uploads/2018/06/Baisakh-2075.pdf (accessed June 29, 2018).
31. World Bank. Nepal | Total Population. (2017). Available online at: https://data.worldbank.org/country/nepal (accessed May 8, 2018).
32. Pandey S, Regmi N. Changing connectivities and renewed priorities: Status and challenges facing Nepali Internet. First Monday. (2018) 23:8071. doi: 10.5210/fm.v23i1.8071
33. OpenSignal. Coverage Maps - Nepal. (2018). Available online at: https://opensignal.com/networks (accessed June 30, 2018).
34. Piipuu M. The Mobile Phone In The Hands of The Nepalese People: A Humanistic Perspective of Technology. Tartu. (2017). Available online at: https://dspace.ut.ee/bitstream/handle/10062/55669/Merilin_Piipuu_Magistritoo_2017_vahendatud.pdf?sequence=5&isAllowed=y (accessed June 2, 2018).
35. Pachler N, Bachmair B, Cook J. Mobile Learning. Structures, Agency, Practices. London: Springer (2010). doi: 10.1007/978-1-4419-0585-7
36. Mccallum S. Gamification serious games for personalized health. In: Blobel B, Pharow P, Sousa F, editors. PHealth 2012 : proceedings of the 9th International Conference on Wearable Micro and Nano Technologies for Personalized Health. Porto: IOS Press (2012).
37. Marcolino MS, Oliveira JAQ, D'Agostino M, Ribeiro AL, Alkmim MBM, Novillo-Ortiz D. The impact of mHealth interventions: systematic review of systematic reviews. JMIR mHealth uHealth. (2018) 6:e23. doi: 10.2196/mhealth.8873
38. Urturi ZS, Zorrilla AM, Zapirain BG. Serious Game based on first aid education for individuals with Autism Spectrum Disorder (ASD) using android mobile devices. In: 2011 16th International Conference on Computer Games (CGAMES). IEEE (2011). doi: 10.1109/CGAMES.2011.6000343
39. Perry B. Gamifying French language learning: a case study examining a quest-based, augmented reality mobile learning-tool. Proc Soc Behav Sci. (2015) 174:2308–2315. doi: 10.1016/j.sbspro.2015.01.892
40. Lee LK, Chau CH, Chau CH, Ng CT. Using augmented reality to teach kindergarten students english vocabulary. in 2017 International Symposium on Educational Technology (ISET). IEEE (2017). doi: 10.1109/ISET.2017.20
41. Molnar A, Kostkova. On effective integration of educational content in serious games: text vs. game mechanics. In: 2013 IEEE 13th International Conference on Advanced Learning Technologies. IEEE (2013). doi: 10.1109/ICALT.2013.94
42. Orjuela MAV, Uribe-Quevedo A, Jaimes N, Perez-Gutierrez B. External automatic defibrillator game-based learning app. in 2015 IEEE Games Entertainment Media Conference (GEM). IEEE (2015). doi: 10.1109/GEM.2015.7377206
43. Guana V, Xiang T, Zhang H, Schepens E, Stroulia E. Under control an educational serious-game for reproductive health. In: Proceedings of the first ACM SIGCHI Annual Symposium on Computer-Human Interaction in Play. (2014). doi: 10.1145/2658537.2662983
44. Cook B, Twidle. Increasing awareness of Alzheimer's disease through a mobile game. In: 2016 International Conference on Interactive Technologies and Games (ITAG). IEEE (2016). doi: 10.1109/iTAG.2016.16
45. Molnar A, Kostkova P. Learning about hygiene and antibiotic resistance through mobile games evaluation of learning effectiveness. In: DH '18 Proceedings of the 2018 International Conference on Digital Health. New York, NY: ACM (2018), p. 95–9.
46. Sherwani Y, Muntasir M, Ahmed M, El-Hilly A, Iqbal S, Siddiqui S, et al. Smoking cessation using the gamification of mHealth apps: A longitudinal qualitative study. Eur Respir J. (2016) 48:3497. doi: 10.1183/13993003.congress-2016.OA3497
47. Miller AS, Cafazzo JA. A game plan: Gamification design principles in mHealth applications for chronic disease management. Health Inform J. (2016) 22:184–93. doi: 10.1177/1460458214537511
48. Pham Q, Khatib Y, Stansfeld S, Fox S, Green T. Feasibility and efficacy of an mhealth game for managing anxiety: “flowy” randomized controlled pilot trial and design evaluation. Games Health J. (2016) 5:50–67. doi: 10.1089/g4h.2015.0033
49. Lazareck LJ, Farrell D, Kostkova P, Lecky DM, McNulty CA, Weerasinghe D. Learning by gaming - evaluation of an online game for children. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology Society. (2010).
50. Farrell D, Kostkova P, Lecky D, McNulty C. Teaching children hygiene using problem based learning: The story telling approach to games based learning. In: Story-Telling and Educational Games. Aachen: CEUR Workshop Proceedings. (2009). Available online at: http://ceur-ws.org/Vol-498/ (accessed July 17, 2020).
51. Molnar A, Kostkova. If You Build It Would They Play? Challenges and Solutions in Adopting Health Games for Children. in. (2013). Available online at: https://www.researchgate.net/publication/250933047_If_you_build_it_would_they_play_Challenges_and_Solutionsin_Adopting_Health_Games_for_Children (accessed July 12, 2020).
52. Prinja S, Nimesh R, Gupta A, Bahuguna P, Thakur JS, Gupta M, et al. Impact assessment and cost-effectiveness of m-health application used by community health workers for maternal, newborn and child health care services in rural Uttar Pradesh, India: a study protocol. Glob Health Action. (2016) 9:31473. doi: 10.3402/gha.v9.31473
53. Hackett K, Lafleur C, Nyella P, Ginsburg O, Lou W, Sellen D. Impact of smartphone-assisted prenatal home visits on women's use of facility delivery: Results from a cluster-randomized trial in rural Tanzania. PLoS ONE. (2018) 13:199400. doi: 10.1371/journal.pone.0199400
54. Ilozumba O, Dieleman M, Van Belle S, Mukuru M, Bardaj, í A, Broerse JE. Multistakeholder perspectives on maternal text messaging intervention in Uganda: Qualitative study. J Med Internet Res. (2018) 20:9565. doi: 10.2196/mhealth.9565
55. Atnafu A. Assessment of voluntary community health workers participation and contribution in mHealth intervention. Ethiopian J Health Dev. (2015) 29:154–9.
56. Suleman Z. Journey of a Thousand Miles : Harnessing mobile communications technology to solve problems in maternal health and child mortality in Balochistan, Pakistan. IEEE Pulse. (2015) 6:28–31. doi: 10.1109/MPUL.2014.2366895
57. Shiferaw S, Spigt M, Tekie M, Abdullah M, Fantahun M, Dinant GJ. The effects of a locally developed mHealth intervention on delivery and postnatal care utilization; A prospective controlled evaluation among health centres in Ethiopia. PLoS ONE. (2016) 11:158600. doi: 10.1371/journal.pone.0158600
58. Ilozumba O, Dieleman M, Kraamwinkel N, Van Belle S, Chaudoury M, Broerse JE. I am not telling. the mobile is telling: Factors influencing the outcomes of a community health worker mHealth intervention in India. PLoS ONE. (2018) 13:194927. doi: 10.1371/journal.pone.0194927
59. Prakash V, Thukral A, Sankar MJ, Agarwal RK, Paul VK, Deorari AK. Efficacy and acceptability of an “app on sick newborn care” in physicians from newborn units. BMC Med Educ. (2016) 16:579. doi: 10.1186/s12909-016-0579-3
60. LeFevre AE, Mohan D, Hutchful D, Jennings L, Mehl G, Labrique A, et al. Mobile technology for community health in ghana: what happens when technical functionality threatens the effectiveness of digital health programs?. BMC Med Inform Decis Mak. (2017) 17:421. doi: 10.1186/s12911-017-0421-9
61. Perreira KM, Bailey E, de Bocaletti E, Hurtado E, de Villagrán SR, Matute J. Increasing awareness of danger signs in pregnancy through community- and clinic-based education in guatemala. Mater Child Health J. (2002) 6:19–28. doi: 10.1023/A:1014360015605
62. UNFPA Nepal. Health Minister Launches Mobile App to Promote Adolescent Sexual and Reproductive Health in Nepal. (2017). Available online at: http://nepal.unfpa.org/en/news/health-minister-launches-mobile-app-promote-adolescent-sexual-and-reproductive-health-nepal (accessed February 17, 2018).
63. Karmacharya PC, Singh GK, Singh MP, Gautam VG, Par A, Banskota AK, et al. Managing the injury burden in Nepal. Clin Orthop Relat Res. (2008) 466:2343–9. doi: 10.1007/s11999-008-0384-3
64. Paudel D, Ahmed M, Pradhan A, Dangol RL. Successful use of tablet personal computers and wireless technologies for the 2011 Nepal Demographic and Health Survey. Global Health Sci Pract. (2013) 1:277–84. doi: 10.9745/GHSP-D-12-00056
65. Pimmer C, Linxen S, Gröhbiel U, Jha AK, Burg G. Mobile learning in resource-constrained environments: A case study of medical education. Med Teach. (2013) 35:733454. doi: 10.3109/0142159X.2012.733454
66. Thapa A, KC B, Shakya B. Cost effective use of free-to-use apps in neurosurgery (FAN) in developing countries: from clinical decision making to educational courses, strengthening health care delivery. World Neurosurg. (2016) 95:270–5. doi: 10.1016/j.wneu.2016.08.001
67. Style S, Beard BJ, Harris-Fry H, Sengupta A, Jha S, Shrestha BP, et al. Experiences in running a complex electronic data capture system using mobile phones in a large-scale population trial in southern Nepal. Glob Health Action. (2017) 10:1330858. doi: 10.1080/16549716.2017.1330858
68. Sharma R, Harsha A, Acharya P, Okada E, Yangdol T, Bhatta S, et al. Pilot and Evaluation of the Feasibility of SafeSIM-a Mobile Technology Platform for Maternal Health Care Coordination in Nepal. Publication Timeline (2015).
69. Gupta S, Ranjit A, Shrestha R, Wong EG, Robinson WC, Shrestha S, et al. Surgical needs of Nepal: Pilot study of population based survey in pokhara, Nepal. World J Surg. (2014) 38:3041–6. doi: 10.1007/s00268-014-2753-2
70. Morrison JL, Shrestha NR, Hayes B, Zimmerman M. Mobile phone support for rural health workers in Nepal through “celemedicine. J Nepal Med Assoc. (2013) 52:538–42. doi: 10.31729/jnma.2287
71. Patterson V, Singh M, Rajbhandari H, Vishnubhatla S. Validation of a phone app for epilepsy diagnosis in India and Nepal. Seizure. (2015) 30:46–9. doi: 10.1016/j.seizure.2015.05.011
72. Pradhan S, Deshmukh A, Shrestha PG, Basnet P, Kandel RP, Lewallen S, et al. Prevalence of blindness and cataract surgical coverage in Narayani Zone, Nepal: A rapid assessment of avoidable blindness (RAAB) study. Br Jo Ophthalmol. (2018) 102:291–4. doi: 10.1136/bjophthalmol-2017-310716
73. Meyers DJ, Ozonoff A, Baruwal A, Pande S, Harsha A, Sharma R, et al. Combining healthcare-based and participatory approaches to surveillance: Trends in diarrheal and respiratory conditions collected by a mobile phone system by community health workers in Rural Nepal. PLoS ONE. (2016) 11:e0152738. doi: 10.1371/journal.pone.0152738
74. Oh DH, Dabbagh A, Goodson JL, Strebel PM, Thapa S, Giri JN, et al. Real-time monitoring of vaccination campaign performance using mobile phones - Nepal, 2016. MMWR Morb Mortal Wkly Rep. (2016) 65:1072–6. doi: 10.15585/mmwr.mm6539a5
75. Mueller S, Soriano D, Boscor A, Saville NM, Arjyal A, Baral S, et al. MANTRA: a serious game improving knowledge of maternal and neonatal health and geohazards in Nepal. Eur J Public Health. (2019) 29:329. doi: 10.1093/eurpub/ckz185.329
76. Soriano D, Arjyal A, Baral S, Boscor A, Mueller S, Hearn GJ, et al. Engaging pictograms! A methodology for graphic design in enhancing player engagement as applied to the design of a serious game for nepalese women with low literacy. In: ACM International Conference Proceeding Series. New York, NY, USA: Association for Computing Machinery (2018).
78. Shorey S, Yang YY, Dennis CL. A mobile health app-based postnatal educational program (home-but not alone): descriptive qualitative study. J Med Internet Res. (2018) 20:e119. doi: 10.2196/jmir.9188
79. Biernacki, Waldorf D. Snowball sampling: problems and techniques of chain referral sampling. Sociol Methods Res. (1981) 10:141–63. doi: 10.1177/004912418101000205
80. Mueller S, Soriano D, Boscor A, Saville NM, Arjyal A, Baral S, et al. MANTRA: Improving knowledge of maternal health, neonatal health, and geohazards in women in rural Nepal using a mobile serious game. Front Public Health. (2020) 8:584375. doi: 10.3389/fpubh.2020.584375
81. Bauer MW, Gaskell G. Qualitative Researching With Text, Image and Sound : A Practical Handjournal. London Sage (2000). doi: 10.4135/9781849209731
84. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. (2006) 3:77–101. doi: 10.1191/1478088706qp063oa
85. Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Evaluat. (2006) 27:237–46. doi: 10.1177/1098214005283748
86. Boyatzis RE. Transforming Qualitative Information : Thematic Analysis and Code Development. London: Sage Publications (1998).
87. Attride-Stirling J. Thematic networks: an analytic tool for qualitative research. Qual Res. (2001) 1:385–405. doi: 10.1177/146879410100100307
88. Mueller S, Stavrianaki K, Soriano D, Boscor A, Saville NM, Arjyal A, et al. 'MANTRA: the effectiveness of a serious game on user knowledge gain and retention assessed through game analytics data (in preparation).
89. Shabiralyani G, Hasan KS, Hamad N, Iqbal N. Impact of visual aids in enhancing the learning process case research. J Educ Pract. (2015) 6:2015.
90. Poudel, Carryer J. Girl-trafficking, HIV/AIDS, and the position of women in Nepal. Gender Dev. (2010) 8:74–79. doi: 10.1080/741923626
91. Parker SJ, Jessel S, Richardson JE, Reid MC. Older adults are mobile too! Identifying the barriers and facilitators to older adults' use of mHealth for pain management. BMC Geriatrics. (2013) 13:43. doi: 10.1186/1471-2318-13-43
92. Molnar A, Kostkova. Gaming to master the game - Game usability and game mechanics. In: 2014 IEEE 3rd International Conference on Serious Games and Applications for Health. IEEE. (2014). doi: 10.1109/SeGAH.2014.7067091
93. Puri M, Shah I, Tamang J. Exploring the nature and reasons for sexual violence within marriage among young women in Nepal. Article J Interp Viol. (2010) 25:1873–92. doi: 10.1177/0886260509354514
94. Michie S, Atkins L, West R. The Behaviour Change Wheel : A Guide to Designing Interventions. Great Britain: Silverback Publishing (2014).
95. Simkhada B, Porter MA, van Teijlingen ER. The role of mothers-in-law in antenatal care decision-making in Nepal: a qualitative study. BMC Preg hildbirth. (2010) 10:34. doi: 10.1186/1471-2393-10-34
Keywords: maternal health, neonatal health, mHealth, LMIC, educational game, knowledge gain, serious games
Citation: Kayastha R, Mueller S, Yadav P, Kelman I, Boscor A, Saville N, Arjyal A, Baral S, Fordham M, Hearn G and Kostkova P (2021) Do Women in Nepal Like Playing a Mobile Game? MANTRA: A Mobile Gamified App for Improving Healthcare Seeking Behavior in Rural Nepal. Front. Public Health 9:645837. doi: 10.3389/fpubh.2021.645837
Received: 24 December 2020; Accepted: 23 August 2021;
Published: 05 November 2021.
Edited by:
Ann Borda, The University of Melbourne, AustraliaReviewed by:
Mitsunori Ogihara, University of Miami, United StatesRobab Abdolkhani, The University of Melbourne, Australia
Nimesh Dhungana, London School of Economics and Political Science, United Kingdom
Copyright © 2021 Kayastha, Mueller, Yadav, Kelman, Boscor, Saville, Arjyal, Baral, Fordham, Hearn and Kostkova. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Sonja Mueller, sonja.mueller.14@alumni.ucl.ac.uk