PEERNaija: A Gamified mHealth Behavioral Intervention to Improve Adherence to Antiretroviral Treatment Among Adolescents and Young Adults in Nigeria

Background: HIV is the leading cause of death for youth in Sub-Saharan Africa (SSA). The rapid proliferation of smart phones in SSA provides an opportunity to leverage novel approaches to promote adherence to life-saving antiretroviral therapy (ART) for adolescents and young adults living with HIV (AYA-HIV) that go beyond simple medication reminders.

Methods: Guided by the Integrate, Design, Assess and Share (IDEAS) framework, our multidisciplinary team developed a peer-based mHealth ART adherence intervention—PEERNaija. Grounded in Social Cognitive Theory, and principles of contingency management and supportive accountability, PEERNaija delivers a multi-faceted behavioral intervention within a smartphone application to address important obstacles to adherence.

Results: PEERNaija was developed as a gamified Android-based mHealth application to support the behavioral change goal of improving ART adherence among AYA-HIV within Nigeria, a low- and middle- income country (LMIC). Identified via foundational interviews with the target population and review of the literature, key individual (forgetfulness and poor executive functioning), environmental (poor social support) and structural (indirect cost of clinic-based interventions) barriers to ART adherence for AYA-HIV informed application features. Further informed by established behavioral theories and principles, the intervention aimed to improve self-efficacy and self-regulation of AYA-HIV, leverage peer relationships among AYA to incentivize medication adherence (via contingency management, social accountability), provide peer social support through an app-based chat group, and allow for outreach of the provider team through the incorporation of a provider application. Gamification mechanics incorporated within PEERNaija include: points, progress bar, leaderboard with levels, achievements, badges, avatars and targeted behavior change messages. PEERNaija was designed as a tethered mobile personal health record application, sharing data to the widely deployed OpenMRS electronic health record application. It also uses the secure opensource Nakama gamification platform, in line with Principles of Digital Development that emphasize use of opensource systems within LMICs.

Conclusions: Theory-based gamified mHealth applications that incorporate social incentives have the potential to improve adherence to AYA-HIV. Ongoing evaluations of PEERNaija will provide important data for the potential role for a gamified, smartphones application to deliver multifaceted adherence interventions for vulnerable AYA-HIV in SSA.

Introduction

Antiretroviral therapy (ART) scale-up has led to unprecedented progress in the global AIDS response, but these gains have not fully benefited the four million adolescents and young adults (15–24 years) living with HIV (AYA-HIV) (1). This is especially true in Sub-Saharan Africa (SSA) where 85% of the world's AYA-HIV reside (1–3). Excellent adherence to ART (~>80–90%) is required to effectively treat HIV infection (4–6). However, as few as 40% of AYA-HIV who have started ART are adherent (1, 7). As a result, AYA-HIV show unacceptably high rates of virologic failure (30–50%) (4–6, 8). Poor adherence to life-saving ART is an important contributor to morbidity and mortality from HIV. Over the past decade, while HIV-related deaths decreased by 30% overall, HIV-related deaths among AYA increased by 50%, making HIV the leading cause of death among this population (1–3). These data underscore the urgent need to identify and evaluate interventions to improve medication adherence and HIV outcomes for AYA-HIV in SSA.

Studies of AYA living with HIV in SSA have identified a range of individual, environmental, structural, and treatment-related factors that impede medication adherence (9). At the individual level, “forgetting to take the dose” is identified as an adherence barrier in approximately 63% of patients (9). The seemingly simple act of forgetting may be driven by cognitive factors that result from complications of HIV infection and/or age-specific developmental factors (9). Youth with perinatal HIV infection, even when it is optimally treated, are at increased risk for cognitive dysfunction that may impede self-efficacy for disease management (10). In addition, adolescence itself is characterized by a developmental mismatch between limbic and pre-frontal cognitive functions leading to impulsivity, risk-taking, and poor concrete thinking that may also challenge the behaviors necessary to remain adherent to chronic medical therapies such as ART (5, 8, 11). Not surprisingly, being asleep (37%) or busy (25%) are also commonly cited as reasons for missing ART doses, but may also reflect the difficulty of organizing one's schedule and priorities to include disease management (10). AYA-HIV also describe a number of treatment-related barriers to adherence including pill burden, palatability, and fear of side effects which can unfortunately worsen if they are prescribed more complicated regimen to treat drug-resistant HIV that develops in response to poor adherence (5, 10).

Stigma–described as a discrediting “mark” that reduces the status of the person in the eyes of society–has been identified as a barrier to adherence among 40% of youth (10). Stigma may often push AYA-HIV into isolation with their disease and ultimately impede adherence to HIV care and treatment (12, 13). Social support is a critical environmental factor that can help to combat stigma and isolation for AYA-HIV (5, 12–15). Structural barriers to medication adherence identified by AYA-HIV include indirect costs of care (cost of travel to the clinic or pharmacy, lost wages incurred on clinical or drug pick-up days for the patient, and caregiver, etc.) (40%) (16, 17). These barriers may pose unique challenges for AYA-HIV who are often not fully autonomous nor financially self-sufficient and dependent on others for these resources (5).

The use of digital health solutions, especially medication reminders delivered via mobile health (mHealth) platforms, have shown promise as adherence support tools for people living with HIV in SSA (18–24). mHealth solutions are uniquely suited to tackle a range of psychosocial barriers by exploiting an ecological momentary approach (EMA), a framework for assessing behavior and delivering interventions to people as they go about their daily lives, in real-time and in real-world settings (25). However, most existing mHealth interventions for medication adherence that target patients within low- and middle- income countries (LMICs) rely solely on simple short message service (SMS)-based approaches (22, 26, 27). SMS reminders alone may not be sufficient to improve medication adherence for many AYA-HIV. The complex nature of the barriers to medication adherence for AYA-HIV suggest that successful adherence interventions may need to adopt a multi-faceted approach (27). Accordingly, a recent systematic review of adherence interventions for AYA-HIV in LMICs concluded that future interventions need to address broader psychosocial barriers for this vulnerable population (28). Few studies have investigated novel approaches such as the use of gamification, social incentives, and EMA interventions within smartphone-based behavioral interventions (29, 30). With rapid and exponential growth in usage of affordable smartphones in LMICs, and AYAs in these settings being early adopters of communication technologies, there is a unique opportunity to implement such innovative approaches (31).

In this paper, we describe the design and development of the PEERNaija smartphone application. Informed by TreatYourSelf , a smart phone-based application designed with input from AYA-HIV in Philadelphia, was created using an EMA for AYA-HIV in the United States (US), and has demonstrated feasibility and short-term (3 month) improvement in self-reported adherence (32–34). Key features of the guiding application include medication reminders and adherence tracking, refill and appointment reminders, leaderboard and adherence points, internal community supports through discussion forums, peer-to-peer kudos, and community-based resources list. Similarly, PEERNaija is a theory-driven and user-centered gamified smartphone application designed to improve medication adherence for AYA-HIV living in LMICs, with the application's initial implementation focused on Nigeria. We report on PEERNaija's development approach, the behavior change techniques incorporated, and the application's features and functionalities with emphasis on implemented gamification mechanics and social incentive features.

Materials and Methods

Objective

This project set out to develop a novel mHealth peer-based intervention that utilizes key behavioral interventions within a smartphone application to promote medication adherence for AYA-HIV living in LMICs. In addition to medication reminders, the proposed intervention aims to provide social support, integrate gamification strategies, and leverage the currency of social incentives to promote medication adherence among AYA-HIV.

Setting and Participants

The proposed solution targets AYA-HIV patients living in LMICs, with particular emphasis on AYA-HIV who have poor adherence to their ART medication. As a smartphone-based solution, users need to own or have access to a smartphone device. The initial implementation setting for the application was in Nigeria. Nigeria has had the highest annual incidence of perinatally infected children for the past seven years; 26.9% of all perinatally infected children worldwide (5, 35). Coupled with ongoing behavioral transmission, Nigeria, Africa's most populous nation, is home to 10% of the global population of AYA-HIV (36, 37). The target implementation site was the Nigerian Institute of Medical Research (NIMR) in Lagos. With a population of more than 13 million, Lagos is Nigeria's biggest city and one of the President's Emergency Plan for AIDS Relief (PEPFAR) priority states for effective ART scaleup (38). NIMR began providing HIV care in 2002 with support from the PEPFAR program. As of December 2020, NIMR had nearly 300 AYA enrolled in care.

PEERNaija Development Approach

The Integrate, Design, Assess and Share (IDEAS) framework was used to develop PEERNaija. IDEAS is a theory-based framework for designing and testing digital behavioral health interventions successfully employed in the US for patient-facing applications (39, 40). IDEAS is comprised of multiple steps, namely: empathize, specify, ground, ideate, prototype, gather, build, pilot, evaluate, and share (41). The development of PEERNaija as described in this paper involves the first seven steps, which focus on application development (Figure 1) (41). As outlined by Mummah et al. these seven steps can be described as follows:

FIGURE 1

Figure 1. Seven steps of the IDEAS framework employed in the development of PEERNaija.

“Empathize: gather qualitative insights from users (e.g., in-depth interviews, focus groups). Specify: translate broad behavioral goals into a highly specific target behavior, taking into consideration actionability, health impact, and user acceptability. Ground: ground intervention in behavioral theory and evidence and incorporate relevant behavioral strategies. Ideate: brainstorm creative strategies for translating theory and user insights into features, using inspiration from wide and varied sources. Prototype: develop rough prototypes of ideas rapidly and iteratively, sharing, discussing, and improving prototypes as a cross-sector team. Gather: gather user feedback on prototypes (e.g., interviews, questionnaires), and uncover insights to inform product improvement. Build: build a fully functional minimum viable product, and incorporate app analytics to collect data on app usage patterns (40).”

Due to constraints placed on in-person gatherings by the COVID-19 pandemic, the initial Gather phase relied on several key stakeholders, but not on end-users. The study team decided to proceed with stakeholder feedback to build the fully functional minimum viable app from which to gather detailed user feedback once in-person meetings were again permitted in Nigeria.

Results

Below, we report details of the PEERNaija development process, as well as the resulting product based on the IDEAS phases, with each phase used to inform the next step of the development process.

Phase 1: Empathize With Users

Research by Ahonkhai et al. with AYA-HIV in Nigeria, experience of Dowshen et al. in the development of the TreatYourSelf application (32–34) for AYA-HIV in the US, and data from systematic reviews highlighting barriers to medication adherence guided the Empathize phase of the development process (4–6, 8). Dr. Ahonkhai's preliminary quantitative data demonstrated that 40% of Nigerian AYA-HIV who remained in care 1 year after starting ART had virologic failure (HIV RNA > 1,000 copies/mL) (4). Further, in a multi-site study of adherence measured by medication possession ratio (MPR), which is the proportion of prescribed doses of ART picked up from the pharmacy, AYA-HIV with MPR > 94% had a marked reduction in the risk of virologic failure in the first year on ART compared to those with MPR <80% (aRR 0.43, p < 0.001) (15). Nonetheless, 26% of AYA-HIV with optimal adherence by MPR (>94%) still had virologic failure, highlighting discordance between ART pick-up from the pharmacy and ART taking behavior among some youth (15). These data underscored both the high prevalence of virologic failure and the need for adherence support measures to help AYA-HIV to take their medicines.

Qualitative insights into the needs and thought processes of AYA-HIV were gathered from formative, in-depth interviews from Nigerian AYA-HIV, as well as by Dowshen et al. through the development of the TreatYourSelf mHealth application (32–34). Ahonkhai conducted semi-structured in-depth interviews with 20 AYA-HIV at the study site, NIMR. Among them, 95% (n = 19) owned mobile phones, and 65% (n = 13) owned smart phones. Only one participant reported that his/her phone was shared, and 90% (n = 18) owned their own devices (Ahonkhai, personal communication, 2019). Most of those surveyed were frequent users of SMS/text messaging (80%, n = 16), WhatsApp (65%, n = 13), and social media platforms (55%, n = 11) (Ahonkhai, personal communication, 2019). Most youth (65%, n = 13) were not fully confident in their ability to remember to take a daily medicine and relied on daily reminders of some sort (parent or alarm most common). Indeed, half (n = 10) also reported missing medications at least once in the past 2 weeks. Thematic analysis revealed that interviewed youth were highly engaged with their mobile phones and interested in potential mobile phone-based strategies to help with adherence. They had not been exposed to adherence apps themselves but thought app-based reminders and peer social support would be important features of such an intervention. Further, through the conduct of formative participatory design workshops, the TreatYourSelf team identified five themes that were important to users: (1) positive and non-judgmental tone, (2) minimal, avatar-based gamification, (3) motivational messages, (4) non-disclosure through neutral signifiers, and (5) social support through camaraderie (32–34). All but one (theme 2) of these themes were supported by growing literature on SMS-based reminder interventions (26, 29, 30) and was consistent with the overall sentiments of Nigerian youth; thus, were incorporated into the PEERNaija prototype (32–34).

Integrating these quantitative and qualitative research experiences in Nigeria and the US with reviews of the literature led us to focus on an intervention package that would help to overcome the issue of forgetting to take medication (9). The intervention package would also provide critical social support (5, 12–15), while being very mindful not to magnify other barriers such as stigma (12, 13), and time/transportation/resources to travel to the clinic (16, 17).

Phase 2: Specify Target Behavior

We determined that the intervention would aim to target increased consumption of ART medication (or medication adherence) in AYA-HIV. Optimal adherence to ART is central to achieving the primary public health goal of HIV treatment—suppression of HIV replication below the limit of detection of commercially available assays (42). This goal is critical not only for the health of PLWH, but for the prevention of HIV transmission in the community (43). The level of medication adherence required to achieve viral suppression depends on a number of factors including the potency and durability of the ART regimen in addition to the amount of time on ART (44). Researchers have historically identified an adherence threshold of >94% as a gold standard for viral suppression, but more contemporary ART regimens may require less stringent adherence levels (80–90% or less) (44). However, the most contemporary regimens are still being scaled up in LMIC. Therefore, we will target traditional thresholds for ART adherence, namely optimal (>94%), suboptimal (80–94%), and poor (<80%) adherence based on existing literature associating with risk of virologic failure (45). Monthly adherence rates were calculated as follows: (number of doses reported within a 4-h window/number of doses * 100%).

Phase 3. Ground in Behavioral Theory

Our intervention approach is grounded in Bandura's (46, 47) Social Cognitive Therapy (SCT), and the foundational behavioral economics principle of incentivization of human behaviors (48). SCT explains health behaviors via their dynamic and reciprocal interaction between individuals and their environments. SCT supposes that behavior change is informed by an individual's knowledge, self-efficacy, outcome expectations (cost and benefit of health habits) and health goals (46, 47). Our intervention is designed to address both self-efficacy and outcome expectations. Medication reminders promote self-efficacy by enhancing self-regulation, while also overcoming cognitive barriers to adherence (e.g., forgetfulness). Bandura's SCT has been expanded to incorporate interactive media, such as digital health interventions, that exploit a key principle—that individuals learn from both direct experiences and social/observational modeling (by watching others) (46, 47). In this way, observing others who resemble us achieve desired outcomes can create outcome expectations. In addition to creating opportunities for social/observational modeling, mHealth interventions offer a unique form of interaction, motivation, and accountability for patients. In 2011, Mohr et al. developed a conceptual model, known as Supportive Accountability, to further characterize the relationship between adherence to mHealth interventions and human support using principles from organizational psychology, motivation theory, and computer-mediated communication (48). Mohr proposed that adherence behaviors are impacted by human support factors driven by bonds, accountability, and legitimacy of support and are moderated by both patient motivation and form of mHealth communication (48).

We have also incorporated additional behavioral economics principles that directly address outcome expectations through the use of peer-based social incentives. Attitudes and behaviors of AYA are strongly influenced by their peers (49, 50). Early research has primarily focused on the link between peer influence and undesirable behaviors, which are sometimes adopted and spread via social networks through a process coined social contagion (51, 52). Several studies however, highlight the important role of peer relationships on a range of desirable health and social behaviors (e.g., volunteerism) (53, 54). Peer relationships may influence behaviors through the exertion of descriptive norms (what is most commonly done, or what individuals perceive to be so) and injunctive norms (what ought to be done) for certain behaviors (55, 56). As such, peer acceptance and alignment with normative behavior may be a powerful social incentive to promote health behaviors in young people. Interventions have taken advantage of the power of social norms within AYA peer groups to address unhealthy behaviors such as excess alcohol consumption (57). Social incentivization is an important example of behavioral economics principles of contingency management. Incentives have been used widely to reward desired health behaviors (58). Conditional incentives for HIV treatment have been effective in small studies, with absolute increases in adherence ranging from 15 to 25% (59–61). Similar data are few in LMICs, and even fewer on the role of peer-driven social incentives, a highly innovative aspect of our intervention.

Phase 4. Ideate Creative Implementation Strategies

Based on insights gained from the intended target behavior (Phase 2) and the identified behavioral strategies to employ (Phase 3), the team comprised of experts in adolescent medicine, HIV medicine, epidemiology and implementation research, behavioral health, bioinformatics, and game design engaged in several group brainstorming sessions to Ideate on the proposed solution. This phase also included the software development team that was well-versed with product development. Requirement analysis revealed the need for an application focused on the following key features, namely: (a) provision of daily medication reminders, (b) recording of medication doses taken, (c) tracking of medication adherence in real-time, (d) comparing adherence performance of individuals relative to their peers, and with the desired normative behavior (social incentive), and (e) provision of social support through peer communication features.

Given that PEERNaija was to be used by patients to manage their care, it can be classified as a mobile personal health record (mPHR) application. PHRs are “electronic applications used by patients to maintain and manage their health information in a private, secure, and confidential environment (62).” Studies show that standalone PHRs, which are only used by individual patients without the data being shared to health professionals, are not as effective as when PHRs are tethered or connected to electronic health record system (EHRs) (tethered PHRs) (63–66). As such, it was decided that the PEERNaija application should be tethered to the opensource OpenMRS EHRs, which meant that patient-level data collected via PEERNaija app would be transmitted and availed to providers using the EHRs. OpenMRS was chosen given that it is the most widely-endorsed and used EHRs for HIV care in Nigeria and is also in use in over 50 other countries worldwide (67, 68). In addition, given the emphasis on open standards and open source applications for solutions within LMICs (as guided by the “Principles of Digital Development”) (69), we settled on the open source Nakama platform for the gamification components for the application (see Gamification server) (70).

Gamification is generally defined as the “use of game design elements in non-game contexts (71).” Gamification has been demonstrated to motivate behavior change and increase engagement in health care, and we utilized gamification strategies to deliver or enhance several core functions of the mPHR (72–75). Gamification strategies can influence behaviors by impacting both intrinsic and extrinsic motivation of individuals (76). Cugelman outlined seven core gamification ingredients that have clear linkages to behavior change strategies, namely: (1) Goal setting: commitment to achieving a goal; (2) Capacity to overcome challenges: growth, learning, development; (3) Providing feedback on performance: receiving constant feedback through experience; (4) Reinforcement: gaining rewards and avoiding punishments; (5) Compare progress: monitoring progress with self and others; (6) Social Connectivity: interacting with other people; and (7) Fun and playfulness: playing out an alternate reality (72). Others have additionally described immersion features such as avatars and virtual identity (77). Among the various gamification mechanics, leaderboards, points and badges make “the trinity” often seen as a base requirement in any gamified application (78). Which additional gamification mechanics to incorporate largely depends on their fit to support the targeted behavior change (77). Increasingly, research shows that incorporation of additional game elements leads to “great presence, enjoyment and effort [a proxy for motivation],” with most applications having an average of five gamification elements (79). Applying these ingredients within mHealth applications through the use of various gamification mechanics can motivate behavior change.

Phase 5: Prototype Potential Products

The project team engaged a User Interface (UI) and User Experience (UX) expert to develop various prototypes for the PEERNaija application. For this, we used the Adobe XD UI/UX design collaboration tool, with resulting storyboard shared, discussed and iteratively refined by the team (80). Further, the back-end server-side features connecting to both OpenMRS and Nakama servers were developed and tested. All features that had been identified in Phase 4: Ideate were also implemented. Technical aspects of the PEERNaija app development were informed by the Technology Acceptance Model (TAM) (81). Derived from social psychological theories of reasonable action and planned behavior, TAM posits that perceived usefulness and ease of use of new technologies mediate behavior intention, use and acceptance of the app. TAM will be used to predict PEERNaija use through routine collection of user feedback (assessing a variety of concepts including ease of use and acceptability) at each study encounter, and assessment of paradata (81). We thus emphasized approaches to improve engagement and acceptance of the PEERNaija app, focusing on easier onboarding, push notifications, personalized dashboards, and product iteration.

Phase 6: Gather User Feedback

We conducted two community engagement studio sessions to gather feedback on the first iteration of the PEERNaija application. Community engagement studios are dynamic, consultative sessions intended to elicit stakeholder input on the planning, design, implementation, translation, or dissemination of a program aimed at improving health related outcomes (82). The process is more deliberative than a focus group, and the participants are compensated as stakeholder “experts” (82). The first studio session included Children's Hospital of Philadelphia researchers who developed the TreatYourSelf mobile application for use among AYA-HIV in the US (32–34). For the second studio session, we invited key stakeholders who work with AYA-HIV in Nigeria including: (a) public health officials active in the oversight and administration of a network of HIV care and treatment centers, (b) pediatric and adolescent providers, and (c) adolescent HIV counselors. User feedback from the target audience was delayed due to constraints of the COVID-19 pandemic. As a result, the study team made a strategic decision to gather detailed user feedback on the initial viable product (after step 7) so that the target users could be convened in person to view and provide feedback on a functional prototype. Given that the participants have not been exposed to apps of this type, it was felt that this approach would give the target users a more nuanced understanding of the app features for which they could provide rich feedback.

Stakeholder feedback from these studio sessions was analyzed using content analysis and included recommendations to (1) develop a provider-facing application to allow for monitoring of individual-level user adherence, (2) moderate chat room content by using peer champion, (3) encourage appropriate chat remove behavior by adding a pop-up notification that reminds users of community guidelines prior to entering the chat room and removing the ability for users to upload photos, and (4) ensure user-specific feedback on presentation, colors, and text in the graphical display.

Phase 7: Build Minimum Viable Product

Based on user feedback, the developed prototype was further revised into a fully functional PEERNaija application. At this stage, several additional features were included, namely: (a) Avatars for use within the immersion feature, (b) logic to define reminders for medication, (c) on-boarding features to allow easy installation, setup and understanding of the application features, (d) application settings to allow changes in medication regimen, avatar, and user preferences on time to take medication. All gamification logic were also incorporated that defined how points accumulated within the application, rankings within leaderboards, and rules for fulfilling defined achievements within the application. Messages, information and feedback features were also programmed.

From feedback received, it was also deemed important to create an application for providers and program managers to give better insights into individual-level performance. While the providers could view clinical data through the EHRs, they needed to be able to see leaderboards, and to contact individuals privately through a chat feature who had poor adherence. These were incorporated within the provider application that allows providers to quickly identify patients who have not been adherent or engaged with the application.

Below, we provide details of the final viable PEERNaija product.

PEERNaija Application

The application was called “PEERNaija” to highlight the social and peer-based nature of its features, as well as to capture the location of its initial deployment in Nigeria. Key implemented features within the PEERNaija app include: (a) reminders for AYA-HIV to take medication, (b) ability to record doses taken, (c) chat-based social feature, and (d) several gamification features and mechanics, including points, progress feedback, leaderboards, badges, and avatars. These features were incorporated to align with several behavioral change techniques targeted for AYA-HIV (Table 1).

TABLE 1

Table 1. Summary of behavior change techniques utilized to deliver intervention components in PEERNaija that address key adherence obstacles.

PEERNaija Application Architecture

Figure 2 provides the overall architecture of the developed PEERNaija application. The application has three main components including an electronic medical record system component, gamification server, and the smartphone-based mobile application.

FIGURE 2

Figure 2. PEERNaija architecture.

Health information exchange between PEERNaija and OpenMRS is achieved through the use of terminologies, location, provider, and patient identifier information that are shared between the two systems, as well as a Representational State Transfer (REST)-application programming interface (API) (83). The clinical data collected through PEERNaija are synchronized back into OpenMRS in real-time or on-demand with the NigeriaEMR OpenMRS distribution (84). With this approach, PEERNaija avoids being a siloed system, with the data available for decision making to providers who have access to the linked OpenMRS implementation.

EMR Interoperability

PEERNaija was developed as a tethered PHR (see Phase 4 above for additional description). Data collected includes medication regimen options and medication update records as entered by the patient on the mobile application. Data interface with the OpenMRS based EMRS is protected over a transport layer security (TSL) connection and with a firewall.

Gamification Server

PEERNaija uses the open source Nakama game server for its gamification functionality (Apache 2.0 license) (70). The Nakama platform was chosen given its broad use and its inclusion of required gamification features, user account management and reliable messaging functionality. Unlike other options, Nakama allowed the project to install its own dedicated gamification server, with no data being shared to any third party, hence ensuring security and confidentiality. Nakama server is developed in GoLang, the Google supported programming language optimized for building gaming applications (85). For its backend database, Nakama utilizes CoackroachDB (86). Nakama ships with its own inbuilt web server simplifying its implementation and management.

PEERNaija Mobile Application Description

PEERNaija was developed as Android application, recognizing that in Africa over 85% of smartphones use the Android operating system (87). On installation, the user is taken through several onboarding screens to familiarize them with how to use the application. They are then provided with the application Terms & Conditions, Privacy Notice, and Community Guidelines to which they have to agree. After this the user can then create an individualized profile, which includes: (a) selecting their preferred avatar and nickname for their immersion experience, (b) choosing their ART medication regimen from a pre-selected list (that can be validated by the provider), (c) selecting preferred times for medication reminders, and (d) creating a preferred reminder message, with several choices also availed (Figures 3.1–3.8). Profile features can be changed at any time through the Settings side-bar menu.

FIGURE 3

Figure 3. (3.1–3.8) PEERNaija application user interfaces.

A username and password, which are initially authenticated against the EMRs, are required for access to the PEERNaija mobile application. Once the user profile is set, the user is taken to the home screen that will be the landing page for all subsequent logins (Figure 3.1). This home screen is a personalized dashboard that includes several features, namely: (a) a welcome and notification area–used to provide informative, evaluative and comparative feedback to the user in a culturally- and age-appropriate language, (b) points display–indicating the number of points earned by the individual from taking their medication, (c) a progress bar that indicates the individual medication adherence level, (d) Recent medication doses taken–a color-coded summary of the individual's medication doses recorded for the week, (e) rank–a snapshot of the individual's position in the leaderboard. From the home screen, users can access detailed information on their monthly intake (Figure 3.3), and of the full leaderboard (Figure 3.4). The application also contains a Tab bar menu at the bottom, that allows access to Achievements, the peer-based Chat functionality, and a Consult feature where the individual can contact a care provider privately and securely.

PEERNaija is programmed to always run in the background when the phone is on. Its key feature includes a notification to the AYA-HIV on when their next dose is due (Figure 3.5). Notifications are programmed to appear as reminder message within an hour of the medication being due, with subsequent reminder messages showing up to 4 h after the due period. How the notifications appear depend on preferences and functionality for notifications with the device in use.

PEERNaija Gamification Features

Medication Reminders

Medication reminders are based on the preferred time for taking medications that had been selected by the patient during setup. Medication reminder messages are programmed to first appear 30-min before the scheduled medication was due. If no action is taken, the reminder appears again when the medication is due, and every hour up to 4 h after the medication due time. Reminder messages can be customized or selected from PEERNaija provided cultural- and age-appropriate reminder choices. Examples of these reminder messages are provided in Table 2.

TABLE 2

Table 2. Sample achievement and normative-based messages used in PEERNaija.

Points

PEERNaija app users accumulate points based on taking and recording their medication within 4 h of the scheduled time. Value of points and activities deserving of points were determined with user input. If all daily medication doses are appropriately taken/recorded the user earns 10 points. However, no points are awarded if the user records the medication more than 4 h after the due time. To facilitate competition and to avoid discouraging individuals, point accumulation started afresh each month.

Leaderboards and Levels

Leaderboards and levels serve to provide extrinsic incentives (88), and as progress indicators that can motivate performance (89). Within PEERNaija, we settled on three leaderboard levels that signified top, medium and bottom tiers. Individuals are ranked based on the points accumulated and adherence rates for the month. An adherence score of above 94% is considered optimal, whereas a rate between 80 and 94% is considered suboptimal and a rate <80% is considered poor. Individuals with the same number of points are given the same rank and listed in the chronological order in which they achieved those points.

Progress Bar

The progress bar within PEERNaija was used as an indicator of the medication adherence and showed the number of points earned thus far. The progress bar resets on a monthly basis.

Achievements and Badges

Specific achievements can be unlocked in PEERNaija and are described in Table 2. On unlocking an achievement, the AYA-HIV received a badge and a congratulatory message. By their very nature, adherence-related achievements become unlocked in a stepwise fashion based on the number of days of perfect adherence. These achievements reset every month.

Avatars

PEERNaija users an select an avatar from a set of 180 culturally-sensitive and age-appropriate Avatars. These Avatars were selected after review by peer consultants. Display of the avatar for various users was randomized to reduce congregation toward the same avatars. For the purposes of the pilot implementation, once a user selects an Avatar, it is no longer available for selection by others.

Group Based-Chat

Nakama's group-based chat feature was implemented to allow users to communicate as peers. The users are required to consent to follow community rules for chatting. Users also receive notification reading, “reminder to adhere to the community guidelines,” that appeared for 15 s prior to ever entering the chatroom. To protect identities, only Avatars and nicknames appear in chats. Though Emoji use is allowed, we disabled features for making voice or video calls and for uploading media within the chat forum based on stakeholder feedback.

Messaging for Behavior Change

Informed by lessons around normative messaging for behavior change, our team developed and implemented culturally- and age-appropriate relevant messages to the implementation context (Table 2). These messages are displayed when particular criteria for the user relative to the group as illustrated in Table 2.

Discussion

ART adherence is central to effective HIV treatment, but AYA have high rates of virologic failure, virologic rebound after initial suppression, and attrition from HIV care. Complications from perinatal HIV infection and unique developmental features of adolescence and young adulthood make daily medication adherence even more challenging in this population. We utilized the IDEAS framework (41) to build on experience from the TreatYourSelf application (32–34) to develop PEERNaija, a theory-driven mHealth intervention aimed at improving medication adherence for AYA-HIV in LMIC settings. Grounded in Social Cognitive Theory, behavioral economics and principles of contingency management, PEERNaija employs several behavior change techniques to address common individual, environmental, and structural barriers to medication adherence identified by AYA-HIV including forgetfulness (9) and poor executive functioning (5, 8, 11), poor social support (5, 12–15), and nascent financial autonomy (5) making some clinic-based interventions less desirable. As its name suggests, PEERNaija also uniquely leverages the importance of peer relationships among AYA to incentivize medication adherence.

Two-way medication reminders are a critical component of this intervention. Indeed, while data suggest that daily, interactive text messages may be effective for AYA-HIV, such data are limited in LMIC and are limited primarily to SMS-based reminders (22, 26). In addition, further contextualization of the barriers to ART adherence for AYA-HIV suggest that medication reminders alone would leave other important barriers unaddressed. To our knowledge, despite the robust field of behavioral economics, there is very limited data exploring the role of social incentivization as a behavioral change technique. One pilot SMS-based intervention for AYA-HIV in Uganda found that youth who received information about their adherence scores relative to their peers showed improved adherence relative to standard of care, highlighting the promise of this approach (30). However, our app-based approach allows for versatility to adopt a multifaceted approach to behavior change, while also enabling the provider team to escalate outreach based on information collected by the app.

We have integrated several gamification approaches, described by Cugelman (72), to motivate both the adherence behavior itself and engagement with the application-based intervention. Despite the promise of mHealth-based approaches, application attrition and habituation are important obstacles (90). As such, we employed goal setting (leaderboard/levels and progress bar), capacity to overcome challenges (achievements and badges), provision of feedback on performance (leaderboard/levels, progress bar, and messaging for behavior change), reinforcement of behavior goals (leaderboard/levels, progress bar, and messaging for behavior change), and comparison of progress toward behavior goals (leaderboard/levels and progress bar). Fun and playfulness are promoted through the use of avatars and a point-based reward system. Social connectivity is another gamification approach that may be of particular importance for AYA-HIV. Lack of social support is a common obstacle to adherence, and fear of stigma and unwanted disclosure can further promote social exclusion and isolation from other potential sources of support (5, 12–15). PEERNaija provides a virtual, anonymous, peer-based social support group that may address an important need for social support, along with social accountability. This is especially important in a region where limited clinic-based outreach and largely unavailable adolescent-focused clinical services threaten adherence (9).

As a next step, we plan to gather detailed user feedback, conduct formal usability, acceptability, and feasibility testing of PEERNaija with AYA-HIV in Nigeria. We plan to evaluate this intervention among AYA-HIV in Nigeria using a pilot randomized controlled trial design. This pilot trial will focus on feasibility and acceptability, but will also allow us to identify characteristics of high and/or low utilization of various app components. Our study protocol also calls for direct outreach (phone then escalating to home-based outreach as needed) among participants who appear to be non-adherent to ART during our ecological assessments of adherence. We will also gather important information on potential implementation barriers such as cost (from the patient and provider perspectives), time, human resource, and structural needs (from the health system and patient perspectives) by tallying intervention costs and conducting FGDs with stakeholder groups at study conclusion. While we do not anticipate that this approach will be a “silver bullet” for all AYA-HIV, this work will provide important data for the potential role for a gamified smartphone application to deliver a multifaceted adherence interventions, along with essential peer support for vulnerable AYA-HIV in LMIC.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Author Contributions

Material preparation and data collection were performed by AA, LP, AN, AD, II, and MW. SM, BW, SO, and MW developed the mHealth application. The first draft of the manuscript was written by AA, LP, and MW. All authors contributed to the study conception and design, editing, revising the manuscript, and approved the final manuscript.

Funding

The data in this manuscript have been supported by the Fogarty International Center (R21-TW011327). AA also received support from NIH/NIDA R25MH080665.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Idele P, Gillespie A, Porth T, Suzuki C, Mahy M, Kasedde S, et al. Epidemiology of HIV and AIDS among adolescents: current status, inequities, and data gaps. J Acquir Immune Defic Syndr. (2014) 66 (Suppl. 2):S144–53. doi: 10.1097/QAI.0000000000000176

PubMed Abstract | CrossRef Full Text | Google Scholar

2. WHO. Health for the World's Adolescents: A Second Chance in the Second Decade. World Health Organization (2014). Available online at: https://www.who.int/maternal_child_adolescent/documents/second-decade/en/ (accessed January 13, 2021).

Google Scholar

3. WHO. Adolescents: Health Risks and Solutions (2018). Available online at: https://www.who.int/news-room/fact-sheets/detail/adolescents-health-risks-and-solutions (accessed January 13, 2021).

4. Ahonkhai AA, Banigbe B, Adeola J, Adegoke AB, Regan S, Bassett IV, et al. Age matters: increased risk of inconsistent HIV care and viremia among adolescents and young adults on antiretroviral therapy in Nigeria. J Adolesc Health. (2016) 59:298–304. doi: 10.1016/j.jadohealth.2016.05.002

PubMed Abstract | CrossRef Full Text | Google Scholar

5. Lowenthal ED, Bakeera-Kitaka S, Marukutira T, Chapman J, Goldrath K, Ferrand RA. Perinatally acquired HIV infection in adolescents from Sub-Saharan Africa: a review of emerging challenges. Lancet Infect Dis. (2014) 14:627–39. doi: 10.1016/S1473-3099(13)70363-3

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Auld AF, Agolory SG, Shiraishi RW, Wabwire-Mangen F, Kwesigabo G, Mulenga M, et al. Antiretroviral therapy enrollment characteristics and outcomes among HIV-infected adolescents and young adults compared with older adults–seven African countries, 2004-2013. MMWR Morb Mortal Wkly Rep. (2014) 63:1097–103.

PubMed Abstract | Google Scholar

7. Kim S-H, Gerver SM, Fidler S, Ward H. Adherence to antiretroviral therapy in adolescents living with HIV: systematic review and meta-analysis. AIDS. (2014) 28:1945–56. doi: 10.1097/QAD.0000000000000316

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Agwu AL, Siberry GK, Ellen J, Fleishman JA, Rutstein R, Gaur AH, et al. Predictors of highly active antiretroviral therapy utilization for behaviorally HIV-1-infected youth: impact of adult versus pediatric clinical care site. J Adolesc Health. (2012) 50:471–7. doi: 10.1016/j.jadohealth.2011.09.001

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Adejumo OA, Malee KM, Ryscavage P, Hunter SJ, Taiwo BO. Contemporary issues on the epidemiology and antiretroviral adherence of HIV-infected adolescents in sub-Saharan Africa: a narrative review. J Int AIDS Soc. (2015) 18:20049. doi: 10.7448/IAS.18.1.20049

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Shubber Z, Mills EJ, Nachega JB, Vreeman R, Freitas M, Bock P, et al. Patient-reported barriers to adherence to antiretroviral therapy: a systematic review and meta-analysis. PLOS Med. (2016) 13:e1002183. doi: 10.1371/journal.pmed.1002183

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Murphy DA, Wilson CM, Durako SJ, Muenz LR, Belzer M, Adolescent Medicine HIV/AIDS Research Network. Antiretroviral medication adherence among the REACH HIV-infected adolescent cohort in the USA. AIDS Care. (2001) 13:27–40. doi: 10.1080/09540120020018161

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Inzaule SC, Hamers RL, Kityo C, Wit TFR, Roura M. Long-term antiretroviral treatment adherence in hiv-infected adolescents and adults in uganda: A qualitative study. PLoS ONE. (2016) 11:e0167492. doi: 10.1371/journal.pone.0167492

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Nabukeera-Barungi N, Elyanu P, Asire B, Katureebe C, Lukabwe I, Namusoke E, et al. Adherence to antiretroviral therapy and retention in care for adolescents living with HIV from 10 districts in Uganda. BMC Infect Dis. (2015) 15:520. doi: 10.1186/s12879-015-1265-5

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Biadgilign S, Deribew A, Amberbir A, Deribe K. Barriers and facilitators to antiretroviral medication adherence among HIV-infected paediatric patients in Ethiopia: a qualitative study. SAHARA J. (2009) 6:148–54. doi: 10.1080/17290376.2009.9724943

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Ahonkhai AA, Banigbe B, Adeola J, Bassett IV, Idigbe I, Okonkwo P, et al. High medication possession ratios associated with greater risk of virologic failure among youth compared to adults in a Nigerian cohort. J Acquir Immune Defic Syndr. (2018) 78:322–8. doi: 10.1097/QAI.0000000000001670

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Emenyonu N, Muyindike W, Habayarimana J, Pops-Eleches C, Thirumurthy N, Ragland K. Cash transfers to cover clinic transportation costs improve adherence and retention in care in a HIV treatment program in rural Uganda. ScienceOpen. (2012). Available online at: https://www.scienceopen.com/document?vid=56318b1a-d178-45d0-bc63-cafca64531d8 (accessed January 13, 2021).

Google Scholar

17. Tuller DM, Bangsberg DR, Senkungu J, Ware NC, Emenyonu N, Weiser SD. Transportation costs impede sustained adherence and access to HAART in a clinic population in southwestern Uganda: a qualitative study. AIDS Behav. (2010) 14:778–84. doi: 10.1007/s10461-009-9533-2

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Simoni JM, Pearson CR, Pantalone DW, Marks G, Crepaz N. Efficacy of interventions in improving highly active antiretroviral therapy adherence and HIV-1 RNA viral load. A meta-analytic review of randomized controlled trials. J Acquir Immune Defic Syndr. (2006) 43 (Suppl. 1):S23–35. doi: 10.1097/01.qai.0000248342.05438.52

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Chaiyachati KH, Ogbuoji O, Price M, Suthar AB, Negussie EK, Bärnighausen T. Interventions to improve adherence to antiretroviral therapy: a rapid systematic review. AIDS. (2014) 28 (Suppl. 2):S187–204. doi: 10.1097/QAD.0000000000000252

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Thakkar J, Kurup R, Laba T-L, Santo K, Thiagalingam A, Rodgers A, et al. Mobile telephone text messaging for medication adherence in chronic disease: a meta-analysis. JAMA Intern Med. (2016) 176:340–9. doi: 10.1001/jamainternmed.2015.7667

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Mbuagbaw L, Thabane L, Ongolo-Zogo P, Lester RT, Mills EJ, Smieja M, et al. The cameroon mobile phone SMS (CAMPS) trial: a randomized trial of text messaging versus usual care for adherence to antiretroviral therapy. PLoS ONE. (2012) 7:e46909. doi: 10.1371/journal.pone.0046909

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Pop-Eleches C, Thirumurthy H, Habyarimana JP, Zivin JG, Goldstein MP, de Walque D, et al. Mobile phone technologies improve adherence to antiretroviral treatment in a resource-limited setting: a randomized controlled trial of text message reminders. AIDS. (2011) 25:825–34. doi: 10.1097/QAD.0b013e32834380c1

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Linnemayr S, Huang H, Luoto J, Kambugu A, Thirumurthy H, Haberer JE, et al. Text messaging for improving antiretroviral therapy adherence: no effects after 1 year in a randomized controlled trial among adolescents and young adults. Am J Public Health. (2017) 107:1944–50. doi: 10.2105/AJPH.2017.304089

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Reid MJA, Steenhoff AP, Thompson J, Gabaitiri L, Cary MS, Steele K, et al. Evaluation of the effect of cellular SMS reminders on consistency of antiretroviral therapy pharmacy pickups in HIV-infected adults in botswana: a randomized controlled trial. Health Psychol Behav Med. (2017) 5:101–9. doi: 10.1080/21642850.2016.1271333

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Heron KE, Smyth JM. Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. Br J Health Psychol. (2010) 15:1–39. doi: 10.1348/135910709X466063

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Demena BA, Artavia-Mora L, Ouedraogo D, Thiombiano BA, Wagner N. A systematic review of mobile phone interventions (SMS/IVR/calls) to improve adherence and retention to antiretroviral treatment in low-and middle-income countries. AIDS Patient Care STDS. (2020) 34:59–71. doi: 10.1089/apc.2019.0181

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Ridgeway K, Dulli LS, Murray KR, Silverstein H, Dal Santo L, Olsen P, et al. Interventions to improve antiretroviral therapy adherence among adolescents in low- and middle-income countries: a systematic review of the literature. PLoS ONE. (2018) 13:e0189770. doi: 10.1371/journal.pone.0189770

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Casale M, Carlqvist A, Cluver L. Recent interventions to improve retention in HIV care and adherence to antiretroviral treatment among adolescents and youth: a systematic review. AIDS Patient Care STDS. (2019) 33:237–52. doi: 10.1089/apc.2018.0320

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Linnemayr S, Stecher C, Saya U, MacCarthy S, Wagner Z, Jennings L, et al. Behavioral economics incentives to support HIV treatment adherence (BEST): protocol for a randomized controlled trial in Uganda. Trials. (2020) 21:9. doi: 10.1186/s13063-019-3795-4

PubMed Abstract | CrossRef Full Text | Google Scholar

30. MacCarthy S, Wagner Z, Mendoza-Graf A, Gutierrez CI, Samba C, Birungi J, et al. A randomized controlled trial study of the acceptability, feasibility, and preliminary impact of SITA (SMS as an incentive to adhere): a mobile technology-based intervention informed by behavioral economics to improve ART adherence among youth in Uganda. BMC Infect Dis. (2020) 20:173. doi: 10.1186/s12879-020-4896-0

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Sawyer SM, Afifi RA, Bearinger LH, Blakemore S-J, Dick B, Ezeh AC, et al. Adolescence: a foundation for future health. Lancet. (2012) 379:1630–40. doi: 10.1016/S0140-6736(12)60072-5

CrossRef Full Text | Google Scholar

32. Dowshen N, Lee S, Min J, Lalley-Chareczko L, Koenig H. 250 A medication adherence and engagement in care mobile application for youth living with HIV: usage and feasibility. J Adolesc Health. (2020) 66: S126–7. doi: 10.1016/j.jadohealth.2019.11.253

CrossRef Full Text | Google Scholar

33. Lee SS, Jacinto S, Costanzo S, Marcu G, Koenig H, Dowshen N. 15 positively connected for health (PC4H): acceptability and feasibility of a digital health adherence and engagement in care intervention for adolescents and young adults living with HIV. J Adolesc Health. (2019) 64:S8. doi: 10.1016/j.jadohealth.2018.10.029

CrossRef Full Text | Google Scholar

34. Marcu G, Dowshen N, Saha S, Sarreal RR, Andalibi N. TreatYoSelf: empathy-driven behavioral intervention for marginalized youth living with HIV, in Proceedings of the 10th EAI International Conference on Pervasive Computing Technologies for Healthcare. Brussels: ICST (2016). p. 69–76. doi: 10.4108/eai.16-5-2016.2263336

CrossRef Full Text | Google Scholar

35. UNAIDS. Start Free, Stay Free, AIDS Free: 2017 Progress Report Available Online at: https://www.unaids.org/sites/default/files/media_asset/JC2923_SFSFAF_2017progressreport_en.pdf

36. UNAIDS. 2015 Progress Report on the Global Plan Towards the Elimination of New HIV Infections Among Children and Keeping Their Mothers Alive (2015). Available online at: https://www.unaids.org/en/resources/documents/2015/JC2774_2015ProgressReport_GlobalPlan (accessed June 10, 2018).

37. UNAIDS. All in to #EndAdolescentAIDS. (2015). Available online at: https://www.unaids.org/en/resources/documents/2015/20150217_ALL_IN_brochure (accessed August 11, 2018).

38. PEPFAR. Nigeria Country Operational Plan (cop) 2019: Strategic Direction Summary (2019). Available online at: https://www.state.gov/wp-content/uploads/2019/09/Nigeria_COP19-Strategic-Directional-Summary_public.pdf

Google Scholar

39. Fedele DA, McConville A, Moon J, Thomas JG. Topical review: design considerations when creating pediatric mobile health interventions: applying the IDEAS framework. J Pediatr Psychol. (2019) 44:343–8. doi: 10.1093/jpepsy/jsy084

PubMed Abstract | CrossRef Full Text | Google Scholar

40. Mummah SA, King AC, Gardner CD, Sutton S. Iterative development of Vegethon: a theory-based mobile app intervention to increase vegetable consumption. Int J Behav Nutr Phys Activ. (2016) 13:90. doi: 10.1186/s12966-016-0400-z

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Mummah SA, Robinson TN, King AC, Gardner CD, Sutton S. IDEAS (integrate, design, assess, and share): a framework and toolkit of strategies for the development of more effective digital interventions to change health behavior. J Med Internet Res. (2016) 18:e317. doi: 10.2196/jmir.5927

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Cohen MS, Chen YQ, McCauley M, Gamble T, Hosseinipour MC, Kumarasamy N, et al. Prevention of HIV-1 infection with early antiretroviral therapy. N Engl J Med. (2011) 365:493–505. doi: 10.1056/NEJMc1110588

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Eisinger RW, Dieffenbach CW, Fauci AS. HIV viral load and transmissibility of HIV infection: undetectable equals untransmittable. JAMA. (2019) 321:451–2. doi: 10.1001/jama.2018.21167

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Paterson DL, Swindells S, Mohr J, Brester M, Vergis EN, Squier C, et al. Adherence to protease inhibitor therapy and outcomes in patients with HIV infection. Ann Intern Med. (2000) 133:21–30. doi: 10.7326/0003-4819-133-1-200007040-00004

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Messou E, Chaix M-L, Gabillard D, Minga A, Losina E, Yapo V, et al. Association between medication possession ratio, virologic failure and drug resistance in HIV-1-infected adults on antiretroviral therapy in Côte d'Ivoire. J Acquir Immune Defic Syndr. (2011) 56:356–64. doi: 10.1097/QAI.0b013e3182084b5a

PubMed Abstract | CrossRef Full Text | Google Scholar

46. Bandura A. The anatomy of stages of change. Am J Health Promot. (1997) 12:8–10. doi: 10.4278/0890-1171-12.1.8

CrossRef Full Text | Google Scholar

47. Bandura A. Health promotion by social cognitive means. Health Educ Behav. (2004) 31:143–64. doi: 10.1177/1090198104263660

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Mohr DC, Cuijpers P, Lehman K. Supportive accountability: a model for providing human support to enhance adherence to eHealth interventions. J Med Internet Res. (2011) 13:e30. doi: 10.2196/jmir.1602

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Brechwald WA, Prinstein MJ. Beyond homophily: a decade of advances in understanding peer influence processes. J Res Adolesc. (2011) 21:166–79. doi: 10.1111/j.1532-7795.2010.00721.x

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Prinstein MJ, Brechwald WA, Cohen GL. Susceptibility to peer influence: using a performance-based measure to identify adolescent males at heightened risk for deviant peer socialization. Dev Psychol. (2011) 47:1167–72. doi: 10.1037/a0023274

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Hill EM, Griffiths FE, House T. Spreading of healthy mood in adolescent social networks. Proc R Soc B Biol Sci. (2015) 282:20151180. doi: 10.1098/rspb.2015.1180

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Kramer ADI, Guillory JE, Hancock JT. Experimental evidence of massive-scale emotional contagion through social networks. PNAS. (2014) 111:8788–90. doi: 10.1073/pnas.1320040111

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Umberson D, Montez JK. Social relationships and health: a flashpoint for health policy. J Health Soc Behav. (2010) 51:S54–66. doi: 10.1177/0022146510383501

PubMed Abstract | CrossRef Full Text | Google Scholar

54. Choukas-Bradley S, Giletta M, Cohen GL, Prinstein MJ. Peer influence, peer status, and prosocial behavior: an experimental investigation of peer socialization of adolescents' intentions to volunteer. J Youth Adolesc. (2015) 44:2197–210. doi: 10.1007/s10964-015-0373-2

PubMed Abstract | CrossRef Full Text | Google Scholar

55. Schultz PW, Nolan JM, Cialdini RB, Goldstein NJ, Griskevicius V. The constructive, destructive, and reconstructive power of social norms. Psychol Sci. (2007) 18:429–34. doi: 10.1111/j.1467-9280.2007.01917.x

PubMed Abstract | CrossRef Full Text | Google Scholar

56. Borsari B, Carey KB. Descriptive and injunctive norms in college drinking: a meta-analytic integration. J Stud Alcohol. (2003) 64:331–41. doi: 10.15288/jsa.2003.64.331

PubMed Abstract | CrossRef Full Text | Google Scholar

57. Faggiano F, Galanti MR, Bohrn K, Burkhart G, Vigna-Taglianti F, Cuomo L, et al. The effectiveness of a school-based substance abuse prevention program: EU-Dap cluster randomised controlled trial. Prevent Med. (2008) 47:537–43. doi: 10.1016/j.ypmed.2008.06.018

PubMed Abstract | CrossRef Full Text | Google Scholar

58. Volpp KG, John LK, Troxel AB, Norton L, Fassbender J, Loewenstein G. Financial incentive-based approaches for weight loss: a randomized trial. JAMA. (2008) 300:2631–7. doi: 10.1001/jama.2008.804

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Galárraga O, Genberg BL, Martin RA, Barton Laws M, Wilson IB. Conditional economic incentives to improve HIV treatment adherence: literature review and theoretical considerations. AIDS Behav. (2013) 17:2283–92. doi: 10.1007/s10461-013-0415-2

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Sorensen JL, Haug NA, Delucchi KL, Gruber V, Kletter E, Batki SL, et al. Voucher reinforcement improves medication adherence in HIV-positive methadone patients: a randomized trial. Drug Alcohol Depend. (2007) 88:54–63. doi: 10.1016/j.drugalcdep.2006.09.019

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Javanbakht M, Prosser P, Grimes T, Weinstein M, Farthing C. Efficacy of an individualized adherence support program with contingent reinforcement among nonadherent HIV-positive patients: results from a randomized trial. J Int Assoc Phys AIDS Care. (2006) 5:143–50. doi: 10.1177/1545109706291706

PubMed Abstract | CrossRef Full Text | Google Scholar

62. HealthIT.gov. What is a Personal Health Record? HealthIT.gov. Available online at: https://www.healthit.gov/faq/what-personal-health-record-0 (accessed January 13, 2021).

63. Bouayad L, Ialynytchev A, Padmanabhan B. Patient health record systems scope and functionalities: literature review and future directions. J Med Internet Res. (2017) 19:e388. doi: 10.2196/jmir.8073

PubMed Abstract | CrossRef Full Text | Google Scholar

64. Vydra TP, Cuaresma E, Kretovics M, Bose-Brill S. Diffusion and use of tethered personal health records in primary care. Perspect Health Inf Manag. (2015) 12:1c.

PubMed Abstract | Google Scholar

65. Kalra D, Fernando B. A review of the empirical evidence of the healthcare benefits of personal health records. Yearb Med Inform. (2013) 8:93–102. doi: 10.1055/s-0038-1638838

PubMed Abstract | CrossRef Full Text | Google Scholar

66. Shah SD, Liebovitz D. It takes two to tango: engaging patients and providers with portals. PM R. (2017) 9:S85–97. doi: 10.1016/j.pmrj.2017.02.005

PubMed Abstract | CrossRef Full Text | Google Scholar

67. OpenMRS. The Global OpenMRS Community Works Together to Build the World's Leading Open Source Enterprise Electronic Medical Record System Platform. Available online at: https://openmrs.org/ (accessed January 13, 2021).

68. Mamlin BW, Biondich PG, Wolfe BA, Fraser H, Jazayeri D, Allen C, et al. Cooking up an open source EMR for developing countries: OpenMRS – a recipe for successful collaboration. AMIA Annu Symp Proc. (2006) 2006:529–33.

PubMed Abstract | Google Scholar

69. Principles for Digital Development. Principles Available online at: https://digitalprinciples.org/principles/ (accessed January 13, 2021).

Google Scholar

70. Heroic Labs. Nakama: Open-Source Game Server Available online at: https://heroiclabs.com/nakama-opensource/ (accessed January 13, 2021).

71. Deterding S, Dixon D, Khaled R, Nacke L. Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments. (2011). Available online at: https://dl.acm.org/doi/proceedings/10.1145/2181037

72. Cugelman B. Gamification: what it is and why it matters to digital health behavior change developers. JMIR Ser Games. (2013) 1:e3. doi: 10.2196/games.3139

PubMed Abstract | CrossRef Full Text | Google Scholar

73. King D, Greaves F, Exeter C, Darzi A. ‘Gamification': influencing health behaviours with games. J R Soc Med. (2013) 106:76–78. doi: 10.1177/0141076813480996

CrossRef Full Text | Google Scholar

74. Johnson D, Deterding S, Kuhn KA, Staneva A, Stoyanov S, Hides L. Gamification for health and wellbeing: a systematic review of the literature. Inter Intervent. (2016) 6:89–106. doi: 10.1016/j.invent.2016.10.002

PubMed Abstract | CrossRef Full Text | Google Scholar

75. Sardi L, Idri A, Fernández-Alemán JL. A systematic review of gamification in e-Health. J Biomed Inform. (2017) 71:31–48. doi: 10.1016/j.jbi.2017.05.011

CrossRef Full Text | Google Scholar

76. McGonigal J. When Reality is Broken: Why Games Make us Better and How They Can Change the World. London: Penguin Press (2011).

Google Scholar

77. Koivisto J, Hamari J. The rise of motivational information systems: a review of gamification research. Int J Informat Manag. (2019) 45:191–210. doi: 10.1016/j.ijinfomgt.2018.10.013

CrossRef Full Text | Google Scholar

78. Werbach K, Hunter D. For the Win: How Game Thinking Can Revolutionize Your Business. Philadelphia, PA: Wharton Digital Press (2012).

Google Scholar

79. Johnson D. Greater rewards in videogames lead to more presence, enjoyment and effort. Comput Hum Behav. (2018) 87:66–74. doi: 10.1016/j.chb.2018.05.025

CrossRef Full Text | Google Scholar

80. Adobe. Adobe XD Platform. Available online at: https://adobexdplatform.com/ (accessed January 13, 2021).

81. Rahimi B, Nadri H, Lotfnezhad Afshar H, Timpka T. A systematic review of the technology acceptance model in health informatics. Appl Clin Inform. (2018) 9:604–34. doi: 10.1055/s-0038-1668091

PubMed Abstract | CrossRef Full Text | Google Scholar

82. Joosten YA, Israel TL, Williams NA, Boone LR, Schlundt DG, Mouton CP, et al. Community engagement studios: a structured approach to obtaining meaningful input from stakeholders to inform research. Acad Med. (2015) 90:1646–50. doi: 10.1097/ACM.0000000000000794

PubMed Abstract | CrossRef Full Text | Google Scholar

83. Mane S. RESTful Services–HTTP Available online at: https://medium.com/@sagar.mane006/restful-services-http-a6a83ca8fb7f (accessed October 15, 2020)

84. GitHub. nmrs-nigeria/openmrs-module-nigeriaemr. nmrs-nigeria. (2021). Available online at: https://github.com/nmrs-nigeria/openmrs-module-nigeriaemr

85. GoLang. The Go Programming Language. Available online at: https://golang.org/ (accessed January 15, 2021).

86. Cockroach Labs. Scalable Distributed SQL Now in a Few Clicks With CockroachCloud. Available online at: https://www.cockroachlabs.com/db/cockroachdb/?utm_source=google&utm_medium=cpc&obility_id=26302355585&utm_campaign=NA_-_BOFU_-_Search_-_Brand&utm_adgroup=Cockroach_Labs&utm_term=cockroachdb-e-c&utm_content=426749496200&_bt=426749496200&_bk=cockroachdb&_bm=e&_bn=g&gclid=CjwKCAiAl4WABhAJEiwATUnEF_C34To-WUTl3gmhnLLdIV4jAwgRFLLE7_hqQmsOBf0gqYmcUnovkxoCFaYQAvD_BwE (accessed January 15, 2021).

87. statcounter GlobalStats. Mobile operating system market share africa. StatCounter Global Stats. Available: https://gs.statcounter.com/os-market-share/mobile/africa (accessed January 4, 2021).

88. Mekler ED, Brühlmann F, Tuch AN, Opwis K. Towards understanding the effects of individual gamification elements on intrinsic motivation and performance. Comput. Hum Behav. (2017) 71:525–34. doi: 10.1016/j.chb.2015.08.048

CrossRef Full Text | Google Scholar

89. Mekler ED. Do points, levels and leaderboards harm intrinsic motivation? An empirical analysis of common gamification elements. In: Research, and Applications-Gamification. New York, NY: Association for Computing Machinery. (2013). doi: 10.1145/2583008.2583017

CrossRef Full Text | Google Scholar

90. Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of attrition and dropout in app-based interventions for chronic disease: systematic review and meta-analysis. J Med Inter Res. (2020) 22:e20283. doi: 10.2196/20283

PubMed Abstract | CrossRef Full Text | Google Scholar