Skip to main content

SYSTEMATIC REVIEW article

Front. Psychiatry, 13 September 2019
Sec. Public Mental Health
This article is part of the Research Topic Digital Interventions in Mental Health: Current Status and Future Directions View all 12 articles

Internet-Based Interventions for the Prevention and Treatment of Mental Disorders in Latin America: A Scoping Review

  • 1Millennium Nucleus to Improve the Mental Health of Adolescents and Youths (Imhay), Santiago, Chile
  • 2Millennium Institute for Research in Depression and Personality (MIDAP), Santiago, Chile
  • 3Millennium Nucleus in Social Development (DESOC), Santiago, Chile
  • 4Programa de Doctorado en Psicoterapia, Facultad de Ciencias Sociales and Facultad de Medicina, Pontificia Universidad Católica de Chile and Universidad de Chile, Santiago, Chile
  • 5CEMERA, Facultad de Medicina, Universidad de Chile, Santiago, Chile
  • 6Escuela de Psicología, Facultad de Humanidades, Universidad de Santiago de Chile, Santiago, Chile
  • 7Hospital Clínico, Universidad de Chile, Santiago, Chile
  • 8Centre for Global Mental Health, Institute of Psychiatry, Psychology & Neuroscience, King’s College London, London, United Kingdom

Background: There is a huge gap in the treatment of mental disorders in Latin America, especially among socioeconomically disadvantaged groups. Given the sharp increase in Internet access and the rapid penetration of smartphones in the region, the use of Internet-based technologies might potentially contribute to overcoming this gap and to provide more widely distributed and low-cost mental health care in a variety of contexts.

Methods: We conducted a scoping review of the literature in order to systematically map the existing evidence on use of Internet-based interventions for prevention, treatment, and management of mental disorders across Latin American countries, as well as to identify existing gaps in knowledge. Six electronic databases were searched for published papers (PubMed, Embase, CINAHL, Web of Science, SciELO, and CENTRAL).

Results: After the eligibility assessment, we identified 22 Internet-based studies carried out in Latin America for prevention, treatment, education, or facilitating self-management of mental disorders. Included studies mainly targeted depression (n = 11), substance misuse (n = 6), anxiety (n = 3), and mental health literacy for education and health professionals (n = 2). Most studies were undertaken in Brazil (n = 6), Mexico (n = 5), and Chile (n = 4). Only 3 studies were randomized controlled trials (RCTs), 4 were pilot RCTs, and 15 were naturalistic, acceptability, or feasibility studies. The three RCTs identified showed disparate results, but overall, there are challenges to face. Better results are seen in the short-term (postintervention or after 3 months), but most studies do not explore outcomes for long enough (follow-up after 6 or 12 months). Most of the feasibility and pilot studies showed reasonably good acceptability for a wide range of strategies but difficulties to engage and retain participants for long enough or adhering to established protocols.

Conclusion: This study shows that Internet-based interventions for the prevention and treatment of mental disorders are growing rapidly in Latin America, but there are few studies on effectiveness and cost effectiveness, making it difficult to provide the evidence needed to justify scaling up these interventions.

Introduction

Mental disorders are common in Latin America. For instance, depression is the largest cause of disability in the region, and mental health problems represent one-third of all years lost for disability in Latin American countries (1). A striking imbalance exists between government spending on mental health and the related disease burden (2), and the treatment gap for mental disorders in Latin America is huge with ∼80% of those suffering from depression receiving no help at all (1). This is even more marked among socioeconomically disadvantaged groups (3, 4).

Among many reasons for this situation, the lack of trained personnel figures prominently. To address this problem, the strategy of task shifting/sharing has been implemented, in which nonmedical health workers deliver most, if not all, of the treatment for mental disorders (5, 6). A model developed in Latin America became the first task-shifted treatment program to show its cost effectiveness from low-middle income countries (LMICs) (7, 8), and it was subsequently successfully adapted and replicated in other LMICs (9, 10). Although this is a promising strategy, it has become increasingly clear that nonmedical health workers have an increasing number of competing demands, and other barriers, such as access to health care clinics and stigma, still pose major hurdles to improve coverage in the region and elsewhere. Expanding task shifting to include the use of technology to either complement or even replace health workers might potentially contribute to overcoming some of these obstacles and reducing the treatment gap.

There has been a rapid growth in the development of Internet-based interventions for preventing and treating mental health problems in developed countries (11). For instance, approximately one-third of all health-related apps are on mental health topics (12). Nonetheless, there are still a number of challenges to be faced by this rapidly growing industry, in particular those related to the evaluation of these products and interventions affecting countries at all levels of development (12, 13).

Given the sharp increase in Internet access and the rapid penetration of smartphones in Latin America and elsewhere (12), the integration of Internet-based interventions may offer a potential to provide more widely distributed and low-cost mental health care (1214). Users have the opportunity to access help, often based on proven effective clinical guidelines, at a convenient time and wherever they are, saving precious time and unnecessary transport costs. Internet-based programs and digital technologies have also the potential to be important tools for disseminating sustainable training programs and to support and supervise mental health workers (11, 14). In spite of all these merits, there has been limited use of digital advances in mental health in LMICs, and some questions remain about their effectiveness in less-developed countries and settings with restrained resources (11). Previous reviews have found virtually no studies on Internet-based solutions in Latin America that can be scaled up in real health-care contexts (1517).

We conducted a scoping review of the literature in order to systematically map the existing evidence on use of Internet-based interventions for mental disorders in Latin America, as well as to identify existing gaps in knowledge. The following research question was formulated: What is known from the literature about Internet-based interventions for the prevention, treatment, or management of mental disorders across Latin American countries? We consider how Internet-based interventions could overcome barriers to improving access to mental health care in these countries, and we evaluate the main strengths and limitations of the interventions developed in the region.

Method

We carried out a systematic search of the literature on Internet-based studies in mental health undertaken in Latin America. While our initial intention was to do a systematic review, we decided to do a scoping review because potentially eligible studies used diverse study designs (many studies were pilot, acceptability, or feasibility studies), recruited diverse population groups with a wide range of mental disorders, and reported heterogeneous outcomes. We use the PRISMA Extension for Scoping Reviews (PRISMA-ScR) to conduct the review and report the results (18). A systematic review would have required greater consideration of intervention effectiveness (19), whereas scoping reviews are useful for answering much broader questions. Likewise, a scoping review allowed for greater discussion of important areas in which we believe that Internet and digital technologies could yield considerable gains towards addressing mental disorders in Latin America.

Eligibility Criteria

We searched for published papers in peer-reviewed journals, written in English or Spanish, indexed from inception to April 5, 2019. The following study eligibility criteria were applied, according to the Population, Intervention, Comparison, Outcomes, and Study design (PICOS) framework (19):

(P) Individuals living in Latin America, without distinction of age, sex, or ethnicity. The scope of this review allowed for the inclusion of subjects experiencing varying degrees of psychopathology, determined either through validated self-reported scales, observer-rated questionnaires, or clinical interviews. For instance, in the case of interventions aimed at the promotion of mental health and/or prevention of mental disorders, individuals may have been identified as healthy or at-risk of mental ill health. We did not exclude any type of mental health problem, as such, we included common mental disorders/symptoms (e.g., depression and/or anxiety), serious mental illnesses (e.g., schizophrenia or bipolar disorder), and alcohol and other substance use disorders. Moreover, we also considered for inclusion those studies in which participants were mental health care providers, whether they were lay health care-workers, primary health-care personnel, or specialized mental health-care professionals.

(I) Internet-based interventions aimed at the promotion of mental health and the prevention and/or treatment of mental disorders, targeted at healthy, at-risk, or mentally ill individuals. Additionally, we included supporting and/or training Internet-based interventions for mental health-care providers. For purposes of this scoping review, interventions must have been based on or supported by Internet and digital technologies (i.e., web and mobile based), with varying degrees of human support. Importantly, these interventions may have been provided alongside other treatment components, regardless of their technological status (e.g., as in the case of blended interventions, which combines face-to-face and Internet-based approaches).

(C) Any intervention that is not based on Internet or digital technologies was considered as a comparator or control. However, studies without comparison/control groups were also considered.

(O) To be included, studies must have used validated self-reported scales, observer-rated questionnaires, or clinical interviews and must have provided postintervention assessments or follow-up evaluations. We do not consider specific restrictions regarding the length of follow-up periods. Outcomes considered included measures of positive mental health, mental disorders or symptoms, information or attitudes (e.g., knowledge) related to mental illness, and use, adherence, or satisfaction with health services.

(S) We did not exclude studies by their design; rather, the rationale for the inclusion of studies was based on studies’ aims. Thus, we identified two study types of interest to our scoping review: feasibility studies, dealing with issues such as the acceptability, demand, and practicality of interventions (i.e., “Can it work?”); and efficacy/effectiveness studies (which addresses the question: “Does the intervention work?”). This meant that we expected to include quantitative, qualitative, and mixed methods studies in order to consider different aspects of Internet-based interventions.

Papers were excluded if they did not fit into the conceptual framework of the study.

Information Sources and Search

To identify potentially relevant documents, the following bibliographic databases were searched: PubMed, Embase, CINAHL, Web of Science, SciELO, and CENTRAL. The appendix shows the complete search strategy used. The search results were exported into EndNote, and duplicates were removed. In addition, we searched reference lists of included studies and other systematic reviews.

Included studies evaluated Internet-based interventions targeting depression, including symptoms and disorders; serious mental illnesses, including schizophrenia or bipolar disorder; alcohol and other substance-misuse disorders; and other common mental health conditions, including anxiety disorders and posttraumatic stress disorder. The included studies considered intervention involving the use of Internet and digital technologies, such as telepsychiatry, web-based, wearable devices, and mobile applications.

We excluded discussion articles, program descriptions, study protocols, and conference abstracts.

Selection of Sources of Evidence

To increase consistency among reviewers, three reviewers (ÁJ-M, PF, and PM) carried out study selection and data collection in an independent manner. These three reviewers evaluated the titles, abstracts, and then full text of all publications identified. The study selection process was documented using the PRISMA-ScR flow diagram (18).

Data were extracted and synthetized for country of origin, sample description, study design, intervention description, and primary outcome. Three authors (RA, VM, and GR) reviewed the list of included studies and the data included in the summary tables to confirm accuracy in data extraction. All authors reviewed the final tables.

Risk of Bias Across Studies

A key difference between systematic and scoping reviews is that the latest are generally conducted to provide an overview of the existing evidence regardless of methodological quality or risk of bias. However, we performed a risk of bias assessment of included randomized controlled trials (RCTs) according to the criteria of the Cochrane Collaboration tool for assessing risk of bias (19). Two reviewers (ÁJ-M and PF) carried out risk of bias assessment in an independent manner.

Synthesis of Results

We grouped the studies according to the type of design: randomized controlled trials, pilot randomized controlled trials, and naturalistic, acceptability or feasibility studies. Narrative techniques were the selected approach for data analysis and synthesis, with due emphasis on study characteristics and risk of bias assessment to interpret study results. We also use comparative tables to facilitate the analysis of study characteristics and results.

Results

After duplicates were removed, a total of 1,375 records were screened. Based on the title and the abstract, 1,283 were excluded, with 92 full text to be retrieved and assessed for eligibility. Of these, 69 were excluded for the following reasons: 18 did not directly evaluate an intervention, 16 did not specifically address mental health issues, 20 were not Internet-based interventions, 6 were not implemented in Latin America, and 3 reported duplicate results in other publications. We also excluded six studies because they were reported in conference abstracts. After the eligibility assessment, we identified 22 Internet-based studies carried out in Latin American countries for the prevention, treatment, education, or facilitating self-management of mental disorders considered eligible for this review (see Figure 1).

FIGURE 1
www.frontiersin.org

Figure 1 PRISMA-ScR Flow diagram. *Seven articles reported in other review + one article published by one of the authors.

Characteristics of Sources of Evidence

Most included studies were undertaken in Brazil (n = 6), Mexico (n = 5), and Chile (n = 4). We found four multisite studies conducted in several countries in South and Central America. Included studies mainly targeted depression (n = 11), substance misuse (n = 6), anxiety (n = 3), and mental health literacy for education and health professionals (n = 2).

The studies included in this review were classified and grouped according to the research design (RCTs, pilot RCTs, and other studies) and the type of intervention: telepsychiatry/psychology, guided Internet-based self-help programs, unguided Internet-based self-help programs, and Internet-based programs for education and training of health/education workers.

Telepsychiatry/psychology interventions reported here use the Internet to allow simultaneous and/or time-delayed communication between a patient or primary health-care professional and a mental health specialist (psychiatrist/psychologist) via video conferencing, chat, or other electronic platform. These interventions can enable mental health specialists to provide remote services or supervise nonspecialized care teams. Guided Internet-based self-help programs were automated interventions that included some kind of human support but considerably less than in face-to-face therapy. Unguided Internet-based self-help programs were automated interventions with no human interaction at all. Finally, Internet-based programs for education and training of health/education workers were interventions using Internet to access mental health knowledge (e.g., e-learning) to professionals who may have a role in preventing, diagnosing, or managing mental disorders.

We identified three RCTs testing the effectiveness of Internet-based interventions: a web-based mental health training program for school teachers (20), an unguided web-based alcohol intervention (21, 22), and a remote collaborative care program (23). Four included studies were pilot RCTs. One evaluated the efficacy of a videoconference for mental health care delivery in clinical settings (24), and the others studied the use of self-help Internet-based programs for the prevention or treatment of mental disorders, with or without support (2527).

We also identified 15 naturalistic, acceptability, or feasibility studies. Three studies used Internet-based technologies to support mental health care delivery in clinical settings (2830) and six studies that used guided self-help Internet-based programs to reach individuals with mental disorders outside clinical settings, promote treatment, or medication adherence, and provide ongoing encouragement and targeted psychosocial support (3136). Likewise, we found four unguided Internet-based self-help programs for mental disorders and alcohol misuse (3740) and two interventions oriented to provide basic mental health education to health-care workers (41, 42).

The main characteristics of each study are presented in Tables 1, 2, and 3, including population setting, aims of interventions, digital technology used, and main outcomes.

TABLE 1
www.frontiersin.org

Table 1 Description of randomized controlled trial (RCT) studies of Internet-based interventions for mental health in Latin America.

TABLE 2
www.frontiersin.org

Table 2 Description of pilot randomized controlled trial (RCT) studies of Internet-based interventions for mental health in Latin America.

TABLE 3
www.frontiersin.org

Table 3 Description of naturalistic, acceptability, and feasibility studies of Internet-based interventions for mental health in Latin America.

Results of Individual Sources of Evidence

Randomized Controlled Trials

In Brazil, a web-based educational program was designed to educate primary school teachers on the recognition and classroom management of children with mental health problems through interactive tutorials, educational videos, and an online discussion forum with mental health experts (20). Teachers receiving this web-based program had greater gains in knowledge about mental disorders such as depression and conduct disorder, and less stigmatized views on mental disorders, than did those trained with a text- and video-based program and those receiving no training. These results suggest that web-based interactive tools can be more effective than traditional educational tools in increasing knowledge and reducing stigma. However, in spite of increased knowledge, the impact on improving recognition and referral could not materialize.

In addition, in Brazil, a web-based intervention aimed at decreasing alcohol consumption and/or preventing alcohol abuse among nightclub patrons demonstrated significant reductions in reducing scores on the Alcohol Use Disorders Identification Test (AUDIT) and the prevalence of binge drinking over time in a “high-risk” group (21, 22). However, in a “low-risk” group, AUDIT scores increased in those receiving the intervention and a control group, and there were no differences in the prevalence of binge drinking across groups or compared with baseline levels.

In Chile, an online platform facilitated collaborative care by giving primary care providers remote access to a psychiatrist who supported the treatment of adolescent depression (23). The intervention proved to be feasible and well accepted by both patients and primary care clinicians. Satisfaction with psychological care, in both groups, was related to a significant change in depressive symptomatology at 12 weeks follow-up. However, at follow-up, the intervention did appear to have equivalent effectiveness to reduce depressive symptoms compared with enhanced usual care.

Pilot Randomized Controlled Trials

In Brazil, monthly telepsychiatry consultations through videoconferencing for the care of people with depression seem to achieve similar clinical outcomes as standard face-to-face treatment regarding mental health status, satisfaction with treatment, treatment adherence, or medication compliance (24). An interesting result is that participants in the videoconferencing group were able to establish an equivalent therapeutic relationship as those treated in person. However, all these results need to be taken with caution, as this was a feasibility study not statistically powered to test any of these differences.

In Mexico, two studies used guided self-help Internet-based programs. One study explored the feasibility of an Internet-based psychoeducation program for social anxiety (25). A module of the program incorporated cognitive–behavioral techniques such as cognitive restructuring and exposure to scenarios depicting real audiences in public-speaking situations through videos. The results supported the feasibility of this program and showed a tentative clinical improvement in measures of anxiety. A relevant aspect to consider is the difference in attrition rate across groups, with the group assisted by therapist showing the lowest (27%) while the group without treatment the highest (45%). In the self-applied group, it seems that some of the attrition can be explained by problems with accessing Internet and achieve the necessary immersion in the exposure scenarios.

Another study developed a web-based cognitive–behavioral intervention (CBT) for the reduction in substance use and depressive symptomatology (PAADD) and compared it with two other CBT brief interventions: an in-person session with an addiction therapist combined with ASSIST Self-help Strategy Guide and the treatment ordinarily offered at participating treatment centers (26). The results suggest that CBT strategies were successfully translated to web format in the PAADD, with possibilities similar to those of brief interventions carried out in person and with printed materials. This intervention appears to be feasible and shows a potential reduction of participants’ depressive symptomatology, although it was not demonstrated to be more effective than the other interventions. Regrettably, the intervention presented problems associated with the high dropout rate.

Finally, a multisite study implemented an unguided Internet-based self-help program for the prevention of postpartum depression in different Latin American countries and the USA (27). Although this study showed that online self-help programs could be delivered and promote mental health among individuals in low-resource settings, it showed high dropout rates and failed to suggest that results could potentially be beneficial. In this respect, it seemed that benefits of receiving the intervention were greater for pregnant women reporting high (vs. low) levels of prenatal depression symptoms.

Naturalistic, Acceptability, or Feasibility Studies

Telepsychiatry/Psychology

In Chile, an online platform facilitated collaborative care by giving primary care providers remote access to a psychiatrist (28). The intervention was feasible and achieved higher user satisfaction. This program also shows better treatment adherence rates at 6 months compared to usual care, suggesting that technology-assisted interventions may help rural primary care teams in the management of depressive patients. While this is not a randomized clinical trial, the potential effectiveness of this intervention seems comparable to the usual care delivered by a national depression treatment program.

In Mexico, a 16-session telepsychology treatment for depression (via chat, audio, or videoconference) seems potentially beneficial in decreasing depressive symptomatology, with gains remaining at 6-month follow-up (29). However, the quality of the study and the small sample size (n = 8) do not allow many conclusions to be drawn from this intervention.

In Colombia, a telepsychiatry intervention for depression management among prison inmates was compared with asynchronous teleconsulting with a psychiatrist through a web-based platform where the primary care professional present clinical information to the psychiatrist (30). Both interventions showed depression symptomatology reduction, but the asynchronous teleconsulting intervention proved to be less costly than the telepsychiatry intervention.

Guided Self-Help Internet-Based Programs

Two pilot studies from Chile showed acceptable online depression treatment programs, including an online video game for supporting depression treatment among adolescents (31) and an online program for symptom monitoring in patients receiving treatment for major depression (32). The online adventure video game is a psychotherapeutic tool for female adolescents in psychotherapy with mild to moderate depression (31). In the game, players follow the story of a female adolescent, who gets involved in interpersonal situations that require psychosocial reasoning. The majority of participants (patients and therapist) valued the game and considered that they could obtain mental health-related benefits from playing it. However, the time of use of the game was very low. Therapists also suggest that it was possible in postgame sessions to relate elements of the game to aspects of the patients’ real lives. Nevertheless, the design of the study and the small number of participants make it impossible to draw conclusions regarding the effectiveness of the game.

Espinosa et al. (32) studied the feasibility and acceptability of the Chilean version of the Supportive Monitoring and Disease Management over the Internet program (SUMMIT) (43), which was called in Spanish ASCENSO. This program aims to monitor and support patients after being discharged from depression treatment. Most of the participants displayed a good level of acceptance and generally regarded the program as a source of support and as beneficial; however, only half of them actively used the program and/or the online chat available. In Colombia, where the ASCENSO program was replicated, the results showed also a favorable acceptability from the participants, but there were important problems with usability and attrition (33). One of the main limitations of its implementation was associated with the difficulty of involving mental health institutions in the use of the program.

In Mexico, a study aimed to explore the feasibility of a program aimed to people who were victims of assaults, kidnappings, and criminal violence and suffered from posttraumatic stress disorder (PTSD) and/or acute stress disorder (ASD) (34). Participants were exposed to Virtual Reality scenarios and asked to talk about the traumatic event in the first person. The results showed that treatment was well received and potentially useful in reducing PTSD and ASD symptoms from pre- to posttreatment. Regarding the satisfaction of participants with the intervention, it is interesting to note that they did not manifest a preference between virtual reality exposure techniques and traditional exposure therapy (in vivo or imagined).

A study conducted in Nicaragua, Guatemala, and Costa Rica developed an Internet-based education program to promote adolescent health, integrating the program in existing organizational curricula and activities (35). This program was delivered in an interactive (requiring feedback) and/or noninteractive fashion (information only). The program proved to be feasible and provided a confidential way for youth and family development organizations to gather information about teenagers’ health behaviors and needs. Nevertheless, access and integration of materials and methods into existing curricula was a major problem, possibly associated with limited access to computers and the Internet in general.

A study conducted in Brazil and Peru developed a psychoeducational technological platform delivered via mobile phones to patients and assisted by a nurse holding a tablet dashboard to monitor progress in the reduction of depressive symptoms among individuals with comorbid diabetes or hypertension (36). The platform (CONEMO) aims at increasing daily life activities and motivation, as well as providing further information and health self-care messages. This tool demonstrated to be feasible in both settings, where three pilot studies were conducted, and participants were satisfied with the intervention. The samples were small to test the efficacy of the intervention. However, there was a trend in all pilot studies for a reduction in depressive symptoms over time. A fully powered RCT is in progress.

Unguided Internet-Based Self-Help Programs

In Mexico, a study collected data on individuals who entered a Mexican open access free web-based psycho-education and CBT intervention for depression (37). Data showed that adherence dropped considerably as individuals progressed through the intervention modules. However, all modules were rated very high for helpfulness/usefulness.

In Brazil, a program seemed beneficial for reducing alcohol consumption among harmful users and those with probable dependence, but program adherence was low (38). In Uruguay, a web-based substance misuse prevention intervention was implemented in 10 private schools (39). This study shows that sending participants periodic reminders via e-mail and SMS text messages has a positive impact in engagement with the program. Despite the adolescent-friendly design and the provision of social networking tools and interactive dynamics, low participation and high attrition were observed during the intervention. In Colombia, participants with a flying phobia that went through a program for treating their phobia with psychoeducation and exposure techniques reported high satisfaction with the intervention (40).

Internet-Based Programs for Education and Training of Health/Educational Workers

In Brazil, a tele-education program consisted of weekly web conference seminars and moderated discussion forums to provide education to family health-care teams about mental health (41). While participants felt that the seminars contributed to their professional development, the implementation of the tele-education program faced significant obstacles. Two major challenges were associated with Internet connectivity and the insertion of new technologies into the daily lives of health professionals, especially physicians.

In addition, in Brazil, an online course was oriented to enhance primary care professionals’ knowledge about the clinical management of alcohol misuse (42). In this study, health-care workers expressed satisfaction with the course, and a significant improvement in their knowledge about the clinical management of alcohol-related problems was observed. This indicates that e-learning is a useful medium for teaching mental health issues. However, this intervention also showed a number of difficulties. First, there was no reduction in stigma and prejudice related to alcohol problems. Second, the comparison between pre- and postcourse scores suggests that general knowledge about alcohol addiction did not improve over time. Finally, the lack of a control group did not allow the performance of e-learning to be compared with traditional face-to-face teaching.

Risk of Bias Across Studies

Table 4 presents a synthesis of the risk of bias assessment of the three included RCTs.

TABLE 4
www.frontiersin.org

Table 4 Risk of bias summary.

The first included RCT (20) describes the use of random sequences to generate the allocation and adequate concealment of allocation prior to assignment. In this type of intervention, it does not seem feasible to blind participants and personnel. Thus, the risk of bias for this item is described as “high.” The publication does not describe the measures used to blind outcome assessors to treatment allocation, so a high risk of detection bias can be inferred. This study describes the outcome data and the number of participants in each group. While this study included replacing missing data through imputation methods, there is a lack of information regarding the specific reasons for attrition. Thus, we assess the risk of attrition bias as “unclear.” The publication includes all prespecified results.

The second included RCT (21, 22) describes the use of random sequences to generate the allocation and adequate concealment of allocation prior to assignment. Participants were probably aware of allocation when they received feedback on their level of risk, so performance bias was identified during the conduct of the study. The outcomes were evaluated through self-report scales, eliminating observer bias. However, lack of information made it difficult to assess the blinding of outcome assessment, resulting in an “unclear” judgment on the risk of detection bias. This study describes the outcome data, reporting the reasons for attrition and exclusions, as well as the number of participants in each group. The publication includes all prespecified results.

The third RCT identified (23) describes that randomization was performed using computer generated random numbers with adequate allocation concealment. However, the participants knew the allocation. A trained consultant, who was blinded to the treatment allocation, assessed patient baseline data and outcomes at 12 weeks of follow-up. The study reports the reasons for attrition and exclusions, as well as the number of participants in each group. The publication includes all the prespecified results.

Synthesis

Overall, the studies identified in this review are heterogeneous in terms of participants (e.g., adolescents, adults, patients, professionals), contexts (rural and urban, clinical and community settings), mental problems addressed (depression, anxiety, alcohol and substance misuse), and methods used to deliver the interventions (e.g., teleconsulting, online self-help programs, education and training of health/education workers, psychoeducation).

Within the 22 studies identified, only 3 studies were RCTs, 4 were pilot RCTs, and 15 were naturalistic, acceptability, or feasibility studies. Most of the feasibility and pilot studies showed reasonably good acceptability for a wide range of strategies but difficulties to engage and retain participants for long enough or adhering to established protocols. We found no large-scale effectiveness studies and no cost-effectiveness study. The methodological quality of RCTs studies identified was reasonably good but showed disparate results, and there are challenges to face. Overall, better results are seen in the short term (postintervention or after 3 months of follow-up), but most studies do not explore outcomes for long enough (follow-up after 6 or 12 months).

Discussion

Internet-based interventions for mental disorders have already shown their potential benefits in high-income countries. The use of the Internet and digital technologies may improve access, enhance the flexibility of conventional treatments, facilitate the monitoring of treatment progress and fidelity with which interventions are delivered, and may improve the integration of different levels of care, obtaining results comparable to face-to-face care (11, 14, 44). However, much less is known about the feasibility and potential benefits of these interventions in LMIC. Although the penetration of technology and its application to health has been swift in all countries regardless of their level of development (12), there are many issues that remain to be resolved if these technologies want to be disseminated at scale. Among these, the relative lack of studies showing effectiveness of Internet-based interventions for mental disorders in LMICs (15, 16). Some questions still remain about the effectiveness of these interventions in settings with constrained resources.

In this scoping review, we identified 22 primary studies addressing Internet-based interventions for mental disorders across Latin American countries published until April 2019. Our findings indicate that there is a growing number of studies testing the feasibility and acceptability of Internet-based interventions for prevention, treatment, education, or facilitating self-management of mental disorders across various settings. However, very few tested the effectiveness of these interventions through RCT designs. This is not an issue just affecting Latin America but the field in general (12).

The studies identified in this review are heterogeneous, demonstrating the flexibility of Internet-based interventions to adapt to different population, contexts, and formats. Many of the studies have prioritized the use of online technologies to assist vulnerable groups in low-resource settings without considering the challenges involved in their use and in future implementation. As a reviewed study shows (34), in some regions of Latin America, especially Central American countries, there is still limited access to computers and connectivity with the Internet, let alone a chronic shortage of supervisory human resources, all of which can become major barriers to the successful implementation of Internet-based interventions. Similarly, a study conducted in Brazil showed significant obstacles to implementing at larger scale a tele-education program not only because of low connectivity but also because of the challenge of introducing new technologies in the daily work of busy practitioners in public health contexts (41). Future studies should pay more attention to these potential challenges when it comes to bring innovation to scale; otherwise, the solutions developed and tested at high cost will never be scaled up.

Most studies had methodological limitations such as poorly defined samples, unclear comparison groups, and lack of randomization methods, and interventions of short duration. One of the most important problems identified is that most of these studies compared results across groups in terms of efficacy, even though none of them was statistically powered to estimate differences across groups. Notwithstanding this, most studies showed a trend suggesting increased benefits when compared to control groups, whenever these had been included in the study design. Caution must be exercised when presenting results of feasibility or pilot studies. A common finding in mental health interventions is that early gains tend to fade away unless there is continuous intervention over time; most studies included were short-term. There is a need for studies that explore outcomes beyond six months; however, it is acknowledged that funding for longer lasting feasibility studies is hard to get.

Some interventions were unguided, but most of them included guidance or support that varied from low-intensity support (feedback and motivation) to using the technology as a means to deliver synchronous assessments, therapy, or supervision (telepsychiatry, telepsychology, or teleconsultation through videoconference). Most interventions adopted evidence-based techniques of traditional face-to-face treatments, which indicate that there is still ample scope for innovation in Internet-supported techniques. There is growing awareness that guided intervention tends to achieve better results, but there is still not enough knowledge in terms of the most cost-effective options to provide this guidance and the options to innovate in this respect are endless. In the case of Latin America, it is possible to explore various options to adopt the “blended approach,” since there is still a large supply of reasonably trained health workers who can assist in this process. However, resources are finite, and there are competing duties that need to be accounted for when planning for human guidance and support. Guided Internet-therapies have the potential to improve effectiveness and reach of psychological support and treatment for mental disorders in developing countries (16), without disproportionately increasing costs for health services.

The lack of specialized human resources is a critical issue in delivering mental health care in LMIC (5, 6). The training of nonspecialist professionals (primary health-care providers, or community health-care workers) with tools to diagnose and detect mental disorders is an important area of development that aims to reduce the treatment gap. As some reviewed studies show, the use of the Internet provides an option to overcome this problem, by delivering online training on mental health for primary healthcare professionals and/or providing remote communication between them and mental health specialists. This can be fundamental in task-shifting strategies from specialist medical providers to less well-trained personnel. However, as this review shows, further research is needed in this area, especially on how to change attitudes towards mental disorders.

Internet-based interventions for mental health identified in this review go beyond clinical settings. A few identified studies targeting school populations, both students and teachers. The results of a web-based educational program included in this review (20) suggest that web-based interactive tools can be more effective than traditional educational tools in increasing knowledge and reducing stigma. This is an interesting result, considering that stigma and misconceptions related to mental health are commonly seen in the educational sector (45). Schools have become relevant spaces for mental health promotion, indicated prevention and early detection of mental health problems. A reduction in stigma related to mental health problems might improve the referral process from the educational sector. To improve teachers’ knowledge on mental health, online training appears as a promising strategy, with benefits like flexible usage not constrained by time and place and easy dissemination through national territories.

High attrition in Internet-based interventions where there is none or low-intensity coach/therapist support is a problem in Latin America as well as in developed countries (11, 15). Future studies should explore in detail how important is the human support in Latin America for increasing engagement and adherence as well as improving outcomes. In addition, other strategies for increasing adherence, like the inclusion of persuasive systems or user-centered designs (46), need to be evaluated. Other aspect less addressed by the included studies is how the integration of these interventions to the existing health networks in which the patient is already inserted could increase their acceptability, adherence, and efficacy.

Overall, this study shows that Internet-based interventions for the prevention and treatment of mental disorders are at an early stage of development in Latin America. The accumulating evidence shows promising results but with important challenges that are not different to those found elsewhere in the world (1116). There is an urgent need to agree on evaluation methodologies and frameworks to assess the growing number of emerging interventions in this field (13). It is also necessary to produce methodological developments in large-scale effectiveness studies, as well as cost effectiveness and implementation studies, especially in primary care services. Future studies should also place greater emphasis on comparing online interventions with traditional face-to-face interventions, either alone or in combination. Progress in these areas is a necessary condition for scaling up these interventions and obtaining funding from health insurers.

Strengths and Limitations

As far as we know, this is the first review of Internet-based interventions for mental disorders that specifically addresses developments in this area in Latin America. However, our scoping review has some limitations. An important limitation is related to the small number of studies and publications found, in particular, the scarcity of randomized clinical trials. There are many feasibility studies of commercial applications and products that are not published anywhere. Likewise, pilot studies for a range of mental disorders have been carried out, and there are many which are developed for commercial purposes, but there is no reporting of its quality or outcomes. There is little consistency in the methodologies used in feasibility and pilot studies, which interferes further when comparing studies. Another important limitation is that four authors of this article (RA, GR, VM, and PM) are also responsible for some of the studies reviewed, which can be a source of many biases in the interpretation of the results. Nevertheless, the risk of bias assessment of RCT studies was carried out by ÁJ-M and PF, who did not participate in any of the studies reviewed. Besides, it shows that there is a group of local researchers in the field that is eager to learn from the experiences of others.

Conclusion

Internet-based interventions of mental disorders are growing rapidly in countries at all levels of development. The aim of this scoping review was to systematically map the existing evidence on use of Internet-based interventions for prevention, treatment, education, or facilitating self-management of mental disorders in Latin America, as well as to identify existing gaps in the literature. The results show that there are a growing number of studies testing the feasibility and acceptability of interventions, but there are few studies on effectiveness and cost effectiveness. Furthermore, there are few studies comparing the efficacy of Internet-based interventions with traditional face-to-face interventions. The relative lack of evidence conspires against efforts to disseminate and scale up digital interventions in the region. These results lead us to advocate for increasing the number of studies and, more importantly, improving the quality of e-mental health research in Latin America to produce better evidence to guide mental health policies.

Data Availability

All datasets generated for this study are included in the manuscript/Supplementary files.

Author Contributions

ÁJ-M, RA, GR, VM, and PM contributed conception and design of the study; PM and ÁJ-M organized the database; ÁJ-M, PF, VM, and RA wrote the first draft of the manuscript. All authors contributed to manuscript revision, read, and approved the submitted version.

Funding

This study was supported by the Millennium Science Initiative of the Ministry of Economy, Development and Tourism, grant “Millennium Nucleus to Improve the Mental Health of Adolescents and Youths, Imhay,” grant “Millennium Nucleus in Social Development, Desoc,” and the Fund for Innovation and Competitiveness (FIC) of the Chilean Ministry of Economy, Development and Tourism, through the Millennium Science Initiative, Grant No. IS130005. PF received funding from CONICYT PFCHA/DOCTORADO NACIONAL/2019-21190745.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

This article is part of the work of the e-mental health network of the University of Chile, VID U-REDES-C_2018_07.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2019.00664/full#supplementary-material

References

1. Pan American Health Organization. The burden of mental disorders in the region of the Americas. Washington DC: PAHO (2018).

Google Scholar

2. Vigo D, Kestel D, Pendakur K, Thornicroft G, Atun R. Disease burden and government spending on mental, neurological, and substance use disorders, and self-harm: cross-sectional, ecological study of health system response in the Americas. Lancet Public Health (2019) 4:e89–96. doi: 10.1016/S2468-2667(18)30203-2

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Araya R, Zitko P, Markkula N, Rai D, Jones K. Determinants of access to health care for depression in 49 countries: a multilevel analysis. J Affect Disord (2018) 234:80–8. doi: 10.1016/j.jad.2018.02.092

PubMed Abstract | CrossRef Full Text | Google Scholar

4. Araya R, Zitko P, Markkula N. The impact of universal health care programmes on improving ‘realized access’ to care for depression in Chile. Adm Policy Ment Health (2018) 45:790–9. doi: 10.1007/s10488-018-0864-z

PubMed Abstract | CrossRef Full Text | Google Scholar

5. World Health Organization (WHO). Integrating mental health into primary care: a global perspective. Geneva: World Health Organization and World Organization of Family Doctors (2008).

Google Scholar

6. Patel V. The future of psychiatry in low- and middle-income countries. Psychol Med (2009) 39:1759–62. doi: 10.1017/S0033291709005224

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Araya R, Rojas G, Fritsch R, Gaete J, Rojas M, Simon G, et al. Treating depression in primary care in low-income women in Santiago, Chile: a randomised controlled trial. Lancet (2003) 361:995–1000. doi: 10.1016/S0140-6736(03)12825-5

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Araya R, Flynn T, Rojas G, Fritsch R, Simon G. Cost-effectiveness of a primary care treatment program for depression in low-income women in Santiago, Chile. Am J Psychiatry (2006) 163:1379–87. doi: 10.1176/ajp.2006.163.8.1379

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Patel V, Weiss H, Chowdhary N, Naik S, Pednekar S, Chatterjee S, et al. Effectiveness of an intervention led by lay health counsellors for depressive and anxiety disorders in primary care in Goa, India (MANAS): a cluster randomised controlled trial. Lancet (2010) 376:2086–95. doi: 10.1016/S0140-6736(10)61508-5

PubMed Abstract | CrossRef Full Text | Google Scholar

10. Chibanda D, Weiss HA, Verhey R, Simms V, Munjoma R, Rusakaniko S, et al. Effect of a primary care-based psychological intervention on symptoms of common mental disorders in Zimbabwe: a randomized clinical trial. JAMA (2016) 316:2618–26. doi: 10.1001/jama.2016.19102

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Andersson G, Titov N. Advantages and limitations of Internet-based interventions for common mental disorders. World Psychiatry (2014) 13:4–11. doi: 10.1002/wps.20083

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Anthes E. Mental Health: there’s an app for that. Nature (2016) 532:20–3. doi: 10.1038/532020a

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Henson P, David G, Albright K, Torous J. Deriving a practical framework for the evaluation of health apps. Lancet Dig Health (2019) 1:eS2–4. doi: 10.1016/S2589-7500(19)30013-5

CrossRef Full Text | Google Scholar

14. Fairburn C, Patel V. The impact of digital technology on psychological treatments and their dissemination. Behav Res Ther (2017) 88:19–25. doi: 10.1016/j.brat.2016.08.012

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Naslund JA, Aschbrenner KA, Araya R, Marsch L, U¨ntzer J, Patel V, et al. Digital technology for treating and preventing mental disorders in low-income and middle-income countries: a narrative review of the literature. Lancet Psychiatry (2017) 4:486–500. doi: 10.1016/S2215-0366(17)30096-2

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Marti´nez P, Rojas G, Marti´nez V, Lara MA, Pe´rez JC. Internet-based interventions for the prevention and treatment of depression in people living in developing countries: a systematic review. J Affect Disord (2018) 234:193–200. doi: 10.1016/j.jad.2018.02.079

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Firth J, Torous J, Nicholas J, Carney R, Pratap A, Rosenbaum S, et al. The efficacy of smartphone-based mental health interventions for depressive symptoms: a meta-analysis of randomized controlled trials. World Psychiatry (2017) 16:287–98. doi: 10.1002/wps.20472

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Tricco A, Lillie E, Zarin W, O’Brien K, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med (2018) 169:467–73. doi: 10.7326/M18-0850

PubMed Abstract | CrossRef Full Text | Google Scholar

19. The Cochrane Collaboration. Cochrane Handbook for systematic reviews of interventions, version 5.1.0. Higgins J, Green S, editor. Chichester, UK: John Wiley & Sons (2011). http://handbook.cochrane.org

Google Scholar

20. Pereira CA, Wen CL, Miguel EC, Polanczyk GV. A randomised controlled trial of a web based educational program in child mental health for schoolteachers. Eur Child Adolesc Psychiatry (2015) 24:931–40. doi: 10.1007/s00787-014-0642-8

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Baldin YC, Sanudo A, Sanchez ZM. Effectiveness of a web-based intervention in reducing binge drinking among nightclub patrons. Rev Saude Publica (2018) 52:1–11. doi: 10.11606/S1518-8787.2018052000281

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Sanchez ZM, Sanudo A. Web-based alcohol intervention for nightclub patrons: opposite effects according to baseline alcohol use disorder classification. Subst Abus (2018) 39:361–70. doi: 10.1080/08897077.2018.1437586

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Martínez V, Rojas G, Martínez P, Zitko P, Irarrázaval M, Luttges C, et al. Remote collaborative depression care program for adolescents in Araucanía Region, Chile: randomized controlled trial. J Med Internet Res (2018) 20:e38. doi: 10.2196/jmir.8021

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Hungerbuehler I, Valiengo L, Loch AA, Rössler W, Gattaz WF. Home-based psychiatric outpatient care through videoconferencing for depression: a randomized controlled follow-up trial. JMIR Ment Health (2016) 3:e36. doi: 10.2196/mental.5675

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Cárdenas López G, Botella Arbona C, Quero Castellano S, de la Rosa Gómez A, Baños Rivera RM. Programa de telepsicología para el tratamiento de la fobia a hablar en público en población mexicana. Psicología Iberoamericana (2014) 22:45–54.

Google Scholar

26. Tiburcio M, Lara MA, Martínez N, Fernández M, Aguilar A. Web-based intervention to reduce substance abuse and depression: a three arm randomized trial in Mexico. Subst Use Misuse (2018) 53:2220–31. doi: 10.1080/10826084.2018.1467452

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Barrera AZ, Wickhama RE, Muñoz RF. Online prevention of postpartum depression for Spanish- and English-speaking pregnant women: a pilot randomized controlled trial. Internet Interv (2015) 2:257–65. doi: 10.1016/j.invent.2015.06.002

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Rojas G, Guajardo V, Martínez P, Castro A, Fritsch R, Moessner M, et al. A remote collaborative care program for patients with depression living in rural areas: open-label trial. J Med Internet Res (2018) 20:e158. doi: 10.2196/jmir.8803

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Flores Plata LA, Cárdenas López G, Durán Baca X, de la Rosa Gómez A. Psicoterapia vía Internet: aplicación de un programa de intervención cognitivo-conductual para pacientes con depresión. Psicología Iberoamericana (2014) 22:7–15.

Google Scholar

30. Barrera-Valencia C, Benito-Devia AV, Vélez-Álvarez C, Figueroa-Barrera M, Franco-Idárraga SM. Costo-efectividad de telepsiquiatría sincrónica frente a asincrónica para personas con depresión privadas de la libertad. Rev Colomb Psiquiatr (2017) 46:65–73. doi: 10.1016/j.rcp.2016.04.008

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Carrasco A. Acceptability of an adventure video game in the treatment of female adolescents with symptoms of depression. Res Psychother Psychopathol (2016) 19:10–8. doi: 10.4081/ripppo.2016.182

CrossRef Full Text | Google Scholar

32. Espinosa HD, Carrasco A, Moessner M, Cristian Cáceres C, Gloger S, Rojas G, et al. Acceptability study of “Ascenso”: an online program for monitoring and supporting patients with depression in Chile. Telemed E Health (2016) 22:1–7. doi: 10.1089/tmj.2015.0124

CrossRef Full Text | Google Scholar

33. Vanegas J, Krause M, Bauer S, Moessner M, Espinosa D, Carrasco A, et al. Uso de e-mental health para el seguimiento posterapia de pacientes con depresión en Colombia. Revista Virtual Universidad Católica del Norte (2017) 52:41–56.

Google Scholar

34. Cárdenas López G, Gómez A, Durón Figueroa R, Durán Baca X. Virtual reality exposure for trauma and stress-related disorders for city violence crime victims. Int J Child Health Hum Dev (2016) 9:315–22.

Google Scholar

35. Solórzano RM, Mendez E, Gutierrez L, Harnecker M, Medrano VR, Lopez AS, et al. Promoting adolescent health via the internet in youth and family development organizations in Central America. Hisp Health Care Int (2010) 8:136–44. doi: 10.1891/1540-4153.8.3.136

CrossRef Full Text | Google Scholar

36. Menezes P, Quayle J, Garcia Claro H, da Silva S, Brandt LR, Diez-Canseco F, et al. Use of a mobile phone app to treat depression comorbid with hypertension or diabetes: a pilot study in Brazil and Peru. JMIR Ment Health (2019) 6:e11698. doi: 10.2196/11698

PubMed Abstract | CrossRef Full Text | Google Scholar

37. Lara MA, Tiburcio M, Aguilar AA, Sánchez-Solís A. A four-year experience with a Web-based self-help intervention for depressive symptoms in Mexico. Rev Panam Salud Publ (2014) 35:398–406.

Google Scholar

38. Andrade AL, de Lacerda RB, Gomide HP, Ronzani TM, Sartes LM, Martins LF, et al. Web-based self-help intervention reduces alcohol consumption in both heavy-drinking and dependent alcohol users: a pilot study. Addict Behav (2016) 63:63–71. doi: 10.1016/j.addbeh.2016.06.027

PubMed Abstract | CrossRef Full Text | Google Scholar

39. Balsa AI, Gandelman N, Lamé D. Lessons from participation in a web-based substance use preventive program in Uruguay. J Child Adolesc Subst Abuse (2014) 23:91–100. doi: 10.1080/1067828X.2012.748600

CrossRef Full Text | Google Scholar

40. Campos D, Quero S, Bretón-López J, Soler C, Mora S, Botella C. Patients’ expectations and satisfaction towards an Internet-based treatment for flying phobia: preliminary data. Annu Rev Cyberther Telemed (2016) 14:204–6.

Google Scholar

41. Novaes M, Machiavelli JL, Verde F, Campos F, Amadeu S, Rodrigues T. Tele-educação para educação continuada das equipes de saúde da família em saúde mental: a experiência de Pernambuco, Brasil. Interface - Comunicação, Saúde, Educação (2012) 16:1095–106. doi: 10.1590/S1414-32832012005000043

CrossRef Full Text | Google Scholar

42. Pereira CA, Wen CL, Tavares H. Alcohol abuse management in primary care: an e-learning course. Telemed E-Health (2015) 21:200–6. doi: 10.1089/tmj.2014.0042

CrossRef Full Text | Google Scholar

43. Kordy H, Backenstrass M, Hüsing J, Wolf M, Aulich K, Bürgy M, et al. Supportive monitoring and disease management through the Internet: an Internet-delivered intervention strategy for recurrent depression. Contemp Clin Trials (2013) 36:327–37. doi: 10.1016/j.cct.2013.08.005

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Anderson G, Cuijpers P. Internet-based and other computerized psychological treatments for adult depression: a meta-analysis. Cogn Behav Ther (2009) 38:196–205. doi: 10.1080/16506070903318960

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Aggarwal N. Attitudes of students towards people with mental ill health and impact on learning and well-being. J Res Spec Educ Needs (2012) 12:37–44. doi: 10.1111/j.1471-3802.2010.01193.x

CrossRef Full Text | Google Scholar

46. Parada F, Martínez V, Espinosa D, Bauer S, Moessner M. Using persuasive systems design model to evaluate “Cuida tu Ánimo”: an internet-based pilot program for prevention and early intervention of adolescent depression. Telemed E-health (2019) doi: 10.1089/tmj.2018.0272

CrossRef Full Text | Google Scholar

Keywords: Internet, technology, telepsychiatry, mental disorders, prevention, treatment, Latin America

Citation: Jiménez-Molina Á, Franco P, Martínez V, Martínez P, Rojas G and Araya R (2019) Internet-Based Interventions for the Prevention and Treatment of Mental Disorders in Latin America: A Scoping Review. Front. Psychiatry 10:664. doi: 10.3389/fpsyt.2019.00664

Received: 10 June 2019; Accepted: 19 August 2019;
Published: 13 September 2019.

Edited by:

Elias Aboujaoude, Stanford University, United States

Reviewed by:

Stephan T. Egger, University of Zurich, Switzerland
Michaela Pascoe, Victoria University, Australia

Copyright © 2019 Jiménez-Molina, Franco, Martínez, Martínez, Rojas and Araya. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Ricardo Araya, ricardo.araya@kcl.ac.uk

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.