Ho Ming Lau
Johannes H. Smit
Theresa M. Fleming
Heleen Riper- 1Department of Psychiatry, The EMGO Institute for Health and Care Research, VU University Medical Center Amsterdam, GGZ inGeest, Amsterdam, Netherlands
- 2Department of Psychological Medicine, University of Auckland, Auckland, New Zealand
- 3Department of Clinical, Neuro and Developmental Psychology, Section of Clinical Psychology, VU University Amsterdam, Amsterdam, Netherlands
Introduction: The development and use of serious games for mental health disorders are on the rise. Yet, little is known about the impact of these games on clinical mental health symptoms. We conducted a systematic review and meta-analysis of randomized controlled trials that evaluated the effectiveness of serious games on symptoms of mental disorder.
Method: We conducted a systematic search in the PubMed, PsycINFO, and Embase databases, using mental health and serious games-related keywords. Ten studies met the inclusion criteria and were included in the review, and nine studies were included in the meta-analysis.
Results: All of the serious games were provided via personal computer, mostly on CD-ROM without the need for an internet connection. The studies targeted age groups ranging from 7 to 80 years old. The serious games focused on symptoms of depression (n = 2), post-traumatic stress disorder (n = 2), autism spectrum disorder (n = 2), attention deficit hyperactivity disorder (n = 1), cognitive functioning (n = 2), and alcohol use disorder (n = 1). The studies used goal-oriented (n = 4) and cognitive training games (n = 6). A total of 674 participants were included in the meta-analysis (380 in experimental and 294 in control groups). A meta-analysis of 9 studies comprising 10 comparisons, using a random effects model, showed a moderate effect on improvement of symptoms [g = 0.55 (95% confidence interval 0.28–0.83); P < 0.001], favoring serious games over no intervention controls.
Discussion/conclusion: Though the number of comparisons in the meta-analysis was small, these findings suggest that serious gaming interventions may be effective for reducing disorder-related symptoms. More studies are needed in order to attain deeper knowledge of the efficacy for specific mental disorders and the longer term effects of this new type of treatment for mental disorders.
Introduction
Serious games are “games that do not have entertainment, enjoyment or fun as their primary purpose” (1). Primary purposes of serious games can be, but are not limited to, education, training, human resource management, and health improvement (2). The term “serious games” was introduced more than a decade ago (3). Since then, the development and use of serious games have grown (4). A Google search for the term “serious games” shows approximately 3.4 million entries in 2016 (search conducted by us on August 8, 2016), compared to some 1.1 million entries that was found using the same search string in 2007 (5). The definition of serious games is, however, still evolving. Various definitions of serious games can be found in the literature (1, 3, 6–9). Some definitions focus on the technological aspect of the games (3, 8), while others focus more on training (7) or educational purposes (6). In the current study, we used the following definition of serious games: games that are designed to educate, train, or change behavior as they entertain players (10). Serious games can be non-digital (11); however, most serious games in the peer-reviewed literature are delivered online or via stand-alone computer technology.
Serious games have found their way into health care (12, 13) as shown by the increase in releases in this sector from 4.7% in 2002 to 8.2% in 2011 of the total serious games market (4). For example, the serious game Re-Mission was developed in order to actively involve young people with cancer in their own treatment by educating them on cancer and its treatment (14). In recent years, the potential use of serious games in mental health care has also been explored. For example, a web-based social network electronic game designed to enhance mental health literacy in young people was developed and evaluated in a pre- and posttest design. This gaming approach was found to be effective for this purpose (d = 0.65) (15). Also, a review of the potential of using games to improve mental health professionals’ knowledge as a teaching strategy found that those allocated to educational games performed considerably better on a mental health nursing test than those health professionals who were not (16). In addition, the deployment and design of serious games for psychotherapy has recently been studied (17, 18). In a review of literature on the use of video games in psychotherapy, Ceranoglu (17) concluded that games will be likely to be used in psychotherapy as therapists gain familiarity with gaming equipment. Further, games have been developed to treat impulse-related conditions such as eating disorders (19, 20). Initial results of an evaluation study showed that patients with eating disorders feel comfortable using a serious game in treatment (20).
Other forms of digital interventions for mental disorders already exist and have been studied more extensively. Internet and computerized interventions are found to be effective for the prevention and treatment of adult common mental disorders, such as depression, anxiety, and alcohol use disorders (AUDs) (21–24). There is also evidence, albeit limited, that computerized cognitive behavioral therapy (CBT) is effective for the treatment of anxiety and depressive symptoms among young people (25–27).
Digital serious games may enrich the array of digital interventions due to their specific characteristics such as the provision of an alternative world in which learning and exploration is encouraged (2, 28). Serious games may make learning more meaningful, engaging, and challenging than traditional teaching by using the interactive, visual, and immersive characteristics available in video games (29). They may help children and adults alike to develop simpler solutions and become more creative in solving problems (30). Looking at these characteristics and benefits of video games, it seems attractive that these are being explored for their potential use in the prevention and treatment of mental disorders (31). Whether it is using games to serve a serious purpose or gamify a serious purpose, the goal is to help individuals reduce mental health complaints or improve their mental wellbeing. But how do these mental health games perform on improving mental health? Are there evidence-based serious games for the treatment or prevention of mental health symptoms?
To date, few serious games have been tested and reported in the scientific literature. A pilot study was conducted to investigate the effectiveness of a brain–computer interface in the treatment of attention deficit hyperactivity disorder (ADHD) (32). The results showed improvement in inattentive symptoms and hyperactive–impulsive symptoms after playing on the attention training game system. Furthermore, a case study has been conducted using a serious game in the treatment of specific phobia (33), indicating that serious games are helpful in reducing fear and avoidance. Results of these randomized controlled trials (RCTs) show that serious games have the potential to be used as a whole or part of treatment for mental health disorders (34, 35). Recent reviews offer a broad view on serious games or game-based digital interventions within the mental health field. Li et al. (36) have focused on game-based digital interventions for depression, including serious games, but also simulations without game elements such as virtual reality exposure therapy (VRET). VRET is exposure therapy that makes use of virtual reality (VR) to simulate a real-world situation in order to treat a specific phobia. Support for the effectiveness of game-based interventions for depression was found. In another review of serious games and mental health conducted by Van der Krieke et al. (37), the scope also comprised simulations without game elements (38, 39), VRET (40, 41), and interactive computerized interventions (42). Games and simulations are, however, different conceptual entities (43). Simulations do not necessarily contain a competitive or conflict element, in contrast to games where users try to win or cope with certain problems bounded by rules. Although some video games are based on simulations, simulations without game elements were not considered as (serious) games for this study. VRET, simulations, and interactive computerized interventions do not necessarily contain elements that make a game a game and thus should not be categorized as serious games (43). Also, since the available reviews (36, 37) included studies that are not all RCTs, questions about effectiveness could not be answered optimally. Thus while a few reviews (36, 37) have been conducted on the potential impact of serious games for common mental disorders, none of these are robust. Therefore, a contemporary update is called for, given the rapidly evolving field; and an evaluation of trials to date by means of a meta-analytic review is still lacking.
The current study aims to systematically evaluate studies that have assessed the effectiveness of serious games in treatment outcomes for mental disorder-related symptoms by means of a systematic review including a meta-analysis.
Materials and Methods
“The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA)” statement (44) was used as guideline to conduct this study.
Search and Study Selection
A literature search of the PubMed, PsycINFO, and Embase databases was conducted. The search string was a combination of serious games-related terms, such as “serious games,” “game-based,” “videogames,” “computer-assisted therapy,” “virtual reality intervention,” “gamification,” “gaming simulation,” and mental health-related terms, such as “mental health,” “depression,” “anxiety,” “problem drinking,” “schizophrenia,” and “obsessive-compulsive disorder.” Duplicate items were removed from the records that were identified through the literature search. The remaining items were screened on basis of title, abstract, and keywords by two independent raters (Ho Ming Lau and Ka Wai Ma). Items were included if the following inclusion criteria were met (a) the intervention used a digital game delivered on any technical platform including personal computers (PCs), consoles, cell phones, and handheld devices, which means that non-digital games were excluded; (b) the intervention targeted mental disorders such as those mentioned above; and (c) the study conducted an RCT. For the purpose of our study, simulations, VR interventions, and interactive programs without game elements were not considered serious games and were therefore excluded. The remaining records were assessed for eligibility by two independent raters (Ho Ming Lau and Jan Smit Jr.). Differences in ratings were resolved by discussion till a consensus was reached. If no consensus was reached, the coauthors of this paper were consulted to make the final decision.
Data Extraction and Synthesis
A data extraction sheet was developed and pretested on two studies. The variables that were extracted from the articles were divided into two categories: (1) participant and study characteristics and (2) game characteristics.
Participant and study characteristics included variables, such as target group, recruitment, treatment type (single- or multicomponent intervention), primary outcome measures, how and how much guidance during intervention was given, setting of intervention, study conditions, attrition, and results.
Game characteristics comprised variables, such as title of the game used in the study, serious game type, game genre, and purpose of the game.
Quality Assessment
The validity of the included studies was assessed using the Risk of Bias Assessment tool of the Cochrane Collaboration (45). We used the following six criteria: random sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessors, incomplete outcome data, and selective outcome reporting. Each type of risk bias was rated low, high, or unclear.
Meta-analysis
Analysis of the data was done using the program Comprehensive Meta-Analysis (CMA) (46). Cohen’s d is an effect size that can be used to indicate the standardized difference between the two means divided by the pooled standard deviation at posttest. Hedges’ g, a variation of Cohen’s d, can be used to correct for potential bias as a result of small sample sizes. In this study, Hedges’ g was applied due to a number of studies with small sample sizes. An effect size of 0.2 indicates a small effect, 0.5 indicates a moderate effect, and 0.8 to infinity indicates a large effect (47). For studies that did not provide means or standard deviations, statistics such as F value or t value were used to calculate the effect sizes according to formulae of CMA. It should be noted that one study conducted two experiments (48). Both experiments were included as separate comparisons in the meta-analysis. The random effects model was used to calculate the mean effect sizes, as we expected heterogeneity among the included studies. It assumes that the calculated effect sizes differ because of true variation in effect size from one study to the next and not only of the random error within studies. The Q-statistic was calculated to assess the presence versus absence of heterogeneity, but only significance was reported. The I2-statistic was also calculated to test the homogeneity of effect sizes. A value of 0% indicates no observed heterogeneity, while larger values indicate increasing heterogeneity, with 25% as low, 50% as moderate, and 75% as high (49). Furthermore, we estimated 95% confidence intervals (CIs) around I2 (50) using the non-central chi square-based approach within the Deducer GUI (51) of R (52).
The numbers needed to treat (NNTs) were calculated, using the formulae provided by Kraemer and Kupfer (53). By calculating the NNT, we obtained an estimation of the number of patients who need to be treated in order to have one who would benefit. The lower the NNT, the more effective the treatment is.
In studies where multiple primary outcomes were used, the effect sizes were averaged to produce a single summary effect size for use in the meta-analysis (54). Data were extracted by two independent reviewers (Ho Ming Lau and Jan Smit Jr.). Differences in extractions were resolved by consulting the coauthors.
Furthermore, two subgroup analyses were conducted according to the random effects model comparing (1) younger (≤18) versus older (>18) participants and (2) clinical versus non-clinical participants. We conducted additional subgroup analyses for the studies on the disorders, such as autism spectrum disorder (ASD), cognitive functioning, and post-traumatic stress disorder (PTSD) separately.
We examined the funnel plots visually in order to detect possible publication bias. A funnel plot is a simple scatterplot of the intervention effect against a measure of each study’s size. A symmetrical inverted appearance of the funnel plot indicates low publication bias, whereas an asymmetrical funnel plot indicates potential publication bias which may lead to an overestimation of the intervention effect (55). To verify an unbiased estimate of the pooled effect size, the Duval and Tweedie trim-and-fill analysis was performed (56). Moreover, Egger’s linear regression method was applied on the intercept to quantify the possible publication bias captured by the funnel plot and its significance.
Results
Study Selection
The PubMed, PsycINFO, and Embase search returned 4,130 items. After removal of duplicates, 3,693 records remained. Initial screening of title and abstract excluded a further 3,612 articles, leaving 81 items. After applying the exclusion criteria, 10 studies were included in the review and 9 in the meta-analysis. See Figure 1 for a flow chart of the study selection.
Figure 1. Flowchart of study inclusion.
Results of the Review
We start by reviewing some characteristics of the serious games at stake, including their game design features per disorder (Table 1). We then present the results of our meta-analysis on the impact of these games on psychiatric-related disorders.
Table 1. Characteristics of the randomized controlled trials that are included in the review.
Game Characteristics
An overview of the game characteristics can be found in Table 2. Three types of serious games in terms of design processes can be identified, namely, designed, purpose-shifted, and modified games (4). Designed serious games are games that are designed with a “serious” purpose from the beginning. Purpose-shifted serious games are games that were not designed as a serious game but are being used for a serious purpose. An example is the use of the game Tetris as part of an intervention to reduce the number flashbacks in PTSD research (48). Modified serious games are similar to purpose-shifted ones, but while purpose-shifted games are left intact, modified ones can differ from the original in terms of gameplay and characters. An example is modifying the engine of the first-person shooter game “Unreal” into a firemen training program (57). All three types (designed, purpose-shifted, and modified) of serious games were of interest for the current study. However, we found no modified games in our study. Eight studies used serious games that were designed as such (34, 35, 58–63). Two studies used an existing entertainment game for a serious purpose (purpose-shifted) (48, 64).
Table 2. Game characteristics of the randomized controlled trials that are included in the review.
We divided the variable game genre into goal-oriented, problem-solving, cognition training, and so-called exergames. Goal-oriented games focus on tasks and the end results of those tasks. Problem-solving games challenge players to find solutions for problems. Cognition training games train the players’ working memories by a series of similar brief challenges that usually have to be tackled within time constraints. Exergames are games that combine physical exercises with game elements. No exergames were identified in the current study. Six studies used serious games in the cognition training genre (48, 58, 59, 61, 63, 65). Three studies used serious games that can be categorized in two genres, namely, goal-oriented and problem-solving (34, 35, 60). One study used a serious game that was goal-oriented only (62).
All the studies used serious games for training purposes. Three of these 10 studies also had psychoeducation as a purpose (34, 35, 60).
Depression
Two RCTs targeted depression, both with the same serious game SPARX (34, 60), aimed at adolescents (aged from 12 to 19 years). In both studies, this goal-oriented and problem-solving game was used in order to reduce depression-related symptoms. This game is based on CBT (66). The version of SPARX used in the studies can be played on a PC without the need for an internet connection (however, an online version is now available at https://www.sparx.org.nz/); it can be used free of charge by collaborators in New Zealand only currently. In this game, the player controls a personalized character who has to restore the balance in a fantasy world, for instance, by solving problems and shooting negative thoughts, all components of CBT. The player is guided by a virtual character who speaks about dealing with depression and gives instructions and objectives for the seven levels in the game. Each level (or module) has a duration of approximately 30 min. The game was played under minimal supervision from educational service providers in Fleming et al. (34). The Children’s Depression Rating Scale Revised (67) was used as primary outcome measure for both studies. In Merry et al. (60), SPARX was played on primary health-care or school guidance center/health locations.
Post-traumatic Stress Disorder
Post-traumatic stress disorder was the focus in two serious game studies (48, 64). A study by Holmes et al. (48) was conducted in an attempt to deal with the limitations in an earlier study (64). Tetris was used in both studies in order to reduce PTSD-related symptoms. The theory of using Tetris is based on findings in cognitive science and neurobiology of memory. Flashbacks of traumatic events are assumed to consist of sensory-perceptual and visuospatial mental images. When visuospatial tasks are performed after a traumatic event and also within the time window of memory consolidation, competition for the same resources will occur, causing interference with and reduction of flashbacks. Tetris (68) was purpose-shifted, since it was originally developed for entertainment. Nowadays, Tetris is available on different devices and platforms (e.g., mobile, tablet, and game consoles). In both studies, the game was played on a PC in the research lab at the university. No internet connection was needed to play Tetris. In this game, a random sequence of geometric shapes consisting of four square blocks each (Tetriminos) fall down the playing field. The player has to try to make horizontal lines without gaps with the Tetriminos. When a full line is created, this line of blocks will disappear and the blocks on top of the line will fall. When the blocks reach the top of the playing field and thus no new Tetriminos are able to enter, the game ends. Within both studies by Holmes et al. (48, 64), this game was played for 10 min with little instruction needed, after watching a film containing traumatic scenes.
Autism Spectrum Disorder
Two studies used serious games to address symptoms of ASD (35, 63). Beaumont and Sofronoff (35) and Tanaka et al. (63) had facial expression as common primary outcome measure. The games are based on the theory of enhancement of emotional understanding and social skills (35) through training. The goal-oriented and problem-solving game Junior Detective Training Program (JDTP) was used in order to reduce social skills impairment (35). JDTP can be played on a PC without the need for an internet connection. In this game, the player is a junior detective in the year 2030 who is specialized in decoding suspects’ thoughts and feelings. The player plays three levels with different missions including decoding suspects’ feelings through facial expressions and body postures, deciphering cartoon character’s feelings in different situations from non-verbal and environmental clues, dealing with bullying, and playing with others. After completing the three levels, the player graduates from the “Detective Academy.” The games group was asked to play for the first hour in the first two sessions and 45 min per session in the third and fourth session. The seven sessions in total also comprised training time for parents. As primary outcome measures, one study used emotion recognition (facial expression and body posture) and emotion management (Dylan is being teased, a coping with bullying test and James and the Maths Test, a coping with anxiety test) (35).
The games of Tanaka et al. (63) are based on the theory of enhancement of recognition skills (63). The cognition training game Let’s Face It! was used in order to reduce ASD-related symptoms such as poor facial recognition skills (63). Let’s Face It! is available to the public and can be downloaded free of charge from the website of the University of Victoria (http://web.uvic.ca/~letsface/letsfaceit/); however, supervision of the player is recommended. The game can be played on the PC (or Mac) without internet connection after downloading. In Let’s Face It!, the player plays face and object recognition games that target face processing skills, e.g., matching faces and connecting faces of the same identity. Participants were instructed to play the games for at least 100 min/week at home until intervention time reached 20 h. The parents received advice from the researchers about which games their children should play based on the data collected on compliance and the child’s game play. Let’s Face It! used face subtests (face dimensions, immediate memory for faces, matching identity, masked features, expression, and parts/whole identity) and object subtests (house dimensions and immediate memory for cars) (63). Data collection was done pre- and post-intervention. The intervention had a duration of 19.1 weeks average (63).
Attention Deficit Hyperactivity Disorder
Symptoms related to ADHD were targeted in one study (59). The serious game is based on ADHD theories which argue that deficits in executive functioning are related to impulsivity, hyperactivity, and attention (69–77). The cognition training PC game Braingame Brian (78) was used in order to reduce ADHD-related symptoms. In the game, the participant plays as Brian, a young inventor who helps and befriends in-game characters by creating inventions. The games consisted of a working memory task, a cognitive flexibility task, and an inhibition task. The game was played for 25 sessions of 35–50 min each.
Cognitive Functioning
Two studies targeted cognitive functioning symptoms (58, 61), meaning limited attention capacity due to impairment (61) and age-related decline in cognitive performances including working memory, speed of processing, and cognitive control (58).
The serious games studied by Rezaiyan et al. (61) are based on the finding that playing video games based on internal motivation can be a source of increasing attention power (61). A cognition training computer games program that focused on path-finding (proceeding from easy to hard) was used in order to reduce cognitive decline symptoms (61). The cognition training games were played for 35 sessions of 20–30 min each in one study (61).
Ballesteros et al. (58) targeted children with cognitive decline symptoms, determined by the Toulouse Pierson Scale. The serious games are based on theories of neuroplasticity (58). Ballesteros et al. (58) pursued a reduction in cognitive decline symptoms by using the commercially available cognition training PC platform Lumosity (79). This game is also available on mobile devices. The serious games were played for 20 sessions of 1 h each (58).
Alcohol Use Disorder
Treatment of AUD symptoms was of interest in one study (62). The participants were recruited at a veterans’ outpatient medical center. The goal-oriented PC game Guardian Angel (80) is based on cognitive behavioral approaches (81). Guardian Angel was designed and used to reduce AUD-related symptoms. The participants played the game on a laptop at the medical center. In this game, the player acts as a “guardian angel” that needs to guide a character in early recovery of AUD to make daily decisions in support of recovery and continued abstinence. Players have to recognize and remove relapse risk factors. Guardian Angel emphasizes relapse prevention intervention techniques including identification of high-risk situations, drink-refusal skills, stimulus control, and craving-management techniques. The game was to be played during eight sessions over the course of 12 weeks. Participants in the game condition played 1 h per session, with the opportunity to play up to 8 h per session.
Results of the Meta-analysis
Study Characteristics
The participants and study characteristics of the included studies are presented in Table 1. The 10 included studies were conducted in various geographical regions ranging from Europe [Sweden (58), the United Kingdom (48, 64), the Netherlands (59)], to Australia (35), New Zealand (34, 60), Asia [Iran (61)] and the United States (62, 63). A total of 674 participants were included in the meta-analysis (380 in experimental and 294 in control group). Total sample sizes ranged from 32 to 89 participants. Two studies targeted depression (34, 60). One study focused on ADHD (59). AUD was targeted in one study (62). PTSD was the subject of two studies (48, 64). Cognitive functioning was targeted in two studies (58, 61). ASD was the focus of two studies (35, 63). Four studies were aimed at children aged between 7 and 12 years (35, 59, 61, 63), two studies focused on teens to young adults (aged between 12 and 18), three studies were aimed at adults (18+) (34, 48, 60, 62, 64), and one study was aimed at older adults aged between 57 and 80 years (58). Six studies compared serious games to no intervention (34, 35, 58, 61, 63, 64); three studies compared them to active controls, such as training cognitive tasks, playing a quiz, and watching slides (48, 59, 62); and one study compared gaming to treatment as usual (TAU) (60).
Two studies used serious games in adjunct to TAU (35, 62). The serious games were played in different settings: three studies were conducted in a research laboratory (48, 58, 64), two at an educational institution (34, 35), two at home (59, 63), two at a health-care center (60), and one remained unclear (61).
The total number of comparisons that could be included in the analysis was n = 9. The study of Verduin et al. (62) on AUD did not provide amenable data for inclusion in the meta-analysis and is therefore excluded (Table 3).
Table 3. Effects of serious games on reducing psychiatric disorder-related symptoms in comparison with control groups and two subgroup analyses.
These studies evaluated the effectiveness of serious games across a broad range of mental disorders and outcomes. The common ground between the included studies is, however, the evaluation through RTCs of possible improvement to mental health symptoms using serious games. Though the studies varied in the use of outcome measures for behavior change, its construct may be measured validly using meta-analytic methods by taking an average of outcome measures of the same construct (82). Firstly, an overall meta-analysis was conducted, which means that we looked at whether participants in the serious game conditions improved over the control conditions. Secondly, a meta-analysis was conducted per disorder using a similar approach.
Risk of Bias
Figure 2 shows the results of the methodological assessment of the included studies in the meta-analysis. Five studies reported adequate random sequence generation (34, 59, 60, 62, 63). Two studies reported allocation to be concealed (59, 60). Two studies reported that both participants and personnel were blinded (59, 60). Three studies reported that research assistants were blinded for the outcome assessment (35, 59, 60). Four studies had a high likelihood of incomplete outcome data (35, 58, 60, 63). Several domains were rated unclear—the reason for this was incomplete reporting.
Figure 2. Risk of bias graph.
Publication Bias
Visual inspection of the funnel plot indicated possible publication bias. Performance of the Duval and Tweedie trim-and-fill procedure also indicated possible publication bias. After adjustment for missing studies, the effect size for serious games interventions changed from g = 0.63 to 0.48 (95% CI 0.17–0.78; trimmed studies = 2). The Egger’s test did not indicate an asymmetrical funnel plot (P > 0.10).
Meta-analyses Outcomes
The overall outcome of the nine studies (n = 10 comparisons) showed a moderately significant effect size of g = 0.55 (95% CI 0.28–0.83, P < 0.001) for improvement on mental disorder symptoms at posttest (see Figure 3). Heterogeneity was substantial and significant (I2 = 58.53, 95% CI 1.31–34.15, P < 0.05) (Table 3). One study (60) had a control group that received TAU in contrast to the other studies (no treatment or waitlist). After excluding this study, a significant moderate almost similar effect size remained, g = 0.63 [95% CI 0.36–0.90, P < 0.001, NNT = 2.91] (Figure 4). Excluding the study with the highest (34) and lowest (63) effect size showed similar results (see Table 3).
Figure 3. Standardized effect sizes of serious gaming interventions for mental health compared with control group.
Figure 4. Standardized effect sizes of serious gaming interventions for mental health compared with control group. Note: study with treatment as usual as control group removed from analysis.
We then conducted meta-analyses on psychiatric disorder-related symptoms for those where two or more studies were available (Table 3). This was the case for ASD (35, 63), cognitive functioning (58, 61), and PTSD (48, 64). The group that aimed at ASD-related symptoms such as lowered ability of recognition skills (35, 63) was shown to have a moderate non-significant (P > 0.05) effect size [g = 0.46 (95% CI 0.10–0.81, NNT = 3.91)]. The group targeting cognitive functioning-related symptoms such as lower attentional ability (58, 61) showed a large significant effect [g = 0.79 (95% CI 0.36–1.21, P < 0.05, NNT = 2.36)]. The group targeting PTSD-related symptoms such as flashbacks (48, 64) showed a moderate significant effect size [g = 0.59 (95% CI 0.20–0.99, P < 0.05, NNT = 3.09)].
We also conducted two subgroup analyses, grouping the studies by age and participant type. The group targeting youth (≤18) (34, 35, 59–61, 63) was shown to have a moderate effect size [g = 0.70 (95% CI 0.32–1.07, NNT = 2.63)] differing non-significantly from the adult group (18+) (48, 58, 64) [g = 0.53 (95% CI 0.07–0.99, NNT = 3.42)]. The group targeting clinical participants (with diagnosed mental disorder) (35, 59, 61, 63) showed a moderate effect size of [g = 0.59 (95% CI 0.18–0.99, NNT = 3.09)] differing non-significantly from the non-clinical group (34, 48, 58, 64) [g = 0.68 (95% CI 0.26–1.09, NNT = 2.70)].
Discussion
Summary of Results
This study aimed to give an overview of serious games for mental health-related symptoms that were evaluated with RCTs.
There were eight different games in our study. One of the games, SPARX, is both a goal-oriented and problem-solving game. The games Guardian Angel and JDTP are goal-oriented games. Five games (Tetris, Let’s Face It!, Braingame Brian, Lumosity, and “path-finding”) were categorized as cognition training games. In order to ascertain which game genre works best in targeting specific mental disorder symptoms more exploration is needed and studies need to be replicated.
All of the serious games were PC applications that required no internet connection to play. However, trends show that PC sales are declining, tablet sales are increasing, more time is spent on the smartphone and that most time spent on the smartphone is in playing games (in the US). It seems that the development and/or validation of serious games for mental health on this technical platform is lagging behind. As Fleming et al. (83) remarked, many mental health apps are already available. It is clear that considerable opportunities lie in this area. Accessibility and feasibility can be improved if this area is utilized. Software can be conveniently downloaded or distributed in app stores already available on smartphones.
We included 10 studies in the review that comprised 8 different serious games. The studies targeted depression-related symptoms, ASD, PTSD, ADHD, cognitive functioning, and AUD. The results of the meta-analysis showed a mean moderate effect size of these serious games for reducing psychiatric disorder-related symptoms. This finding is similar to that of a recently conducted meta-analysis of game-based interventions by Li et al. (36) for depression only. The effect sizes found in this study correspond to NNTs of approximately 3, indicating that three patients have to be treated in order to have one who would benefit, slightly lower than Li and colleagues. However, Li and colleagues did not confine their meta-analysis to serious games—they included simulation studies as well. The clinical impact for the youth group (≤18, g = 0.70, n = 5) is comparable to the adult group (g = 0.53), as in the Li et al.’s study (36).
These findings indicate that serious games for mental health-related symptoms have potential for various age groups. Our results compare favorably to those found in the review of serious games for depression only by Fleming et al. (83). This review was not confined to RCTs. Comparing our results with internet interventions that are not serious game based is more complex due to the differences in setting, study designs, and outcomes applied. A very generic comparison, with similar results could be made with the meta-analysis of Ebert et al. (27) on youth (2015) who likewise found evidence for the moderate efficacy of internet and computer-based CBT in the treatment of depression and anxiety (g = 0.76). Regarding adults, another meta-analysis on the impact of internet-based depression interventions (18 RCTs) of Cowpertwait and Clarke (84) likewise showed that web-based interventions targeting adult depression reduced symptoms moderately significantly compared to controls (g = 0.43). This study also showed that reminders and guidance are important moderators for treatment outcome.
The majority of studies focused on youth and young adults especially for ASD, ADHD, and depression (34, 35, 59–61, 63). Games for children with ASD-related symptoms showed comparable moderate effect as found by Grynszpan et al. (85) for technology-based (non-serious gaming) interventions for children with autism spectrum-related symptoms (d = 0.47). Studies using serious games targeting cognitive functioning were available for both adults and youth.
No serious games primarily targeting anxiety were found in this study. This finding may not be surprising, because this can be expected of a relatively new field of research. Another explanation could be that game elements do not add much more to VRET, which is found to have potential to combat anxiety (86–88).
Strengths and Limitations
The strength of this study is that it is the first to provide insight into the potential effectiveness of serious games on psychiatric disorder-related symptoms based on RCTs only and on a strict definition of what is regarded to be a “serious game.” This is important as RCTs are considered the gold standard of research to measure effectiveness of interventions and to make clear what a serious game is or is not. This study has some limitations as well. First, the number of studies that were eligible for inclusion in this review was small and the number of participants included in those studies likewise. The risk of bias in these studies was unclear in many cases due to incomplete reporting and may have been a problem (selection, performance, and detection bias) indicating that the methodological quality of studies could be improved and effect sizes could be overestimated. Furthermore, given the small number of studies, several mental health disorders and clinical outcomes were collated as psychiatric-related disorders instead of focusing on single ones. This means the findings can only indicate improvement instead of clear symptom reduction (89). Such an approach is, however, not uncommon in an evolving new domain of academic endeavor [see, e.g., Ref. (89)]. As a consequence, we decided not to conduct subgroup analyses of distinct mental disorders as the number of studies and power for doing so was too low.
Conclusion
Using serious games as interventions for reducing mental health problems appears feasible. Due to the limited number of RCTs that we have been able to include in this analysis, this review can only give an idea of the potential of serious games for treating mental disorders in the future. More RCTs are needed to determine the effectiveness of serious games. Future studies should not lose the technological development out of sight. Smartphone-based serious games for mental health need more exploration. Further, the effect and use of serious games for mental health that let players connect with other players using an internet connection need to be investigated.
Author Contributions
HL: substantial contribution to every aspect of the manuscript, critical revision, and final approval and agrees to be accountable. JS: substantial contribution to design/conception, analysis, critical revision, and final approval and agrees to be accountable. TF: substantial contribution to interpretation of data, critical revision, and final approval and agrees to be accountable. HR: substantial contribution to design/conception, analysis, interpretation of data, critical revision, and final approval and agrees to be accountable.
Conflict of Interest Statement
TF is a codeveloper of SPARX computerized therapy for depression and can benefit from any commercialization of it outside of New Zealand. The remaining authors have no conflict of interest to declare.
Acknowledgments
The authors would like to express their sincere thanks to Ms. Ka Wai Ma for assisting with the study selection and Mr. Jan Smit Jr. for helping with the data extraction.
References
1. Michael DR, Chen SL. Serious Games: Games That Educate, Train, and Inform. Education. (2005). p. 1–95. Available from: http://portal.acm.org/citation.cfm?id=1051239
2. Stapleton AJ. Serious Games: Serious Opportunities. Health Care. (Vol. 1). Don Mills (2004). p. 1–6. Available from: https://www.researchgate.net/profile/Andrew_Stapleton/publication/228384342_Serious_games_Serious_opportunities/links/0f31752f7505603c5a000000.pdf
3. Sawyer B, Rejeski D. Serious Games: Improving Public Policy through Game Based Learning and Simulation. (2002). Available from: https://www.scribd.com/document/38259791/Serious-Games-Improving-Public-Policy-through-Gamebased-Learning-and-Simulation
4. Djaouti D, Alvarez J, Jessel J, Rampnoux O. Origins of serious games. In Serious Games and Edutainment Applications. London: Springer (2011). p. 25–43.
5. Susi T, Johannesson M, Backlund P. Serious Games – An Overview. Sweden: School of Humanities and Informatics, University of Skövde (2007). Technical Report HS-IKI-TR-07-001.
7. Annetta LA. The “I’s” have it: a framework for serious educational game design. Rev Gen Psychol (2010) 14(2):105–12. doi: 10.1037/a0020505
8. Göbel S, Hardy S, Wendel V. Serious Games for Health – Personalized Exergames. Proceedings of the 18th ACM International Conference on Multimedia (2010). p. 1663–6
10. Stokes B. Videogames have changed: time to consider “serious games”? Development Education Journal (2005) 11(3):12–14.
11. Khazaal Y, Favrod J, Azoulay S, Finot SC, Bernabotto M, Raffard S, et al. “Michael’s Game,” a card game for the treatment of psychotic symptoms. Patient Educ Couns (2011) 83(2):210–6. doi:10.1016/j.pec.2010.05.017
12. Adams SA. Use of “serious health games” in health care: a review. Stud Health Technol Inform (2010) 157:160–6. doi:10.3233/978-1-60750-569-3-160
13. Kato PM. Video games in health care: closing the gap. Rev Gen Psychol (2010) 14(2):113–21. doi:10.1037/a0019441
14. Beale IL, Kato PM, Marin-Bowling VM, Guthrie N, Cole SW. Improvement in cancer-related knowledge following use of a psychoeducational video game for adolescents and young adults with cancer. J Adolesc Health (2007) 41(3):263–70. doi:10.1016/j.jadohealth.2007.04.006
15. Li TMH, Chau M, Wong PWC, Lai ESY, Yip PSF. Evaluation of a web-based social network electronic game in enhancing mental health literacy for young people. J Med Internet Res (2013) 15(5):e80. doi:10.2196/jmir.2316
16. Bhoopathi PS, Sheoran R, Adams CE. Educational games for mental health professionals: a Cochrane review. Int J Psychiatr Nurs Res (2007) 12(3):1497–502.
17. Ceranoglu TA. Video games in psychotherapy. Rev Gen Psychol (2010) 14(2):141–6. doi:10.1037/a0019439
18. Wilkinson N, Ang RP, Goh DH. Online video game therapy for mental health concerns: a review. Int J Soc Psychiatry (2008) 54(4):370–82. doi:10.1177/0020764008091659
19. Fagundo AB, Santamaría JJ, Forcano L, Giner-Bartolomé C, Jiménez-Murcia S, Sánchez I, et al. Video game therapy for emotional regulation and impulsivity control in a series of treated cases with bulimia nervosa. Eur Eat Disord Rev (2013) 21(6):493–9. doi:10.1002/erv.2259
20. Fernández-Aranda F, Jiménez-Murcia S, Santamaría JJ, Gunnard K, Soto A, Kalapanidas E, et al. Video games as a complementary therapy tool in mental disorders: PlayMancer, a European multicentre study. J Ment Health (2012) 21:364–74. doi:10.3109/09638237.2012.664302
21. Richards D, Richardson T. Computer-based psychological treatments for depression: a systematic review and meta-analysis. Clin Psychol Rev (2012) 32(4):329–42. doi:10.1016/j.cpr.2012.02.004
22. Andersson G, Cuijpers P, Carlbring P, Riper H, Hedman E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: a systematic review and meta-analysis. World Psychiatry (2014) 13(3):288–95. doi:10.1002/wps.20151
23. Cuijpers P, Riper H. Internet interventions for depressive disorders: an overview. Rev Psicopatol Psicol Clín (2014) 19(3):209–16. doi:10.5944/rppc.vol.19.num.3.2014.13902
24. Riper H, Blankers M, Hadiwijaya H, Cunningham J, Clarke S, Wiers R, et al. Effectiveness of guided and unguided low-intensity internet interventions for adult alcohol misuse: a meta-analysis. PLoS One (2014) 9(6):e99912. doi:10.1371/journal.pone.0099912
25. Calear AL, Christensen H, Mackinnon A, Griffiths KM, O’Kearney R. The YouthMood Project: a cluster randomized controlled trial of an online cognitive behavioral program with adolescents. J Consult Clin Psychol (2009) 77(6):1021–32. doi:10.1037/a0017391
26. Richardson T, Stallard P, Velleman S. Computerised cognitive behavioural therapy for the prevention and treatment of depression and anxiety in children and adolescents: a systematic review. Clin Child Fam Psychol Rev (2010) 13(3):275–90. doi:10.1007/s10567-010-0069-9
27. Ebert DD, Zarski A-C, Christensen H, Stikkelbroek Y, Cuijpers P, Berking M, et al. Internet and computer-based cognitive behavioral therapy for anxiety and depression in youth: a meta-analysis of randomized controlled outcome trials. PLoS One (2015) 10(3):e0119895. doi:10.1371/journal.pone.0119895
29. Stapleton A, Taylor P. Why videogames are cool and school sucks! Australian Game Developers Conference (AGDC). (2003). Available from: http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.323.4909&rep=rep1&type=pdf
30. Durkin K, Aisbett K. Computer Games and Australians Today. Sydney: Office of Film and Literature Classification (1999).
31. Gamberini L, Barresi G, Majer A, Scarpetta F. A game a day keeps the doctor away: a short review of computer games in mental healthcare. J Cyber Ther Rehabil (2008) 1(2):127–45.
32. Lim CG, Lee TS, Guan C, Sheng Fung DS, Cheung YB, Teng SS, et al. Effectiveness of a brain-computer interface based programme for the treatment of ADHD: a pilot study. Psychopharmacol Bull (2010) 43(1):73–82.
33. Botella C, Bretón-López J, Quero Castellano S, Baños RM, García-Palacios A, Zaragozá I, et al. Treating cockroach phobia using a serious game on a mobile phone and augmented reality exposure: a single case study. Comput Human Behav (2011) 27(1):217–27. doi:10.1016/j.chb.2010.07.043
34. Fleming T, Dixon R, Frampton C, Merry S. A pragmatic randomized controlled trial of computerized CBT (SPARX) for symptoms of depression among adolescents excluded from mainstream education. Behav Cogn Psychother (2012) 40(05):529–41. doi:10.1017/S1352465811000695
35. Beaumont R, Sofronoff K. A multi-component social skills intervention for children with Asperger syndrome: the Junior Detective Training Program. J Child Psychol Psychiatry (2008) 49(7):743–53. doi:10.1111/j.1469-7610.2008.01920.x
36. Li J, Theng Y-L, Foo S. Game-based digital interventions for depression therapy: a systematic review and meta-analysis. Cyberpsychol Behav Soc Netw (2014) 17(8):519–27. doi:10.1089/cyber.2013.0481
37. Van der Krieke L, Sytema S, de Jonge P. Serious Games for People with Mental Health Problems: A Systematic Review. Groningen: Rijksuniversiteit Groningen (2012).
38. Mosso JL, Gorini A, De La Cerda G, Obrador T, Almazan A, Mosso D, et al. Virtual reality on mobile phones to reduce anxiety in outpatient surgery. Stud Health Technol Inform (2009) 142:195–200. doi:10.3233/978-1-58603-964-6-195
39. Riva G, Bacchetta M, Cesa G, Conti S, Castelnuovo G, Mantovani F, et al. Is severe obesity a form of addiction? Rationale, clinical approach, and controlled clinical trial. Cyberpsychol Behav (2006) 9:457–79. doi:10.1089/cpb.2006.9.457
40. St-Jacques J, Bouchard S, Bélanger C. Is virtual reality effective to motivate and raise interest in phobic children toward therapy? A clinical trial study of in vivo with in virtuo versus in vivo only treatment exposure. J Clin Psychiatry (2010) 71(7):924–31. doi:10.4088/JCP.08m04822blu
41. Tortella-Feliu M, Botella C, Llabrés J, Bretón-López JM, del Amo AR, Baños RM, et al. Virtual reality versus computer-aided exposure treatments for fear of flying. Behav Modif (2011) 35(1):3–30. doi:10.1177/0145445510390801
42. Margalit M. Promoting classroom adjustment and social skills for students with mental retardation within an experimental and control group design. Exceptionality (1991) 2:195–204. doi:10.1080/09362839109524783
43. Sauvé L, Renaud L, Kaufman D, Marquis JS. Distinguishing between games and simulations: a systematic review. Educ Techno Soc (2007) 10(3):247–56.
44. Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses. Ann Intern Med (2014) 151(2):264–9.
45. Higgins JPT, Green S. Cochrane Handbook for Systematic Reviews of Interventions Version 5.1.0 [Updated March 2011]. Hoboken, NJ: The Cochrane Collaboration (2011).
46. Smith J. Comprehensive Meta-Analysis (Version 2) [Computer software]. Englewood, NJ: Biostat (2014). Available from: http://www.comprehensive.com
47. Cohen J. Statistical Power Analysis for the Behavioral Sciences. (1988). 567 p. Available from: http://www.worldcat.org/title/statistical-power-analysis-for-the-behavioral-sciences/oclc/17877467
48. Holmes EA, James EL, Kilford EJ, Deeprose C. Key steps in developing a cognitive vaccine against traumatic flashbacks: visuospatial tetris versus verbal pub quiz. PLoS One (2010) 5(11):e13706. doi:10.1371/journal.pone.0013706
49. Higgins JPT, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta-analyses. BMJ (2003) 327(7414):557–60. doi:10.1136/bmj.327.7414.557
50. Ioannidis JP, Patsopoulos NA, Evangelou E. Uncertainty in heterogeneity estimates in meta-analyses. BMJ (2007) 335(7626):914–6. doi:10.1136/bmj.39343.408449.80
51. Fellows I. Deducer: a data analysis GUI for R. J Stat Softw (2012) 49(8):1–15. doi:10.18637/jss.v049.i08
52. R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing (2016). 409 p. Available from: https://www.r-project.org
53. Kraemer HC, Kupfer DJ. Size of treatment effects and their importance to clinical research and practice. Biol Psychiatry (2006) 59:990–6. doi:10.1016/j.biopsych.2005.09.014
54. Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to Meta-Analysis. Chicester: John Wiley & Sons (2011).
55. Egger M, Davey Smith G, Schneider M, Minder C. Bias in meta-analysis detected by a simple, graphical test. BMJ (1997) 315(7109):629–34. doi:10.1136/bmj.315.7109.629
56. Duval S, Tweedie R. Trim and fill: a simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics (2000) 56(2):455–63. doi:10.1111/j.0006-341X.2000.00455.x
58. Ballesteros S, Prieto A, Mayas J, Toril P, Pita C, Ponce de Leon L, et al. Brain training with non-action video games enhances aspects of cognition in older adults: a randomized controlled trial. Front Aging Neurosci (2014) 6:277. doi:10.3389/fnagi.2014.00277
59. Dovis S, Van Der Oord S, Wiers RW, Prins PJM. Improving executive functioning in children with ADHD: training multiple executive functions within the context of a computer game. A randomized double-blind placebo controlled trial. PLoS One (2015) 10(4):e0121651. doi:10.1371/journal.pone.0121651
60. Merry SN, Stasiak K, Shepherd M, Frampton C, Fleming T, Lucassen MFG. The effectiveness of SPARX, a computerised self help intervention for adolescents seeking help for depression: randomised controlled non-inferiority trial. BMJ (2012) 344(3):e2598. doi:10.1136/bmj.e2598
61. Rezaiyan A, Mohammadi E, Fallah PA. Effect of computer game intervention on the attention capacity of mentally retarded children. Int J Nurs Pract (2007) 13(5):284–8. doi:10.1111/j.1440-172X.2007.00639.x
62. Verduin ML, LaRowe SD, Myrick H, Cannon-Bowers J, Bowers C. Computer simulation games as an adjunct for treatment in male veterans with alcohol use disorder. J Subst Abuse Treat (2013) 44(3):316–22. doi:10.1016/j.jsat.2012.08.006
63. Tanaka JW, Wolf JM, Klaiman C, Koenig K, Cockburn J, Herlihy L, et al. Using computerized games to teach face recognition skills to children with autism spectrum disorder: the Let’s Face It! program. J Child Psychol Psychiatry (2010) 51(8):944–52. doi:10.1111/j.1469-7610.2010.02258.x
64. Holmes EA, James EL, Coode-Bate T, Deeprose C. Can playing the computer game “Tetris” reduce the build-up of flashbacks for trauma? A proposal from cognitive science. PLoS One (2009) 4(1):1–6. doi:10.1371/journal.pone.0004153
65. Horowitz M, Wilner N, Alvarez W. Impact of Event Scale: a measure of subjective stress. Psychosom Med (1979) 41(3):209–18. doi:10.1097/00006842-197905000-00004
66. Burns DD. The Feeling Good Handbook. Chemistry & Biodiversity (1999). p. 1–7. Available from: http://onlinelibrary.wiley.com/doi/10.1002/cbdv.200490137/abstract
67. Poznanski EO, Mokros HB. Children’s Depression Rating Scale-Revised: Manual. Los Angeles: Western Psychological Services (1996).
69. Barkley RA. Attention-Deficit Hyperactivity Disorder: A Handbook for Diagnosis and Treatment. New York, NY: Guilford Press (2006).
70. Nigg JT. What Causes ADHD? Understanding What Goes Wrong and Why. New York: Guilford Press (2006).
71. Rapport MD, Bolden J, Kofler MJ, Sarver DE, Raiker JS, Alderson RM. Hyperactivity in boys with attention-deficit/hyperactivity disorder (ADHD): a ubiquitous core symptom or manifestation of working memory deficits? J Abnorm Child Psychol (2009) 37(4):521–34. doi:10.1007/s10802-008-9287-8
72. Burgess GC, Depue BE, Ruzic L, Willcutt EG, Du YP, Banich MT. Attentional control activation relates to working memory in attention-deficit/hyperactivity disorder. Biol Psychiatry (2010) 67(7):632–40. doi:10.1016/j.biopsych.2009.10.036
73. Crosbie J, Arnold P, Paterson A, Swanson J, Dupuis A, Li X, et al. Response inhibition and ADHD traits: correlates and heritability in a community sample. J Abnorm Child Psychol (2013) 41(3):497–507. doi:10.1007/s10802-012-9693-9
74. Kofler MJ, Rapport MD, Bolden J, Sarver DE, Raiker JS. ADHD and working memory: the impact of central executive deficits and exceeding storage/rehearsal capacity on observed inattentive behavior. J Abnorm Child Psychol (2010) 38(2):149–61. doi:10.1007/s10802-009-9357-6
75. Raiker JS, Rapport MD, Kofler MJ, Sarver DE. Objectively-measured impulsivity and attention-deficit/hyperactivity disorder (ADHD): testing competing predictions from the working memory and behavioral inhibition models of ADHD. J Abnorm Child Psychol (2012) 40(5):699–713. doi:10.1007/s10802-011-9607-2
76. Rapport MD, Chung KM, Shore G, Isaacs P. A conceptual model of child psychopathology: implications for understanding attention deficit hyperactivity disorder and treatment efficacy. J Clin Child Psychol (2001) 30(1):48–58. doi:10.1207/S15374424JCCP3001_6
77. Tillman C, Eninger L, Forssman L, Bohlin G. The relation between working memory components and ADHD symptoms from a developmental perspective. Dev Neuropsychol (2011) 36(2):181–98. doi:10.1080/87565641.2010.549981
78. Prins PJM, Brink ET, Dovis S, Ponsioen A, Geurts HM, de Vries M, et al. “Braingame Brian”: toward an executive function training program with game elements for children with ADHD and cognitive control problems. Games Health J (2013) 2(1):44–9. doi:10.1089/g4h.2013.0004
80. Bowers C, Procci K, Joyce R, Verduin M, LaRowe S, Mynck H, et al. Serious games for therapy: a training perspective. J Cyber Ther Rehabil (2011) 4(4):447–53.
81. Marlatt GA, Gordon JR. Relapse Prevention: Maintenance Strategies in the Treatment of Addictive Behaviors. New York: Guilford Press (1985).
83. Fleming TM, Cheek C, Merry SN, Thabrew H, Bridgman H, Stasiak K, et al. Serious games for the treatment or prevention of depression: a systematic review. Revista de Psicopatología y Psicología Clínica (2014) 19:227–42. doi:10.5944/rppc.vol.19.num.3.2014.13904
84. Cowpertwait L, Clarke D. Effectiveness of web-based psychological interventions for depression: a meta-analysis. Int J Ment Health Addict (2013) 11(2):247–68. doi:10.1007/s11469-012-9416-z
85. Grynszpan O, Weiss PLT, Perez-Diaz F, Gal E. Innovative technology-based interventions for autism spectrum disorders: a meta-analysis. Autism (2014) 18(4):346–61. doi:10.1177/1362361313476767
86. Gregg L, Tarrier N. Virtual reality in mental health. A review of the literature. Soc Psychiatry Psychiatr Epidemiol (2007) 42:343–54. doi:10.1007/s00127-007-0173-4
87. Eichenberg C, Wolters C. Virtual realities in the treatment of mental disorders: a review of the current state of research. Virtual Reality in Psychological, Medical and Pedagogical Applications. (2012). p. 35–64. Available from: http://cdn.intechopen.com/pdfs/39049/InTech-Virtual_realities_in_the_treatment_of_mental_disorders_a_review_of_the_current_state_of_research.pdf
88. Opris D, Pintea S, Garcia-Palacios A, Botella C, Szamoskozi S, David D. Virtual reality exposure therapy in anxiety disorders: a quantitative meta-analysis. Depress Anxiety (2012) 29(2):85–93. doi:10.1002/da.20910
Keywords: serious games, gamification, game-based intervention, depression, anxiety, post-traumatic stress disorder, alcohol, attention
Citation: Lau HM, Smit JH, Fleming TM and Riper H (2017) Serious Games for Mental Health: Are They Accessible, Feasible, and Effective? A Systematic Review and Meta-analysis. Front. Psychiatry 7:209. doi: 10.3389/fpsyt.2016.00209
Received: 17 August 2016; Accepted: 21 December 2016;
Published: 18 January 2017
Edited by:
Stéphane Bouchard, Université du Québec en Outaouais, CanadaReviewed by:
Martin Desseilles, University of Namur, BelgiumErika Comasco, Uppsala University, Sweden
Copyright: © 2017 Lau, Smit, Fleming and Riper. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ho Ming Lau, aG0mI3gwMDA0MDtsYXUuaW0=