Martin Johannes Dechant
Julian Frommel
Regan Lee Mandryk- Human-Computer-Interaction Laboratory, Department of Computer Science, University of Saskatchewan, Saskatoon, SK, Canada
Social relationships are essential for humans; neglecting our social needs can reduce wellbeing or even lead to the development of more severe issues such as depression or substance dependency. Although essential, some individuals face major challenges in forming and maintaining social relationships due to the experience of social anxiety. The burden of social anxiety can be reduced through accessible assessment that leads to treatment. However, socially anxious individuals who seek help face many barriers stemming from geography, fear, or disparities in access to systems of care. But recent research suggested digital behavioral markers as a way to deliver cheap and easily accessible digital assessment for social anxiety: As earlier work shows, players with social anxiety show similar behaviors in virtual worlds as in the physical world, including tending to walk farther around other avatars and standing farther away from other avatars. The characteristics of the movement behavior in-game can be harnessed for the development of digital behavioral markers for the assessment of social anxiety. In this paper, we investigate whether implicit as well as explicit digital behavioral markers, proposed by prior work, for social anxiety can be used for predicting the level of social anxiety. We show that both, explicit and implicit digital behavioral markers can be harnessed for the assessment. Our findings provide further insights about how game-based digital behavioral markers can be used for the assessment of social anxiety.
Introduction
Social anxiety, one of the most common mental problems worldwide (Kessler et al., 2005), is characterized by the intense fear of being exposed to the judgment of others. This intense fear may push affected individuals to withdraw from social interaction or can lead to elevated stress when facing an unavoidable social encounter (National Collaborating Centre for Mental Health, 2013; Karasewich and Kuhlmeier, 2020). But this intense fear of evaluation in social contexts stands in strong contrast to the universal human need to be part of a social group and form and maintain social bonds with others (Deci and Ryan, 2000; Taormina and Gao, 2013). As prior research shows, social anxiety is a highly prevalent mental illness worldwide and especially affects children and adolescents (Rao et al., 2007; Knappe et al., 2015). Unfortunately, the characteristic social inhibition and withdrawal of affected individuals are often mistaken for shyness by others or perceived as a character flaw by the individual (Heiser et al., 2009; Poole et al., 2017). Additionally, social anxiety and the underlying fear of any evaluation may cause individuals to avoid consultation with mental health professionals about their concerns (Lecrubier et al., 2000). As a result, only a minority of socially anxious individuals receive treatment (Ruscio et al., 2008). Individuals seeking help have to face not only the challenges of the mental disorder and the inherent social fears themselves, but also have to overcome sociocultural barriers, such as stigmatization and discrimination of mental health problems, economic barriers (Vigo et al., 2016), such as lack of financial coverage for mental health treatments, and geographical barriers (e.g., limited access to mental health care in remote communities) (Olfson et al., 2000; Kumar and Phookun, 2016).
The heavy burden of social anxiety may be decreased through early and easily accessible assessment; prior work showed that early assessment of social anxiety in adolescenthood—which is a critical time for the development of social anxiety (Velting and Albano, 2001; Rao et al., 2007)—increases the efficacy of treatment and could prevent the development of the most harmful effects (Dams et al., 2017). Prior research suggests evidence-based assessment of social anxiety as a reliable way to identify affected individuals (Silverman and Ollendick, 2005). This approach combines information gathered from multiple perspectives to characterize the patient’s concerns, develop suitable treatment strategies, and monitor the patient’s response to the selected treatment approaches (Tulbure et al., 2012). Assessment combines the personal perspective of the patient and the analysis of the patient’s behavior when confronted with social situations (Gordon et al., 2014). Mental health professionals utilize standardized questionnaires and interviews, in which the expert identifies concerns and the potential severity of social anxiety. While this approach is very effective in most cases, the subjective answers may be biased by several problems related to self-report measurements such as social desirability bias (Van de Mortel, 2008) and practice effect (Calamia et al., 2012). Within the context of social anxiety, these biases can often occur due to the desire of the patients to “please” the expert or to fit into the surrounding cultural and social context (Furnham and Henderson, 1982). To compensate for these effects, experts analyze behavioral data either by recording the reaction of the patient while being exposed to social situations within clinical assessment or by interviewing people close to the patient (Antony and Rowa, 2005). However, these approaches of behavioral information gathering are time consuming, can become expensive, and further involve additional people beyond the patient and the expert, which can introduce biases and false assumptions leading to biased conclusions (Davis, 2009; Ollendick and Davis, 2012). However, any accurate assessment is prevented when socially anxious individuals avoid reaching out for support because they are ashamed of their illness or in fear of negative evaluation (Lecrubier et al., 2000).
But prior research suggests a promising tool to assist existing techniques in assessing social anxiety: digital biomarkers. Digital biomarkers are measurable responses gathered from digital devices and used to reliably predict the incidence of a dysfunction or disorder (Gielis et al., 2019; Mandryk and Birk, 2019). Digital biomarkers can be harnessed to predict the severity of a disease and increase the temporal and spatial resolution of recorded behavior during an assessment (Dorsey et al., 2017). Furthermore, digital biomarkers are more resistant against human bias and may be less stress-inducing for patients (Shehab and Abdulle, 2011). Through various sensors [e.g., gaze tracking (Dechant et al., 2017)], platforms [e.g., social media platforms (Pourmand et al., 2019)], and devices [e.g., smartphones and wearables (Huang et al., 2016; Jacobson et al., 2020)], researchers can access a rich source of previously unobtainable insights, recorded with minimal effort from the patient and the expert alike (Torous et al., 2017). One subcategory of these digital biomarkers are digital behavioral markers which focus on the overall behavior, such as movement patterns using GPS coordinates (Mohr et al., 2017). More recently, motivated to harness the popularity of digital games, researcher have started to develop ways to incorporate game-based digital behavioral markers into the context of mental-health assessment (Dechant M. et al., 2021).
In 2019, two-thirds of the online population enjoy digital games (Wijman, 2020), including players of all ages, genders, and ethnicities from around the world. While enjoying digital games, players produce a large volume of data that can be used to create digital behavioral markers for the assessment of mental health concerns. Mandryk and Birk (2019) describe two complementary ways for developing game-based biomarkers: by harnessing in-game behavior data, which was produced naturally through interactions with the digital game or by developing custom games that place a player in a relevant context and record their response or performance using known behavioral correlates of mental health. Within the context of social anxiety, prior research outlined several reasons why behaviors related to social anxiety may translate into the context of a game: First, interpersonal interaction biases of the physical world have also been observed in similar player-avatar interactions (Bian et al., 2015); second, cognition biases and the characteristic avoidance behavior of social anxiety have been shown to manifest in-game as players of massively multiplayer online role player games (MMORPG) affected by social anxiety tend to avoid social interactions and highly challenging activities (Dechant et al., 2020). Third, prior research shows typical avoidance behavior of social anxiety in virtual reality simulations (Lange and Pauli, 2019). Finally, the media equation theory suggests that people react to computers with social responses (Nass and Moon, 2000; Rehm et al., 2016), which likely includes how socially anxious individuals react to virtual characters.
In developing digital behavioral markers, a first step is to identify behaviors that are characteristic of the mental health concern; the next step is to determine if these behaviors can be measured reliably by a system.
Characteristic Behaviors of Social Anxiety
At the core of social anxiety is an intense fear of potential exposure to negative or positive evaluation from others (National Collaborating Centre for Mental Health, 2013; Spence and Rapee, 2016). This fear leads to changes in an individual’s behavior, for example social withdrawal, but also in physical symptoms such as blushing, trembling, or sweating. Prior work suggests that social anxiety is one of the most common anxiety disorders with a population prevalence of 2.0% (Fehm et al., 2005, 2008). This mental burden is most accurately expressed along a severity continuum where someone can experience a high level of social anxiety but not reach the threshold for a clinical diagnosis (Spence and Rapee, 2016). Several personal as well as environmental risk factors, such as social environment, can cause the development of social anxiety and affect how individuals could be affected by this mental burden. For example, people may experience high social anxiety only in a certain context, such as presenting in front of an unfamiliar audience, whereas the same task is less distressing with a familiar audience. Prior research emphasizes that adolescence is a critical phase for the development of social anxiety, which can grow into a chronic and generally unremitting course through a lifespan if left untreated (Perugi et al., 1999; Kessler, 2003; Villarosa-Hurlocker et al., 2019).
Socially anxious individuals face greater difficulties forming and maintaining social relationships with others (Miers et al., 2013). As a result of this fear, individuals tend to have fewer close friends, but are also at greater risk of being rejected or ignored by their peers. Additionally, affected individuals are also at higher risk of being victimized by others due to their lack of social competence (Navarro et al., 2012). As a way to escape this vicious circle for a moment, some socially anxious individuals develop dangerous coping strategies, such as substance abuse (Buckner et al., 2008). Untreated social anxiety can also lead to other severe mental illnesses, such as depression (Van Ameringen et al., 1991; Perugi et al., 1999).
As prior research shows, social inhibition and private anguish are inherent to social anxiety. However, these symptoms are often misinterpreted as shyness or as a character flaw of the individual rather than a mental illness (Poole et al., 2017; Jacobson et al., 2020). Also patients affected by social anxiety may avoid the consultation about their psychological problems with their physicians due to elevated experience of shame (Lecrubier et al., 2000). As a result, the nuanced effects of social anxiety are frequently underreported and under recognized. According to previous estimations, only 35% of individuals with symptoms of social anxiety disorder receive proper treatment for their anxiety (Ruscio et al., 2008). Therefore, to increase the efficacy and success rate of treatment, reliable assessment of social anxiety plays an important role in preventing serious harm (Herbert et al., 2009).
Leveraging (Digital) Behavioral Markers for the Assessment of Social Anxiety
Mental health experts use standardized procedures that combine interviews, questionnaires, and behavioral information to achieve reliable assessment of mental health concerns. Most of the used scales, such as the Liebowitz Social Anxiety Scale (Liebowitz, 1987; Baker et al., 2002), depict different social scenarios and ask respondents to rate their fear and/or avoidance within the described situations. Other tools focus on the special needs of specific groups, such as children (Delgado et al., 2019). But there is an ongoing discussion about the advantages of evidence-based assessment, which harnesses not only self-reported perspectives but also relies on objective evidence for the mental illness. This search for evidence-based assessment approaches has fueled an interest in finding behavioral correlates that are also predictive of mental health. These behavioral correlates are often referred to as biomarkers, which are defined by the World Health Organization (WHO) as “any substance, structure, or process that can be measured in the body or its products, and that influences or predicts the incidence of outcome or disease” (Strimbu and Tavel, 2010). One example within the context of social anxiety would be the measurement of the individual’s blood pressure while being exposed to a social interaction. However, prior research provides only mixed results about the benefits of biomarkers for the assessment of social anxiety. Digital Biomarkers focus on objective, quantifiable physiological and behavioral data, which are collected and measured by means of various digital devices (e.g., wearable devices) (Jacobson et al., 2020).
To enhance the research agenda of finding reliable biomarkers for social anxiety, researchers have identified potential cognitive and behavioral characteristics of social anxiety which could be used for the assessment of social anxiety in a gaming task. Cognitive characteristics of social anxiety include aspects such as attentional biases (Pineles and Mineka, 2005) and interpretation (Miers et al., 2011) or memory biases (Glazier and Alden, 2019) that are affected by social anxiety. Prior work shows that socially anxious individuals prefer to maintain a greater distance from strangers (Givon-Benjio and Okon-Singer, 2020). Depending on the personality of an individual, these biases may cause the development of behavioral characteristics, such as the reliance and usage of avoidance and safety behaviors in the physical world (Voncken et al., 2006; McManus et al., 2008). These behaviors include individual approaches that aim to reduce the risk of drawing attention to oneself and therefore the risk of subsequent evaluation by others. For example, individuals with social anxiety over-rehearse a speech to prevent stuttering or other feared situations in front of an audience. But excessive reliance on safety behaviors results in consequences, such as the increased experience of anxiety, as well as self-focus attention, maintenance of negative beliefs, and even contamination of social situations, as the affected individual may come across as uninterested and insecure to others (Kley et al., 2012). Through various sensors, such as global positioning system (GPS) devices (Huang et al., 2016), gaze tracking devices (Chen et al., 2015), and skin conductance sensors (Voncken and Bögels, 2009), researchers successfully identified several promising digital biomarkers for social anxiety. Especially within virtual reality simulations, researchers have demonstrated the robustness of describing cognitive and behavioral markers for social anxiety, mostly by simulating physical situations in the safe space of virtual reality applications (Safir et al., 2012; Chesham et al., 2018). However, instrumenting people with contact sensors (e.g., gaze or skin conductance) limits the accessibility of the developed biomarkers. To gain the widest reach, digital biomarkers and behavioral markers should be extracted from standard interactions with computers or smartphones. One common source of engagement on computers or smartphones is through digital gaming.
Prior research has shown preliminary evidence that in-game behavior might be harnessed for the assessment of social anxiety (Dechant M. et al., 2021). In this earlier study, participants were asked to bypass a non-playable character (NPC) and move toward a targeted position in the room. Speed, accuracy, and path characteristics were measured per trial. Furthermore, two common game design aspects were altered to investigate design choices that may affect the visibility of typical social anxiety behaviors in the game. The results suggested that a third-person camera perspective combined with a customized self-representation resulted in the strongest effects of social anxiety on in-game behavior. People with higher levels of social anxiety tended to walk farther around the NPC and were less accurate in finding the final destination. This first investigation lays the essential foundation for further research about how digital behavioral markers in-game can be harnessed within digital games for the assessment of social anxiety. However, this initial work did not fully demonstrate the validity of in-game behaviors as a digital behavioral markers, as effects were shown on a trial level. To substantiate the initial evidence, we require further insights showing relationships per participant—a necessary approach for classifying individuals and suggesting the incidence of the mental health concern.
The Present Research
Given the need for digital behavioral markers to assist with the assessment of social anxiety, the accessibility and prevalence of digital gaming, and preliminary evidence that behaviors characteristic of social anxiety also manifest in digital contexts, we conducted a study with the aim of identifying promising digital behavioral markers of social anxiety, drawn from interactions with a digital game.
Our game environment involves a player using a customized self-representation to interact with a NPC through a dialog, and to move around the NPC in the digital world. Based on previous work (Dechant M. et al., 2021), we look for the manifestation of movement behaviors, such as moving farther around an NPC. We also introduce new measures that rely on explicit behaviors (e.g., ask participants to indicate a comfortable distance to a stranger), and not just implicit ones (e.g., the movement behavior around a stranger), similar to prior work (Lange et al., 2008; Ritter et al., 2013). Explicit measurements are valuable for the prediction of deliberate and controlled behavior, whereas implicit measurements are assumed to be more indicative of less controlled and more impulsive behavior. Within the context of in-game digital biomarkers and behavioral markers for assessing social anxiety, prior work leveraged implicit measurements, which means that these behaviors are characteristic of less controlled, more impulsive, and rather autonomic in nature. However, an explicit measurement of behavior could also hold valuable insights for the development of further digital behavioral markers for the assessment of social anxiety. For example, interpersonal distance (IPD) describes the distance between an individual and a stranger at which individuals are comfortable to interact (Perry et al., 2015). Prior research shows that socially anxious individuals prefer to stand farther away in social interactions (Kroczek et al., 2020), resulting in a higher IPD. Therefore, the goal of this work is to answer the question of whether both explicit and implicit measurements of in-game behaviors can be harnessed as digital behavioral markers for the assessment of social anxiety. To be a reliable digital behavioral markers, measurements also must be able to identify affected individuals, a more challenging task than identifying characteristic behavior in a single trial. As such, we model the relationship between behavior and social anxiety at the level of participant.
Materials and Methods
We conducted an experiment to investigate whether aspects of an in-game movement path as well as the interpersonal distance between player and an in-game character can be harnessed for the assessment of social anxiety of players. In the task, participants were asked to deliver documents to different teams in a building.
Task Description
The task itself consists of two elements: The character editor and the assessment task; these elements will be described in the following sections.
Character Editor
Prior to the in-game task, participants were asked to create an avatar for the game, as prior work shows that customized avatars not only increase the engagement with a game but also affect the expression of social anxiety in-game (Dechant M. et al., 2021). First, participants selected the gender of their avatar (woman, man), then adjusted major aspects of the avatar’s body (i.e., height, weight, muscles, head offset, and breast size) and selected the hairstyle and skin and eye color of their avatar. Due to technical limitations of the underlying framework for the character creation, we were not able to offer a non-binary gender option in this experiment. Next, participants shaped the head of their avatar via 34 sliders to define different aspects of the head, such as face, eye, brows, nose, mouth, chin, jaw, ear, neck. After that, participants could choose the outfit of their avatar by selecting the style and color of clothing on the upper body, lower body, and shoes, as well as through head accessories, such as glasses, headphones, face masks, or hats (13 different options per element). To further enhance the participant’s identification with their avatar, we asked participants to describe the personality of their avatar by adjusting five sliders, which each represented one personality trait based on the Big Five Inventory. The 10 items of the BFI-10 (Rammstedt and John, 2007) were grouped into bipolar semantically anchored categories for the five traits and participants were asked to choose the slider position between the elements (e.g., calm to anxious). Participants had to spend at least 4 min with the design of their avatar. After 4 min, a button appeared on the screen that allowed participants to move to the next step of the experiment.
After customizing their in-game representation, participants filled out the Player Identification Scale (PIS) (Van Looy et al., 2012). Through the PIS, we were able to determine how much participants associated their avatar with themselves on the following three dimensions: similarity, embodied, and wishful identification. These insights were used to explain potential variance when participants may have felt they were limited in their self-expression due to the limitations of the character editor, such as the missing non-binary options as well as the lack of certain hair styles, such as curly hair styles. Figure 1 shows the character editor.
Figure 1. The character editor interface: First, participants selected the gender (A), then customized their avatar’s body (B) and outfit (C), and then selected their personality traits (D). Images of the character assets reproduced with permission from Alex Lenk.
Assessment Task
In the beginning, participants were introduced to the background story and the control scheme of the task: As new interns at a large company, participants were instructed to deliver documents to 20 teams in a large building, named after Greek letters (e.g., Team alpha). Each team was randomly assigned to one floor number. These floors were then assigned to two elevators (1–10: right elevator; 11–20: left elevator). To find out the floor number, participants were instructed to walk toward a NPC, which stood ten meters in front of both elevators and centered in the room (see Figure 2), and to ask them on which floor they could find the team they were looking for. This interaction was intended to replicate a social situation with another stranger similar to prior work in the context of social anxiety assessments (Dechant et al., 2017).
Figure 2. The setup of the of the assessment room: The avatar of the player stands at every trial on the purple point, the NPC on the orange point. Blockades (black) were used to guide the users’ movement toward the NPC.
Once participants stood at a comfortable distance to the NPC, they had to press spacebar to start a conversation with the NPC. The NPC reacted either in a friendly manner, greeting participants and offering to help, or angry manner, insulting participants at the beginning of the conversation. In the conversation, the camera focused the face of the NPC and a chat interface appeared (see Figure 3). After either a friendly (e.g., “Hi! Nice to meet you. Let me know if I can help you.”) or angry (e.g., “What do you want, idiot?”) introduction, participants were asked to enter their question for the NPC, including the team name. Next, the NPC stated the floor number of the desired team in a friendly (e.g., “Team alpha is on floor 12”) or insulting manner (e.g., “Team alpha is on floor 12, idiot”). The two emotional reactions were balanced across the elevator sides over the experiment (five time for each side for each emotion). After the conversation, participants were asked to go to the elevator that led to the floor of the team. Once in front of the elevator, participants had to hit the space bar to confirm their selection. After that, we asked participants to rate the friendliness of the NPC on a scale from 0 (= “very angry”) to 100 (= “very friendly”). In total, participants had to deliver 20 files (2 elevator sides × 2 emotions × 5 repetitions). For each trial (one delivery of a file), we used a distinct team name. Prior work suggested the usage of a third-person camera setup, so that the participant can see over the shoulder of their own avatar over the whole trial to maximize in-game expression of social anxiety (because the self-representation is always visible on screen) (Bögels et al., 2002; George and Stopa, 2008). Whenever the player interacted with the NPC, the camera focused the NPC. Figure 3 summarizes the task implementation.
Figure 3. The task: First, participants have to approach the NPC and then ask for directions. Afterward they have to select the correct elevator. Images of the character assets reproduced with permission from Alex Lenk.
The task was implemented using the Unity Engine (Unity Technologies, 2020) combined with the Asset-Bundle “Advanced People Pack 2” (Lenk, 2020) and deployed in a web browser using the Bride of Frankenstein framework (Johanson, 2020). The asset package offers prepared 3D objects with blend shapes, which allowed us to adjust the body shape (e.g., weight and muscularity) as well as the face characteristics (e.g., the shape of the eyes). Furthermore, the package includes a suitable variation of clothing and hair styles for both genders that we could use for customization.
Participants and Procedure
The experiment was deployed online, and participants were recruited using Amazon’s Mechanical Turk (MTurk). MTurk is an online platform, on which human intelligence tasks (HIT) can be offered by requesters. Workers can opt-in to these HITs. Prior researchers in different areas (Depping et al., 2018; Johanson et al., 2019; Passmore et al., 2020; Miller et al., 2021) successfully used this platform to collect data online. However, researchers need to carefully examine the data and ensure that bots or negligent workers are removed from the final analysis (Mason and Suri, 2012). Participants who were not able to play a 3D interaction game on their computers and those who left the experiment prior to completion were excluded from our data file. To avoid any behavioral bias induced by knowing the original goal of the story [e.g., white coat hypertension (Shehab and Abdulle, 2011)], we used a cover story to explain why participants were engaging in this task. For this experiment, we used the cover story that the goal of the experiment is to analyze effects of lag (input lag or network lag) on performance in a 3D game. The experiment itself as well as the usage of the cover story was approved by the Ethics board of the University of Saskatchewan. The actual goal of the experiment was revealed in the debrief of the study, at which point participants could ask to have their data excluded from further analysis.
MTurk allows requesters to use predefined or custom filters, such as demographics, prior work experience or how many HITs the worker successfully finished. For this study, we recruited participants who indicated that they live either in Canada or the United States of America, had at least 500 successfully completed HITs, and had a high approval rate of previous HITs (>95%).
We recorded the data of 117 participants following the suggestions of prior work (Dechant M. et al., 2021). First, we identified negligent participants based on their time spent answering the trait social anxiety questionnaire (LSAS; described later) and a short summary of the experiment, which they were required to provide in an open text field after the experiment. Participants who spent less than 1.5 s per item in the LSAS questionnaires were removed from the sample as well as participants who provided a non-descriptive or inaccurate summary of the experiment (e.g., “This is a nice experiment”). Furthermore, we removed participants who did not complete all 20 trials. After removing suspected bots and negligent participants (n = 11), we conducted our analysis with the remaining 102 participants (39 women, 62 men, one non-binary), aged 20–65 (M = 37.5, SD = 9.893). All participants received $8 USD compensation for participating in this study, which took approximately 40 min to be completed.
After providing consent, participants were provided with the cover story and had to answer one questionnaire to assess trait social anxiety and multiple about aspects of their gaming behavior, as well as their personal experience with lag in digital games (see section “Measurements”). These gaming questionnaires were used to emphasize the cover story. Following this, the task started with the previously introduced character creation interface, in which participants were instructed to design an avatar that represented them as best as possible. After that, the assessment task started, and participants completed their 20 trials. After the assessment task, demographic information was recorded, and participants were debriefed about the goal of the study. Additionally, we offered support resources such as contact information to a crisis hotline, and a link to picture of baby animals to reduce the potential negative effect on participants in considering their individual level of social anxiety.
Measurements
Trait Social Anxiety
Participants answered the self-report version of the Liebowitz Social Anxiety Scale (LSAS) (Liebowitz, 1987; Baker et al., 2002). The LSAS consists of 24 items, split into two categories, which describe different social situations and interactions: social interaction (11 items; e.g., “Giving a party”) and public performance (13 items e.g., “Eating in a public place”). These items are rated on two 4-point Likert scales, one to measure the fear (0 = “none,” 3 = “severe”) and a second on how often these items were avoided in the last 2 weeks (0 = “0%/never,” 3 = “usually/68–100%”). The answers are summed together to estimate the level of trait social anxiety, between 0 and 144, where higher values indicate a higher level of social anxiety. Prior work suggests a score of 30 as a threshold to distinguish between non-anxious and anxious individuals, while a threshold of 60 provides the threshold that identifies a high risk of generalized social anxiety. In this sample, LSAS scores ranged from 1 to 126 (M = 58.7; SD = 28.65) with a high internal consistency (Cronbach’s α = 0.97). On average, our sample scored higher in comparison to a study with 31,243 cross-cultural participants (M = 44.07) (Caballo et al., 2019) as well as a study of 1,007 college students in the United Kingdom (M = 34.7) (Russell and Shaw, 2009); However, this study is in line with prior work examining United States MTurk samples [M = 51.24 (Dechant et al., 2020) and M = 58.85 (Dechant M. et al., 2021)], which contain workers with elevated levels of social anxiety.
Avatar Identification
In this experiment, we leveraged the avatar-related subscales of similarity, embodied identification, and wishful identification from the Player Identification Scale (PIS) (Van Looy et al., 2012). Participants rated their agreement to different statements such as “My avatar is like me in many ways” on 5-point Likert scales from 0 (= “strongly disagree”) to 4 (= “strongly agree”). Internal consistency was high for all subscales: similarity (Cronbach’s α = 0.93), embodied (Cronbach’s α = 0.94), and wishful identification (Cronbach’s α = 0.90).
Perceived Emotion of the NPC
After each trial, participants were asked to rate the perceived emotional state of the NPC on a scale ranging from 0 (= “very angry”) to 100 (= “very friendly”). This measurement was used to emphasize the reflection of the social interaction with the NPC.
In-Game Digital Behavioral Markers for Social Anxiety
To assess the level of social anxiety within the digital game, we recorded the following aspects of the participant’s in-game behavior: comfortable interpersonal distance, movement features, and temporal features.
Comfortable Interpersonal Distance
As previously described, participants were asked to approach the NPC and had to press the spacebar once they reached a comfortable distance to start a conversation. We calculated the Euclidian distance between the position of the participant’s avatar and the NPC when they hit spacebar to start the conversation with the NPC. This measurement is referred to as interpersonal distance (IPD). Prior research shows that individuals with social anxiety show a distance estimation bias. As a result of this bias, socially anxious individuals tend to prefer a larger IPD to other individuals, not only in the physical world, but also in virtual reality simulations (Lange and Pauli, 2019; Givon-Benjio and Okon-Singer, 2020; Kroczek et al., 2020). Therefore, we expected that elevated levels of social anxiety would result in a higher IPD.
Speed and Movement Features
We measured the time in seconds from starting the trial until participants completed the whole trial (time spent in room). This time measurement includes the time in the conversation and the rating screen in the end of the trial.
According to prior research, socially anxious individuals tend to walk farther around other individuals in the physical world as well as in simulated realities, such as virtual-reality experiences (Lange and Pauli, 2019). Furthermore, prior work suggests several aspects of the movement behavior in-game which can be used to identify social anxiety (Lange and Pauli, 2019; Dechant M. et al., 2021). Similar to prior work, we recorded the location of the participant’s avatar in the digital world with a timestamp, sampled every 50 ms after the conversation with the NPC was completed, as they approached the elevator.
Based on these samples, we calculated the following movement features, as suggested by prior work: The path length describes the absolute travelled distance per trial from the point where the conversation with the NPC started to one of the selected elevator doors.
Prior work shows that socially anxious individuals prefer to stay farther away from strangers in the physical realm (Givon-Benjio and Okon-Singer, 2020) and also in the digital realm (Kroczek et al., 2020). To confirm these findings, we measured the minimum distance between the participant’s avatar and the NPC after the conversation, measured as the smallest Euclidean distance to the NPC over the whole trial. We expected that participants with elevated social anxiety will show higher minimum distances as they prefer to stay farther away and walk farther around strangers (Lange and Pauli, 2019). The mean distance to the NPC represents the average distance to the NPC of all recorded samples per trial. Like prior work recommends, we additionally took all samples per trial and calculated two statistics related to the distribution of the samples: skew and kurtosis. Participants walking farther around the NPC should result in an elevated (right-leaning) skew. An elevated kurtosis is reflective of a narrower distribution, which results from a more consistent path with fewer points either very close to or very far from the NPC, indicative of less exploration and more controlled movements characteristic of people with elevated social anxiety (see Figure 4).
Figure 4. The calculation of skew and kurtosis of the distribution per trial.
In summary, we had one explicit measurement, the (1) IPD, and six implicit measurements: (2) minimal and (3) mean distance to NPC, (4) time spent in room, (5) kurtosis and (6) skew of the distribution of the distances and the (7) path length.
Demographics
We recorded a variety of demographic factors, such as: age, gender, income, marital status, and ethnicity. See Table 1 for details about the characteristics of the sample.
Table 1. Overview of demographic information, LSAS and PIS measurements.
Hypotheses Based on Prior Work
Prior work suggests that highly socially anxious participants will aim to complete the task—which includes potential social threats and performance aspects—as quickly as possible, resulting in reduced time spent in the task (time spent in room). Further, elevated levels of social anxiety will result in elevated levels of skew and kurtosis, as participants with elevated social anxiety will try to walk farther around the NPC and have a higher minimum and mean distance to the NPC. As a result of this behavior, also the path length will increase as participants need to travel greater distances. Furthermore, we expect that the distance estimation bias caused by social anxiety (Givon-Benjio and Okon-Singer, 2020) will lead to an increased IPD for people with elevated levels of social anxiety.
Analysis
Data were gathered and stored using an on-premises server and then exported once data collection was complete. All data were analyzed using SPSS 26; moderated regressions used the Process 3.4 integration. Statistical tests are described prior to reporting the results.
Results
Characteristics of the Sample
We first looked at the characteristics of the recorded sample and whether players feel represented and connected to their self-created in-game representation. Table 1 summarizes the characteristics of our sample of 102 participants. The PIS subscales revealed that players felt that the self-representation is similar to their own visual appearance, resulting in a high score of similar identification score compared to prior work (Dechant M. et al., 2021).
RQ2: Is There an Influence of the NPC’s Emotion as Well as the Elevator Side?
First, we investigated whether the emotion of the NPC as well as the side of the destination elevator affected the explicit and implicit measurements. We used a repeated measures MANCOVA with side and emotion of NPC as repeated within-subject factors on the seven previously introduced dependent measures, controlling for age and gender. We found no significant results indicating that either the side of the elevator (all p > 0.129) nor the emotion of the NPC (all p > 0.148) significantly affected any movement behaviors. Therefore, we merged all trials together to calculate the central tendency, using the means of each measurement, and modeled the results on the participant level. Table 2 summarizes these results.
Table 2. Results of the MANCOVA.
RQ3: Can We Predict the Participant’s Trait Social Anxiety Through in-Game Behavior?
To find out whether the proposed measures can be used for assessing the social anxiety of a player, we conducted hierarchical linear regressions for each measure to analyze whether it predicts trait social anxiety, expressed by the LSAS score (Liebowitz, 1987; Fresco et al., 2001). We included age and dummy-coded gender (−1 = man; 1 = woman, removed 1 non-binary participant) in the first block, and the movement feature in the second block, with LSAS as the dependent measure. We report unstandardized regression coefficients (denoted as B) and standardized regression coefficients (denoted as β). In all models for which the feature was significantly predicting social anxiety, the model fit was significant. Table 3 summarizes these results.
Table 3. The regression results.
The results show that most of the proposed in-game behavioral markers were useful for the prediction of trait social anxiety. As expected and suggested by the literature (Perry et al., 2015; Givon-Benjio and Okon-Singer, 2020), the interpersonal distance shows that players with elevated social anxiety explicitly prefer to stop at a larger distance when approaching an NPC. Furthermore, kurtosis and skew indicate that individuals with elevated social anxiety tend to maintain a consistently farther route around the NPC and avoid any close distance to the NPC, as the minimum distance to the NPC shows. Contrary to prior work (Dechant M. et al., 2021), the complete length of the path starting from the recording of the IPD to the selected elevator door, shows no significant relationship with LSAS. Also the mean distance between the player’s avatar and the NPC indicated no significant relationship with LSAS once modeled on the participant level. Figure 5 visualizes these results.
Figure 5. Scatter plots of the regression results for all proposed features.
Discussion
Summary of Results
In summary, the results of this study confirm that characteristic behaviors of social anxiety appear within the realm of digital games. We show that higher levels of social anxiety result in a biased movement pattern expressed by an increased kurtosis and skew as well as increase in the minimum distance to the NPC. Additionally, we show that the characteristic preferences of social anxiety are also expressed by players prior to interacting with the NPC, as displayed in the increasing interpersonal distance. Contrary to prior work, the mean distance to the NPC as well as the path length around the NPC were not significant predictors for social anxiety.
Explanation of Findings
In line with prior work, the results of this study show that explicit and implicit behaviors characteristic to social anxiety that have been observed in the physical world may also manifest in-game.
According to prior work in the physical world, as well as in virtual reality simulations, individuals with elevated social anxiety show that they prefer a larger physical distance between themselves and other individuals. Socially anxious individuals have also been shown to prefer less intimidating communication platforms, such as online chats (Miller et al., 2021) over voice or in person meetings. Within the context of digital games, players affected by social anxiety have been shown to be drawn toward games with a focus on playing together with others, such as MMORPGs; however, even in this context, the characteristic preference for distance toward others appears and biases the players’ preferences. Players with an elevated level of social anxiety withdraw from social activities in-game and avoid highly challenging tasks to avoid any potential exposure to the judgment of other players (Dechant et al., 2020). The results of our study contribute a similar result: socially anxious participants showed that they prefer greater distance between themselves and NPCs in-game, similar to within the physical world. However, this preference bias induced by social anxiety also appears in our study as what may be characterized as some visible strategies, similar to safety behavior techniques in the physical world. Prior work provides evidence for a distance estimation bias of socially anxious individuals. This bias may cause individuals to walk farther around another individual to not harm the personal space of another person as previously discussed. This study demonstrates similar behavior in the digital realm, which may stem from a similar strategy, or may be a habitual transfer of behaviors from the physical realm into the digital one.
A potential explanation for why social anxiety may trigger avoidance and preference biases that we observe in movement patterns may come from the elevated experience of self-awareness intensified by social presence; experiments in which socially anxious patients had to interact in front of a mirror show an association between experiencing social anxiety and elevated self-awareness (George and Stopa, 2008). This increased self-awareness plays an essential role in the maintenance of social anxiety, because socially anxious individuals are highly aware of their self-presentation to avoid any negative consequences (Bögels et al., 2002). In our study, the third-person camera perspective can be seen as a mirror which shows the player’s action within the digital realm of the game. Additionally, this effect is intensified through the use of a customized self-representation in the game. The combination of both resulted in prior work in the strongest expression of social anxiety within the game. Therefore, this study may provide more evidence for the hypothesis that customizing the own avatar and seeing it throughout the whole task enhances identification with the avatar, which triggers self-awareness and prompts the expression of safety behaviors.
Furthermore, the usage of customized avatars may enhance the experience of social presence (Bente et al., 2008). Social presence describes the experience that others are sharing the digital space with the player (Felnhofer et al., 2019). For the therapeutic effectiveness of digital interventions for social anxiety, the experience of social presence plays an essential role, because the experience of social presence may be more predictive of social anxiety responses than the self-reported experience of physical presence in a virtual world (Clutton-Brock et al., 2009). For example, prior work shows that participants experienced elevated social anxiety when their self-representation looked more similar to themselves (Vasalou et al., 2007; Aymerich-Franch et al., 2014). Also, social presence may also intensify the self-awareness of participants which may cause even stronger expression of social anxiety within the digital realm. Customizing avatars has also been recently shown to enhance fear within an exposure task for social anxiety (Dechant M.J. et al., 2021); the authors show that the customization enhances identification with the avatar, and speculate that customization enhances the invested effort and engagement in the task. In our study, all players customized their avatar, which may have helped reinforce the perception that they themselves were interacting with the NPC, aiding in the transference of behaviors and coping strategies common in physical spaces into our game.
Digital behavioral markers embedded in a gaming task may help to develop new approaches for the assessment of social anxiety, which may offer many benefits for health professionals as well as the affected individuals. Early assessment, such as when individuals are still young and developing their identities (Grant et al., 2005), habits, and behaviors, may prevent the harshest outcomes of social anxiety (Miers et al., 2013). However, a common challenge for the assessment is the risk of attrition due to waning of the patient’s motivation to continue with the process. Game based assessment may help to increase the engagement of patients who enjoy playing video games (Birk et al., 2016; Mandryk and Birk, 2019), which is not only limited to younger generations, as the still growing popularity of digital games in older generations suggests (ESA, 2019). These customized games may offer an easily accessible screening tool in combination with other existing tools as well as a way for continuous monitoring of the current progress in a treatment. However, researchers as well as developers need to be aware of several ethical implications when harnessing digital biomarkers in a gaming task.
Ethical Implications
Despite the suggested benefits of digital biomarkers in general within a digital game, the growing discussion about the appropriate usage of data derived from digital sources raises several ethical concerns that are part of an ongoing discussion (Floridi and Taddeo, 2016; Metcalf and Crawford, 2016; Mittelstadt et al., 2016; Kenwright, 2018). When harnessing digital biomarkers, we need to ensure the protection of the user’s privacy as well as the creation of a safe space for the patient grounded on a legal basis. The communication about measured (mental) health issues might have negative effects for the patient, and experts need to be aware of the potential harm the communication can cause for the player. When deployed by mental health experts, assessment data is interpreted within a safe context that can lower the risk for a biased interpretation of the results of the assessment. Additionally, to leverage these approaches in an appropriate and healthy manner, developers must ensure the safety of the patient as well as the therapist while using such tools.
However, designers of these applications need to balance the enjoyment of the digital game and the requirements of an effective assessment. Depending on the complexity of the game mechanics as well as the context of the game, players may behave differently in the digital realm as compared to the physical. As prior work outlines, games allow players to explore and enact different roles or fantasies, which guides them to behave differently. Furthermore, excessive play of video games should be avoided especially within the context of social anxiety. Prior work emphasizes a relationship between problematic gaming behavior and social anxiety (Cole and Hooley, 2013; Lee and Leeson, 2015). However, this relationship highlights the potential of using game-based behavioral markers applied by medical experts for assessing social anxiety. Overall, these techniques should only be applied within a health and safe patient-therapist relationship.
Limitations and Future Research
There are several questions future research may address in further follow-up investigations. First the lack of non-binary representation; although only one participant identified themself as non-binary, future research should overcome the technical limitations of the used framework to offer participants a non-binary character option, which will allow them to identify themselves with their character. Second, we must consider the influence of culture on the expression of social anxiety. This work focused on the development of digital b behavioral markers for characteristics linked to social anxiety in a western context. However, the literature suggests the differentiation of social anxiety and Taijin kyofusho (Kleinknecht et al., 1997) which, in comparison to social anxiety (disorder), focuses on the fear of embarrassing or offending another person rather than embarrassing oneself in front of others. Furthermore, the preference of the interpersonal distance may also be biased by the cultural background, where the shape of what constitutes personal space varies over different cultures. Therefore, future research may investigate the effect of the cultural background on the expression of social anxiety behavior within the digital realm. Third, we acknowledge the lack of comparison to other mental illnesses. Prior research suggests a comorbidity between different mental illnesses, such as Autism and Social anxiety. Therefore, future work may investigate if related mental illnesses will be expressed differently through the proposed in-game digital behavioral markers. However, this paper further confirms that prior suggested in-game movement behaviors and preference features embedded into a game can be used for assessing the personal level of social anxiety.
Conclusion
Social anxiety, one of the most common mental disorders worldwide, is underdiagnosed due to several barriers induced by the disorder as well as by existing assessment approaches. However, prior work suggests digital behavioral markers embedded in a gaming task to complement existing assessment techniques. These behavioral markers allow for a timely identification for early intervention, ongoing assessment during an intervention and lowering barriers to access systems of care, due to their broad accessibility and low cost. This study replicated previous findings that movement behaviors characteristic of people with social anxiety also manifest in digital spaces, and also provides new evidence that digital behavioral markers within a game can be harnessed to assess the personal level of social anxiety. Specifically, the player’s preferred distance from an NPC prior to interaction as well as altered movement path around the NPC after interaction were able to predict social anxiety. However, certain aspects of the movement path, such as the length of the path, were less useful as they were strongly affected by the surrounding game environment. The presented findings confirm prior research showing how game-based digital behavioral markers can be effectively used to assess social anxiety and offering the benefits of early and ongoing digital assessment for the mental health expert and the patient.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by Ethics Board of the University of Saskatchewan. The patients/participants provided their written informed consent to participate in this study.
Author Contributions
MD led the research, co-designed the task and experiment, implemented the task, gathered and analyzed the data, and wrote the manuscript. JF provided feedback on the task and experiment design, contributed to the analyses, and edited the manuscript. RM co-designed the task and experiment, guided the analyses, and edited the manuscript. All authors contributed to the article and approved the submitted version.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
We would like to thank NSERC and SWaGUR for funding, members of the Interaction Lab at the University of Saskatchewan, and our participants.
References
Antony, M. M., and Rowa, K. (2005). Evidence-based assessment of anxiety disorders in adults. Psychol. Assess 2005:256. doi: 10.1037/1040-3590.17.3.256
Aymerich-Franch, L., Kizilcec, R. F., and Bailenson, J. N. (2014). The Relationship between Virtual Self Similarity and Social Anxiety. Front. Hum. Neurosci. 2014:944. doi: 10.3389/fnhum.2014.00944
Baker, S. L., Heinrichs, N., Kim, H. J., and Hofmann, S. G. (2002). The Liebowitz social anxiety scale as a self-report instrument: A preliminary psychometric analysis. Behav. Res. Ther. 2002:2. doi: 10.1016/S0005-7967(01)00060-2
Bente, G., Rüggenberg, S., Krämer, N. C., and Eschenburg, F. (2008). Avatar-mediated networking: Increasing social presence and interpersonal trust in net-based collaborations. Hum. Commun. Res. 34, 287–318.
Bian, Y., Zhou, C., Tian, Y., Wang, P., and Gao, F. (2015). The Proteus Effect: Influence of Avatar Appearance on Social Interaction in Virtual Environments BT - HCI International 2015 - Posters’ Extended Abstracts. Cham: Springer International Publishing, 78–83.
Birk, M. V., Atkins, C., Bowey, J. T., and Mandryk, R. L. (2016). “Fostering Intrinsic Motivation through Avatar Identification in Digital Games,” in Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, (New York, NY: ACM), 2982–2995. doi: 10.1145/2858036.2858062
Bögels, S. M., Rijsemus, W., and De Jong, P. J. (2002). Self-focused attention and social anxiety: The effects of experimentally heightened self-awareness on fear, blushing, cognitions, and social skills. Cognit. Ther. Res. 26, 461–472. doi: 10.1023/A:1016275700203
Buckner, J. D., Schmidt, N. B., Lang, A. R., Small, J. W., Schlauch, R. C., and Lewinsohn, P. M. (2008). Specificity of social anxiety disorder as a risk factor for alcohol and cannabis dependence. J. Psychiatr. Res. 2008:2. doi: 10.1016/j.jpsychires.2007.01.002
Caballo, V. E., Salazar, I. C., Arias, V., Hofmann, S. G., and Curtiss, J. (2019). Psychometric properties of the Liebowitz Social Anxiety Scale in a large cross-cultural Spanish and Portuguese speaking sample. Rev. Bras. Psiquiatr. 41, 122–130. doi: 10.1590/1516-4446-2018-0006
Calamia, M., Markon, K., and Tranel, D. (2012). Scoring Higher the Second Time Around: Meta-Analyses of Practice Effects in Neuropsychological Assessment. Clin. Neuropsychol. 26, 543–570. doi: 10.1080/13854046.2012.680913
Chen, N. T. M., Thomas, L. M., Clarke, P. J. F., Hickie, I. B., and Guastella, A. J. (2015). Hyperscanning and avoidance in social anxiety disorder: The visual scanpath during public speaking. Psychiatry Res. 225, 667–672. doi: 10.1016/j.psychres.2014.11.025
Chesham, R. K., Malouff, J. M., and Schutte, N. S. (2018). Meta-Analysis of the Efficacy of Virtual Reality Exposure Therapy for Social Anxiety. Behav. Chang 2018:15. doi: 10.1017/bec.2018.15
Clutton-Brock, T., West, S., Ratnieks, F., and Foley, R. (2009). The evolution of society. Philos. Trans. R. Soc. B Biol. Sci. 364, 3127–3133. doi: 10.1098/rstb.2009.0207
Cole, S. H., and Hooley, J. M. (2013). Clinical and Personality Correlates of MMO Gaming: Anxiety and Absorption in Problematic Internet Use. Soc. Sci. Comput. Rev. 2013:894439312475280. doi: 10.1177/0894439312475280
Dams, J., König, H. H., Bleibler, F., Hoyer, J., Wiltink, J., Beutel, M. E., et al. (2017). Excess costs of social anxiety disorder in Germany. J. Affect. Disord 2017:41. doi: 10.1016/j.jad.2017.01.041
Davis, T. E. (2009). PTSD, Anxiety, and Phobia in Treating Childhood Psychopathology and Developmental Disabilities. New York, NY: Springer New York, 183–220. doi: 10.1007/978-0-387-09530-1_7
Dechant, M., Frommel, J., and Mandryk, R. (2021). “Assessing Social Anxiety Through Digital Biomarkers Embedded in a Gaming Task” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems CHI’21. (New York, NY: ACM), 1–15. doi: 10.1145/3411764.3445238
Dechant, M., Poeller, S., Johanson, C., Wiley, K., and Mandryk, R. L. (2020). “In-game and Out-of-game Social Anxiety Influences Player Motivations, Activities, and Experiences in MMORPGs,” in Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, (New York, NY: ACM), 1–14. doi: 10.1145/3313831.3376734
Dechant, M., Trimpl, S., Wolff, C., Mühlberger, A., and Shiban, Y. (2017). Potential of virtual reality as a diagnostic tool for social anxiety: A pilot study. Comput. Human Behav. 76:5. doi: 10.1016/j.chb.2017.07.005
Dechant, M. J., Birk, M. V., Shiban, Y., Schnell, K., and Mandryk, R. L. (2021). How Avatar Customization Affects Fear in a Game-based Digital Exposure Task for Social Anxiety. Proc. ACM Human-Computer Interact. 2021:5.
Deci, E. L., and Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychol. Inq. 11, 227–268. doi: 10.1207/S15327965PLI1104_01
Delgado, B., García-Fernández, J. M., Martínez-Monteagudo, M. C., Inglés, C. J., Marzo, J. C., La Greca, A. M., et al. (2019). Social Anxiety Scale for Adolescents and School Anxiety Inventory: Psychometric properties in French adolescents. Child Psychiatry Hum. Dev. 50, 13–26. doi: 10.1007/s10578-018-0818-4
Depping, A. E., Johanson, C., and Mandryk, R. L. (2018). “Designing for Friendship: Modeling Properties of Play, In-Game Social Capital, and Psychological Well-being,” in Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play, (New York, NY: ACM), 87–100. doi: 10.1145/3242671.3242702
Dorsey, E. R., Papapetropoulos, S., Xiong, M., and Kieburtz, K. (2017). The First Frontier: Digital Biomarkers for Neurodegenerative Disorders. Digit. Biomarkers 2017:477383. doi: 10.1159/000477383
Fehm, L., Beesdo, K., Jacobi, F., and Fiedler, A. (2008). Social anxiety disorder above and below the diagnostic threshold: Prevalence, comorbidity and impairment in the general population. Soc. Psychiatry Psychiatr. Epidemiol. 2008:4. doi: 10.1007/s00127-007-0299-4
Fehm, L., Pelissolo, A., Furmark, T., and Wittchen, H. U. (2005). Size and burden of social phobia in Europe. Eur. Neuropsychopharmacol. 2005:2. doi: 10.1016/j.euroneuro.2005.04.002
Felnhofer, A., Hlavacs, H., Beutl, L., Kryspin-Exner, I., and Kothgassner, O. D. (2019). Physical Presence, Social Presence, and Anxiety in Participants with Social Anxiety Disorder During Virtual Cue Exposure. Cyberpsychology, Behav. Soc. Netw. 22, 46–50. doi: 10.1089/cyber.2018.0221
Floridi, L., and Taddeo, M. (2016). What is data ethics? Philos. Trans. R. Soc. A Math. Phys. Eng. Sci. 2016:360. doi: 10.1098/rsta.2016.0360
Fresco, D. M., Coles, M. E., Heimberg, R. G., Liebowitz, M. R., Hami, S., Stein, M. B., et al. (2001). The Liebowitz Social Anxiety Scale: A comparison of the psychometric properties of self-report and clinician-administered formats. Psychol. Med. 2001:S0033291701004056. doi: 10.1017/S0033291701004056
Furnham, A., and Henderson, M. (1982). The good, the bad and the mad: Response bias in self-report measures. Pers. Individ. Dif. 1982:4. doi: 10.1016/0191-8869(82)90051-4
George, L., and Stopa, L. (2008). Private and public self-awareness in social anxiety. J. Behav. Ther. Exp. Psychiatry 2008:4. doi: 10.1016/j.jbtep.2006.09.004
Gielis, K., Kennes, J., Dobbeleer, C., De, Puttemans, S., Abeele, V., et al. (2019). “Collecting digital biomarkers on cognitive health through computer vision and gameplay: An image processing toolkit for card games,” in 2019 IEEE International Conference on Healthcare Informatics, (ICHI) doi: 10.1109/ICHI.2019.8904511
Givon-Benjio, N., and Okon-Singer, H. (2020). Biased estimations of interpersonal distance in non-clinical social anxiety. J. Anxiety Disord 2020:102171. doi: 10.1016/j.janxdis.2019.102171
Glazier, B. L., and Alden, L. E. (2019). Social anxiety disorder and memory for positive feedback. J. Abnorm. Psychol. 128, 228–233. doi: 10.1037/abn0000407
Gordon, D., Wong, J., and Heimberg, R. G. (2014). Cognitive-Behavioral Therapy for Social Anxiety Disorder: The State of the Science. Wiley Blackwell Handbook Soc. Anxiety Dis. 2014, 475–497. doi: 10.1002/9781118653920.ch22
Grant, B. F., Hasin, D. S., Blanco, C., Stinson, F. S., Chou, S. P., Goldstein, R. B., et al. (2005). The epidemiology of social anxiety disorder in the United States: Results from the National Epidemiologic Survey on Alcohol and Related Conditions. J. Clin. Psychiatry 2005:1102. doi: 10.4088/JCP.v66n1102
Heiser, N. A., Turner, S. M., Beidel, D. C., and Roberson-Nay, R. (2009). Differentiating social phobia from shyness. J. Anxiety Disord 2009:2. doi: 10.1016/j.janxdis.2008.10.002
Herbert, J. D., Gaudiano, B. A., Rheingold, A. A., Moitra, E., Myers, V. H., Dalrymple, K. L., et al. (2009). Cognitive behavior therapy for generalized social anxiety disorder in adolescents: A randomized controlled trial. J. Anxiety Disord. 23, 167–177.
Huang, Y., Xiong, H., Leach, K., Zhang, Y., Chow, P., Fua, K., et al. (2016). “Assessing social anxiety using GPS trajectories and point-of-interest data,” in UbiComp 2016 - Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, (UbiComp), doi: 10.1145/2971648.2971761
Jacobson, N. C., Summers, B., and Wilhelm, S. (2020). Digital biomarkers of social anxiety severity: Digital phenotyping using passive smartphone sensors. J. Med. Internet Res. 2020:16875. doi: 10.2196/16875
Johanson, C. (2020). colbyj/bride-of-frankensystem 1.1. Github 2020:3738761. doi: 10.5281/ZENODO.3738761
Johanson, C., Gutwin, C., Bowey, J. T., and Mandryk, R. L. (2019). “Press pause when you play: Comparing spaced practice intervals for skill development in games,” in CHI PLAY 2019 - Proceedings of the Annual Symposium on Computer-Human Interaction in Play, (CHI PLAY) doi: 10.1145/3311350.3347195
Karasewich, T. A., and Kuhlmeier, V. A. (2020). Trait social anxiety as a conditional adaptation: A developmental and evolutionary framework. Dev. Rev. 2020:100886. doi: 10.1016/j.dr.2019.100886
Kenwright, B. (2018). Virtual Reality: Ethical Challenges and Dangers [Opinion]. IEEE Technol. Soc. Mag. 37, 20–25. doi: 10.1109/MTS.2018.2876104
Kessler, R. C. (2003). The impairments caused by social phobia in the general population: Implications for intervention. Acta Psychiatr. Scand. 2003:2. doi: 10.1034/j.1600-0447.108.s417.2.x
Kessler, R. C., Berglund, P., Demler, O., Jin, R., Merikangas, K. R., and Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the national comorbidity survey replication. Arch. Gen. Psychiatry 2005, 593. doi: 10.1001/archpsyc.62.6.593
Kleinknecht, R. A., Dinnel, D. L., Kleinknecht, E. E., Hiruma, N., and Harada, N. (1997). Cultural factors in social anxiety: A comparison of social phobia symptoms and Taijin Kyofusho. J. Anxiety Disord 1997:2. doi: 10.1016/S0887-6185(97)00004-2
Kley, H., Tuschen-Caffier, B., and Heinrichs, N. (2012). Safety behaviors, self-focused attention and negative thinking in children with social anxiety disorder, socially anxious and non-anxious children. J. Behav. Ther. Exp. Psychiatry 43, 548–555. doi: 10.1016/j.jbtep.2011.07.008
Knappe, S., Sasagawa, S., and Creswell, C. (2015). Developmental Epidemiology of Social Anxiety and Social Phobia in Adolescents BT - Social Anxiety and Phobia in Adolescents: Development, Manifestation and Intervention Strategies. Cham: Springer International Publishing, 39–70. doi: 10.1007/978-3-319-16703-9_3
Kroczek, L. O. H., Pfaller, M., Lange, B., Müller, M., and Mühlberger, A. (2020). Interpersonal Distance During Real-Time Social Interaction: Insights From Subjective Experience, Behavior, and Physiology. Front. Psychiatry 11:561. doi: 10.3389/fpsyt.2020.00561
Kumar, A., and Phookun, H. R. (2016). Barriers in the treatment of psychiatric disorders. Open J. Psychiatry Allied Sci. 7, 99–102.
Lange, B., and Pauli, P. (2019). Social anxiety changes the way we move—A social approach-avoidance task in a virtual reality CAVE system. PLoS One 14:e0226805. doi: 10.1371/journal.pone.0226805
Lange, W.-G., Keijsers, G., Becker, E. S., and Rinck, M. (2008). Social anxiety and evaluation of social crowds: Explicit and implicit measures. Behav. Res. Ther. 46, 932–943. doi: 10.1016/j.brat.2008.04.008
Lecrubier, Y., Wittchen, H. U., Faravelli, C., Bobes, J., Patel, A., and Knapp, M. (2000). A European perspective on social anxiety disorder. Eur. Psychiatry 2000:9. doi: 10.1016/S0924-9338(00)00216-9
Lee, B. W., and Leeson, P. R. C. (2015). Online gaming in the context of social anxiety. Psychol. Addict. Behav. 29, 473–482. doi: 10.1037/adb0000070
Lenk, A. (2020). Advanced People Pack 2. Available online at: https://assetstore.unity.com/packages/3d/characters/humanoids/humans/advanced-people-pack-2-170756 (accessed date Nov 6, 2021.
Liebowitz, M. R. (1987). Social phobia. Mod. Probl. Pharmacopsychiatry 22, 141–173. doi: 10.1159/000414022
Mandryk, R. L., and Birk, M. V. (2019). The potential of game-based digital biomarkers for modeling mental health. J. Med. Internet Res. 2019:13485. doi: 10.2196/13485
Mason, W., and Suri, S. (2012). Conducting behavioral research on Amazon’s Mechanical Turk. Behav. Res. Methods 2012:6. doi: 10.3758/s13428-011-0124-6
McManus, F., Sacadura, C., and Clark, D. M. (2008). Why social anxiety persists: An experimental investigation of the role of safety behaviours as a maintaining factor. J. Behav. Ther. Exp. Psychiatry 2008:2. doi: 10.1016/j.jbtep.2006.12.002
Metcalf, J., and Crawford, K. (2016). Where are human subjects in Big Data research? The emerging ethics divide. Big Data Soc. 2016:2053951716650211.
Miers, A. C., Blöte, A. W., De Rooij, M., Bokhorst, C. L., and Westenberg, P. M. (2013). Trajectories of social anxiety during adolescence and relations with cognition, social competence, and temperament. J. Abnorm. Child Psychol. 2013:6. doi: 10.1007/s10802-012-9651-6
Miers, A. C., Blöte, A. W., and Westenberg, M. M. (2011). Negative Social Cognitions in Socially Anxious Youth: Distorted Reality or a Kernel of Truth? J. Child Fam. Stud. 2011:2. doi: 10.1007/s10826-010-9423-2
Miller, M. K., Dechant, M. J., and Mandryk, R. L. (2021). “Meeting You, Seeing Me: The Role of Social Anxiety, Visual Feedback, and Interface Layout in a Get-to-Know-You Task via Video Chat,” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, (New York, NY: Association for Computing Machinery), doi: 10.1145/3411764.3445664
Mittelstadt, B. D., Allo, P., Taddeo, M., Wachter, S., and Floridi, L. (2016). The ethics of algorithms: Mapping the debate. Big Data Soc. 3:2053951716679679.
Mohr, D. C., Zhang, M., and Schueller, S. M. (2017). Personal Sensing: Understanding Mental Health Using Ubiquitous Sensors and Machine Learning. Annu. Rev. Clin. Psychol. 13, 23–47. doi: 10.1146/annurev-clinpsy-032816-044949
Nass, C., and Moon, Y. (2000). Machines and mindlessness: Social responses to computers. J. Soc. Issues 2000:153. doi: 10.1111/0022-4537.00153
National Collaborating Centre for Mental Health (2013). Social Anxiety Disorder. Recognition. Assessment and Treatment. N. Engl. J. Med. 2013:1614701. doi: 10.1056/NEJMcp1614701
Navarro, R., Yubero, S., Larrañaga, E., and Martínez, V. (2012). Children’s cyberbullying victimization: Associations with social anxiety and social competence in a Spanish sample. Child Indic. Res. 2012:4. doi: 10.1007/s12187-011-9132-4
Olfson, M., Guardino, M., Struening, E., Schneier, F. R., Hellman, F., and Klein, D. F. (2000). Barriers to the Treatment of Social Anxiety. Am. J. Psychiatry 157, 521–527. doi: 10.1176/appi.ajp.157.4.521
Ollendick, T. H., and Davis, T. E. I. (2012). Evidence-Based Assessment and Treatment of Specific Phobias in Children and Adolescents. New York, NY: Springer, 43–56. doi: 10.1007/978-1-4614-3253-1_3
Passmore, C. J., Miller, M. K., Liu, J., Phillips, C. J., and Mandryk, R. L. (2020). A Cheating Mood: The Emotional and Psychological Benefits of Cheating in Single-Player Games. Proc. Annu. Symp. Comp.-Hum. Inter. Play 2020, 58–70.
Perry, A., Levy-Gigi, E., Richter-Levin, G., and Shamay-Tsoory, S. G. (2015). Interpersonal distance and social anxiety in autistic spectrum disorders: A behavioral and ERP study. Soc. Neurosci. 2015:1010740. doi: 10.1080/17470919.2015.1010740
Perugi, G., Akiskal, H. S., Ramacciotti, S., Nassini, S., Toni, C., Milanfranchi, A., et al. (1999). Depressive comorbidity of panic, social phobic, and obsessive-compulsive disorders re-examined: Is there a bipolar II connection? J. Psychiatr. Res. 1999:2. doi: 10.1016/S0022-3956(98)00044-2
Pineles, S. L., and Mineka, S. (2005). Attentional Biases to Internal and External Sources of Potential Threat in Social Anxiety. J. Abnorm. Psychol. 114, 314–318. doi: 10.1037/0021-843X.114.2.314
Poole, K. L., Van Lieshout, R. J., and Schmidt, L. A. (2017). Exploring relations between shyness and social anxiety disorder: The role of sociability. Pers. Individ. Dif. 2017:20. doi: 10.1016/j.paid.2017.01.020
Pourmand, A., Roberson, J., Caggiula, A., Monsalve, N., Rahimi, M., and Torres-Llenza, V. (2019). Social Media and Suicide: A Review of Technology-Based Epidemiology and Risk Assessment. Telemed. e-Health 2019:203. doi: 10.1089/tmj.2018.0203
Rammstedt, B., and John, O. P. (2007). Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. J. Res. Pers. 41, 203–212. doi: 10.1016/j.jrp.2006.02.001
Rao, P. A., Beidel, D. C., Turner, S. M., Ammerman, R. T., Crosby, L. E., and Sallee, F. R. (2007). Social anxiety disorder in childhood and adolescence: Descriptive psychopathology. Behav. Res. Ther. 2007:15. doi: 10.1016/j.brat.2006.07.015
Rehm, I. C., Foenander, E., Wallace, K., Abbott, J. A. M., Kyrios, M., and Thomas, N. (2016). What role can avatars play in e-mental health interventions? Exploring new models of client-therapist interaction. Front. Psychiatry 2016:186. doi: 10.3389/fpsyt.2016.00186
Ritter, V., Ertel, C., Beil, K., Steffens, M. C., and Stangier, U. (2013). In the Presence of Social Threat: Implicit and Explicit Self-Esteem in Social Anxiety Disorder. Cognit. Ther. Res. 37, 1101–1109. doi: 10.1007/s10608-013-9553-0
Ruscio, A. M., Brown, T. A., Chiu, W. T., Sareen, J., Stein, M. B., and Kessler, R. C. (2008). Social fears and social phobia in the USA: Results from the National Comorbidity Survey Replication. Psychol. Med. 2008:7001699. doi: 10.1017/S0033291707001699
Russell, G., and Shaw, S. (2009). A study to investigate the prevalence of social anxiety in a sample of higher education students in the United Kingdom. J. Ment. Heal. 18, 198–206. doi: 10.1080/09638230802522494
Safir, M. P., Wallach, H. S., and Bar-Zvi, M. (2012). Virtual reality cognitive-behavior therapy for public speaking anxiety: One-year follow-up. Behav. Modif. 2012:145445511429999. doi: 10.1177/0145445511429999
Shehab, A., and Abdulle, A. (2011). Cognitive and autonomic dysfunction measures in normal controls, white coat and borderline hypertension. BMC Cardiovasc. Disord. 2011:3. doi: 10.1186/1471-2261-11-3
Silverman, W. K., and Ollendick, T. H. (2005). Evidence-based assessment of anxiety and its disorders in children and adolescents. J. Clin. Child Adolesc. Psychol. 2005:2. doi: 10.1207/s15374424jccp3403_2
Spence, S. H., and Rapee, R. M. (2016). The etiology of social anxiety disorder: An evidence-based model. Behav. Res. Ther. 2016:7. doi: 10.1016/j.brat.2016.06.007
Strimbu, K., and Tavel, J. A. (2010). What are biomarkers? Curr. Opin. HIV AIDS 5, 463–466. doi: 10.1097/COH.0b013e32833ed177
Taormina, R. J., and Gao, J. H. (2013). Maslow and the motivation hierarchy: Measuring satisfaction of the needs. Am. J. Psychol. 2013:155. doi: 10.5406/amerjpsyc.126.2.0155
Torous, J., Onnela, J. P., and Keshavan, M. (2017). New dimensions and new tools to realize the potential of RDoC: Digital phenotyping via smartphones and connected devices. Transl. Psychiatry 2017:25. doi: 10.1038/tp.2017.25
Tulbure, B. T., Szentagotai, A., Dobrean, A., and David, D. (2012). Evidence based clinical assessment of child and adolescent social phobia: A critical review of rating scales. Child Psychiatry Hum. Dev. 2012:297. doi: 10.1007/s10578-012-0297-y
Van Ameringen, M., Mancini, C., Styan, G., and Donison, D. (1991). Relationship of social phobia with other psychiatric illness. J. Affect. Disord 1991:90055. doi: 10.1016/0165-0327(91)90055-W
Van de Mortel, T. (2008). Faking it: social desirability response bias in self-report research. Aust. J. Adv. Nurs. 25, 40–48.
Van Looy, J., Courtois, C., De Vocht, M., and De Marez, L. (2012). Player Identification in Online Games: Validation of a Scale for Measuring Identification in MMOGs. Media Psychol. 15, 197–221. doi: 10.1080/15213269.2012.674917
Vasalou, A., Joinson, A. N., and Pitt, J. (2007). Constructing my online self: Avatars that increase self-focused attention. Conf. Hum. Fact. Comp. Syst. Proc. 2007:1240696. doi: 10.1145/1240624.1240696
Velting, O. N., and Albano, A. M. (2001). Current trends in the understanding and treatment of social phobia in youth. J. Child Psychol. Psychiatry Allied Discip 2001:21963001006588. doi: 10.1017/S0021963001006588
Vigo, D., Thornicroft, G., and Atun, R. (2016). Estimating the true global burden of mental illness. Lancet Psychiatry 2016:2. doi: 10.1016/S2215-0366(15)00505-2
Villarosa-Hurlocker, M. C., Bravo, A. J., Pearson, M. R., Prince, M. A., Madson, M. B., Henson, J. M., et al. (2019). The Relationship Between Social Anxiety and Alcohol and Marijuana Use Outcomes Among Concurrent Users: A Motivational Model of Substance Use. Alcohol. Clin. Exp. Res. 2019:13966. doi: 10.1111/acer.13966
Voncken, M. J., Alden, L. E., and Bögels, S. M. (2006). Hiding anxiety versus acknowledgment of anxiety in social interaction: Relationship with social anxiety. Behav. Res. Ther. 2006:5. doi: 10.1016/j.brat.2005.11.005
Voncken, M. J., and Bögels, S. M. (2009). Physiological blushing in social anxiety disorder patients with and without blushing complaints: Two subtypes? Biol. Psychol. 81, 86–94. doi: 10.1016/j.biopsycho.2009.02.004
Wijman, T. (2020). The World’s 2.7 Billion Gamers Will Spend $159.3 Billion on Games in 2020; The Market Will Surpass $200 Billion by 2023. Available online at: https://newzoo.com/insights/articles/newzoo-games-market-numbers-revenues-and-audience-2020-2023/ (accessed November 17, 2021).
Keywords: social anxiety, assessment, digital biomarkers, digital games, interpersonal distance, in-game movement, behavioral markers
Citation: Dechant MJ, Frommel J and Mandryk RL (2021) The Development of Explicit and Implicit Game-Based Digital Behavioral Markers for the Assessment of Social Anxiety. Front. Psychol. 12:760850. doi: 10.3389/fpsyg.2021.760850
Received: 18 August 2021; Accepted: 04 November 2021;
Published: 15 December 2021.
Edited by:
Ioana Roxana Podina, University of Bucharest, RomaniaReviewed by:
Lavinia Carmen Uscatescu, University of Salzburg, AustriaRăzvan Jurchiş, Babeş-Bolyai University, Romania
Copyright © 2021 Dechant, Frommel and Mandryk. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Martin Johannes Dechant, martin.dechant@usask.ca