Dominik Gall
Daniel Roth
Jan-Philipp Stauffert
Julian Zarges
Marc Erich Latoschik- Human-Computer Interaction, Institute of Computer Science, Universtiy of Würzburg, Würzburg, Germany
Modulating emotional responses to virtual stimuli is a fundamental goal of many immersive interactive applications. In this study, we leverage the illusion of illusory embodiment and show that owning a virtual body provides means to modulate emotional responses. In a single-factor repeated-measures experiment, we manipulated the degree of illusory embodiment and assessed the emotional responses to virtual stimuli. We presented emotional stimuli in the same environment as the virtual body. Participants experienced higher arousal, dominance, and more intense valence in the high embodiment condition compared to the low embodiment condition. The illusion of embodiment thus intensifies the emotional processing of the virtual environment. This result suggests that artificial bodies can increase the effectiveness of immersive applications psychotherapy, entertainment, computer-mediated social interactions, or health applications.
1. Introduction
Human-computer interfaces like virtual reality systems can display immersive virtual environments where participants can feel fully immersed and present in the virtual environment (Slater, 2018). Moreover, through virtual reality systems, it is possible to induce the sense of embodiment toward virtual bodies (Slater et al., 2008). Users not only see a virtual body in place of their own, but they can also develop the sensation that the virtual body parts are parts of their own body. Botvinick and Cohen (1998) first reported the observation that we can induce the illusion that an unanimated object is part of one's own body through multisensory correlations such as visuotactile stimulation: the authors sat participants in front of a rubber hand aligned to their real hidden one. Then, they applied synchronous tactile stimulation with two paintbrushes to both hands. Participants reported experiencing the illusion that the rubber hand, to some degree, was their natural hand. People can experience a similar illusion in virtual reality setups, where visuotactile stimulation can be applied simultaneously to a virtual body representation and the natural body. We can describe this sensation to own an artificial or virtual body as the illusion of virtual body ownership. This illusion is part of a more general experience, the sense of embodiment toward an artificial body. Following the working definition of Kilteni et al. (2012), embodiment describes the sensation that our self is located inside a virtual body; we control this body and that this body belongs to us. Hence, embodiment consists of three subcomponents, the self of presence (or self-location in the original paper), the sense of agency, and the sense of body ownership. Presence or self-location refers to the sensation of physically being at a virtual place while knowing that one is not there (Akin et al., 1983; Skarbez et al., 2017). Agency describes the sensation of controlling a virtual body with one's own will. And finally, body ownership describes the sensation that a body is the source of one's sensation (see e.g., Braun et al., 2018 for a discussion of the concepts virtual body ownership and agency).
Previous investigations demonstrated the applicability of the sensation of embodiment in different virtual reality applications, such as health (Ramakonar et al., 2011; Martini, 2016; Matamala-Gomez et al., 2019, 2021) and entertainment (Riva et al., 2016; Slater and Sanchez-Vives, 2016; Xu et al., 2020). However, we know little about the mechanisms of how virtual embodiment affects the effectiveness of such applications.
The illusion of virtual embodiment and its subcomponents can arise in many different circumstances. The visual impression to have a virtual body often suffices to induce the sense of ownership (e.g., Vogeley et al., 2004; Kokkinara et al., 2016; Burin et al., 2020). Additionally, multisensory feedback provides means to manipulate the strength of the illusion. In the original rubber hand experiment, participants, for example, saw a pencil stroking a rubber hand while feeling a simultaneous stroke on their own hand (Botvinick and Cohen, 1998). The rubber hand was only slightly displaced to the real hand. Since the integration of different sensory information is based on imprecise estimation processes, this process can err, leading to such an illusion (Ernst and Banks, 2002). Several factors can contribute to the induction of virtual embodiment (see Kilteni et al., 2015 for a review): First, the shape, texture, and position of the virtual body seem sufficiently plausible. Second, the virtual body appears in the same place as their real body. Third, the virtual body gets touched in the same place and time as the real body. Fourth, the virtual body moves synchronously to the real body.
What we know is that the illusion of virtual embodiment affects not only the perception of one's body but has an impact on cognitive processes: virtual body ownership, as a subcomponent of embodiment can influence our spatial perception, for example the perceived location of the real body part (Botvinick and Cohen, 1998; Lenggenhager et al., 2007; Sanchez-Vives et al., 2010), once spatial orientation (Preuss et al., 2018), or the perceived size and distance of virtual objects (Van Der Hoort et al., 2011; Banakou et al., 2013; Linkenauger et al., 2013; Van der Hoort and Ehrsson, 2014; Van Der Hoort and Ehrsson, 2016; Jung et al., 2018). Virtual body ownership can affect social perception. It influences how we identify with social groups. It can affect the attitudes toward the social group to which the virtual body belongs (Farmer et al., 2012, 2014; Banakou et al., 2013; Fini et al., 2013; Maister et al., 2013; Peck et al., 2013). Moreover, virtual body ownership can modualte pain perception (Martini et al., 2013, 2014, 2015; Osumi et al., 2014; Giummarra et al., 2015; Nierula et al., 2017; Matamala-Gomez et al., 2018, 2019, 2020b), the perceived body weight (Serino et al., 2016; Chirico et al., 2019; Wolf et al., 2020), motor performance (Matamala-Gomez et al., 2020a) or memory processes (Tacikowski et al., 2020b). Virtual body ownership also affects responses to physical threat stimuli delivered toward to the virtual body (Ehrsson, 2007; Ehrsson et al., 2007; Petkova and Ehrsson, 2008; Gentile et al., 2013). Previous studies also showed, that virtual body ownership affect threat-evoked skin conductance responses (Ehrsson, 2007; Petkova and Ehrsson, 2008, 2009; Gentile et al., 2013; Guterstam et al., 2015; Tacikowski et al., 2020b) and threat evoked fMRI activations in areas related to fear and pain anticipation during rubber hand illusion (Ehrsson et al., 2007; Gentile et al., 2013). Body ownership changes in full-body illusion paradigms are also related to feelings of body satisfaction (Preston and Ehrsson, 2014, 2016) and feelings of femininity or masculinity (Tacikowski et al., 2020a).
These findings suggest that virtual embodiment might have a general effect on information processing processes. General moderators for information processing are emotional reactions to virtual stimuli. Emotional reactions play an important role in immersive systems, for example, in health applications like virtual exposure therapy or virtual social interactions (Riva et al., 2007). Emotions organize motivation, attention, memory, performance, and decision-making Oatley et al. (2006). There are specific findings that virtual embodiment modulates anxiety and arousal for stimuli that directly threaten the virtual body (Romano et al., 2014; Guterstam et al., 2015; Argelaguet et al., 2016; Chen et al., 2017). However, we do not know the impact of virtual embodiment on the intensity of general emotional reactions to virtual stimuli to date.
We present results from a study that supports the hypothesis that virtual embodiment intensifies emotional reactions to virtual stimuli. However, we cannot determine whether the subcomponents, ownership, agency, or presence drive the effect. The goal of our study was to investigate if virtual embodiment modulates the emotional responses to the virtual environment. We use the three-dimensional conceptualization of emotions as valence, arousal, and dominance (Osgood, 1952; Russell and Mehrabian, 1977). We designed one experimental condition that aimed to induce low levels of virtual embodiment and one condition that aimed to induce high virtual embodiment levels. We then compared emotional reactions to visual stimuli within the environment. We used subjective rating scales to assess these emotional reactions. Our results suggest that virtual embodiment increases the intensity of emotional responses to general virtual stimuli. We conclude that virtual embodiment might play an active role in organizing emotional responses to virtual stimuli. This finding encourages the introduction of virtual bodies for immersive scenarios that aim to intensify emotional responses in users. Applications may lie in entertainment, computer-mediated social interactions, or health applications.
2. Methods
2.1. Study Design and Participants
The experiment followed a single-factor repeated-measures design with two-factor levels. We manipulated the factor temporal synchrony of visuotactile and passive visuomotor stimulation (synchronous vs. asynchronous). We assumed that participants would experience higher virtual embodiment in the synchronous condition. Participants completed the two conditions in balanced, randomized order.
Undergraduate female students from the University of Würzburg volunteered to participate in the experiment. We only included female participants because we selected the stimuli according to female norm values (Lang, 2005). The sample consisted of N = 21 women, with age ranging from 19 to 30 years (M = 21.62, SD = 2.80). All participants provided written informed consent before participation. They received course credit for participation. All reported normal or corrected-to-normal vision and the absence of motor impairments. Participants were naive regarding the hypotheses of the experiment. The institutional ethics committee Human-Computer-Media approved this study on April 10, 2018.
2.2. Apparatus
During the experiment, the right hand of participants rested on a hand rest. The hand rest defined static positions for each finger. The examiner could rotate the hand rest around the wrist by 13 degrees without touching the participant. A position sensor (HTC Vive Controller) tracked the rotation angle. The examiner could stroke the hand of the participant with a styrofoam ball. The styrofoam ball had a diameter of 5 cm. A position sensor (HTC Vive Controller) tracked the position of the styrofoam ball. Participants looked through an immovable head-mounted display (HTC Vive Headset). The static field of view comprised the right hand at a distance of 35 cm. An Intel i7 4.00 GHz, 16 GB RAM computer with an NVIDIA GeForce GTX 1080 Ti graphics card rendered stereoscopic images at 90 Hz. We implemented sensor data integration, visualization of the virtual environment, and response registration in the Epic Games Unreal Engine 4.17. We presented auditive stimuli with a headphone (Superlux HD330). Figure 1 illustrates the apparatus.
Figure 1. Apparatus. We presented visual stimuli in a immovable head-mounted display. Participants placed their right hands on a hand rest. The experimenter delivered visuotactile stimulation with a styrofoam ball attached to a position sensor. The experimenter delivered visuomotor stimulation by rotating the hand rest. A sensor tracked the position of the hand rest. We presented Brownian noise in headphones.
2.3. Stimuli
Participants saw a virtual representation of their right hand. The virtual hand appeared in the same position as the real hand. During visuotactile stimulation, participants also saw a virtual representation of the styrofoam ball. In the synchronous stimulation condition, the virtual styrofoam ball appeared in the same position as the real styrofoam ball. In the synchronous stimulation condition, the virtual hand rotated analogous to the real hand. In the asynchronous stimulation condition, we delayed the movements of the virtual styrofoam ball and the virtual hand by 5 s. To neutralize noises of the tactile or motoric stimulation, we presented Brownian auditive noise through the headphones at 50 dB during the visuotactile and visuomotor stimulation. A calibration measurement of the system showed that the delay in the synchronous conditions was below 40 ms. The threshold for detecting visuomotor delays is above 100 ms (Franck et al., 2001; Shimada et al., 2009, 2010).
In each condition, we presented 20 pictures from the international affective picture system (Lang, 2005). The pictures appeared on a frontal plane behind the virtual hand. The virtual index finger pointed to the center of the image. The virtual hand covered a lower right fraction of the image. So participants still saw the virtual hand when they looked at the image. The 20 images consisted of 10 images with low and ten images with high valence female norm values. On average, the female norm arousal values of both groups were approximately equal. For the positive image group, female norm values on a Likert scale from 1 (negative/low) to 9 (positive/high) were (Lang, 2005): valence M = 7.00, SD = 0.62; arousal M = 6.79, SD = 0.28; dominance 5.38, SD = 0.34. For the negative image group, female norm values on a Likert scale from 1 (negative/low) to 9 (positive/high) were: valence M = 2.47, SD = 0.43; arousal M = 6.63, SD = 0.43; dominance 3.10, SD = 0.71 (Lang, 2005). We selected the images with maximal norm values for arousal and valence (very high or very low valence) while minimizing the possibility to choose pictures that might be ethically controversial. The positive valent image group consisted of the following images (international affective picture system number with a description in brackets): 4,525 (attractive male), 4,668 (erotic couple), 4,698 (erotic couple), 5,621 (skydivers), 5,629 (hiker), 8,001 (basketball player), 8,158 (hiker), 8,179 (bungee jumper), 8,180 (cliff divers), and 8,185 (skydivers). The negative valent image group consisted of the following images (international affective picture system number and description in brackets): 9,623 (fire), 9,600 (ship), 7,380 (roach on pizza), 6250,1 (aimed gun), 6,220 (boys with guns), 2,811 (gun), 1,932 (shark), 1,271 (roaches), 1,201 (spider), and 1,052 (snake). Figure 2 depicts the virtual stimuli.
Figure 2. Procedure and stimuli. Participants completed the synchronous and the asynchronous condition in a balanced randomized order. In each condition, participants received visuomotor and visuotactile stimulation for 4 min. We stroked the hands of participants with a ball and rotated their hands. In the synchronous condition, the hand and the virtual ball moved synchronously to the real hand and real ball. In the asynchronous condition, the virtual objects moved 5 s delayed. Afterward, participants completed 20 trials in each condition. In each trial, participants saw the virtual hand for 6 s, then an image with the virtual hand for 6 s. Afterward, they completed self-assessment manikin and presence ratings. After completing both conditions, participants answered a questionnaire to assess if the manipulation worked. Placeholder image stimulus by Julie Johnson on Unsplash.
2.4. Procedure
Participants sat in front of a table. They placed their right hand on a hand rest and wore an immovable head-mounted display with headphones. In the synchronous and asynchronous conditions, participants continuously saw a virtual representation of their right hand.
At the beginning of each condition, the experimenter delivered visual-tactile and passive visuomotor stimulation. We alternated between visual-tactile and passive visuomotor stimulation every 30 s for a total of 4 min. The experimenter manually delivered visual-tactile stimulation by stroking the index and middle finger from the fingertips to the back of the hand with the styrofoam ball. In the synchronous condition, the virtual styrofoam ball synchronously strokes the virtual hand. In the asynchronous condition, the virtual styrofoam ball moved 5 s delayed. The experimenter manually delivered passive visuomotor stimulation by rotating the hand rest around 13 degrees. In the synchronous condition, the virtual hand rotated synchronously. In the asynchronous condition, the virtual hand rotated 5 s delayed.
After the stimulation period, participants completed 20 rating trials. In each trial, participants saw the virtual representation of their right hand for 6 s. Then, participants saw an image from the international affective picture system on a frontal plane behind the virtual hand for 6 s. Afterward, participants self-assessed valence, arousal, and dominance on self-assessment manikin scales and a one-item presence scale. The scales appeared behind the virtual hand. Participants used a mouse in their left hand to select answers and to continue to the next trial.
Afterward, we conducted mid-immersion one-item virtual embodiment and agency ratings with the headphones. Between the two conditions, participants rested for 5 min. Figure 2 illustrates the procedure.
2.5. Measures
After each trial, participants completed a questionnaire that consisted of self-assessment manikin scales and a one-item presence scale. The questionnaire appeared on a frontal plane behind the virtual hand. The virtual hand did not cover parts of the questionnaire. We used the self-assessment manikin scales (Bradley and Lang, 1994) to assess emotional responses in each trial. Self-assessment manikin scales allow non-verbal pictorial assessment of self-reported affective experience immediately after stimulus presentation. Self-assessment manikin scales assessed norm values for international affective picture system images (Lang, 2005). We used self-assessment manikin scales with five pictures, labeled with a 9-point Likert scale from 1 (low/negative) to 9 (high/positive). This measure assumes the conceptualization of emotion as three independent dimensional bipolar factors: valence, arousal, and dominance (Osgood, 1952; Russell and Mehrabian, 1977). Valence conceptualizes approach or avoidance tendencies. Arousal conceptualizes the perceived level of physiological activity. Dominance conceptualizes the perceived level of control. Before the experiment, we described the self-assessment manikin scales to the participants, as proposed by Lang et al. (1999) Dimensional self-reports about affective experiences made directly after an emotion eliciting event have reasonable validity (Mauss and Robinson, 2009). Validity and reliability of the self-assessment manikin scales are reasonable (Bradley and Lang, 1994). Dominance is the least sensitive scale among the three and correlates positively with valence (Russell, 1979; Bradley and Lang, 1994; Warriner et al., 2013).
Furthermore, we used a visual one-item mid-immersion presence scale to assess self-reported presence in each trial, as proposed in Bouchard et al. (2008). Participants answered the following question on a scale of 1 (not at all) to 9 (totally): “To what extent do you feel present in the virtual environment?” There is evidence that brief one-item presence measures during immersion are more sensitive to the subjective feeling of presence than post-immersive questionnaires (Freeman et al., 1999; Slater, 1999; Bouchard et al., 2008). Hendrix and Barfield (1995) confirmed the reliability of a similar presence rating. Others showed the ability of this and similar measures to detect treatment effects (Hoffman et al., 2006; Bouchard et al., 2008; Kober et al., 2012) gives preliminary evidence of its validity.
At the end of each condition, we assessed virtual embodiment and a proxy measure for agency while participants still saw the virtual hand. We presented auditive one-item mid-immersion questions through the headphones. Participants answered the following questions out loud on a scale of 0 (not at all) to 10 (totally): “To what extent do you have the feeling as if the virtual body is your body?” (virtual embodiment, adapted from Kalckert and Ehrsson, 2012) and “To what extent do you have the feeling that the virtual body moves just like you want it to as if it is obeying your will?” (proxy measure for agency, however, no active movement was involved adapted from Kalckert and Ehrsson, 2012).
2.6. Statistical Analysis
We used linear mixed models to compare valence, arousal, dominance, and presence ratings between the synchronous and the asynchronous stimulation condition. We used lme4 (Bates et al., 2015) in R 3.5.1. (R Core Team, 2018) to model participants and stimuli as additive random effects to account for their interdependence in the repeated measurements design (e.g., arousal ~ (1|participant) + (1|stimulus) + condition). We used lmerTest (Kuznetsova et al., 2017) to calculate p-values. We compared valence ratings separately for stimuli with high (i.e., positive) and low (i.e., negative) norm valence. Positive and negative valent stimuli modulate the intensity of valence ratings in inverted directions. To assert if our manipulation worked, we used two-tailed paired t-tests to compare virtual body ownership and agency ratings between the synchronous and asynchronous stimulation conditions. To achieve a global alpha level of 5%, we Bonferroni-Holm adjusted the significance thresholds of the tests for multiple comparisons. We report Cohen's d as a measure of effect size. Data and code for all analyses are available at https://osf.io/quysv/.
3. Results
We examined whether virtual embodiment increases emotional responses to virtual stimuli. Therefore, we manipulated the degree of virtual embodiment and assessed responses to emotional stimuli. We used subjective rating scales for valence, arousal, and dominance to assess the intensity of emotional responses. To check if the experimental manipulation works, we assessed virtual body ownership and a proxy measure for agency at the end of each condition, and we assessed presence after each stimulus. We collected all data without technical problems and hence included the subjective ratings of all 21 participants in the repeated measures analysis.
We presented stimuli with high norm arousal and dominance. In the synchronous stimulation condition participants reported significantly higher arousal (p = 0.002, d = 0.18), and dominance (p = 0.003, d = 0.19) compared to the asynchronous stimulation condition. We presented stimuli with positive and negative valence. Positive valence translates to high ratings and negative valence translates to low ratings. Since positive and negative valence ratings nullify if analyzed together, we analyzed valence ratings separately for stimuli with high (i.e., positive) and low (i.e., negative) norm valence. For positive valent stimuli, participants reported significantly higher valence ratings (p < 0.001, d = 0.27) in the synchronous compared to the asynchronous stimulation condition. For negative valent stimuli, participants did not report a significant difference in the synchronous compared to the asynchronous stimulation condition (p = 0.877). Table 1 lists the detailed results of these mean comparisons.
Table 1. Mean comparisons.
We checked if the intended manipulation of virtual embodiment worked. To this end, we assessed virtual body ownership and agency in each condition after participants completed the trials, and we assessed presence in each trial. In the synchronous stimulation condition participants reported significantly higher virtual body ownership [t(20) = 6.15, p < 0.001, d = 1.34] and agency [t(20) = 8.99, p < 0.001, d = 1.96] compared to the asynchronous stimulation condition. Paricipants also reported higher presence ratings in the synchronous (M = 4.30, SD = 1.99) compared to the asynchronous condition (M = 3.30, SD = 1.81, p < 0.001, d = 0.64). Figure 3 depicts the mean comparisons of the virtual body ownership and agency.
Figure 3. Results. Mean (+ SD) of trial-wise self-assessment manikin and presence ratings, as well as condition-wise questionnaire ratings. Participants reported significantly higher valence for positive stimuli, arousal, dominance, and presence when they receive synchronous compared to asynchronous stimulation. The manipulation check revealed significantly higher virtual embodiment and agency after synchronous compared to asynchronous stimulation. The p-values indicate significant results of Bonferroni-Holm adjusted mean comparisons. Cohen's d values indicate effect sizes. Self-assessment manikin ratings range from 1 (low/negative) to 9 (high/positive). Questionnaire ratings range from 0 (not at all) to 10 (totally). Abbreviations: **p < 0.01, ***p < 0.001.
4. Discussion
4.1. Main Findings
Numerous studies have demonstrated the potential of virtual embodiment in shaping cognitive processes. But despite the profound impact of virtual embodiment on the sense of self, there is a lack of understanding about how virtual embodiment affects fundamental information processing in human-computer interaction. This lack has impeded leveraging the effects of virtual embodiment to engage users of immersive systems. Our study now suggests that virtual embodiment affects a fundamental quality of information processing: the emotional responses to stimuli. The induction of emotions is central for many applications in human-computer interaction, from virtual therapy to entertainment (Brave and Nass, 2003). We hypothesized that the sensation of virtual embodiment changes emotional reactions to stimuli in the virtual environment and obtained experimental support for this hypothesis. In our experiment, we manipulated virtual embodiment and assessed the emotional responses to stimuli in the virtual environment. Participants reported higher emotional responses regarding arousal, dominance, and valence in the high embodiment condition compared to the low embodiment condition. A manipulation check confirmed that the experimental setup induced virtual embodiment as intended. We conclude that the illusion of virtual embodiment modulates the emotional responses to the virtual environment and hence provides means to leverage the effectiveness of immersive virtual reality systems. However, our results do not allow us to conclude which subcomponents of embodiment drive the effect. Our manipulation yielded changes in all three subcomponents of embodiment: virtual body ownership, agency, and presence (Kilteni et al., 2012).
To induce a sense of agency, the experimenter rotated the hand for a total of 2 min in each condition. The rotation movement of the hand rest was uniform and determined only by the experimenter. Hence participants could anticipate the action but could not actively control the virtual hand. Even though this manipulation did not include motor intention, participants reported a different degree of how the virtual hand obeyed their will. We assume that the uniform movement of the hand rest induced a voluntary action that mimicked the expected hand rotation. We decided only to use passive motor movements to increase standardization between participants, however to the cost of decreasing the validity of the measure. However, we can only use the term agency with caution since voluntary actions can be considered a prerequisite for experiencing agency (Gallagher, 2000).
Participants reported slightly higher arousal, dominance, and more positive valence to positive valent stimuli. We assume that higher arousal might since feeling embodied within an environment might increase the relevance of the surrounding object to oneself. For example, threatening objects might appear more dangerous if one imagines being in that place (Zhang and Hommel, 2016). Valence describes as the degree of pleasant or unpleasantness one perceives (Russell, 1979). We hypothesize that more intense valence ratings for positive stimuli reflect increased engagement in the virtual surrounding of one feels embodied in that world. We could not see this association for negative valent stimuli. For negative valent stimuli, this moderation effect of embodiment might be overshadowed by a more intense reaction to aversive stimuli. The result might raise the hypothesis that the effect of virtual embodiment might be different for positive and negative valent stimuli. Dominance ratings might relate to a feeling of being in control. Feeling embodied in a virtual body might increase the sensation of being able to control the surrounding environment, hence exerting more dominance.
The hypothesis that virtual embodiment affects emotions might inform theories about emotional processes. On the one hand, our findings support theories that assume that emotions express the relevance of stimuli to personal goals (see Nelissen et al., 2007 for a review). We hypothesize that having a body in an environment increases the relevance of entities in this environment since they can impact our bodies. Therefore, the presence of a body in a particular environment might increase the relevance of that environment to one's goals. On the other hand, our findings could raise the hypothesis that there might also be an inverse association of embodiment and emotional responses: That reduced embodiment might reduce emotional responses. This hypothesis is consistent with the theory of depersonalization, a body function that decreases intense emotional reactions in highly threatening situations (Simeon et al., 2000; Sierra and David, 2011; Dewe et al., 2016, 2018).
4.2. Limitations
Our method does not allow to identify which subcomponent of embodiment drives the observed effect (virtual body ownership, agency, or presence), since our manipulation affected all three, at least to some degree. It might also be possible that the sensation of presence mediates the effect. There is some evidence that presence relates to emotional reactions. However, the results are controversial (Schuemie et al., 2001). Some studies found correlations between presence and fear reactions, but only if arousal was sufficiently high (see Diemer et al., 2015 for a review). Presence, however, does not relate to outcomes of virtual exposure therapy (Diemer et al., 2015). Some studies indicate a causal influence of emotions on presence (Bouchard et al., 2008; Gorini et al., 2011; Gromer et al., 2019).
Our results suggest that the effects of virtual embodiment on emotional responses to virtual stimuli exist but that it might be small. Small effect sizes in our study can be due to three reasons: first, the intensity of the displayed stimuli, in general, was low. Due to ethical reasons, we selected images that do not induce intense emotional reactions. The general, moderate arousal ratings reflect this selection. Second, the stimuli were two-dimensional image stimuli within the virtual environment. Hence the presented stimuli induced a second layer of virtuality: virtual stimuli within a virtual world. This abstraction might loosen the association of the stimuli to the virtual body and hence their emotional relevance. Third, we presented stimuli out of context, stimuli without relation to the participants' personal goals. Since emotions provide information about goal attainment states, we expect only a moderate reaction to such out-of-context stimuli. However, our data imply a causal relationship between virtual embodiment and emotional responses despite these three issues. This finding underlines this relationship's potential in settings with virtual stimuli that have high relevance for users.
In our study, we used a well-established but still reductionist concept to measure emotional reactions: We used a three-dimensional, continuous model to operationalize emotional reactions, and we assessed this model with retrospective self-reports. We assume that this model may only capture a simplistic image of the actual emotional responses of participants. However, our results suggest that even such a simple model reveals a causal effect of virtual embodiment on emotional responses. Further studies might qualify and differentiate this effect.
We used only a virtual hand to represent a virtual body to reduce visual inconsistencies that might break the illusion of being embodied Kilteni et al. (2015). However, a full-body illusion might yield stronger effects. It is also possible that the effect of embodiment faded away during the exposure to the virtual stimuli. Our study by design did not allow to detect such an effect over time. However, we did not find meaningful differences when comparing the first and the second half of the trials in an exploratory analysis (see analysis in https://osf.io/quysv/).
A conservative power simulation of the model reveals a power of 50%. Hence the study might be underpowered, increasing the probability that the findings reported here are false positives. Hence we interpret the results with caution, and treat them in an exploratory manner and encourage replication of our findings.
We only used three items to assess virtual embodiment, one item for body ownership, agency, and presence. We also did not use physiological measures to operationalize a sensation of ownership. Hence, more elaborated measures for the discussed constructs might increase the external validity in future studies. So we consider our results as preliminary findings that require replication with more specific operationalizations of the subconstructs of embodiment. We also did not include control statements to control for random answers or phantom sensations since we tried to keep the trials as short as possible and assume that such effects would be equally distributed across the two conditions due to the counter-balanced design.
We can not exclude that the results of our study are confounded with other cognitive processes that may have varied systematically between the two conditions. For example, participants might feel more distracted or irritated in the asynchronous condition leading to a lesser engagement and hence reduce emotional engagement. However, we assume that an aversive reaction to the asynchronous stimulation would increase arousal levels (Craig, 1968) in the asynchronous condition compared to the synchronous condition, and hence be contrary to the observed direction.
4.3. Implications
Despite technological advancements in immersive systems in health, entertainment, and computer-mediated collaborative work, virtual bodies to date only play a minor role in customer applications. For example, many studies investigate virtual reality for the treatment of psychopathologies. Notably, virtual reality exposure therapy reduces anxiety in phobic disorders (Freeman et al., 2017), where a higher activation of emotions relates to positive treatment effects (e.g., Greenberg and Pascual-Leone, 2006; Craske et al., 2014). However, previous clinical studies that use virtual stimuli mostly did not present virtual bodies (Freeman et al., 2017). In line with Braun et al. (2018), our findings encourage the development of technologies that facilitate a robust induction of virtual embodiment. Such developments would allow inducing virtual embodiment and hence intensify the emotional response to therapeutic stimuli. Then virtual embodiment, in turn, might enhance treatment outcomes of virtual reality interventions.
4.4. Conclusion
We provide experimental support for the hypothesis that virtual embodiment intensifies emotional response to virtual stimuli. The increase in emotional responses is essential for many human-computer interaction applications such as virtual psychotherapy, entertainment, or computer-mediated cooperative work. Our results encourage the development of technologies that allow leveraging virtual embodiment to increase the effectiveness of virtual reality systems.
Data Availability Statement
Data and code for all analyses are available at https://osf.io/quysv/.
Ethics Statement
The studies involving human participants were reviewed and approved by Universtiy of Würzburg, Human-Computer-Media. The participants provided their written informed consent to participate in this study.
Author Contributions
ML and DG designed and planned the study. DR and J-PS helped to design the study supported the creation of the apparatus and software. JZ collected the data and contributed to the creation of the apparatus and software. DG analyzed the data and wrote the first draft of the manuscript. ML supervised the data collection and data analysis. All authors contributed to the final manuscript.
Funding
The German Federal Ministry of Education and Research supported this work (grant no. 16SV7322).
Conflict of Interest
The authors declare that this study received resources (namely the 3D model of the virtual hand) from Gotoxy AV-Media GbR, Nuremberg, Germany. The company was not involved in the study design, collection, analysis, interpretation of data, the writing of this article or the decision to submit it for publication.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
Gotoxy AV-Media GbR, Nuremberg, Germany, provided the virtual hand stimulus. This work is part of the first author's doctoral thesis. This publication was supported by the Open Access Publication Fund of the University of Würzburg.
References
Akin, D. L., Minsky, M., Thiel, E., and Kurtzman, C. (1983). Space applications of automation, robotics and machine intelligence systems (ARAMIS), Phase 2, Vol. 1. Telepresence Technology Base Development. Available online at: https://ntrs.nasa.gov/api/citations/19840002516/downloads/19840002516.pdf
Argelaguet, F., Hoyet, L., Trico, M., and Lécuyer, A. (2016). “The role of interaction in virtual embodiment: effects of the virtual hand representation,” in 2016 IEEE Virtual Reality (Greenville, SC: IEEE), 3–10.
Banakou, D., Groten, R., and Slater, M. (2013). Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proc. Natl. Acad. Sci. U.S.A. 110, 12846–12851. doi: 10.1073/pnas.1306779110
Bates, D., Mächler, M., Bolker, B., and Walker, S. (2015). Fitting linear mixed-effects models using lme4. J. Stat. Softw. 67, 1–48. doi: 10.18637/jss.v067.i01
Botvinick, M., and Cohen, J. (1998). Rubber hands 'feel' touch that eyes see. Nature 391, 756. doi: 10.1038/35784
Bouchard, S., St-Jacques, J., Robillard, G., and Renaud, P. (2008). Anxiety increases the feeling of presence in virtual reality. Presence 17, 376–391. doi: 10.1162/pres.17.4.376
Bradley, M. M., and Lang, P. J. (1994). Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25, 49–59. doi: 10.1016/0005-7916(94)90063-9
Braun, N., Debener, S., Spychala, N., Bongartz, E., Sorös, P., Müller, H. H. O., et al. (2018). The senses of agency and ownership: a review. Front. Psychol. 9:535. doi: 10.3389/fpsyg.2018.00535
Brave, S., and Nass, C. (2003). “Emotion in human-computer interaction,” in The Human-Computer Interaction Handbook: Fundamentals, Evolving Technologies and Emerging Applications (London: Taylor & Francis), 81–96.
Burin, D., Liu, Y., Yamaya, N., and Kawashima, R. (2020). Virtual training leads to physical, cognitive and neural benefits in healthy adults. Neuroimage 222:117297. doi: 10.1016/j.neuroimage.2020.117297
Chen, W., Zhang, J., Qian, Y., and Gao, Q. (2017). How disentangled sense of agency and sense of ownership can interact with different emotional events on stress feelings. Psicol. Reflex Crit. 30:17. doi: 10.1186/s41155-017-0071-y
Chirico, A., Malighetti, C., Serino, S., Cipresso, P., Pedroli, E., Tuena, C., et al. (2019). Towards an advancement of multisensory integration deficits in anorexia nervosa: exploring temporal discrimination processing of visuo-auditory stimuli. Ann. Rev. Cyber Ther. Telemed. 17, 53–58. Available online at: https://www.arctt.info/volume-17-summer-2019
Craig, K. D. (1968). Physiological arousal as a function of imagined, vicarious, and direct stress experiences. J. Abnorm Psychol. 73:513. doi: 10.1037/h0026531
Craske, M. G., Treanor, M., Conway, C. C., Zbozinek, T., and Vervliet, B. (2014). Maximizing exposure therapy: an inhibitory learning approach. Behav. Res. Ther. 58, 10–23. doi: 10.1016/j.brat.2014.04.006
Dewe, H., Watson, D. G., and Braithwaite, J. J. (2016). Uncomfortably numb: new evidence for suppressed emotional reactivity in response to body-threats in those predisposed to sub-clinical dissociative experiences. Cogn. Neuropsychiatry 21, 377–401. doi: 10.1080/13546805.2016.1212703
Dewe, H., Watson, D. G., Kessler, K., and Braithwaite, J. J. (2018). The depersonalized brain: new evidence supporting a distinction between depersonalization and derealization from discrete patterns of autonomic suppression observed in a non-clinical sample. Conscious Cogn. 63, 29–46. doi: 10.1016/j.concog.2018.06.008
Diemer, J., Alpers, G. W., Peperkorn, H. M., Shiban, Y., and Mühlberger, A. (2015). The impact of perception and presence on emotional reactions: a review of research in virtual reality. Front. Psychol. 6:26. doi: 10.3389/fpsyg.2015.00026
Ehrsson, H. H. (2007). The experimental induction of out-of-body experiences. Science 317, 1048–1048. doi: 10.1126/science.1142175
Ehrsson, H. H., Wiech, K., Weiskopf, N., Dolan, R. J., and Passingham, R. E. (2007). Threatening a rubber hand that you feel is yours elicits a cortical anxiety response. Proc. Natl. Acad. Sci. U.S.A. 104, 9828–9833. doi: 10.1073/pnas.0610011104
Ernst, M. O., and Banks, M. S. (2002). Humans integrate visual and haptic information in a statistically optimal fashion. Nature 415, 429–433. doi: 10.1038/415429a
Farmer, H., Maister, L., and Tsakiris, M. (2014). Change my body, change my mind: the effects of illusory ownership of an outgroup hand on implicit attitudes toward that outgroup. Front. Psychol. 4:1016. doi: 10.3389/fpsyg.2013.01016
Farmer, H., Tajadura-Jiménez, A., and Tsakiris, M. (2012). Beyond the colour of my skin: How skin colour affects the sense of body-ownership. Conscious Cogn. 21, 1242–1256. doi: 10.1016/j.concog.2012.04.011
Fini, C., Cardini, F., Tajadura-Jiménez, A., Serino, A., and Tsakiris, M. (2013). Embodying an outgroup: the role of racial bias and the effect of multisensory processing in somatosensory remapping. Front. Behav. Neurosci. 7:165. doi: 10.3389/fnbeh.2013.00165
Franck, N., Farrer, C., Georgieff, N., Marie-Cardine, M., Daléry, J., d'Amato, T., et al. (2001). Defective recognition of one's own actions in patients with schizophrenia. Am. J. Psychiatry 158, 454–459. doi: 10.1176/appi.ajp.158.3.454
Freeman, D., Reeve, S., Robinson, A., Ehlers, A., Clark, D., Spanlang, B., et al. (2017). Virtual reality in the assessment, understanding, and treatment of mental health disorders. Psychol. Med. 47, 2393–2400. doi: 10.1017/S003329171700040X
Freeman, J., Avons, S. E., Pearson, D. E., and IJsselsteijn, W. A. (1999). Effects of sensory information and prior experience on direct subjective ratings of presence. Presence 8, 1–13. doi: 10.1162/105474699566017
Gallagher, S. (2000). Philosophical conceptions of the self: implications for cognitive science. Trends Cogn. Sci. 4, 14–21. doi: 10.1016/S1364-6613(99)01417-5
Gentile, G., Guterstam, A., Brozzoli, C., and Ehrsson, H. H. (2013). Disintegration of multisensory signals from the real hand reduces default limb self-attribution: an fmri study. J. Neurosci. 33, 13350–13366. doi: 10.1523/JNEUROSCI.1363-13.2013
Giummarra, M. J., Georgiou-Karistianis, N., Verdejo-Garcia, A., and Gibson, S. J. (2015). Feeling the burn: when it looks like it hurts, and belongs to me, it really does hurt more. Conscious Cogn. 36, 314–326. doi: 10.1016/j.concog.2015.07.010
Gorini, A., Capideville, C. S., De Leo, G., Mantovani, F., and Riva, G. (2011). The role of immersion and narrative in mediated presence: the virtual hospital experience. Cyberpsychol. Behav. Soc. Netw. 14, 99–105. doi: 10.1089/cyber.2010.0100
Greenberg, L. S., and Pascual-Leone, A. (2006). Emotion in psychotherapy: a practice-friendly research review. J. Clin. Psychol. 62, 611–630. doi: 10.1002/jclp.20252
Gromer, D., Reinke, M., Christner, I., and Pauli, P. (2019). Causal interactive links between presence and fear in virtual reality height exposure. Front. Psychol. 10:141. doi: 10.3389/fpsyg.2019.00141
Guterstam, A., Abdulkarim, Z., and Ehrsson, H. H. (2015). Illusory ownership of an invisible body reduces autonomic and subjective social anxiety responses. Sci. Rep. 5:9831. doi: 10.1038/srep09831
Hendrix, C., and Barfield, W. (1995). “Presence in virtual environments as a function of visual and auditory cues,” in Proceedings Virtual Reality Annual International Symposium '95 (Research Triangle Park, NC: IEEE), 74–82.
Hoffman, H. G., Seibel, E. J., Richards, T. L., Furness, T. A., Patterson, D. R., and Sharar, S. R. (2006). Virtual reality helmet display quality influences the magnitude of virtual reality analgesia. J. Pain 7, 843–850. doi: 10.1016/j.jpain.2006.04.006
Jung, S., Bruder, G., Wisniewski, P. J., Sandor, C., and Hughes, C. E. (2018). “Over my hand: using a personalized hand in vr to improve object size estimation, body ownership, and presence,” in Proceedings of the Symposium on Spatial User Interaction (New York, NY: ACM), 60–68.
Kalckert, A., and Ehrsson, H. H. (2012). Moving a rubber hand that feels like your own: a dissociation of ownership and agency. Front. Hum. Neurosci. 6:40. doi: 10.3389/fnhum.2012.00040
Kilteni, K., Groten, R., and Slater, M. (2012). The sense of embodiment in virtual reality. Presence 21, 373–387. doi: 10.1162/PRES_a_00124
Kilteni, K., Maselli, A., Kording, K. P., and Slater, M. (2015). Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Front. Hum. Neurosci. 9:141. doi: 10.3389/fnhum.2015.00141
Kober, S. E., Kurzmann, J., and Neuper, C. (2012). Cortical correlate of spatial presence in 2d and 3d interactive virtual reality: an eeg study. Int. J. Psychophysiol. 83, 365–374. doi: 10.1016/j.ijpsycho.2011.12.003
Kokkinara, E., Kilteni, K., Blom, K. J., and Slater, M. (2016). First person perspective of seated participants over a walking virtual body leads to illusory agency over the walking. Sci. Rep. 6, 1–11. doi: 10.1038/srep28879
Kuznetsova, A., Brockhoff, P. B., and Christensen, R. H. B. (2017). lmerTest package: tests in linear mixed effects models. J. Stat. Softw. 82, 1–26. doi: 10.18637/jss.v082.i13
Lang, P. J. (2005). International Affective Picture System (iaps): Affective Ratings of Pictures and Instruction Manual. Technical report.
Lang, P. J., Bradley, M. M., and Cuthbert, B. N. (1999). International Affective Picture System (IAPS): Technical Manual and Affective Ratings. Gainesville, FL: The Center for Research in Psychophysiology, University of Florida 2.
Lenggenhager, B., Tadi, T., Metzinger, T., and Blanke, O. (2007). Video ergo sum: manipulating bodily self-consciousness. Science 317, 1096–1099. doi: 10.1126/science.1143439
Linkenauger, S. A., Leyrer, M., Bülthoff, H. H., and Mohler, B. J. (2013). Welcome to wonderland: the influence of the size and shape of a virtual hand on the perceived size and shape of virtual objects. PLoS ONE 8:e68594. doi: 10.1371/journal.pone.0068594
Maister, L., Sebanz, N., Knoblich, G., and Tsakiris, M. (2013). Experiencing ownership over a dark-skinned body reduces implicit racial bias. Cognition 128, 170–178. doi: 10.1016/j.cognition.2013.04.002
Martini, M. (2016). Real, rubber or virtual: the vision of “one's own” body as a means for pain modulation. a narrative review. Conscious Cogn. 43, 143–151. doi: 10.1016/j.concog.2016.06.005
Martini, M., Kilteni, K., Maselli, A., and Sanchez-Vives, M. V. (2015). The body fades away: investigating the effects of transparency of an embodied virtual body on pain threshold and body ownership. Sci. Rep. 5:13948. doi: 10.1038/srep13948
Martini, M., Pérez Marcos, D., and Sanchez-Vives, M. V. (2013). What color is my arm? changes in skin color of an embodied virtual arm modulates pain threshold. Front. Hum. Neurosci. 7:438. doi: 10.3389/fnhum.2013.00438
Martini, M., Perez-Marcos, D., and Sanchez-Vives, M. V. (2014). Modulation of pain threshold by virtual body ownership. Eur. J. Pain 18, 1040–1048. doi: 10.1002/j.1532-2149.2014.00451.x
Matamala-Gomez, M., Donegan, T., Bottiroli, S., Sandrini, G., Sanchez-Vives, M. V., and Tassorelli, C. (2019). Immersive virtual reality and virtual embodiment for pain relief. Front. Hum. Neurosci. 13:279. doi: 10.3389/fnhum.2019.00279
Matamala-Gomez, M., Gonzalez, A. M. D., Slater, M., and Sanchez-Vives, M. V. (2018). Decreasing pain ratings in chronic arm pain through changing a virtual body: different strategies for different pain types. J. Pain. 20, 685–697. doi: 10.1016/j.jpain.2018.12.001
Matamala-Gomez, M., Malighetti, C., Cipresso, P., Pedroli, E., Realdon, O., Mantovani, F., et al. (2020a). Changing body representation through full body ownership illusions might foster motor rehabilitation outcome in patients with stroke. Front. Psychol. 11:1962. doi: 10.3389/fpsyg.2020.01962
Matamala-Gomez, M., Maselli, A., Malighetti, C., Realdon, O., Mantovani, F., and Riva, G. (2021). Virtual body ownership illusions for mental health: a narrative review. J. Clin. Med. 10:139. doi: 10.3390/jcm10010139
Matamala-Gomez, M., Nierula, B., Donegan, T., Slater, M., and Sanchez-Vives, M. V. (2020b). Manipulating the perceived shape and color of a virtual limb can modulate pain responses. J. Clin. Med. 9:291. doi: 10.3390/jcm9020291
Mauss, I. B., and Robinson, M. D. (2009). Measures of emotion: A review. Cogn. Emot. 23, 209–237. doi: 10.1080/02699930802204677
Nelissen, R. M., Dijker, A. J., and de Vries, N. K. (2007). Emotions and goals: assessing relations between values and emotions. Cogn. Emot. 21, 902–911. doi: 10.1080/02699930600861330
Nierula, B., Martini, M., Matamala-Gomez, M., Slater, M., and Sanchez-Vives, M. V. (2017). Seeing an embodied virtual hand is analgesic contingent on colocation. J. Pain 18, 645–655. doi: 10.1016/j.jpain.2017.01.003
Oatley, K., Keltner, D., and Jenkins, J. M. (2006). Understanding Emotions. Oxford: Blackwell Publishing.
Osgood, C. E. (1952). The nature and measurement of meaning. Psychol. Bull. 49, 197. doi: 10.1037/h0055737
Osumi, M., Imai, R., Ueta, K., Nobusako, S., and Morioka, S. (2014). Negative body image associated with changes in the visual body appearance increases pain perception. PLoS ONE 9:e107376. doi: 10.1371/journal.pone.0107376
Peck, T. C., Seinfeld, S., Aglioti, S. M., and Slater, M. (2013). Putting yourself in the skin of a black avatar reduces implicit racial bias. Conscious Cogn. 22, 779–787. doi: 10.1016/j.concog.2013.04.016
Petkova, V. I., and Ehrsson, H. H. (2008). If i were you: perceptual illusion of body swapping. PLoS ONE 3:e3832. doi: 10.1371/journal.pone.0003832
Petkova, V. I., and Ehrsson, H. H. (2009). When right feels left: referral of touch and ownership between the hands. PLoS ONE 4:e6933. doi: 10.1371/journal.pone.0006933
Preston, C., and Ehrsson, H. H. (2014). Illusory changes in body size modulate body satisfaction in a way that is related to non-clinical eating disorder psychopathology. PLoS ONE 9:e85773. doi: 10.1371/journal.pone.0085773
Preston, C., and Ehrsson, H. H. (2016). Illusory obesity triggers body dissatisfaction responses in the insula and anterior cingulate cortex. Cereb. Cortex 26, 4450–4460. doi: 10.1093/cercor/bhw313
Preuss, N., Brynjarsdóttir, B. L., and Ehrsson, H. H. (2018). Body ownership shapes self-orientation perception. Sci. Rep. 8:16062. doi: 10.1038/s41598-018-34260-7
R Core Team (2018). R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing.
Ramakonar, H., Franz, E. A., and Lind, C. R. (2011). The rubber hand illusion and its application to clinical neuroscience. J. Clin. Neurosci. 18, 1596–1601. doi: 10.1016/j.jocn.2011.05.008
Riva, G., Ba nos, R. M., Botella, C., Mantovani, F., and Gaggioli, A. (2016). Transforming experience: the potential of augmented reality and virtual reality for enhancing personal and clinical change. Front. Psychiatry 7:164. doi: 10.3389/fpsyt.2016.00164
Riva, G., Mantovani, F., Capideville, C. S., Preziosa, A., Morganti, F., Villani, D., et al. (2007). Affective interactions using virtual reality: the link between presence and emotions. Cyberpsychol. Behav. 10, 45–56. doi: 10.1089/cpb.2006.9993
Romano, D., Pfeiffer, C., Maravita, A., and Blanke, O. (2014). Illusory self-identification with an avatar reduces arousal responses to painful stimuli. Behav. Brain Res. 261, 275–281. doi: 10.1016/j.bbr.2013.12.049
Russell, J. A. (1979). Affective space is bipolar. J. Pers. Soc. Psychol. 37:345. doi: 10.1037/0022-3514.37.3.345
Russell, J. A., and Mehrabian, A. (1977). Evidence for a three-factor theory of emotions. J. Res. Pers. 11, 273–294. doi: 10.1016/0092-6566(77)90037-X
Sanchez-Vives, M. V., Spanlang, B., Frisoli, A., Bergamasco, M., and Slater, M. (2010). Virtual hand illusion induced by visuomotor correlations. PLoS ONE 5:e10381. doi: 10.1371/journal.pone.0010381
Schuemie, M. J., Van Der Straaten, P., Krijn, M., and Van Der Mast, C. A. (2001). Research on presence in virtual reality: a survey. Cyberpsychol. Behav. 4, 183–201. doi: 10.1089/109493101300117884
Serino, S., Pedroli, E., Keizer, A., Triberti, S., Dakanalis, A., Pallavicini, F., et al. (2016). Virtual reality body swapping: a tool for modifying the allocentric memory of the body. Cyberpsychol. Behav. Soc. Netw. 19, 127–133. doi: 10.1089/cyber.2015.0229
Shimada, S., Fukuda, K., and Hiraki, K. (2009). Rubber hand illusion under delayed visual feedback. PLoS ONE 4:e6185. doi: 10.1371/journal.pone.0006185
Shimada, S., Qi, Y., and Hiraki, K. (2010). Detection of visual feedback delay in active and passive self-body movements. Exp. Brain Res. 201, 359–364. doi: 10.1007/s00221-009-2028-6
Sierra, M., and David, A. S. (2011). Depersonalization: a selective impairment of self-awareness. Conscious Cogn. 20, 99–108. doi: 10.1016/j.concog.2010.10.018
Simeon, D., Guralnik, O., Hazlett, E. A., Spiegel-Cohen, J., Hollander, E., and Buchsbaum, M. S. (2000). Feeling unreal: a pet study of depersonalization disorder. Am. J. Psychiatry 157, 1782–1788. doi: 10.1176/appi.ajp.157.11.1782
Skarbez, R., Brooks, F. P. Jr., and Whitton, M. C. (2017). A survey of presence and related concepts. ACM Comput. Surveys 50:96. doi: 10.1145/3134301
Slater, M. (1999). Measuring presence: a response to the witmer and singer presence questionnaire. Presence 8, 560–565. doi: 10.1162/105474699566477
Slater, M. (2018). Immersion and the illusion of presence in virtual reality. Br. J. Psychol. 109, 431–433. doi: 10.1111/bjop.12305
Slater, M., Pérez Marcos, D., Ehrsson, H., and Sanchez-Vives, M. V. (2008). Towards a digital body: the virtual arm illusion. Front. Hum. Neurosci. 2:6. doi: 10.3389/neuro.09.006.2008
Slater, M., and Sanchez-Vives, M. V. (2016). Enhancing our lives with immersive virtual reality. Front. Rob. AI 3:74. doi: 10.3389/frobt.2016.00074
Tacikowski, P., Fust, J., and Ehrsson, H. H. (2020a). Fluidity of gender identity induced by illusory body-sex change. Sci. Rep. 10, 1–14. doi: 10.1038/s41598-020-71467-z
Tacikowski, P., Weijs, M. L., and Ehrsson, H. H. (2020b). Perception of our own body influences self-concept and self-incoherence impairs episodic memory. iScience 23:101429. doi: 10.1016/j.isci.2020.101429
Van der Hoort, B., and Ehrsson, H. H. (2014). Body ownership affects visual perception of object size by rescaling the visual representation of external space. Atten. Percept. Psychophys. 76, 1414–1428. doi: 10.3758/s13414-014-0664-9
Van Der Hoort, B., and Ehrsson, H. H. (2016). Illusions of having small or large invisible bodies influence visual perception of object size. Sci. Rep. 6:34530. doi: 10.1038/srep34530
Van Der Hoort, B., Guterstam, A., and Ehrsson, H. H. (2011). Being barbie: the size of one's own body determines the perceived size of the world. PLoS ONE 6:e20195. doi: 10.1371/journal.pone.0020195
Vogeley, K., May, M., Ritzl, A., Falkai, P., Zilles, K., and Fink, G. R. (2004). Neural correlates of first-person perspective as one constituent of human self-consciousness. J. Cogn. Neurosci. 16, 817–827. doi: 10.1162/089892904970799
Warriner, A. B., Kuperman, V., and Brysbaert, M. (2013). Norms of valence, arousal, and dominance for 13,915 english lemmas. Behav. Res. Methods 45:1191. doi: 10.3758/s13428-012-0314-x
Wolf, E., Döllinger, N., Mal, D., Wienrich, C., Botsch, M., and Latoschik, M. E. (2020). “Body weight perception of females using photorealistic avatars in virtual and augmented reality,” in 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (Porto de Galinhas: IEEE), 462–473.
Xu, W., Liang, H.-N., He, Q., Li, X., Yu, K., and Chen, Y. (2020). Results and guidelines from a repeated-measures design experiment comparing standing and seated full-body gesture-based immersive virtual reality exergames: within-subjects evaluation. JMIR Serious Games 8:e17972. doi: 10.2196/17972
Keywords: embodiment, virtual body ownership, avatars, agency, immersive interfaces, human-computer interaction, affective computing, emotions
Citation: Gall D, Roth D, Stauffert J-P, Zarges J and Latoschik ME (2021) Embodiment in Virtual Reality Intensifies Emotional Responses to Virtual Stimuli. Front. Psychol. 12:674179. doi: 10.3389/fpsyg.2021.674179
Received: 28 February 2021; Accepted: 10 August 2021;
Published: 06 September 2021.
Edited by:
Jonathan Gratch, University of Southern California, United StatesReviewed by:
Marta Matamala-Gomez, University of Milano-Bicocca, ItalyDalila Burin, Tohoku University School of Medicine, Japan
H. Henrik Ehrsson, Karolinska Institutet (KI), Sweden (Ryu Ohata contributed to the review of H. Henrik Ehrsson)
Copyright © 2021 Gall, Roth, Stauffert, Zarges and Latoschik. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Dominik Gall, ZG9taW5pay5nYWxsJiN4MDAwNDA7bXl0dW0uZGU=