- 1Center for Translational Neurophysiology of Speech and Communication, Istituto Italiano di Tecnologia, Ferrara, Italy
- 2Department of Psychology, University of Campania Luigi Vanvitelli, Caserta, Italy
- 3Department of Mathematics and Computer Science, University of Ferrara, Ferrara, Italy
Introduction: Recent studies showed that VR is a valid tool to change implicit attitudes toward outgroup members. Here, we extended this work by investigating conditions under which virtual reality (VR) is effective in changing implicit racial attitudes.
Methods: To this end, participants were embodied in a Black or White avatar and we manipulated the perspective through which they could see their virtual body. Participants in one condition, could see their virtual body both from a first-person perspective (i.e., by looking down toward themselves) and reflected in a mirror placed in front of them in the VR environment. Participants in another condition could instead see their virtual body only from a first-person perspective (i.e., by looking down toward themselves) as no mirror was placed in the VR environment. Implicit racial attitudes were assessed using the Implicit Association Test (IAT) before and immediately after the VR intervention.
Results: Results showed that when White participants were embodied in a Black avatar compared to a White avatar, they showed a decrease in their implicit pro-White attitudes but only when they could see their virtual body both from a first-person perspective and in a mirror.
Discussion: These results suggest that, in immersive virtual reality interventions, the possibility for participants to see their body also reflected in a mirror, might be a critical factor in changing their implicit racial attitudes.
Introduction
Thinking about others and making inferences about them is a spontaneous and automatic process of the human mind (Mitchell et al., 2002; Mitchell, 2009). Our brain is specialized in drawing inferences about other people – about their thoughts and feelings, their beliefs and intentions, their abilities and attributes – based on the social group to which they belong (Mitchell et al., 2006; Marini and Banaji, 2022a). We tend to display positive attitudes and act positively toward people that we deem more “similar” to us (in-group members), and display negative attitudes and act negatively toward people who are not similar to us (out-group members; Tajfel et al., 1971; Hewstone et al., 2002).
Although making inferences about others can be viewed as a useful cognitive process to quickly understand a situation and inform our behavioral responses (Allport, 1954), studies showed that such inferences can be inaccurate and operate implicitly (i.e., without intentional and direct control; Fazio et al., 1995; Greenwald and Banaji, 1995). Inferences about others concerning evaluations with some degree of favor or disfavor (e.g., good/bad, pleasant/unpleasant) that occur outside of conscious awareness and control are defined as implicit attitudes (Greenwald and Banaji, 1995). Implicit attitudes are assessed using indirect measures. Unlike explicit measures (i.e., self-reports) in which the content is assessed directly, implicit measures infer constructs of interest through behavioral performances (e.g., individuals’ response latency or errors in specific tasks). One of the most widely used indirect measures to assess implicit attitudes is the Implicit Association Test (IAT; Greenwald et al., 1998).
Research showed that implicit attitudes can predict variations in behavior across a variety of topics, in many cases above and beyond explicit measures (Fazio et al., 1995; Dovidio et al., 1997; Greenwald and Nosek, 2008; Greenwald et al., 2009). Implicit attitudes have been indeed shown to have a role in predicting discriminatory behaviors, including biased medical decisions (Green et al., 2007), lethal use of force by police (Hehman et al., 2018), and hiring discrimination (Moss-Racusin et al., 2012). Furthermore, they were also found to correlate with physiological markers of empathy (Avenanti et al., 2010).
Over the past decades, several interventions have been proposed in the literature to produce changes in implicit attitudes (Dasgupta and Greenwald, 2001; Blair, 2002; Gawronski and Bodenhausen, 2006; Sritharan and Gawronski, 2010) and mitigate their potential influence on behavior (Guedj et al., 2021a,b; Marini and Banaji, 2022b). This research showed that implicit attitudes can be temporally reduced (Dasgupta and Greenwald, 2001; Marini et al., 2012; Lai et al., 2016) by a variety of factors, ranging from behavioral interventions (e.g., educational programs: Kawakami et al., 2000; Rudman et al., 2001) to the use of neuroscience techniques (e.g., noninvasive brain stimulation: for a review, see Marini et al., 2018). For example, it has been shown that implicit racial attitudes can be temporarily shifted by exposing people to counter-stereotypical exemplars (Marini et al., 2012; Lai et al., 2014), producing changes in their emotional states (DeSteno et al., 2004), or setting equalitarian goals (Legault et al., 2011; Mann and Kawakami, 2012). Similar changes have been observed also using noninvasive brain stimulation techniques (Marini et al., 2018), such as transcranial magnetic stimulation (TMS) and transcranial direct-current stimulation (tDCS). Sellaro et al. (2015), for instance, showed that interfering with the activity of the medial prefrontal cortex (mPFC) via tDCS decreased implicit attitudes toward outgroup members.
Using virtual reality to change implicit attitudes
More recently, studies have shown that implicit attitudes can be shifted also by employing immersive virtual reality (VR). VR represents a powerful tool for embodying people into a “different” body (virtual embodiment) and changing their body representation. When people are virtually embodied with a body different from their own, they tend to exhibit behaviors associated with attributes and characteristics of that body (Banakou et al., 2013): An effect known as Proteus Effect (Yee and Bailenson, 2007).
Studies showed that VR embodiment allows to produce changes in the social processing of individuals and to modulate their implicit attitudes against outgroup members (Peck et al., 2013; Banakou et al., 2016; Salmanowitz, 2018). For example, Peck et al. (2013) demonstrated that the embodiment of White participants in a Black virtual body, for as short as 12 min, produced a reduction of their implicit pro-White attitudes. Similarly, Banakou et al. (2016) conducted a study in which participants performed a series of Tai Chi movements displayed by a virtual teacher. Results showed that not only implicit pro-White attitudes decreased more for participants embodied in a Black than a White virtual body, but also that this effect was still present 1 week after the intervention. In both studies, participants could look at their virtual body both from a first-person perspective, by directly looking down toward themselves, and reflected in a mirror placed in front of them in the virtual environment.
Subsequent research showed that several characteristics of the VR setup seem to have a role in producing a modulation of implicit attitudes (Tassinari et al., 2022b). Indeed, a reduction in implicit attitudes is more likely to occur among those participants who liked their virtual body (Hasler et al., 2017), when the virtual environment had a positive, as opposed to a negative, valence (Banakou et al., 2020), or when the virtual social context was cooperative (Patané et al., 2020). Conversely, other variables, such as the lack of physical similarity between participants’ real body and virtual body (Banakou et al., 2013) or the number of embodiment exposures (Banakou et al., 2016) seems to have no specific influence in reducing implicit attitudes.
Overview of the study
The main goal of the present study was to further examine conditions under which VR can change implicit racial attitudes. In previous studies, embodiment was achieved by synchronizing the movements of the avatar in the virtual environment with those of the participants who could concurrently see their actions both from the avatar’s perspective and in a virtual mirror placed in the scene (Peck et al., 2013; Banakou et al., 2016, 2020; Hasler et al., 2017; Salmanowitz, 2018). Participants had thus two different visual perspectives on their actions: a first-person perspective given by the synchronization of their movements with those of the virtual avatar and the frontal view of their same movements provided by the virtual mirror. This raises the question as to what is the contribution of the additional view of one’s own movements provided by the virtual mirror and whether this is a crucial factor to elicit changes in implicit attitudes.
To address this question, we used immersive VR to embody White, Caucasian female participants in a Black or White female avatar. Participants wore a body-tracking suit that provided real-time motion capture, so that they could see their virtual body moving synchronously with their real body. To draw attention to their novel virtual body, we required participants to perform a series of manual tasks (Fregna et al., 2022) during the virtual embodiment.
Our study followed a mixed design with two between-subjects factors (condition: “first-person and mirror” vs. “first-person only”; avatar: Black vs. White) and one within-subjects factor (session: pre-intervention vs. post-intervention). That is, each participant was randomly assigned to one of the two experimental conditions and embodied in one of the two avatars. For all participants, implicit racial attitudes were assessed using the Implicit Association Test (IAT) before and immediately after the VR intervention. Participants in the “first-person and mirror” condition could see their virtual body both by looking down toward themselves and reflected in a mirror placed in front of them in the virtual environment, while participants in the “first-person only” condition could instead see their virtual body only from a first-person perspective (i.e., by looking down toward themselves) as no mirror was present in the VR scene.
Materials and methods
Participants
A total of 64 volunteers (all female, White, Caucasian; age range 22–38) took part in the present study. Participants were naive to the purpose of the study. The study and all experimental procedures were approved by the local ethics committee (Comitato Etico della Provincia di Ferrara, approval number: 170592). All participants gave their written informed consent and they were paid for their participation.
Procedure
After signing the informed consent, participants wore a motion capture suite with reflective markers attached on the main joints by means of Velcro straps and completed an Implicit Association Tests (Greenwald et al., 1998) assessing their implicit racial attitudes (race attitude IAT). Then, they went through a VR session during which they were immersed in the virtual environment for approximately 15 min. Finally, they completed again the IAT and filled out a questionnaire evaluating the degree of embodiment experience during the experiment (Gonzalez-Franco and Peck, 2018).
During the VR session, participants comfortably sat in a chair in front of a table. In the VR environment, participants were placed in front of a (virtual) table as well. The experimenter then used calibration routines programmed in our system to set the height and distance of the table in the VR environment to match those of the real table that the participant was facing. In this manner, when touching the table in the VR environment the participant also experienced a sensation of touch produced by the real table. This step was implemented, based on previous results showing that the experience of multi-modal (in our case, vision, touch, and proprioception) matching cues enhance the feelings of embodiment, presence and immersion of subjects in a VR environment (Gallace et al., 2012; Martin et al., 2022). Our immersive virtual environment was developed in C# using the Unity 3D game engine1 and the SteamVR plugin (Valve Corporation, Bellevue, United States). It consisted of a cozy home interior with windows showing a beachside scenario (Scandinavian Interior Archviz purchased from the Unity Asset Store) and we displayed it to participants by means of an Oculus Rift (Meta, Menlo Park, CA) Head Mounted Display (HMD).
While immersed in the virtual environment, the subjects performed three different tasks (Fregna et al., 2022), with the purpose of acting with and paying attention to their virtual body. Task 1 (Glasses): The task started with four pedestals presented on the table. The pedestals were distributed along a circle centered on the participants’ body at equal angular displacements. A glass then appeared on one randomly selected pedestal and the participants had to push it down using the hand closer to the pedestal on which it appeared. Task 2 (Cloud): At the beginning of trial a cloud of small bubbles appeared, which pop upon touching. The cloud was placed either to the right or to the left of the participants and they had to pop all of the bubbles with the corresponding hand. Task 3 (Ball in hole): For this task, a box-like support with a pocket at its center was placed on the virtual table. At the beginning of each trial, a tennis ball was placed on this support either to the right or left of the participants and they had to gently push the ball into the hole with their corresponding hand.
During task performance the participants wore a motion capture suit (Figure 1A). Their movements were measured by means of an OptiTrack motion capture system (NaturalPoint, Inc., Corvallis, OR, United States) equipped with 15 Flex 13 cameras and they were used to animate in real-time a photorealistic avatar (Figure 1B). The virtual camera of the HMD was placed in the head of the avatar as to give the impression of effectively being in the avatar’s body. Each participant performed one of two primary conditions (“first-person and mirror” or “first-person only”) and was embodied in one of two avatars (Black or White). Participants in the “first-person and mirror” condition, could see their virtual body both by looking down toward themselves and reflected in a mirror placed in front of them in the virtual scene (left column in Figure 1C). Participants in the “first-person only” condition, could see their body only by looking down toward themselves as no virtual mirror was placed in the VR environment (right column in Figure 1C). For the White avatar, participants were embodied in a white Caucasian avatar (Monique8 HD from the DAZ asset store, Salt Lake City, UT, United States), while participants for the Black avatar were embodied in an African American avatar (Imani8 HD also from the DAZ store).
Figure 1. Experimental setup and conditions. (A) Motion capture suite with reflective markers and head-mounted display wore by participants in our experiments. (B) Photorealistic Black (upper row) and White (bottom row) avatars used in our experiments. (C) Experimental conditions. Participants in the “first-person and mirror” condition (left column) could see their virtual body both from a first-person perspective (i.e., by looking down toward themselves) and reflected in a mirror placed in front of them in the VR environment. Participants in the “first-person only” condition (right column) could see their virtual body only from a first-person perspective (i.e., by looking down toward themselves) as no mirror was placed in the VR environment (right column).
Measures
Implicit association test
The Implicit Association Test (IAT; Greenwald et al., 1998) is a widely-used and validated implicit measure that assesses psychological construct (e.g., attitudes, stereotypes) indirectly by measuring how quickly and accurately a person can categorize and associate stimuli related to two conceptual categories and two attributes. In this study, participants completed a race attitude IAT assessing their implicit racial attitudes. Specifically, the race attitude IAT evaluated the automatic strength of association between the categories Black People and White People and the evaluative attributes good and bad.
The IAT followed the standard procedure described in Nosek et al. (2005). Participants categorized stimuli representing two categories and two attributes in two different sorting conditions by pressing one of two keys. In one condition, participants categorized pictures of Black individuals and positively-valenced words (e.g., joy and love) with one response key, while categorizing pictures of white individuals and negatively-valenced words (e.g., agony and hate) by using another response key. In the other condition, they categorized the same stimuli but with a different response key configuration: this time pictures of Black individuals and negatively-valenced words were categorized with one key, whereas pictures of White individuals and positively-valenced words with the other. The order of these two conditions was randomized across participants. Stimuli were presented one at a time at the center of a computer screen.
We computed IAT scores according to the algorithm described by Greenwald et al. (2003). That is, we divided the difference in mean response between the two IAT sorting conditions by the participant’s latency standard deviation inclusive of the two conditions. Responses faster than 350 ms and slower than 10,000 ms were removed, and errors were replaced with the mean of the correct responses in that response block plus a 600 millisecond penalty. IAT score could range from +2 to-2, with zero indicating no implicit preference between Black and White people. Positive scores indicated implicit pro-White attitudes, while negative scores indicated implicit pro-Black attitudes. Participants with IAT scores or differences in scores deviating more than 2SD from their group’s mean were considered outliers and were not considered further. A total of 58 participants were included in our analysis.
Embodiment questionnaire
To evaluate the degree of embodiment during the experiment we used a subset of a standardized questionnaire proposed by Gonzalez-Franco and Peck (2018). The questionnaire was administered in Italian at the end of the session and it consisted of 11 questions (see section 1 in the Supplementary Material) corresponding to questions Q1, Q2, Q3, Q6, Q7, Q8, Q9, Q17, Q18, Q19, and Q20 in Gonzalez-Franco and Peck (2018). The subjects could respond to each question by checking one out of 7 possible choices corresponding to a 7 point Likert scale ranging from-3 to 3, with-3 indicating strong disagreement and 3 indicating strong agreement with the statement. Ratings were used to quantitatively evaluate three aspects of the embodiment experience, namely Ownership, Agency, and Appearance, that, following Gonzalez-Franco and Peck (2018), were computed in the following manner:
• Ownership: (Q1 - Q2) - Q3
• Agency: Q6 + Q7 + Q8 – Q9
• Appearance: Q17 + Q18 + Q19 + Q20
Results
Implicit association test
Overall, participants showed positive IAT scores before the VR intervention, indicating strong implicit pro-White attitudes (M = 0.61, SD = 0.33, Cohen’s d = 1.85, t(57) = 14.165, p < 0.001). Mean IAT scores and their standard deviation for each condition before and after VR intervention are reported in Supplementary Table S1.
Following the analysis procedure applied in previous VR studies investigating implicit attitudes (Peck et al., 2013; Banakou et al., 2016), IAT scores after the VR intervention (post-intervention) were submitted to an ANCOVA with avatar (Black vs. White) and condition (first-person and mirror vs. first-person only) as fixed factors. Scores before the VR intervention (pre-intervention) were included in the analysis as a covariate. Results revealed a significant interaction between factors avatar and condition [F(1,53) = 4.624, p < 0.05, ηp2 = 0.080], indicating that implicit racial attitudes after VR intervention were modulated by these two factors. No significant main effect of the factors avatar [F(1,53) = 0.949, p = n.s., ηp2 = 0.018] or condition [F(1,53) = 0.025, p = n.s., ηp2 = 0.000] was observed. The covariate showed a significant effect [F(1,53) = 11.236, p < 0.001, ηp2 = 0.175], indicating a relevant contribution in the model.
To study the interaction between the factors avatar and condition, we then compared the difference in IAT scores, measured after and before VR embodiment, in the Black and White avatar for each condition. Results showed that, in the “first-person and mirror” condition, the embodiment in a Black avatar produced a stronger reduction of implicit pro-White attitudes than when they were embodied in a White avatar (left panel in Figure 2; t(22) = 2.22, p < 0.05). No difference between avatars was instead observed in the “first-person only” condition (right panel in Figure 2; t(32) = −0.68, p = n.s.). These results show a reduction of implicit pro-White attitudes when participants are embodied in a Black avatar (compared to a White avatar) but only if they can see their virtual body both from a first-person perspective and in a mirror.
Figure 2. Changes in IAT scores – In all panels the black dots represent the individual differences in IAT scores (dIAT) after and before virtual embodiment for the Black (dark gray bar) and White (light gray bar) avatar. The left panel shows results for participants that could see their virtual bodies both from a first-person perspective and in a mirror, while the right panel shows results for participants that could see their virtual body only from a first-person perspective. The thick vertical bars represent the first and third quantiles and the white dots the median of the distribution. Significant differences are highlighted by an asterisk (*).
Embodiment questionnaires
A t-test analysis of the “appearance” scores revealed that they were higher for the White than for the Black avatar (Left column in Figure 3) both in the “first-person and mirror” (Black: −1.58 ± 3.63, White: 2.25 ± 3.55; t(22) = −2.62, p < 0.05) and in the “first-person only” (Black: −0.41 ± 4.05, White: 2.71 ± 4.77; t(32) = −2.06, p < 0.05) conditions. The same analysis on the “agency” scores revealed instead no difference between the Black and White avatars neither in the “first-person and mirror” (Black: 5.17 ± 1.53, White: 4.58 ± 3.34; t(22) = 0.55, p = n.s.) nor in the “first-person only” (Black: 3.65 ± 3.32, White: 4.53 ± 3.14; t(32) = −0.8, p = n.s.) condition. Similar results were obtained for the “ownership” scores (first-person and mirror: Black: 4.5 ± 2.58, White: 3.58 ± 4.54; t(22) = 0.61, p = n.s.; first-person only: Black: 1.59 ± 4.72, White: 3.71 ± 3.98; t(32) = −1.41, p = n.s.). Taken together, these results indicate that participants were aware of the different bodily characteristics of the avatars as the appearance ratings were significantly different between Black and White avatars in both the “first-person and mirror” and “first-person only” conditions. However, the reduction of implicit pro-White attitudes after the VR intervention with a Black avatar cannot be due to a potential different experience in acting in the virtual environment as the agency and ownership ratings were not significantly different between the Black and White avatars in neither condition.
Figure 3. Results of the appearance, agency and ownership questionnaires – The six panels show the appearance (left column), agency (middle column) and ownership (right column) ratings obtained in the post-experiment questionnaires when participants could see their body in both the first-person perspective and in a mirror (“first-person and mirror” condition, upper row) and when they could see it only from a first-person perspective (“firstperson only” condition, lower row). Vertical bars represent standard error. Significant differences are highlighted by an asterisk (*).
Discussion
The main purpose of the present study was to examine the conditions under which VR embodiment in an outgroup member can change implicit racial attitudes. To this aim, we conducted an experiment in which participants completed an IAT assessing racial attitudes both before and after a VR intervention. In the VR intervention, we manipulated participants’ perspective of their virtual body: in one condition (“first-person and mirror”), they could see their virtual body both from a first-person perspective (i.e., both by looking down toward themselves) and reflected in a mirror placed in front of them in the virtual environment, while in another condition (“first-person only”), they saw their virtual body only from a first-person perspective (i.e., by looking down toward themselves) as no mirror was placed in the VR environment. Results showed that the implicit pro-White attitudes of participants embodied in a Black avatar decreased in a significant manner, compared to a White avatar, when they could see their virtual body both from a first-person perspective and in a mirror. We observed no such significant decrease when participants saw their virtual body only from a first-person perspective. These results indicate that participants’ perspective of their virtual body in the VR environment might be a critical factor to change implicit racial attitudes. Specifically, they suggest that seeing the virtual body in a mirror might be a crucial factor to produce such change.
One potential explanation for these results is that the presence of the virtual mirror in the “first-person and mirror condition” gave participants a visual feedback not only of their bodily movements and features (e.g., their skin tone) but also of their facial features, increasing thus the perception to be embodied in a virtual body of a different race. Previous studies showed that facial characteristics compared to skin color play a major role in the perception and recognition of Black individuals (Dixon and Maddox, 2005; Ronquillo et al., 2007; Bar-Haim et al., 2009; Brooks and Gwinn, 2010; Strom et al., 2012). For example, in a study in which participants were asked to rate the racial prototypicality of individuals belonging to different race groups, White participants perceived Black people as more or less racially prototypical relying more on their facial features rather than on their skin color (Strom et al., 2012). Similarly, in a study in which the skin color of Black individuals was manipulated, results showed that facial features played a bigger role, compared to skin tone, in the recognition of Black individuals (Bar-Haim et al., 2009). It is thus conceivable that, in our experiments, seeing the virtual face reflected in a mirror placed in the VR environment may have induced in the participants a stronger recognition of their virtual body as an outgroup member, producing a change in their implicit pro-White attitudes. Notably, it has been demonstrated that facial features are critical also to activate evaluative judgments (for reviews, see Maddox, 2004; Kleider-Offutt et al., 2017). For example, it has been shown that Black people with specific facial characteristics (e.g., a wide nose and full lips) were readily recognized and categorized as Black individuals, but they were also more likely to be associated with stereotypical attributions (Blair et al., 2004; Kleider et al., 2012; Knuycky et al., 2014). These findings suggest that the lack of a reduction in implicit racial attitudes after the VR intervention in which participants could see their virtual body only from a first-person perspective found in our study, may be due to the fact that participants could not see their virtual face and thus activate the evaluative attributions associated to the outgroup.
An alternative, non-mutually exclusive, explanation is that the presence of the virtual mirror in the “first-person and mirror” condition recruited, compared with the “first-person only” condition, additional representations of one’s own body that enhanced the efficacy of the VR intervention. Indeed, results in somatoparaphrenia patients suggest that first-person and mirror-view of one’s own actions rely on partially different neuronal substrates. Somatoparaphrenia is a condition, predominantly associated with brain damages to the right hemisphere, in which patients experience disownership of left-sided body parts (for review see, Vallar and Ronchi, 2009). That is, the delusional feeling that they belong to someone else. Notably, the feeling of disownership significantly decreased when somatoparaphrenia patients observed their body in a mirror (Fotopoulou et al., 2011; Jenkinson et al., 2013). Interestingly, also the opposite dissociation (i.e., disownership of one’s own body when viewed in a mirror but not in direct, first-person, view) has been reported (Breen et al., 2000). A complementary role of the first-person and mirror views of one’s own bodily movements is also suggested by behavioral experiments showing a greater visual sensitivity to either the former (Campanella et al., 2011) or the latter (Prasad and Shiffrar, 2009) stimulus presentation, depending on the task. Interestingly, the existence of partially dissociated neuronal and behavioral representations of the egocentric and allocentric points of view has been shown also for observation of others’ actions (Maeda et al., 2002; Shmuelof and Zohary, 2008; Caggiano et al., 2011, 2015; Casile, 2013, 2022). Taken together, the experimental results reviewed above suggest that the first-person and mirror views of one’s own actions have partially non-overlapping neuronal and cognitive representations. It is thus conceivable that, when both are present, as in the “first-person and mirror” condition in our experiments, the brain has access to additional information that enhance the experience of being embodied in a virtual avatar. This enhancement is not consciously perceived, as participants’ explicit ownership and agency scores are not different between the “first-person and mirror” and “first-person only” conditions but it nonetheless influences their implicit, unconscious racial attitudes.
In addition to immersive reality, a widely-used paradigm to elicit the embodiment of fake bodily parts is the rubber hand illusion (RHI: Botvinick and Cohen, 1998). In the RHI, subjects see a lifelike rubber hand placed in front of them being stroke with a brush simultaneously with their corresponding unseen hand. After few minutes of simultaneous stimulation of the rubber and their unseen hand, the subjects report a strong sense of embodiment of the rubber hand and report it as being their own (Botvinick and Cohen, 1998). In the standard RHI paradigm, the to-be-embodied, rubber hand is seen from the same subjective perspective as in the “first-person only” condition in our experiments. The question thus arises as to why we found no significant modulation of the implicit bias in that condition, while a modulation of implicit associations has been consistently reported in RHI studies (Farmer et al., 2012, 2014; Maister et al., 2013). An important difference between our “first-person only” condition and the RHI paradigm is that, participants in the latter, experience, in addition to the first-person representation of the rubber hand, also a consistent tactile stimulation (i.e., the simultaneous stroking of both the real and rubber hands). The visual representation, per se, is not sufficient to create an embodiment of the rubber hand. In our “first-person only” paradigm, while participants experience a consistent proprioceptive feedback (i.e., they see their virtual body move when they move their real body), they cannot necessarily experience a tactile feedback from their interactions with objects in the virtual environment. The addition of the mirror in the “first-person and mirror” condition might have thus contributed to, at least partially, overcome this “sensory conflict” by activating complementary/additional one’s own body’s representations. In keeping with the idea that a mirror can indeed activate additional internal bodily representations, is the experimental finding that while the RHI is virtually abolished when the rubber is rotated 180 degree from the subjects’ body and it is thus seen from a frontal rather than a first-person perspective (Costantini and Haggard, 2007), it is instead fully established when the rubber hand or a whole-body mannequin are presented from the same frontal perspective by means of a mirror (Bertamini et al., 2011; Jenkinson et al., 2013; Preston et al., 2015).
Our study has also limitations that are worth discussing. First, it provides no understanding of the mechanisms mediating the modulation of implicit bias that we observed. To this end, a potentially promising direction for future studies, might be the exploration of moderating factors in prejudice reduction in VR (Tassinari et al., 2022b). Presently available evidence seems to suggest that the emotional valence of the VR experience has a role in this process (e.g., Kalyanaraman et al., 2010; Banakou et al., 2020) and further studies are needed to fully elucidate this point. Second, the scope of our questionnaires was limited to measure participants’ subjective ratings of ownership, agency and appearance during the VR embodiment. There are indications that, at the individual level, personality traits (e.g., empathy or nervousness during the VR immersion) might contribute to enhance prejudice reduction in VR (Peck et al., 2013; Chen et al., 2021) and future studies might want to include questionnaires to evaluate participants also along those dimensions. Finally, future studies should explore whether the changes in the race IAT observed here using VR are also associated with changes in behavior. Recent research indeed showed that changes in implicit measures as the IAT are possible, but those changes might not readily translate into changes in behavior (Forscher et al., 2019).
In summary, our results have important implications for the creation of VR interventions aimed at changing implicit racial attitudes as they provide relevant information about conditions under which these changes can occur. In particular, they suggest that the possibility of viewing one’s own body and actions in a virtual environment both from a first-person perspective and reflected in a mirror might be important to produce chances in implicit attitudes. Results presented here represent a further step forward for understanding the malleability of implicit racial preferences using VR and for developing future basic research to clarify the mechanisms of such change. Future studies comparing different VR interventions are needed to further determine the most effective practices in using VR to change implicit attitudes. For example, VR could be also used to create virtual interactions with outgroup members (Breves, 2020; Tassinari et al., 2022a) or it may be used together with behavioral interventions aimed at reducing implicit pro-White attitudes (Lai et al., 2014) to enhance their effects by providing a more vivid and realistic experience.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics statement
The studies involving human participants were reviewed and approved by Comitato Etico della Provincia di Ferrara, approval number: 170592. The patients/participants provided their written informed consent to participate in this study.
Author contributions
MM and AC conceived and designed the study, implemented the study, analyzed the data, interpreted the data, drafted the manuscript, and revised and approved the manuscript. All authors contributed to the article and approved the submitted version.
Funding
This work was partially supported by a grant from the Bial Foundation (grant number 344/18).
Acknowledgments
We thank Chiara Terzo for her help in the data collection.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.989582/full#supplementary-material
Footnotes
References
Avenanti, A., Sirigu, A., and Aglioti, S. M. (2010). Racial bias reduces empathic sensorimotor resonance with other-race pain. Curr. Biol. 20, 1018–1022. doi: 10.1016/j.cub.2010.03.071
Banakou, D., Beacco, A., Neyret, S., Blasco-Oliver, M., Seinfeld, S., and Slater, M. (2020). Virtual body ownership and its consequences for implicit racial bias are dependent on social context. R. Soc. Open Sci. 7:201848. doi: 10.1098/rsos.201848
Banakou, D., Groten, R., and Slater, M. (2013). Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes. Proc. Nat. Acad. Sci. U. S. A. 110, 12846–12851. doi: 10.1073/pnas.1306779110
Banakou, D., Hanumanthu, P. D., and Slater, M. (2016). Virtual embodiment of white people in a black virtual body leads to a sustained reduction in their implicit racial bias. Front. Hum. Neurosci. 10:601. doi: 10.3389/FNHUM.2016.00601
Bar-Haim, Y., Saidel, T., and Yovel, G. (2009). The role of skin color in face recognition. Perception 38, 145–148. doi: 10.1068/p6307
Bertamini, M., Berselli, N., Bode, C., Lawson, R., and Wong, L. T. (2011). The rubber hand illusion in a mirror. Conscious. Cogn. 20, 1108–1119. doi: 10.1016/j.concog.2011.04.006
Blair, I. V. (2002). The malleability of automatic stereotypes and prejudice. Personal. Soc. Psychol. Rev. 6, 242–261. doi: 10.1207/S15327957PSPR0603_8
Blair, I. V., Judd, C. M., and Fallman, J. L. (2004). The automaticity of race and Afrocentric facial features in social judgments. J. Pers. Soc. Psychol. 87, 763–778. doi: 10.1037/0022-3514.87.6.763
Breen, N., Caine, D., Coltheart, M., Hendy, J., and Roberts, C. (2000). Towards an understanding of delusions of misidentification: four case studies. Mind Lang. 15, 74–110. doi: 10.1111/1468-0017.00124
Breves, P. (2020). Bringing people closer: the prosocial effects of immersive media on users’ attitudes and behavior. Nonprofit Volunt. Sect. Q. 49, 1015–1034. doi: 10.1177/0899764020903101
Brooks, K. R., and Gwinn, O. S. (2010). No role for lightness in the perception of black and white? Simultaneous contrast affects perceived skin tone, but not perceived race. Perception 39, 1142–1145. doi: 10.1068/p6703
Caggiano, V., Fogassi, L., Rizzolatti, G., Pomper, J. K., Thier, P., Giese, M. A., et al. (2011). View-based encoding of actions in mirror neurons of area F5 in macaque premotor cortex. Curr. Biol. 21, 144–148. doi: 10.1016/j.cub.2010.12.022
Caggiano, V., Giese, M. A., Thier, P., and Casile, A. (2015). Encoding of point of view during action observation in the local field potentials of macaque area F5. Eur. J. Neurosci. 41, 466–476. doi: 10.1111/ejn.12793
Campanella, F., Sandini, G., and Morrone, M. C. (2011). Visual information gleaned by observing grasping movement in allocentric and egocentric perspectives. Proc. R. Soc. Lon. B 278, 2142–2149. doi: 10.1098/rspb.2010.2270
Casile, A. (2013). Mirror neurons (and beyond) in the macaque brain: an overview of 20 years of research. Neurosci. Lett. 540, 3–14. doi: 10.1016/j.neulet.2012.11.003
Casile, A. (2022). “Mirror Neurons” in Encyclopedia of Behavioral Neuroscience. ed. S. Della Sala. 2nd Edn. (Elsevier), 541–552.
Chen, V. H. H., Ibasco, G. C., Leow, V. J. X., and Lew, J. Y. Y. (2021). The effect of VR avatar embodiment on improving attitudes and closeness toward immigrants. Front. Psychol. 12, 1–17. doi: 10.3389/fpsyg.2021.705574
Costantini, M., and Haggard, P. (2007). The rubber hand illusion: sensitivity and reference frame for body ownership. Conscious. Cogn. 16, 229–240. doi: 10.1016/j.concog.2007.01.001
Dasgupta, N., and Greenwald, A. G. (2001). On the malleability of automatic attitudes: combating automatic prejudice with images of admired and disliked individuals. J. Pers. Soc. Psychol. 81, 800–814. doi: 10.1037/0022-3514.81.5.800
DeSteno, D., Dasgupta, N., Bartlett, M. Y., and Cajdric, A. (2004). Prejudice from thin air. The effect of emotion on automatic intergroup attitudes. Psychol. Sci. 15, 319–324. doi: 10.1111/j.0956-7976.2004.00676.x
Dixon, T. L., and Maddox, K. B. (2005). Skin tone, crime news, and social reality judgments: priming the stereotype of the dark and dangerous black Criminal1. J. Appl. Soc. Psychol. 35, 1555–1570. doi: 10.1111/j.1559-1816.2005.tb02184.x
Dovidio, J. F., Kawakami, K., Johnson, C., Johnson, B., and Howard, A. (1997). On the nature of prejudice: automatic and controlled processes. J. Exp. Soc. Psychol. 33, 510–540. doi: 10.1006/jesp.1997.1331
Farmer, H., Maister, L., and Tsakiris, M. (2014). Change my body, change my mind: the effects of illusory ownership of an outgroup hand on implicit attitudes toward that outgroup. Front. Psychol. 4, 1–10. doi: 10.3389/fpsyg.2013.01016
Farmer, H., Tajadura-Jiménez, A., and Tsakiris, M. (2012). Beyond the color of my skin: how skin color affects the sense of body-ownership. Conscious. Cogn. 21, 1242–1256. doi: 10.1016/j.concog.2012.04.011
Fazio, R. H., Jackson, J. R., Dunton, B. C., and Williams, C. J. (1995). Variability in automatic activation as an unobtrusive measure of racial attitudes: a bona fide pipeline? J. Pers. Soc. Psychol. 69, 1013–1027. doi: 10.1037/0022-3514.69.6.1013
Forscher, P. S., Lai, C. K., Axt, J. R., Ebersole, C. R., Herman, M., Devine, P. G., et al. (2019). A meta-analysis of procedures to change implicit measures. J. Pers. Soc. Psychol. 117, 522–559. doi: 10.1037/pspa0000160
Fotopoulou, A., Jenkinson, P. M., Tsakiris, M., Haggard, P., Rudd, A., and Kopelman, M. D. (2011). Mirror-view reverses somatoparaphrenia: dissociation between first-and third-person perspectives on body ownership. Neuropsychologia 49, 3946–3955. doi: 10.1016/j.neuropsychologia.2011.10.011
Fregna, G., Schincaglia, N., Baroni, A., Straudi, S., and Casile, A. (2022). A novel immersive virtual reality environment for the motor rehabilitation of stroke patients: a feasibility study. Front. Robot. Al. 9:421. doi: 10.3389/frobt.2022.906424
Gallace, A., Ngo, M. K., Sulaitis, J., and Spence, C. (2012). “Multisensory presence in virtual reality” in Multiple sensorial media advances and applications. eds. G. Ghinea, F. Andres, and S. Gulliver (Hershey, Pennsylvania, USA: IGI Global), 1–38. doi: 10.4018/978-1-60960-821-7.ch001
Gawronski, B., and Bodenhausen, G. V. (2006). Associative and propositional processes in evaluation: an integrative review of implicit and explicit attitude change. Psychol. Bull. 132, 692–731. doi: 10.1037/0033-2909.132.5.692
Gonzalez-Franco, M., and Peck, T. C. (2018). Avatar embodiment: Toward a standardized questionnaire. Front. Robot. 5, 1–9. doi: 10.3389/frobt.2018.00074
Green, A. R., Carney, D. R., Pallin, D. J., Ngo, L. H., Raymond, K. L., Iezzoni, L. I., et al. (2007). Implicit bias among physicians and its prediction of thrombolysis decisions for black and white patients. J. Gen. Intern. Med. 22, 1231–1238. doi: 10.1007/s11606-007-0258-5
Greenwald, A. G., and Banaji, M. R. (1995). Implicit social cognition: attitudes, self-esteem, and stereotypes. Psychol. Rev. 102, 4–27. doi: 10.1037/0033-295X.102.1.4
Greenwald, A. G., McGhee, D. E., and Schwartz, J. L. K. (1998). Measuring individual differences in implicit cognition: the implicit association test. J. Pers. Soc. Psychol. 74, 1464–1480. doi: 10.1037/0022-3514.74.6.1464
Greenwald, A. G., and Nosek, B. A. (2008). “Attitudinal dissociation what:What does it mean?” in Attitudes: Insights from the new implicit measures. eds. R. E. Petty, R. H. Fazio, and P. Briñol (London, England: Psychology Press), 65–82.
Greenwald, A. G., Nosek, B. A., and Banaji, M. R. (2003). Understanding and using the implicit association test: I an improved scoring algorithm. J. Pers. Soc. Psychol. 85, 197–216. doi: 10.1037/0022-3514.85.2.197
Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., and Banaji, M. R. (2009). Understanding and using the implicit association test: III. Meta-analysis of predictive validity. J. Pers. Soc. Psychol. 97, 17–41. doi: 10.1037/a0015575
Guedj, R., Marini, M., Kossowsky, J., Berde, C. B., Kimia, A. A., and Fleegler, E. W. (2021a). Racial and ethnic disparities in pain management of children with Limb Fractures or suspected appendicitis: a retrospective cross-sectional study. Front. Pediatr. 9, 1–9. doi: 10.3389/fped.2021.652854
Guedj, R., Marini, M., Kossowsky, J., Berde, C., Mateo, C., and Fleegler, E. W. (2021b). Explicit and implicit bias based on race, ethnicity, and weight among pediatric emergency physicians. Acad. Emerg. Med. 28, 1073–1076. doi: 10.1111/acem.14301
Hasler, B. S., Spanlang, B., and Slater, M. (2017). Virtual race transformation reverses racial in-group bias. PLoS One 12:e0174965. doi: 10.1371/journal.pone.0174965
Hehman, E., Flake, J. K., and Calanchini, J. (2018). Disproportionate use of lethal force in policing is associated with regional racial biases of residents. Soc. Psychol. Personal. Sci. 9, 393–401. doi: 10.1177/1948550617711229
Hewstone, M., Rubin, M., and Willis, H. (2002). Intergroup bias. Annu. Rev. Psychol. 53, 575–604. doi: 10.1146/annurev.psych.53.100901.135109
Jenkinson, P. M., Haggard, P., Ferreira, N. C., and Fotopoulou, A. (2013). Body ownership and attention in the mirror: insights from somatoparaphrenia and the rubber hand illusion. Neuropsychologia 51, 1453–1462. doi: 10.1016/j.neuropsychologia.2013.03.029
Kalyanaraman, S., Penn, D. L., Ivory, J. D., and Judge, A. (2010). The virtual doppelganger. J. Nerv. Ment. Dis. 198, 437–443. doi: 10.1097/NMD.0b013e3181e07d66
Kawakami, K., Dovidio, J. F., Moll, J., Hermsen, S., and Russin, A. (2000). Just say no (to stereotyping): effects of training in the negation of stereotypic associations on stereotype activation. J. Pers. Soc. Psychol. 78, 871–888. doi: 10.1037/0022-3514.78.5.871
Kleider, H. M., Cavrak, S. E., and Knuycky, L. R. (2012). Looking like a criminal: stereotypical black facial features promote face source memory error. Mem. Cogn. 40, 1200–1213. doi: 10.3758/s13421-012-0229-x
Kleider-Offutt, H. M., Bond, A. D., and Hegerty, S. E. A. (2017). Black stereotypical features. Curr. Dir. Psychol. Sci. 26, 28–33. doi: 10.1177/0963721416667916
Knuycky, L. R., Kleider, H. M., and Cavrak, S. E. (2014). Line-up misidentifications: when being ‘prototypically black’ is perceived as criminal. Appl. Cogn. Psychol. 28, 39–46. doi: 10.1002/acp.2954
Lai, C. K., Marini, M., Lehr, S. A., Cerruti, C., Shin, J.-E. L., Joy-Gaba, J. A., et al. (2014). Reducing implicit racial preferences: I. a comparative investigation of 17 interventions. J. Exp. Psychol. Gen. 143, 1765–1785. doi: 10.1037/a0036260
Lai, C. K., Skinner, A. L., Cooley, E., Murrar, S., Brauer, M., Devos, T., et al. (2016). Reducing implicit racial preferences: II. Intervention effectiveness across time. J. Exp. Psychol. Gen. 145, 1001–1016. doi: 10.1037/xge0000179
Legault, L., Gutsell, J. N., and Inzlicht, M. (2011). Ironic effects of antiprejudice messages. Psychol. Sci. 22, 1472–1477. doi: 10.1177/0956797611427918
Maddox, K. B. (2004). Perspectives on racial phenotypicality bias. Personal. Soc. Psychol. Rev. 8, 383–401. doi: 10.1207/s15327957pspr0804_4
Maeda, F., Kleiner-Fisman, G., and Pascual-Leone, A. (2002). Motor facilitation while observing hand actions: specificity of the effect and role of observer’s orientation. J. Neurophysiol. 87, 1329–1335. doi: 10.1152/jn.00773.2000
Maister, L., Sebanz, N., Knoblich, G., and Tsakiris, M. (2013). Experiencing ownership over a dark-skinned body reduces implicit racial bias. Cognition 128, 170–178. doi: 10.1016/j.cognition.2013.04.002
Mann, N. H., and Kawakami, K. (2012). The long, steep path to equality: progressing on egalitarian goals. J. Exp. Psychol. Gen. 141, 187–197. doi: 10.1037/a0025602
Marini, M., and Banaji, M. R. (2022a). “Us and them: cognitive and neural mechanisms of intergroup behavior” in Encyclopedia of behavioral neuroscience. 2nd Edn. ed. S. D. Sala (Elsevier), 508–517. doi: 10.1016/B978-0-12-819641-0.00062-1
Marini, M., and Banaji, M. R. (2022b). An implicit gender sex-science association in the general population and STEM faculty. J. Gen. Psychol. 149, 299–326. doi: 10.1080/00221309.2020.1853502
Marini, M., Banaji, M. R., and Pascual-Leone, A. (2018). Studying implicit social cognition with noninvasive brain stimulation. Trends Cogn. Sci. 22, 1050–1066. doi: 10.1016/j.tics.2018.07.014
Marini, M., Rubichi, S., and Sartori, G. (2012). The role of self-involvement in shifting IAT effects. Exp. Psychol. 59, 348–354. doi: 10.1027/1618-3169/a000163
Martin, D., Malpica, S., Gutierrez, D., Masia, B., and Serrano, A. (2022). Multimodality in VR: a survey. ACM Comput. Surv. 216, 1–36. doi: 10.1145/3508361
Mitchell, J. P. (2009). Social psychology as a natural kind. Trends Cogn. Sci. 13, 246–251. doi: 10.1016/j.tics.2009.03.008
Mitchell, J. P., Heatherton, T. F., and Macrae, C. N. (2002). Distinct neural systems subserve person and object knowledge. Proc. Nat. Acad. Sci. U. S. A. 99, 15238–15243. doi: 10.1073/pnas.232395699
Mitchell, J. P., Macrae, C. N., and Banaji, M. R. (2006). Dissociable medial prefrontal contributions to judgments of similar and dissimilar others. Neuron 50, 655–663. doi: 10.1016/j.neuron.2006.03.040
Moss-Racusin, C. A., Dovidio, J. F., Brescoll, V. L., Graham, M. J., and Handelsman, J. (2012). Science faculty’s subtle gender biases favor male students. Proc. Nat. Acad. Sci. U. S. A. 109, 16474–16479. doi: 10.1073/pnas.1211286109
Nosek, B. A., Greenwald, A. G., and Banaji, M. R. (2005). Understanding and using the implicit association test: II. Method variables and construct validity. Personal. Soc. Psychol. Bull. 31, 166–180. doi: 10.1177/0146167204271418
Patané, I., Lelgouarch, A., Banakou, D., Verdelet, G., Desoche, C., Koun, E., et al. (2020). Exploring the effect of cooperation in reducing implicit racial bias and its relationship with dispositional empathy and political attitudes. Front. Psychol. 11, 1–12. doi: 10.3389/fpsyg.2020.510787
Peck, T. C., Seinfeld, S., Aglioti, S. M., and Slater, M. (2013). Putting yourself in the skin of a black avatar reduces implicit racial bias. Conscious. Cogn. 22, 779–787. doi: 10.1016/j.concog.2013.04.016
Prasad, S., and Shiffrar, M. (2009). Viewpoint and the recognition of people from their movements. J. Exp. Psychol. Hum. Percept. Perform. 35, 39–49. doi: 10.1037/a0012728
Preston, C., Kuper-Smith, B. J., and Ehrsson, H. H. (2015). Owning the body in the mirror: the effect of visual perspective and mirror view on the full-body illusion. Sci. Rep. 5:18345. doi: 10.1038/srep18345
Ronquillo, J., Denson, T. F., Lickel, B., Lu, Z.-L., Nandy, A., and Maddox, K. B. (2007). The effects of skin tone on race-related amygdala activity: an fMRI investigation. Soc. Cogn. Affect. Neurosci. 2, 39–44. doi: 10.1093/scan/nsl043
Rudman, L. A., Ashmore, R. D., and Gary, M. L. (2001). “Unlearning” automatic biases: the malleability of implicit prejudice and stereotypes. J. Pers. Soc. Psychol. 81, 856–868. doi: 10.1037/0022-3514.81.5.856
Salmanowitz, N. (2018). The impact of virtual reality on implicit racial bias and mock legal decisions. J. Law Biosci. 5, 174–203. doi: 10.1093/jlb/lsy005
Sellaro, R., Derks, B., Nitsche, M. A., Hommel, B., Van Den Wildenberg, W. P. M., Van Dam, K., et al. (2015). Reducing prejudice through brain stimulation. Brain Stimul. 8, 891–897. doi: 10.1016/j.brs.2015.04.003
Shmuelof, L., and Zohary, E. (2008). Mirror-image representation of action in the anterior parietal cortex. Nat. Neurosci. 11, 1267–1269. doi: 10.1038/nn.2196
Sritharan, R., and Gawronski, B. (2010). Changing implicit and explicit prejudice. Soc. Psychol. 41, 113–123. doi: 10.1027/1864-9335/a000017
Strom, M. A., Zebrowitz, L. A., Zhang, S., Bronstad, P. M., and Lee, H. K. (2012). Skin and bones: the contribution of skin tone and facial structure to racial prototypicality ratings. PLoS One 7:e41193. doi: 10.1371/journal.pone.0041193
Tajfel, H., Billig, M. G., Bundy, R. P., and Flament, C. (1971). Social categorization and intergroup behaviour. Eur. J. Soc. Psychol. 1, 149–178. doi: 10.1002/ejsp.2420010202
Tassinari, M., Aulbach, M. B., and Jasinskaja-Lahti, I. (2022a). Investigating the influence of intergroup contact in virtual reality on empathy: an exploratory study using AltspaceVR. Front. Psychol. 12, 1–13. doi: 10.3389/fpsyg.2021.815497
Tassinari, M., Aulbach, M. B., and Jasinskaja-Lahti, I. (2022b). The use of virtual reality in studying prejudice and its reduction: a systematic review. PLoS One 17:e0270748. doi: 10.1371/journal.pone.0270748
Vallar, G., and Ronchi, R. (2009). Somatoparaphrenia: a body delusion. A review of the neuropsychological literature. Exp. Brain Res. 192, 533–551. doi: 10.1007/s00221-008-1562-y
Keywords: implicit attitudes, race/ethnicity, virtual reality, implicit association test, malleability, visual perspective, virtual mirror
Citation: Marini M and Casile A (2022) I can see my virtual body in a mirror: The role of visual perspective in changing implicit racial attitudes using virtual reality. Front. Psychol. 13:989582. doi: 10.3389/fpsyg.2022.989582
Edited by:
Lionel Brunel, Université Paul-Valéry Montpellier III, FranceReviewed by:
Francois Quesque, INSERM U1171 Troubles Cognitifs Dégénératifs et Vasculaires, FranceMartina Fusaro, Sapienza University of Rome, Italy
Copyright © 2022 Marini and Casile. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Maddalena Marini, bWFkZGFsZW5hLm1hcmluaTE5ODNAZ21haWwuY29t; bWFkZGFsZW5hLm1hcmluaUB1bmljYW1wYW5pYS5pdA==