The Borderline Bias in Explicit Emotion Interpretation

Hyniewska, Sylwia; Dąbrowska, Joanna; Makowska, Iwona; Jankowiak-Siuda, Kamila; Rymarczyk, Krystyna

doi:10.3389/fpsyg.2021.733742

ORIGINAL RESEARCH article

Front. Psychol., 15 December 2021

Sec. Emotion Science

Volume 12 - 2021 | https://doi.org/10.3389/fpsyg.2021.733742

This article is part of the Research Topic Facial Expression Recognition and Computing: An Interdisciplinary Perspective View all 14 articles

The Borderline Bias in Explicit Emotion Interpretation

$\r\nSylwia Hyniewska*$ Sylwia Hyniewska^1*

Joanna Dąbrowska²

Iwona Makowska³

Kamila Jankowiak-Siuda⁴ $Krystyna Rymarczyk*\r\n$ Krystyna Rymarczyk^4*

¹Department of Experimental Psychology, University College London, London, United Kingdom
²Psychiatric Clinic I, Institute of Psychiatry and Neurology, Warsaw, Poland
³Child and Adolescent Psychiatric Department, Medical University of Łódź, Łódź, Poland
⁴Department of Biological Psychology, Behavioral Neuroscience Lab, SWPS University of Social Sciences and Humanities, Warsaw, Poland

Atypical emotion interpretation has been widely reported in individuals with borderline personality disorder (iBPD); however, empirical studies reported mixed results so far. We suggest that discrepancies in observations of emotion interpretation by iBPD can be explained by biases related to their fear of rejection and abandonment, i.e., the three moral emotions of anger, disgust, and contempt. In this study, we hypothesized that iBPD would show a higher tendency to correctly interpret these three displays of social rejection and attribute more negative valence. A total of 28 inpatient iBPDs and 28 healthy controls were asked to judge static and dynamic facial expressions in terms of emotions, valence, and self-reported arousal evoked by the observed faces. Our results partially confirmed our expectations. The iBPD correctly interpreted the three unambiguous moral emotions. Contempt, a complex emotion with a difficulty in recognizing facial expressions, was recognized better by iBPD than by healthy controls. All negative emotions were judged more negatively by iBPD than by controls, but no difference was observed in the neutral or positive emotion. Alexithymia and anxiety trait and state levels were controlled in all analyses.

Introduction

Adaptive emotion interpretation is fundamental for healthy human interactions and the mental health of individuals. Atypical appraisal of emotional cues of others could be related to traits, such as anger, anxiety, and alexithymia (Schlegel et al., 2017; Kiliç et al., 2020), and are characteristics of various mental disorders, such as borderline personality disorder (BPD) (Domes et al., 2009, 2011; De Panfilis et al., 2015). Interestingly, research into emotion perception in individuals with borderline personality disorder (iBPD) reported heterogeneous results, with different studies suggesting deficits in emotion understanding, generalized negative biases, or, in some cases, even high sensitivity and more accurate labeling of subtle emotions.

Studies highlighting sensitivity to emotional signals, i.e., low threshold for the naming of emotional stimuli, showed, for example, that iBPD were able to correctly classify emotions at a lower intensity level of facial expression compared with healthy individuals (Lynch et al., 2006). Higher emotional reactivity in iBPD compared with controls was also reported as greater amygdala activation to emotional and neutral faces (Donegan et al., 2003), as well as to aversive stimuli in general (Herpertz et al., 2001). However, in several studies, neither increased psychophysiological responses, e.g., no greater potentiation of the startle response to negative pictures (Herpertz et al., 1999, 2000), nor any increased facial mimicry to facial expressions of emotions was observed (Matzke et al., 2014) in iBPD compared with controls. The authors of the latter study observed, however, a general tendency in iBPD to react with augmented activation of the corrugator supercilii muscle, i.e., frowning, to all displays of negative expressions. The authors concluded that, rather than heightened affective empathy in iBPD, a potential negativity bias could explain the diverse emotion interpretation deficits reported in the literature (Matzke et al., 2014). Moreover, visual search tasks where iBPD had to spot schematic happy and angry faces among neutral ones did not show any higher performance to angry stimuli compared with healthy participants either (Hagenhoff et al., 2013). Although only one negatively valenced emotion was presented, the authors suggested that these visual search results most probably can be explained by a lack of bias to negative stimuli.

Different studies also showed more general deficits in the interpretation of emotional displays. Deficits were observed in the naming of surprise when iBPD watched morphs from neutral to basic emotion displays and, after having reported the face to be emotional, were asked to attribute one of the six basic emotions (Domes et al., 2008). However, the authors did not provide any explanation of confusions or eventual biases observed in their study. Another study on morphs showed biases in the attribution of anger, with iBPD being more likely to respond “anger,” when anger and disgust faces were blended 50%/50% or anger and happiness faces were blended 40%/60% (Domes et al., 2008). Other teams reported deficits in the interpretation of negatively valenced emotional displays (Levine et al., 1997; Wagner and Linehan, 1999; Bland et al., 2004), which is sometimes interpreted as contradicting the existence of an increased vigilance to social threat stimuli as postulated by Linehan (1993). Some questions were raised, however, regarding the stimuli used, e.g., Bland et al. (2004) reported changes in anger, sadness, and disgust, but in each case, only one picture of the three presented for each emotion led to interpretation differences in iBPD compared with healthy participants, and the authors presented no confusion matrix. Another study showed a higher tendency to attribute fear to emotional displays and to neutral faces, which led to a higher correct attribution of fear in iBPD compared with healthy participants, as well as to a high number of false alarms when appraising neutral faces (Wagner and Linehan, 1999). Although only fear showed these results, the authors interpreted them as reflecting a negativity bias in iBPD when appraising social cues.

Different teams tried to explain the inconsistencies through the prism of comorbidities at play in BPD, particularly elevated alexithymia (Domes et al., 2011; Kiliç et al., 2020), or anxiety, which is reported at high levels in this population (Domes et al., 2008).

Another approach to elucidating emotion interpretation skills is to look at the characteristics of emotional stimuli encountered in naturalistic settings, i.e., before all the dynamic modality. Previous studies that have attempted to investigate the question of dynamic facial expression being easier to interpret have yielded inconsistent findings (for a review, see Kätsyri, 2006; Fiorentini and Viviani, 2011; Alves, 2013; Krumhuber et al., 2013; Rymarczyk et al., 2016). Interestingly, however, clinical and neuropsychological conditions have been shown to influence the extent to which dynamic displays lead to processing benefits (Ambadar et al., 2005; Torro-Alves et al., 2016; Bala et al., 2018; Żurowska et al., 2018). Thus, individuals with major depression have been observed to present atypical emotion interpretation patterns depending on whether they watched static or dynamic facial expressions of emotions, namely, greater accuracy in labeling static sadness and angry faces and less accuracy in labeling dynamic happiness faces (Bomfim et al., 2019). Patients with brain lesions in the mesial temporal zone have shown lower performance in interpreting social information from movement compared with healthy individuals (Bala et al., 2018). Patients during and after benzodiazepine detoxification recognized dynamic facial displays better than static displays, whereas no similar emotional recognition enhancement for the dynamic modality was observed in the healthy controls (Żurowska et al., 2018). Although numerous empirical scientists support the importance of testing both static and dynamic stimuli to improve the understanding of processes at play in emotion interpretation, whether in healthy or clinical populations, no study so far has investigated this aspect in the population with BPD.

Therefore, we decided to investigate how the presentation modality of stimuli, i.e., dynamic vs. static facial displays, affects emotion interpretation in BPD while controlling for alexithymia and anxiety levels. Given that fear of rejection and abandonment might be a defining feature of iBPD (Gunderson, 2008; De Panfilis et al., 2015), presenting iBPD with stimuli relating to these specific emotions would be invaluable for the understanding of atypical emotion perception in this disorder. In fact, most of the former studies in iBPD investigated some or all of the basic emotions as well as neutral faces and, to the best of our knowledge, have never included any expressions of contempt.

Although we do not have any expectations regarding how the presentation modality of stimuli might influence emotion interpretation in iBPD, we predict that facial expressions of emotions associated with social threat might exhibit a high unbiased hit rate, mostly anger, disgust, and contempt, the three being the so-called moral emotions (Hutcherson and Gross, 2011). Given the mentioned fear of rejection and abandonment, we expected higher arousal and higher negativity to be attributed to these three emotion stimuli by iBPD compared with healthy controls.

Materials and Methods

Participants

A total of 28 inpatients, meeting the diagnosis of BPD according to the DSM-5 criteria, and 28 healthy individuals participated in this study. The sample size of this study was determined regarding an a priori power analysis, for which we used the G*Power software application (version 3.1.9.2, Heinrich-Heine-Universität Düsseldorf, Düsseldorf, Germany; Faul et al., 2007). According to the calculations, 17 samples per group were required to accomplish an ANOVA with an α of 0.05, a power (1 − β) of 0.80, and an effect size f of 0.40 based on the data provided in similar designs comparing emotion recognition in patients with BPD and healthy controls (Fenske et al., 2015; Lowyck et al., 2016; Kiliç et al., 2020). These seemed to be the only similar studies to report sufficient prior information to run power analyses. Participants from both groups were of similar age (t = − 1.77, p = 0.083, d = − 0.473).

All patients (24 females and 4 males), aged 19–57 years (M = 26.86; SD = 8.78, SE = 1.66), were referred to the study by psychiatrists from the 24/7 Department of Neurosis, Personality Disorders and Eating Disorders at the Institute of Psychiatry and Neurology in Warsaw, Poland. The higher ratio of females to males is a reflection of this specific patient population and in accordance with the DSM-5, which records a higher prevalence of women among those being diagnosed clinically with BPD. For the control group, individuals were involved from the general population in Warsaw (23 females and 5 males), aged 18–54 years (M = 30.96; SD = 8.60, SE = 1.62), through online advertisements and mailing groups. None from the control group had any current or past history of mental health conditions, nor any excessive consumption of alcohol or recreational drugs as verified through self-reports.

Procedure

Videos and static photographs of forward-facing actors (two women and two men) were presented in a semi-random sequence. Each actor displayed nine emotional faces (i.e., joy, sadness, anger, fear, disgust, surprise, embarrassment, contempt, and pride) and one neutral face in dynamic and static format from the Amsterdam Dynamic Facial Expression Set (ADFES; Van der Schalk et al., 2011). In the neutral ADFES dynamic condition, actors could be observed blinking, closing their eyes, or slightly changing the position of their heads. All stimuli were 576 pixels in height and 720 pixels in width, presented on a gray background. For our study, facial displays from four ADFES actors were selected (two males and two females), presenting each emotion once in a dynamic format and once in a static format. Both formats are accessible in a usable form directly from the ADFES dataset. All stimuli were unambiguous, and as per the wish of authors, the expressions were to be highly standardized: they were to be included in the dataset exclusively when following closely established atheoretical prototypes for each emotion display and have received very high recognition rates in healthy populations (see Van der Schalk et al., 2011).

Each participant saw and evaluated 80 stimuli in total (10 facial displays × 4 actors × 2 modalities). The experimental session was preceded by an explanatory session with two faces to be judged in order for the participants to become acquainted with the experimental procedure. Each face stimulus was preceded by a fixation dot (5 s duration) presented in the place where the face of the stimulus actor would follow (Figure 1). Each stimulus was presented for 5 s independently of whether in a photograph or video format. Each facial stimulus was followed automatically by three evaluative questions.

FIGURE 1

Figure 1. Experimental procedure.

First, participants were asked to use the pictorial Self-Assessment Manikin (SAM; Bradley and Lang, 1994) to judge whether the presented emotion is more positive or more negative (valence). Second, they were asked to use SAM to judge to what degree the presented emotion triggers a reaction in them, in other words, to report their arousal level. Finally, the emotion attributions of participants were recorded through a multiple-choice task, where participants had to choose 1 label out of 11 to name the emotion of the stimuli they observed.

All participants answered the self-report Toronto Alexithymia Scale (TAS-20). This questionnaire measures 20 items with a five-point Likert scale, with a focus on identifying feelings, describing feelings, and externally oriented thinking (Bagby et al., 1994a,b). The two groups differed in terms of total TAS scores (t = 6.902, p < 0.001, d = 1.864), with higher alexithymia in iBPD (M = 69.00, SD = 8.94, SE = 1.660) than in controls (M = 52.89, SD = 8.31, SE = 1.63), with 24 and 4, respectively, being classified as alexithymic given the following interpretation: ≤51, no alexithymia; 52–60, borderline alexithymia; and ≥61, alexithymia. Levels of anxiety were measured in both populations using the State-Trait Anxiety Inventory (STAI; Spielberger, 2010). STAI state was higher for iBPD (M = 55.66, SD = 10.955, SE = 2.034) than for controls (M = 34.52, SD = 9.323, SE = 1.865) and so was the STAI trait (M = 58.72, SD = 10.42, SE = 1.94 and M = 41.76, SD = 9.02, SE = 1.80, respectively).

Results

Label Attribution

To investigate how facial displays were perceived in terms of emotion label attributions, unbiased hit rates, confusion matrices, and factorial analyses were computed. The “unbiased hit rate” (H_u) was calculated as proposed by Wagner (1993) to account for response biases. H_u was calculated as the squared frequency of correct attributions for an emotion stimulus category divided by the product of the number of times the category was assessed and the overall frequency of this emotion label being attributed. Its value ranges from zero to one, one indicating that all stimuli of an emotion have been correctly identified and the respective emotion has never been falsely chosen for a different emotion.

A repeated-measures ANOVA on unbiased hit rates and STAI trait, STAI state, and TAS as covariates showed a participant group and emotion interaction effect, as well as an emotion effect (see Table 1 and Figure 2). There was also a group effect. No effects of the modality of stimuli were observed (Figure 3).

TABLE 1

Table 1. Repeated measures ANOVA on the number of unbiased hits.

FIGURE 2

Figure 2. Unbiased hits for 2 groups (i.e., BPD, controls) and 10 emotions (i.e., anger, contempt, disgust, embarrassment, fear, joy, neutrality, pride, sadness, surprise).

FIGURE 3

Figure 3. Unbiased hit rates observed in the interpretation of dynamic (A) and static (B) stimuli by healthy controls and in patients with BPD in terms of emotional labels. Confidence interval 95%.

FIGURE 4

Figure 4. Arousal judgments in the control and iBPD population. Confidence interval 95%.

Contempt expressions were labeled as contempt more often by iBPD (H_u = 0.34 M = 2.11; SD = 1.26) vs. controls (Hu = 0.18, M = 2.11; SD = 1.26, p < 0.05). The misattribution profiles were slightly different (see Table 2), with the attribution of a surprise to the contempt expression significantly higher in controls (p < 0.05). Thus, controls misattributed the expression mostly to surprise (25%) and to the “none of the above” emotion category (22%). iBPD attributed the “none of the above” category most often (20%) than surprise (19%).

TABLE 2

Table 2. Confusion matrix for (A) inpatients with BPD and (B) the control group.

The overattribution of surprise labels in controls went to contempt and fear: 25% of all contempt stimuli were labeled as surprise as well as 16% of all fear stimuli.

In iBPD and controls, anger stimuli were most often mislabeled as sadness (7%; 9%), disgust as anger (18%; 20%), and contempt as surprise (19%; 25%).

In iBPD and controls, the anger label was most often misattributed to disgust (18%; 20%), disgust was most often misattributed to fear (8%; 5%), while contempt to disgust (9%; 9%), pride (8%; 6%), and anger (5%; 5%).

Arousal

The repeated measures ANOVA (Table 3) showed differences between groups of participants in the arousal reports (Figure 4), with TAS, STAI trait, and STAI state as covariants. There was an emotion effect, an emotion × group interaction but no effect of modality nor any group × emotion × modality interaction.

TABLE 3

Table 3. Repeated measures ANOVA on arousal levels and mean scores per category.

Both populations reported the strongest arousal for joy (M = 4.05; SD = 1.67). In iBPD, this was followed by high arousal scores for disgust (M = 4.0; SD = 1.59), followed closely by anger (M = 3.90; SD = 1.9). In controls, arousal levels that followed those of joy were for pride (M = 3.71; SD = 1.75) and sadness (M = 3.29; SD = 1.56).

Valence

To check the differences between groups of participants in the emotional valence attribution, repeated-measures ANOVA was computed, using TAS, STAI trait, and STAI state as covariants.

There was an emotion effect (p < 0.001) as well as a modality × emotion × group interaction (p = 0.002) (see Table 4 and Figure 5). The modality × group interaction did not reach significance (p = 0.051).

TABLE 4

Table 4. Repeated measures ANOVA on valence scores and mean scores per category.

FIGURE 5

Figure 5. Valence judgments in the control and iBPD population and 10 emotions (i.e., anger, contempt, disgust, embarrassment, fear, joy, neutrality, pride, sadness, and surprise). (A) Valence: Dynamic facial display stimuli. (B) Valence: Static facial display stimuli.

Discussion

When studying BPD, researchers have focused until now on the recognition of emotions, i.e., the attribution of an expected emotional label to a specific expression, and sensitivity to threat, i.e., interpretation of facial displays of anger or sometimes fear. The aim of this study was to change the focus to moral emotions (Hutcherson and Gross, 2011). These emotions, namely, anger, contempt, and disgust, are particularly relevant to iBPD given that a strong fear of rejection is a diagnostic feature of BPD (Goodman et al., 2014). In line with former studies describing comorbidities associated with BPD, we recorded and anxiety scores in all participants as their levels are known to influence emotion interpretation and define perception biases.

As expected, we observed a more accurate interpretation of contempt in iBPD compared with controls. These results could be explained by these emotional displays being perceived by individuals as predictors of rejection and abandonment, therefore, having survival value for this population and necessitating correct interpretation. The high sensitivity to the displays of contempt may also be related to their vulnerability to harm from others as well as their generalized belief that other individuals are hostile (Beck and Freeman, 1990).

As expected, dynamic presentations improved recognition of emotions in both populations, especially for the emotion of contempt, which is a complex emotion often poorly recognized (see former uses of the ADFES database in the general population: Van der Schalk et al., 2011; Wingenbach et al., 2016).

To summarize, our results support that iBPD have good emotion recognition skills, on par with healthy individuals, except facial expressions of contempt, which are recognized more accurately by iBPD, most probably due to their survival value iBPD attributes to this social information.

Confirming former studies reporting sensitivity to threat, iBPD, compared with healthy controls, attributed more negative valence to all presented emotions, more specifically, contempt, embarrassment, fear, disgust, and surprise.

The iBPD reported higher arousal to observed stimuli than healthy individuals, which means a higher reactivity to facial expressions. The highest arousal was observed in dynamically presented emotions of anger and disgust. This is in line with numerous studies showing that iBPD tend to react more strongly to anger expressions and to judge strangers performing simple tasks such as entering a room and sitting down as more aggressive than healthy controls do (Barnow et al., 2009). This bias might be explained by the belief expressed by iBPD that all other individuals are malevolent (Pretzer, 1990; Arntz and Veen, 2001).

Greater emotional reactivity seen in BDP controls has also been observed in their brain activity during the perception of negative social signals (van Zutphen et al., 2015), particularly greater activation of the amygdala during the perception of facial expressions of anger (Donegan et al., 2003; Minzenberg et al., 2007). The high arousal induced by disgust expressions in iBPD has previously been reported (Bland et al., 2004; Guitart-Masip et al., 2009; Jovev et al., 2011), and according to Rusch et al. (2011), not only the perceived disgust but also the experience of disgust toward the self may be a prominent emotion in BPD pathology, stronger than anxiety or anger.

The general greater emotional sensitivity reflected in the high arousal levels reported by iBPD could be an expression of non-adaptive emotion regulation strategies, such as the less frequent redirection of attention from negative to more positive stimuli (Porter et al., 2016).

BPD is an important psychological disorder characterized by emotional, interpersonal, and behavioral instability (American Psychiatric Association [APA], 2013). Following the biosocial theory proposed by Linehan (1993), iBPD can exhibit difficulties with the identification and correct reaction to relevant social stimuli, particularly to the facial expressions of emotions of others. This might be one of the factors contributing to difficulties in interpersonal functioning.

Our results support previous studies suggesting a higher sensitivity to negative emotions (Lynch et al., 2006; Zanarini and Frankenburg, 2007) and are in line with reports of iBPD exhibiting higher emotional reactivity (Ebner-Priemer et al., 2007). This higher mood lability and emotional fluctuations in iBPD could explain some of the previously reported divergent results reported in different studies, e.g., neutral faces being colored by own emotional states of patients (e.g., Wagner and Linehan, 1999; Herr and Meier, 2020). In this study, we observed no higher attribution of negative valence to neutral faces, which is aligned with findings from several studies failing to find any significant differences in neutral facial expression recognition accuracy (Levine et al., 1997; Bland et al., 2004; Minzenberg et al., 2006a,b; Merkl et al., 2010; Mier et al., 2012; Hagenhoff et al., 2013).

Given how important it is to use due to their better ecological validity and the added complexity seen in a naturalistic emotional context (e.g., Dziobek, 2012; Hyniewska et al., 2019) and the fact that previous studies on emotion perception in iBPD mostly relied on static stimuli, we introduced dynamic stimuli, and their comparison with static ones, to try to elucidate discrepancies observed in iBPD and emotion labeling of facial expressions. Our study did not show any particular advantage of modality for iBPD; however, more studies are necessary to understand the process at play and whether any conditions (e.g., for low-intensity emotions) require iBPD to rely on dynamic vs. static information in facial emotion interpretation tasks. Intensity of facial expressions is a factor that will need to be integrated in future studies, especially for complex emotions such as contempt (see Wingenbach et al., 2016).

To comprehend the conflicting results regarding emotion interpretation in iBPD, the great heterogeneity of this clinical population needs to be acknowledged (Mitchell et al., 2014). Numerous factors could play a role in influencing the performance of patients, from the emotional and clinical state of the individual to comorbidities. Mitchell et al. (2014) suggested that emotional states and personal experience could be influencing emotion interpretation in iBPD. For example, following the mood-congruency hypothesis (Bower, 1981), patients with BPD who regularly experience negative states might be more skilled at processing and interpretating negative stimuli.

Given data on neglect and childhood abuse often reported in iBPD (Wagner and Linehan, 1999), which are considered factors influencing the shaping of the borderline traits, further studies on emotion interpretation would need to record these characteristics for this population and healthy counterparts. This is on par with the quantifying of the degree of BPD-related dysfunctions, along with the study of BPD traits in non-clinical populations (Trull et al., 1997).

The sensitivity to negativity and more generally emotional reactivity observed in patients with BPD is in line with Linehan’s biosocial model of emotion dysregulation. This dysregulation can be explained by an interplay of biological vulnerabilities and an early environment characterized by invalidation (Linehan, 1993). Particularly, sensitivity to injustice predisposes to emotional and cognitive biases and to intense reactions when expecting and perceiving potential rejection (Downey and Feldman, 1996) either as a victim, an observer, or a perpetrator (Schmitt et al., 2010). Furthermore, sensitivity to moral disgust predisposes to a stronger experience of disgust when confronted with moral norm violations (Tybur et al., 2009). These sensitivities could help explain cognitive and emotional biases observed in individuals with high BPD scores, who show a tendency to ascribe negative and hostile intent to observed social interactions and more generally ambiguous or explicit behavior of others (De Panfilis et al., 2015). Possibly, the development of atypical coping strategies, including emotional perception biases, might be functional attempts to deal with the fear of abandonment and emotional overstimulation, which in specific life circumstances might appear to be effective coping.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding authors.

Ethics Statement

The studies involving human participants were reviewed and approved by Department of Biological and Behavioral Psychology, Behavioral Neuroscience Lab, SWPS University of Social Sciences and Humanities, Warsaw, Poland. The patients/participants provided their written informed consent to participate in this study. The animal study was reviewed and approved by Department of Biological and Behavioral Psychology, Behavioral Neuroscience Lab, SWPS University of Social Sciences and Humanities, Warsaw, Poland.

Author Contributions

SH and KR were responsible for the conceptual definition of the research. JD obtained the data. SH, JD, and KR analyzed the data. All authors wrote the manuscript.

Funding

This study was supported by the Regional Initiative of Excellence, project number 012/RI/2018/19.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Acknowledgments

The authors thank Agnieszka Ziemska for patient referrals, Maciej Mazur for creating the computerized stimuli presentation software, and all the participants for their participation.

Supplementary Material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2021.733742/full#supplementary-material

References

Alves, N. T. (2013). Recognition of static and dynamic facial expressions: a study review. Estud. Psicol. 18, 125–130. doi: 10.1590/S1413-294X2013000100020

CrossRef Full Text | Google Scholar

Ambadar, Z., Schooler, J. W., and Cohn, J. F. (2005). Deciphering the enigmatic face: the importance of facial dynamics in interpreting subtle facial expressions. Psychol. Sci. 16, 403–410.