Skip to main content

ORIGINAL RESEARCH article

Front. Psychol., 08 August 2024
Sec. Emotion Science

The eyes as the exclamation mark of the face: exploring the relationship between eye size, intensity of female facial expressions and attractiveness in a range of emotions

  • 1Faculty of Psychology, Universitat Autònoma de Barcelona - UAB, Barcelona, Spain
  • 2Department of Psychobiology and Methodology, Universitat Autònoma de Barcelona - UAB, Barcelona, Spain

Background-objective: The eyes play an important role in communicating emotions and shape the determination of other facial attributes. Here, we explored the relationship between eye size, perceived intensity and attractiveness of facial expressions.

Methods: A sample of N = 63 participants (men and women, aged 18–35) rated attractiveness and emotional intensity for images displaying emotionally expressive women’s faces with digitally manipulated eye size (15% smaller, unchanged, or 15% larger).

Results: The analysis of perceived intensity showed an interaction parameter between eye size and gender. Female individuals reported differences when comparing unchanged and larger eyes; male participants showed differences across all eye size comparisons (smaller-unchanged, smaller-larger, unchanged-larger). Regarding perceived attractiveness, faces with smaller eyes registered lower mean scores than both unchanged and larger. The lowest intensity level was associated with neutral faces and the highest with fearful ones. Faces displaying happiness were perceived as the most attractive.

Conclusion: Larger eyes seem to make emotions more intense and attractive. We suggest that the more intense phenomenon serves an evolutive purpose, as it might encourage caretaking behavior.

1 Introduction

Ekman and Friesen (1975) stated that when wanting to assess the truthfulness of someone’s expression, the feature that should be primarily paid attention to is the eyes. Baron-Cohen et al. (2001) suggested that a person’s state of mind can be decoded by looking at the widening and narrowing of the eyes. Lee and Anderson (2017) endorsed the idea that the eyes’ area reveals emotional states without the need to observe other parts of the face; and that no other facial feature reveals as much information about emotional processing as the eyes. Current studies have also highlighted the fact that facial expressions, including the perception of eye size, can serve as salient nonverbal signals to capture individuals’ attention (Carlson and Aday, 2018; Aday et al., 2023).

Conversely, Eisenbarth and Alpers (2011) observed that, when initially looking at a face, the first gaze tends to be directed toward either the eyes or the mouth. Blais et al. (2012) advocated that the most distinct facial gestures across expressions are found in the mouth area, and that this region provides the most relevant cues to recognize facial expressions. Salience is a key factor in faces with a smile, independently of the eyes (whether or not congruent) that accompany the mouth (Fernández-Martín et al., 2013; Calvo et al., 2016). Carbon (2020) proposed that not seeing the lower half of the face (the mouth and surrounding area) impairs emotional recognition to the point of misinterpreting happy, sad, or angry expressions as neutral.

Eisenbarth and Alpers (2011) addressed the question by subdividing it into specific emotions. According to these authors, sadness and anger are mostly noticed in the eyes. Attention is mainly directed toward the mouth in happy faces; and in fearful and neutral expressions, the eyes and mouth are equally important. Paradoxically, Barrett (2018) indicated that a clear indicator of fear are widely open eyes. Ekman and Friesen (1975) argued that, although fear is initially shown in the eyebrows, its intensity is expressed by the openness of the eyes. Notably, when contradictory stimuli are shown (i.e., happy mouth and sad eyes simultaneously, or vice versa), people choose to rely on the mouth (Dunlap, 1927). Recent studies have compared emotions in faces with and without surgical masks. Langbehn et al. (2022) showed that, when the mouth is hidden, the information about the emotion on the face shrinks. Tsantani et al. (2022) supported the idea that the intensity of facial expressions is reduced in all basic emotions—joy, fear, anger, sadness, disgust, and surprise (Ekman et al., 1969; Jack et al., 2012)—except anger, when the mouth is hidden. Kim et al. (2022) observed that, when compared with the eyes, the mouth was most salient for happiness, sadness, and anger; however, in the case of fear, the eyes achieved higher relevance.

Succinctly, empirical research suggests that both eyes and mouth are important for emotional decoding; that the information drawn from the face varies depending on the emotion; and that attention is paid to one or another part of the face depending on the emotion on display. Furthermore, it has been hypothesized that it is not the components of the face, but rather the areas (i.e., the center), that attract our attention. However, the more familiar the face, the higher the chance that attention will be drawn to the eyes (Royer et al., 2016). Other components of the face also claim visual attention [e.g., eyebrows are fundamental in anger (Ekman and Friesen, 1975)]. Therefore, it is not a simple eye vs. mouth question for all emotions.

Rather than analyzing which components or facial areas provide more information, some studies have focused on how those features work together in the face (Bartlett and Searcy, 1993; Xiao et al., 2014; Matsushita et al., 2015a). It has been suggested that faces could be recognized in a holistic way (Maurer et al., 2002) (as a unit rather than as a collection of components). However, emotions could be interpreted in different ways. For example, Tanaka et al. (2012) suggested that emotion recognition should be holistic when information is contradictory (such as a smiley face with angry eyebrows), but divided into different elements when all components point in the same direction (i.e., a happy face). Contrarily, Omigbodun and Cottrell (2013) argued that facial expression processing is essentially holistic, independent of the components. Curby et al. (2012) proposed that differences in the processing type are associated with the emotion types, negative emotions being less globally processed. Regarding the rating of attractiveness, facial proportions have been suggested to play a fundamental role in the holistic assessment of beauty in women (Ulrich et al., 2019).

Studies have addressed the relationship between eye size, perceived level of attractiveness and perceived intensity of emotions (Reis et al., 1990; Oosterhof and Todorov, 2009; Schmidt et al., 2012; Golle et al., 2013; Przylipiak et al., 2018). Regarding the three possible analyses (association between eye size and attractiveness, eye size and intensity, and attractiveness and intensity), research has mainly focused on the impact of eye size on attractiveness, based on the potential evolutionary advantage of larger eyes (increased eye size has been associated with improved visual perceptiveness, a key capacity for finding food and detecting predators in animals). Berry and McArthur (1985) proposed that large eyes, high eyebrows, and narrow chins generate baby-like appearances. Glocker et al. (2009) suggested that babies’ eye size is attractive due to evolution and that cuteness motivates caretaking behavior, which increases the child’s chances of survival. Larger eyes have also been linked to attractiveness in adulthood (Berry and McArthur, 1985). Although averageness has repeatedly been linked to attractiveness (Thornhill and Gangestad, 1993; Grammer and Thornhill, 1994; Scheib et al., 1999), larger eyes might signify health, which is an influential factor when choosing a sexual mate (Thornhill and Gangestad, 1999). When other parts of the face (e.g., nose, lips) are smaller—making the eyes more dominant—attractiveness rates increase (Przylipiak et al., 2018). On the flip side, effects that make the eyes more attractive have been shown to make them seem larger (Matsushita et al., 2015b). These studies suggest that eye size also has an influence on attraction in adulthood. Noticeably, the relationship between attractiveness and eye size has been analyzed using essentially positive emotions, mostly happiness (Wagner, 1990), and it has been observed that faces characterized by positive emotions are perceived as more attractive than faces with neutral or negative expressions (Reis et al., 1990; Oosterhof and Todorov, 2009; Schmidt et al., 2012; Golle et al., 2013; Ueda et al., 2016).

The link between attractiveness and intensity has only been found to be significant when positive emotions are considered. The study by Golle et al. (2013) observed that happier faces were perceived as more attractive than faces reflecting other emotion types. Another study aiming to compare the intensity and attractiveness levels of faces with happy, sad, and neutral expressions observed that more intense happy faces were considered more attractive than less intense happy faces (Ueda et al., 2016). This work also observed that sad faces evaluated as more intense were not perceived as less attractive. This evidence suggests that positive and negative emotions do not have opposite effects on the perception of attractiveness. Other studies also obtained higher intensity levels associated with angry and happy faces, as compared with neutral faces (Garrido and Prada, 2017).

Studies have also explored the role of the participants’ gender when interpreting emotion intensity assessments of facial expressions. Hama and Koeda (2023) suggested that female participants rated happy and sad expressions as more intense than male individuals. Happiness has also been identified as more intensely perceived among women rating female images, and less intensely when men are rating male images. Gong et al. (2018) have also suggested that females perceive both positive and negative emotions as more intense than males. However, these results also seem to be associated with age and culture. The aforementioned studies were carried out in Japan and China. A study carried out with German participants (Gong et al., 2018) suggested that women perceive negative emotions more intensely and positive emotions less intensely, when compared to men. Regarding attractiveness levels, studies suggest that this measure may be similar regardless of participants’ gender (Kranz and Ishai, 2006; Levy et al., 2008).

In summary, empirical research provides inconsistent results about the role of the eyes in the recognition of emotions. A number of studies support the theory that the eyes provide cues to the emotional state of people, thus claiming the main role in the recognition of emotions in the face (Ekman and Friesen, 1975; Baron-Cohen et al., 2001; Lee and Anderson, 2017). Other findings suggest that the eyes are not always the main values of emotion, but that this role is instead claimed by the mouth (Dunlap, 1927; Blais et al., 2012; Carbon, 2020; Langbehn et al., 2022). Either way, this approach sustains that eyes could be a central element (primary or secondary, in addition to the mouth) for decoding and assessing emotional states, and that the specific role of the eye could vary depending on the emotion type (Eisenbarth and Alpers, 2011; Kim et al., 2022; Tsantani et al., 2022). An alternative theory proposes that emotions, like faces, are processed in a holistic way, rather than by separate components (Omigbodun and Cottrell, 2013). However, results in this research area are contradictory (Curby et al., 2012; Tanaka et al., 2012), suggesting that although some features of the face could be relevant in understanding specific emotions, the face as a whole could also have effects on emotional decoding.

Previous studies have also established a relationship between perceived attractiveness and intensity of emotions, as well as between attractiveness and eye size. It must be stressed that the link between intensity and eye size remains mostly unexplored, and some results seem inconsistent and related to the emotions type. Overall, eye size ratings have been shown to increase alongside attractiveness, and apace with the intensity of happiness (Ueda et al., 2016). Fewer studies have addressed negative emotions. Regarding attractiveness, negative emotions are perceived as less attractive than happy and neutral ones (Ueda et al., 2016; Garrido and Prada, 2017). Regarding intensity, Eisenbarth and Alpers (2011) argued that eyes achieve a more central role than the mouth for the assessment of angry and sad faces, which in turn might make bigger eyes distort the perception of intensity in those emotions. Moreover, fearful and neutral faces are understood equally from the eyes and the mouth, which reduces the role of the eyes in comparison to the other emotions. Paradoxically, fearful faces are characteristically recognized by widened eyes (Barrett, 2018), which suggests the relevance of the eyes when it comes to this emotion. Gender and age might also have an effect on intensity (Gong et al., 2018; Hama and Koeda, 2023). Participant’s gender and sexual preference should also be considered when interpreting attractiveness ratings (Kranz and Ishai, 2006; Levy et al., 2008).

Additionally, when human representations are artificially altered to diverge from reality, it is essential to consider the degree of these changes. The uncanny valley is the phenomenon in which artificial human representations are perceived as uncomfortable as they become more similar to reality (Mori et al., 2012). This phenomenon is commonly seen in video games, robotics, and human-like dolls (Cheetham, 2011).

To summarize, there is debate concerning to what extent emotions are perceived in the eyes. Empirical results suggest that eye size could be a key indicator of some emotions, and that this characteristic might modify the intensity of the emotional cues provided by the face as a whole. Concretely, larger eyes would make happy faces look happier, angry faces angrier, and so on. According to evolution-based theories, neutral faces with bigger eyes may also be rated as more intense than those with smaller eyes (Berry and McArthur, 1985; Glocker et al., 2009). The hypothesis that eye size intensifies facial emotional clues also supports the argument that emotions are processed holistically, and that emotional expressions are deciphered by understanding the face as a compendium of pieces that must be looked at together, as the emotions in which the eyes do not have as much of an effect (e.g., happiness) would still be affected by the face in its entirety. However, the results are uncertain and new empirical studies are needed to consolidate (or refute) this line of research.

The main goal of the present study was to examine the relationship between eye size and facial emotional expression with the perceived intensity and attractiveness ratings. In addition, the study explored the potential moderator role of gender and age within the aforementioned relationships. Based on the existing empirical studies, we hypothesized that larger eyes should be associated with higher scores in attractiveness and intensity, particularly for fear and happiness. Due to the lack of previous empirical evidence, no hypothesis was formulated regarding the potential interaction of gender and age in the relationships.

2 Materials and methods

2.1 Sample

The experiment was shared as a URL. Participants were recruited with a short text message introducing them to the study via social media (e.g., Instagram) and online chats (e.g., WhatsApp). The URL was further spread by means of snowball sampling. Participants volunteered their time. There were no economic or otherwise relevant incentives. Inclusion criteria for all participants were: to have normal or corrected to normal vision and to be between 18 and 35 years of age. No participants were removed due to gender, age, ethnicity, or occupation.

An initial sample of N = 82 individuals started the experiment. Nineteen subjects did not complete the first section with the demographics or abandoned during the training task, which led to a final sample consisting of N = 63 participants (43 were classified as Female, 17 as Male and 3 as Other) who completed the experimental task. The task was not only repetitive but also long to complete. We hypothesize it required too much time and some participants lost motivation to continue. Those two aspects might have led the 19 subjects to abandon the experiment before completing it.

Figure 1 shows the flow-chart with the sampling process (participants retained during the experimental task and dropouts). No statistically significant differences between completers and dropouts were observed for gender (p = 0.051), age (p = 0.082), employment status (p = 0.264), and ethnicity (p = 0.440).

Figure 1
www.frontiersin.org

Figure 1. Flow-chart with the sampling method.

2.2 Materials

2.2.1 Stimuli

To conduct the study, some of the previously defined basic emotions were used: anger, joy, fear, and sadness. Not all original Ekman’s facial expressions—joy, fear, anger, sadness, disgust, and surprise (Ekman et al., 1969; Jack et al., 2012)—were selected for the experimental task, as doing so would have required more time to complete it, and a longer task might have increased the number of dropouts. A neutral expression was used to set a baseline for the intensity ratings. The emotions chosen for this study were selected based on those that have received the most attention in previous scientific research. Some of the studies addressing the topics of intensity, attractiveness or eye size in relation to decoding facial expressions have used either the exact same emotions used in this study (Eisenbarth and Alpers, 2011) or a subset of them (Oosterhof and Todorov, 2009; Carlson and Aday, 2018; Aday et al., 2023).

Thirty-five pictures—seven female identities, each displaying five facial expressions: neutral, happiness, fear, sadness and anger—were selected from The racially diverse affective expression (RADIATE) face stimulus set (Conley et al., 2018). The code-files used for the experimental trials were faces AF01, AF12, BF03, BF09, WF06, and WF10; and the code-file used for the training trial was face WF15. All the images corresponded to female identities spanning a mixture of ethnicities (Asian, Black, White). There were two female faces of each ethnic group. Male identities were not included with the purpose of reducing the time needed to complete the experiment, as the inclusion of a new experimental condition (male faces) would have doubled the time needed to complete the experiment, thus increasing the chances that a larger number of participants abandoned the study, as they received no monetary or otherwise compensation for their participation. Furthermore, the consideration of this new experimental condition would have required the inclusion of a new experimental factor, and the planned sample size might not have allowed adequate statistical power. Female faces were chosen over male ones because it is more common to use male identities, rather than female, in psychological experiments; doing it differently adds representativity to the field. Faces with hair in front of the eyes in any expression were discarded, as this would have complicated the process of digitally altering the eye size within the stimuli.

Three versions of each original picture were used in the experiment. The original, unmodified image was used for the medium-sized eyes. Previous research has worked with values of 5–10% change (Glocker et al., 2009) in similar experiments. With the purpose of assessing a different degree of change than the ones already studied and published by the scientific community, the eyes were changed 15% from their original size. Each picture was modified twice. The eyes were reduced 15% for the smaller eye images and increased 15% for the larger ones (including eyelids and eyelashes, excluding eyebrows). The eyes area was enlarged or reduced as necessary, and then blended into the picture so that the change was not obvious. To edit the images Adobe Photoshop version 16.0 was used. See Figure 2 for examples of images used during the experiment with different eye sizes, as well as an example of how the eyes area was modified. The original unchanged images are part of the open-access RADIATE face stimulus set published by Conley et al. (2018).

Figure 2
www.frontiersin.org

Figure 2. Eye sizes on a scared face used during the experimental trials.

Fifteen images of one female identity (five expressions, three eye sizes) were readied to be used only during an initial training task. Ninety images of the remaining six female identities (five expressions, three eye sizes, each) were readied to be used during the experimental task. The identities used for the practice and experimental trials remained constant for all participants.

The experiment was built and conducted using Sona Systems written in PHP and JavaScript, using MySQL for the database. Demographics and experimental data were collected online with participants able to undertake the task on any computer/laptop but not tablet or smart device.

2.3 Data collection

Five fixed lists of stimuli were created for the experimental trials. Participants were randomly assigned to one of the lists when they started the experiment. The order of the images was randomized beforehand for the purpose of facilitating the technicalities of setting up the experiment. Images with the same emotion and human face were not shown twice in a row during the trials so that the difference in eye sizes was not apparent. MATLAB software and in-house code were used to create the random list of images, with the condition that images of the same identity and expression with different eye size did not follow each other. The experimental trials were broken down into three equally long blocks with self-paced short breaks in between to avoid tiredness. During the breaks an encouraging message was shown on the screen accompanied by a picture of an animal. One main reason for dropping out of experimental studies is a lack of motivation, particularly in studies with no financial compensation for participation. The message was meant to keep participants engaged in the experimental task with the purpose of reducing the number of dropouts. The message was also meant to let participants know it was the moment to take a pause should they need it. Additionally, the message indicated how far along in the experiment they had arrived (1/3 the first message and 2/3 the second message). The purpose of the picture was to make the experiment less mentally tiring.

Participants were naive to the experimental tasks and purpose. The entire experiment was carried out in approximately 20 min. Firstly, participants were shown a welcoming message that introduced them to the study. Next, they were asked to complete the demographic section, and a training task to ensure that they adequately understood how to perform the experimental task. Participants were instructed to complete both the practice and experimental tasks in a quiet space with stable internet connection, and to maximize their browser.

There were a total of 95 trials (including the five training trials). Each training trial displayed one of the five emotions (neutral, happiness, fear, sadness, anger), with one of the eye sizes. On all trials, participants evaluated each face twice, rating first the intensity of the emotion shown, and then the attractiveness of each face, on a scale from 1 to 7. During the trials the images were presented in color, placed in the center of the screen and covered approximately 40% of the screen space. A written question shown below each image informed the participant of the task: (1) How intense do you find her expression? (2) How attractive do you find her? The image remained on screen until both evaluations had been made. The order of questions was fixed. Participants responded based on a seven-point Likert scale from 1 (lowest intensity level: Not very intense/Not very attractive) to 7 (highest intensity level: Very intense/Very attractive) located below the question. Participants were only informed of the interpretation of the extremes of the scale (values 1 and 7), similar to an analog scale. Each image was preceded by a fixation cross for 500 milliseconds, and subsequent trials began immediately after the second response.

After the training task, participants moved on to the experimental task. There were six experimental trials per condition. Only female faces were selected for the experiment. The experimental task consisted of 90 trials split into three equal blocks. Breaks were self-paced and featured a message (e.g., “End of part 1 (of 3), you are doing great!”) and an accompanying encouraging picture. The procedure followed the same structure as in the training trials. Participants were shown one image at a time. There was no time limit to rate the images. Once finished, participants were debriefed and thanked for participating (Supplementary Table S1).

Participants rated the intensity and attractiveness of 90 images, that corresponded to 6 different human faces presented in 15 experimental conditions (three eye sizes × five emotions). The statistical analysis was performed for the mean value calculated for the 6 human faces in each experimental condition. That is, each participant provided 15 measures of the attractiveness level and 15 measures of the intensity level (for the combination of the three eye sizes with the five emotion types).

2.4 Statistical analysis

The statistical analysis was carried out with SPSS24 for Windows. Repeated measures analysis of variance (ANOVA) was used to assess the effect of eye size (within-subjects factor with three levels: small, unchanged, large) and emotion type (within-subjects factor with five levels: neutral, happiness, fear, sadness, anger). To assess the potential moderator effect of the participants’ gender (female, male) and age (young, middle), two between-subjects factors were also added into the model and tested, resulting in a 3 × 5 × 2 × 2 ANOVA (eye × emotion × gender × age). The dependent variables of the analyses were the perceived intensity and attractiveness of the visualized emotions.

Mauchly’s test was used to assess the sphericity condition for the ANOVA procedures, and if the assumption was not met (p < 0.05) Greenhouse–Geisser corrected tests were selected. The effect size of the parameters obtained in the ANOVA was measured through partial eta-squared coefficients (ηp2), considering values of 0.06 as poor, 0.10 as moderate–mild and 0.25 as high-large (Levine and Hullet, 2002). Because of the relatively small sample size (that could have had an impact on the statistical power), relevant effects were considered for both any statistical significance (p ≤ 0.05) or effect sizes at least in the moderate–mild range (ηp2 ≥ 0.01).

2.5 Ethical considerations

The experiment was approved by the ethics board of the Department of Psychological Sciences, Birkbeck College, University of London (approval number: 2122068, date of approval: 09/05/2022). All the participants provided informed consent by ticking a box within the website before starting the experiment. Participants did not receive economic compensation for their engagement in the research.

3 Results

3.1 Descriptive for the sample

Table 1 shows the descriptive for the sample. Most participants were female (68.3%), white-European (81.0%), and employed (44.4%). Mean age was 25.2 years (SD = 5.0). No differences between female and male participants were obtained for ethnicity (χ2 = 0.42, p = 1.00), employment status (χ2 = 2.26, p = 0.447) and chronological mean age (F = 0.99, p = 0.377).

Table 1
www.frontiersin.org

Table 1. Descriptive for the sample.

Table 2 contains the descriptive for both the intensity and the attractiveness levels in the study, among the total sample and stratified by participants’ gender and age (classification into the two age groups was based on the median [percentile 50] estimated in the sample). Supplementary Figure S1 shows line-plots with the mean scores for both intensity and attractiveness, considering the within-subjects factors (eye size and emotion type) and the between-subjects factors (gender and age).

Table 2
www.frontiersin.org

Table 2. Descriptive for intensity and attractiveness levels.

3.2 Assessment of the interaction role of participants’ gender and age

The results of the initial ANOVAs assessing the interaction parameters between emotion and eye size with participants’ gender and age are displayed in Table 3. The second order interactions (emotion × eye size × gender, and emotion × eye size × age) were excluded from the ANOVA procedures based on the results achieved by these parameters (not statistically significant [p > 0.05] and poor effect size [ηp2 < 0.10]). The participants’ age was also excluded from the ANOVA because the first order interactions (emotion × age, and eye size × age) also obtained non-statistical significance or irrelevant effect size. The between-subject factor was retained in the ANOVA that was carried out for the intensity level measure, based on the observed statistically significant interaction eye size × gender.

Table 3
www.frontiersin.org

Table 3. Assessment of the first and second order interactions with participants’ gender and age.

3.3 Association between eye size and intensity

The ANOVA performed for intensity level scores included eye size (small, unchanged, and large) and emotion type (neutral, happiness, fear, sadness, and anger) as within-subjects factors, and participants’ gender (female, and male) as between-subjects factors. The complete results of this model are displayed in Supplementary Table S2.

The multivariate tests obtained non-statistical significance and an irrelevant effect size for the interaction emotion × eye size × gender (F = 0.94, p = 0.464, ηp2 = 0.016), emotion × eye size (F = 0.66, p = 0.680, ηp2 = 0.011) and emotion × gender (F = 0.78, p = 0.493, ηp2 = 0.013). Statistically significant results were achieved for the interaction parameter eye size × gender (F = 5.42, p = 0.010, ηp2 = 0.085). Based on these results, single effects were estimated for the eye size factor (that is, pairwise comparisons between small, unchanged, and large eye sizes were obtained, separately for female and male participants), and main effects were estimated for the emotion type factor.

Figure 3A displays the graphic visualization of the interaction between eye size and participants’ gender. Among female individuals, differences were observed comparing unchanged eyes with larger eye size faces (p = 0.026). Among male participants, differences were identified across all comparisons (small versus unchanged: p = 0.026; small versus large: p < 0.001; unchanged versus large: p = 0.001). It is worth noting that the comparison between genders suggested that male (compared to female) subjects tended to report higher intensity levels for unchanged and large eye size faces.

Figure 3
www.frontiersin.org

Figure 3. Visualization of the eye size effects on the intensity and the attractiveness levels. (A) Means for the intensity levels (Y-axis) based on the eye size (X-axis), stratified by the participants’ gender. (B) Means for the intensity levels (Y-axis) based on the emotion type (X-axis). (C) Means for the attractiveness levels (Y-axis) based on the eye size (X-axis), stratified by the emotion type. (D) Means for the attractiveness levels (Y-axis) based on the emotion type (X-axis), stratified by the eye size.

Regarding the differences for intensity levels based on emotion type (Figure 3B), the lowest intensity mean score was associated with neutral faces and the highest with fearful ones. The contrasts between emotion types showed relevant differences across all pairwise comparisons (p < 0.001), except for the difference between happy and angry faces (p = 0.396).

3.4 Association between eye size and attractiveness level

The ANOVA obtained for attractiveness level included eye size (small, unchanged, and large) and emotion type (neutral, happiness, fear, sadness, and anger) as within-subjects factors. The complete results of this model are displayed in Supplementary Table S3.

Since the interaction parameter eye size × emotion reached statistically significant results (F = 4.17, p = 0.001, ηp2 = 0.063), single effects were estimated and interpreted to assess the differences based on the eye size and the emotion type. Figure 3C displays the graphic visualization of this interaction effect. Regarding the eye size factor, all the pairwise comparisons between small eye size faces and unchanged and large reached relevant differences (p < 0.05), independently of the emotion. The mean comparisons between unchanged and large eye size faces showed no differences (independently of the emotion). For the emotion type factor, the highest attractiveness level was associated with happy faces across all eye size comparisons (Figure 3D).

4 Discussion

The aim of this study was to obtain empirical evidence regarding the association between eye size and the perceived intensity and attractiveness of different emotions, in an experimental task based on the visualization of female faces. The comparison of the intensity levels showed an interaction with participants’ gender: within the male participants, differences were found across all eye size comparisons. Within the females group, differences were only found when comparing the unchanged and larger eyes. No interaction was found between gender and emotion type. The emotion perceived as the most intense was fear, and neutral faces were rated with the lowest intensity. No interaction was found when comparing age by emotion and age by eye size. Regarding the perception of attractiveness, no significant interactions were found with either age or gender. The lowest mean was associated with the smaller eyes, with no differences between the unchanged and larger eyes. The most attractive emotion was happiness.

The results of this study are based solely on the visualization of images of female faces. Therefore, they should not be considered representative of or generalizable to both men and women.

Neutral expressions were expected to be perceived as the least intense (Garrido and Prada, 2017), and fearful ones the most intense (Ekman and Friesen, 1975; Becker, 2012; Żurowska et al., 2018). Happy and angry faces were expected to be equally intense, and sadness more intense than neutral, but less than the other three (Ueda et al., 2016; Garrido and Prada, 2017). The results of this study support these findings, and outline the premise that codification of face expressions is related to eye size. Moreover, participants’ gender reached a moderator role in the relationships.

The results of our study also suggest that attractiveness ratings are not dependent on the participants’ age or gender. However, differences have been found associated with the emotion type. We hypothesized that happy expressions should be rated as more attractive than all the others, and neutral more attractive than fearful, sad and angry (Golle et al., 2013; Ueda et al., 2016; Garrido and Prada, 2017). Some of these differences have been observed. Happy faces were more attractive than all the rest. Neutral, fear, sadness and anger were not rated as different from each other except for the comparison neutral-fear with large eyes, and neutral-anger with small eyes. In regard to attractiveness and eye size, bigger eyes were expected to be perceived as more attractive than smaller eyes (Glocker et al., 2009; Przylipiak et al., 2018). In particular, it was expected for large eyes to be rated as more attractive than unchanged and small. A difference was also anticipated between unchanged and smaller eyes, as previously found by Glocker et al. (2009). A main effect of eye size on attractiveness was replicated, but the difference was not found where it was expected: participants found smaller eyes to be less attractive than unchanged and larger; but there was no difference between unchanged and larger.

Overall, the results of this study suggest that emotions are perceived more intensely when the eye size is digitally increased in women’s faces, and that these changes are gender-dependent, men being more susceptible to changes than women. Noticeably, neutral faces with smaller eyes were rated as less intense than larger and unchanged (as the rest of emotions). This phenomenon—“more intense neutrality”—may suggest that larger eyes not only intensify emotions, but also increase the perceived intensity of the face in its entirety, which supports the theory that emotions are, at least partially, holistically perceived (Omigbodun and Cottrell, 2013), as bigger eyes intensify the message projected by the rest of the face.

Glocker et al. (2009) suggested that larger eyes in babies lead to a higher perception of attractiveness, which motivates caretaking behavior, thus increasing the child’s chances of survival. The phenomenon “the bigger the eyes, the more intense the emotion” supports the theory that emotions are perceived as more intense due to evolutive mechanisms: a sad baby with bigger eyes might seem sadder, which might prompt caregivers to take care of them more urgently. Both Glocker et al. (2009)’s attractiveness-caretaking behavior theory, and the theory “the bigger the eyes, the more intense the emotion” support the idea that bigger eyes increase the chances of survival by increasing both the intensity of the emotion on display, and the attractiveness of the face. This phenomenon is also applicable to adulthood age, as bigger eyes also make adult faces gain in attractiveness (Berry and McArthur, 1985; Thornhill and Gangestad, 1999; Matsushita et al., 2015b; Przylipiak et al., 2018) and intensity, as seen in this study.

The results of the present study support the premise that eye size has an impact on attractiveness: faces with larger eyes are generally perceived as more attractive than those with smaller eyes (Glocker et al., 2009; Przylipiak et al., 2018). However, our data also indicated that bigger than normal eyes do not enhance attractiveness any more than unchanged eyes. This is a novel finding, as previous literature has repeatedly suggested that bigger eyes are perceived as more attractive, especially in happy faces (Berry and McArthur, 1985; Glocker et al., 2009; Matsushita et al., 2015b; Ueda et al., 2016; Przylipiak et al., 2018; Hine and Okubo, 2021). In any case, our results should be interpreted considering that our research tested increase and decrease changes of 15%, while other experiments have tested smaller changes in the 5% or 10% range (Przylipiak et al., 2018). The modifications used in our study might have altered the facial expression too much making the images reach the uncanny valley, resulting in faces that were perceived as uncomfortable (missing any chance of gaining in attractiveness).

5 Limitations

The results of this work should be interpreted in accordance with certain limitations. First, the asymmetrical distribution of the participants’ gender (the proportion of male individuals was lower than female individuals) should be considered for generalization purposes.

Second, the female faces visualized in the experimental task showed characteristics in addition to the face area, such as hair, and therefore differences in attributes such as hairstyles could have affected attractiveness ratings due to individual preferences. Furthermore, the variety of faces in the experimental task was relatively low, which limited the possibility of including intra-ethnical differences. However, it must be considered that the high number of experimental conditions in our study (three eye size values multiplied by five emotion types) did not allow a greater number of images, otherwise the experiment would have been too long and tiring for the participants.

In relation to the previous point, the study was carried out using images of female faces. Other replication studies including male faces are necessary for generalization purposes, mostly because females are usually perceived as more attractive and/or intense than males (Garrido and Prada, 2017). Lastly, additional research that explores a wider range of emotions (including other primary emotions such as surprise or contempt) is necessary to further understand the role of eye size in the interpretation of facial expressions.

6 Conclusion

To our knowledge, this is the first study addressing the combined impact of eye size and emotions on the perceived intensity and attractiveness of facial expressions, considering the potential role of the participants’ gender and age. The results indicate that the eyes act as intensifiers of emotions, particularly among male respondents, and that facial emotional expressions are, at least partially, holistically perceived. The results of this work also show that the attractiveness ratings were affected by eye size, with smaller eyes perceived as less attractive, independently of the emotion. This evidence could be interpreted as an evolutionary phenomenon.

Data availability statement

The datasets presented in this article are not readily available because restrictions apply to the datasets: limitations to making data publicly available include participant privacy, in accordance with the ethical consent provided by participants on the use of confidential/identifiable human data. Requests to access the datasets should be directed to AEJ, Alanis.Este@autonoma.cat.

Ethics statement

The studies involving humans were approved by Ethics board of the Department of Psychological Sciences, Birkbeck College, University of London (approval number: 2122068, date of approval: 09/05/2022). The studies were conducted in accordance with the local legislation and institutional requirements. Participants provided informed consent by ticking a box within the website before starting the experiment. Written informed consent was obtained from the individual(s) for the publication of any identifiable images or data included in this article.

Author contributions

AEJ: Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft, Writing – review & editing. RG: Formal analysis, Writing – original draft, Writing – review & editing.

Funding

The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.

Acknowledgments

The authors would like to thank Dr. Marie Smith, Ruben Zamora, and José Tomás Esté for their invaluable guidance and support throughout this research. RG was supported by The Catalan Institution for Research and Advanced Studies (ICREA Academia Program, 2021).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2024.1421707/full#supplementary-material

References

Aday, J. S., Fang, L., and Carlson, J. M. (2023). Eye-size effects in the dot-probe task: greater sclera exposure predicts delayed disengagement from fearful faces. PLoS One 18:e0285839. doi: 10.1371/journal.pone.0285839

PubMed Abstract | Crossref Full Text | Google Scholar

Baron-Cohen, S., Wheelwright, S., Hill, J., Raste, Y., and Plumb, I. (2001). The “Reading the mind in the eyes” test revised version: a study with Normal adults, and adults with Asperger syndrome or high-functioning autism. J. Child Psychol. Psychiatry 42, 241–251. doi: 10.1111/1469-7610.00715

Crossref Full Text | Google Scholar

Barrett, L. F. (2018). Seeing fear: It’s all in the eyes? Trends Neurosci. 41, 559–563. doi: 10.1016/j.tins.2018.06.009

PubMed Abstract | Crossref Full Text | Google Scholar

Bartlett, J. C., and Searcy, J. (1993). Inversion and configuration of faces. Cogn. Psychol. 25, 281–316. doi: 10.1006/cogp.1993.1007

Crossref Full Text | Google Scholar

Becker, M. W. (2012). Negative emotional photographs are identified more slowly than positive photographs. Atten. Percept. Psychophys. 74, 1241–1251. doi: 10.3758/s13414-012-0308-x

Crossref Full Text | Google Scholar

Berry, D. S., and McArthur, L. Z. (1985). Some components and consequences of a babyface. J. Pers. Soc. Psychol. 48, 312–323. doi: 10.1037/0022-3514.48.2.312

Crossref Full Text | Google Scholar

Blais, C., Roy, C., Fiset, D., Arguin, M., and Gosselin, F. (2012). The eyes are not the window to basic emotions. Neuropsychologia 50, 2830–2838. doi: 10.1016/j.neuropsychologia.2012.08.010

Crossref Full Text | Google Scholar

Calvo, M. G., Gutiérrez-García, A., and Del Líbano, M. (2016). What makes a smiling face look happy? Visual saliency, distinctiveness, and affect. Psychol. Res. 82, 296–309. doi: 10.1007/s00426-016-0829-3

Crossref Full Text | Google Scholar

Carbon, C.-C. (2020). Wearing face masks strongly confuses counterparts in reading emotions. Front. Psychol. 11:566886. doi: 10.3389/fpsyg.2020.566886

PubMed Abstract | Crossref Full Text | Google Scholar

Carlson, J. M., and Aday, J. (2018). In the presence of conflicting gaze cues, fearful expression and eye-size guide attention. Cognit. Emot. 32, 1178–1188. doi: 10.1080/02699931.2017.1391065

PubMed Abstract | Crossref Full Text | Google Scholar

Cheetham, M. (2011). The human likeness dimension of the “uncanny valley hypothesis”: behavioral and functional MRI findings. Front. Hum. Neurosci. 5:126. doi: 10.3389/fnhum.2011.00126

PubMed Abstract | Crossref Full Text | Google Scholar

Conley, M. I., Dellarco, D. V., Rubien-Thomas, E., Cohen, A. O., Cervera, A., Tottenham, N., et al. (2018). The racially diverse affective expression (RADIATE) face stimulus set. Psychiatry Res. 270, 1059–1067. doi: 10.1016/j.psychres.2018.04.066

PubMed Abstract | Crossref Full Text | Google Scholar

Curby, K. M., Johnson, K. J., and Tyson, A. (2012). Face to face with emotion: holistic face processing is modulated by emotional state. Cognit. Emot. 26, 93–102. doi: 10.1080/02699931.2011.555752

Crossref Full Text | Google Scholar

Dunlap, K. (1927). The role of eye-muscles and mouth-muscles in the expression of the emotions. Genet. Psychol. Monogr. 2, 196–233.

Google Scholar

Eisenbarth, H., and Alpers, G. W. (2011). Happy mouth and sad eyes: scanning emotional facial expressions. Emotion 11, 860–865. doi: 10.1037/a0022758

PubMed Abstract | Crossref Full Text | Google Scholar

Ekman, P., and Friesen, W. V. (1975). Unmasking the face. A guide to recognizing emotions from facial clues. Hoboken, New Jersey, United States: Prentice-Hall, Cop.

Google Scholar

Ekman, P., Sorenson, E. R., and Friesen, W. V. (1969). Pan-cultural elements in facial displays of emotion. Science 164, 86–88. doi: 10.1126/science.164.3875.86

PubMed Abstract | Crossref Full Text | Google Scholar

Fernández-Martín, A., Gutiérrez-García, A., and Calvo, M. G. (2013). A smile radiates outwards and biases the eye expression. Span. J. Psychol. 16:E53. doi: 10.1017/sjp.2013.68

Crossref Full Text | Google Scholar

Garrido, M. V., and Prada, M. (2017). KDEF-PT: valence, emotional intensity, familiarity and attractiveness ratings of angry, neutral, and happy faces. Front. Psychol. 8:2181. doi: 10.3389/fpsyg.2017.02181

PubMed Abstract | Crossref Full Text | Google Scholar

Glocker, M. L., Langleben, D. D., Ruparel, K., Loughead, J. W., Valdez, J. N., Griffin, M. D., et al. (2009). Baby schema modulates the brain reward system in nulliparous women. Proc. Natl. Acad. Sci. 106, 9115–9119. doi: 10.1073/pnas.0811620106

PubMed Abstract | Crossref Full Text | Google Scholar

Golle, J., Mast, F. W., and Lobmaier, J. S. (2013). Something to smile about: the interrelationship between attractiveness and emotional expression. Cognit. Emot. 28, 298–310. doi: 10.1080/02699931.2013.817383

PubMed Abstract | Crossref Full Text | Google Scholar

Gong, X., Wong, N., and Wang, D. (2018). Are gender differences in emotion culturally universal? Comparison of emotional intensity between Chinese and German samples. J. Cross-Cult. Psychol. 49, 993–1005. doi: 10.1177/0022022118768434

Crossref Full Text | Google Scholar

Grammer, K., and Thornhill, R. (1994). Human (Homo sapiens) facial attractiveness and sexual selection: the role of symmetry and averageness. J. Comp. Psychol. 108, 233–242. doi: 10.1037/0735-7036.108.3.233

PubMed Abstract | Crossref Full Text | Google Scholar

Hama, T., and Koeda, M. (2023). Characteristics of healthy Japanese young adults with respect to recognition of facial expressions: a preliminary study. BMC Psychol. 11:237. doi: 10.1186/s40359-023-01281-5

PubMed Abstract | Crossref Full Text | Google Scholar

Hine, K., and Okubo, H. (2021). Overestimation of eye size: people see themselves with bigger eyes in a holistic approach. Acta Psychol. 220:103419. doi: 10.1016/j.actpsy.2021.103419

Crossref Full Text | Google Scholar

Jack, R. E., Garrod, O. G. B., Yu, H., Caldara, R., and Schyns, P. G. (2012). Facial expressions of emotion are not culturally universal. Proc. Natl. Acad. Sci. 109, 7241–7244. doi: 10.1073/pnas.1200155109

PubMed Abstract | Crossref Full Text | Google Scholar

Kim, G., Seong, S. H., Hong, S.-S., and Choi, E. (2022). Impact of face masks and sunglasses on emotion recognition in south Koreans. PLoS One 17:e0263466. doi: 10.1371/journal.pone.0263466

PubMed Abstract | Crossref Full Text | Google Scholar

Kranz, F., and Ishai, A. (2006). Face perception is modulated by sexual preference. Curr. Biol. 16, 63–68. doi: 10.1016/j.cub.2005.10.070

Crossref Full Text | Google Scholar

Langbehn, A. T., Yermol, D. A., Zhao, F., Thorstenson, C. A., and Niedenthal, P. M. (2022). Wearing N95, surgical, and cloth face masks compromises the perception of emotion. Affect. Sci. 3, 105–117. doi: 10.1007/s42761-021-00097-z

PubMed Abstract | Crossref Full Text | Google Scholar

Lee, D. H., and Anderson, A. K. (2017). Reading what the mind thinks from how the eye sees. Psychol. Sci. 28, 494–503. doi: 10.1177/0956797616687364

Crossref Full Text | Google Scholar

Levine, T. R., and Hullet, C. R. (2002). Eta squared, partial eta squared, and misreporting of effect size in communication research. Hum. Commun. Res. 28, 612–625. doi: 10.1111/j.1468-2958.2002.tb00828.x

Crossref Full Text | Google Scholar

Levy, B., Ariely, D., Mazar, N., Chi, W., Lukas, S., and Elman, I. (2008). Gender differences in the motivational processing of facial beauty. Learn. Motiv. 39, 136–145. doi: 10.1016/j.lmot.2007.09.002

PubMed Abstract | Crossref Full Text | Google Scholar

Matsushita, S., Morikawa, K., Mitsuzane, S., and Yamanami, H. (2015a). Eye shape illusions induced by eyebrow positions. Perception 44, 529–540. doi: 10.1068/p7823

Crossref Full Text | Google Scholar

Matsushita, S., Morikawa, K., and Yamanami, H. (2015b). Measurement of eye size illusion caused by eyeliner, mascara, and eye shadow. J. Cosmet. Sci. 66, 161–174.

PubMed Abstract | Google Scholar

Maurer, D., Grand, R. L., and Mondloch, C. J. (2002). The many faces of configural processing. Trends Cogn. Sci. 6, 255–260. doi: 10.1016/s1364-6613(02)01903-4

PubMed Abstract | Crossref Full Text | Google Scholar

Mori, M., MacDorman, K., and Kageki, N. (2012). The Uncanny Valley [from the field]. IEEE Robot. Automat. Mag. 19, 98–100. doi: 10.1109/mra.2012.2192811

Crossref Full Text | Google Scholar

Omigbodun, A., and Cottrell, G. (2013). Evidence for holistic facial expression processing with a Neurocomputational model. J. Vis. 13:99. doi: 10.1167/13.9.99

Crossref Full Text | Google Scholar

Oosterhof, N. N., and Todorov, A. (2009). Shared perceptual basis of emotional expressions and trustworthiness impressions from faces. Emotion 9, 128–133. doi: 10.1037/a0014520

PubMed Abstract | Crossref Full Text | Google Scholar

Przylipiak, M., Przylipiak, J., Terlikowski, R., Lubowicka, E., Chrostek, L., and Przylipiak, A. (2018). Impact of face proportions on face attractiveness. J. Cosmet. Dermatol. 17, 954–959. doi: 10.1111/jocd.12783

PubMed Abstract | Crossref Full Text | Google Scholar

Reis, H. T., Wilson, I. M., Monestere, C., Bernstein, S., Clark, K., Seidl, E., et al. (1990). What is smiling is beautiful and good. Eur. J. Soc. Psychol. 20, 259–267. doi: 10.1002/ejsp.2420200307

Crossref Full Text | Google Scholar

Royer, J., Blais, C., Barnabé-Lortie, V., Carré, M., Leclerc, J., and Fiset, D. (2016). Efficient visual information for unfamiliar face matching despite viewpoint variations: It’s not in the eyes! [review of efficient visual information for unfamiliar face matching despite viewpoint variations: It’s not in the eyes!]. Vis. Res. 123, 33–40. doi: 10.1016/j.visres.2016.04.004

PubMed Abstract | Crossref Full Text | Google Scholar

Scheib, J. E., Gangestad, S. W., and Thornhill, R. (1999). Facial attractiveness, symmetry and cues of good genes. Proc. R. Soc. Lond. Ser. B Biol. Sci. 266, 1913–1917. doi: 10.1098/rspb.1999.0866

PubMed Abstract | Crossref Full Text | Google Scholar

Schmidt, K., Levenstein, R., and Ambadar, Z. (2012). Intensity of smiling and attractiveness as facial signals of trustworthiness in women. Percept. Mot. Skills 114, 964–978. doi: 10.2466/07.09.21.pms.114.3.964-978

PubMed Abstract | Crossref Full Text | Google Scholar

Tanaka, J. W., Kaiser, M. D., Butler, S., and Le Grand, R. (2012). Mixed emotions: holistic and analytic perception of facial expressions. Cognit. Emot. 26, 961–977. doi: 10.1080/02699931.2011.630933

PubMed Abstract | Crossref Full Text | Google Scholar

Thornhill, R., and Gangestad, S. W. (1993). Human facial beauty. Hum. Nat. 4, 237–269. doi: 10.1007/bf02692201

Crossref Full Text | Google Scholar

Thornhill, R., and Gangestad, S. W. (1999). Facial attractiveness. Trends Cogn. Sci. 3, 452–460. doi: 10.1016/s1364-6613(99)01403-5

Crossref Full Text | Google Scholar

Tsantani, M., Podgajecka, V., Gray, K. L. H., and Cook, R. (2022). How does the presence of a surgical face mask impair the perceived intensity of facial emotions? PLoS One 17:e0262344. doi: 10.1371/journal.pone.0262344

PubMed Abstract | Crossref Full Text | Google Scholar

Ueda, R., Kuraguchi, K., and Ashida, H. (2016). Asymmetric effect of expression intensity on evaluations of facial attractiveness. SAGE Open 6:215824401667756. doi: 10.1177/2158244016677569

Crossref Full Text | Google Scholar

Ulrich, L., Dugelay, J.-L., Vezzetti, E., Moos, S., and Marcolin, F. (2019). Perspective morphometric criteria for facial beauty and proportion assessment. Appl. Sci. 10:8. doi: 10.3390/app10010008

Crossref Full Text | Google Scholar

Wagner, H. L. (1990). The spontaneous facial expression of differential positive and negative emotions. Motiv. Emot. 14, 27–43. doi: 10.1007/bf00995547

Crossref Full Text | Google Scholar

Xiao, W. S., Fu, G., Quinn, P. C., Sun, Y.-H., Xiao, N. G., Wang, Q., et al. (2014). The eye-size illusion: psychophysical characteristics, generality, and relation to holistic face processing. Perception 43, 265–274. doi: 10.1068/p7647

PubMed Abstract | Crossref Full Text | Google Scholar

Żurowska, N., Kałwa, A., Rymarczyk, K., and Habrat, B. (2018). Recognition of emotional facial expressions in benzodiazepine dependence and detoxification. Cogn. Neuropsychiatry 23, 74–87. doi: 10.1080/13546805.2018.1426448

Crossref Full Text | Google Scholar

Keywords: emotion intensity, emotion perception, facial expression, eye size, avatar generation

Citation: Esté Jaloveckas A and Granero R (2024) The eyes as the exclamation mark of the face: exploring the relationship between eye size, intensity of female facial expressions and attractiveness in a range of emotions. Front. Psychol. 15:1421707. doi: 10.3389/fpsyg.2024.1421707

Received: 22 April 2024; Accepted: 24 July 2024;
Published: 08 August 2024.

Edited by:

Federica Marcolin, Polytechnic University of Turin, Italy

Reviewed by:

Elena Carlotta Olivetti, Polytechnic University of Turin, Italy
Luca Ulrich, Polytechnic University of Turin, Italy
Jefferson Ortega, University of California, Berkeley, United States

Copyright © 2024 Esté Jaloveckas and Granero. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Roser Granero, roser.granero@uab.cat

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.