Survey of Heteronormative Attitudes and Tolerance Toward Gender Non-conformity in Mountain West Undergraduate Students

Introduction: Heteronormative attitudes are prevalent in the United States and may contribute to discrimination against individuals who do not conform to traditional gender roles. Understanding the attitudes of undergraduate students is of particular interest as they may represent emergent societal views toward gender non-conformity.

Materials and Methods: We conducted an online survey of Mountain West college students between the ages of 18–24 years to assess perceptions of personal gender conformity using the Traditional Masculinity-Femininity Scale (TMF), endorsement of heteronormative beliefs using the Heteronormative Attitudes and Beliefs Scale (HABS), and explicit tolerance of gender non-conformity on a seven-point Likert Scale.

Results: The sample (n = 502) was 84% female and 78% white. Approximately 21% of respondents identified as a sexual minority and 36% identified as liberal or somewhat liberal (27% were conservative). The mean score on the TMF was 5.23 (95% CI: 5.15–5.32), indicating moderate levels of personal gender conformity. The mean HABS score was 3.31 (95% CI: 3.19–3.43), indicating relatively low endorsement of heteronormative attitudes. TMF and HABS scores were both highest in heterosexual males. Most respondents (73%) were taught traditional gender roles in their childhood home, and 89% had heard negative opinions about non-conformity. The majority (80.6%) of respondents reported that they know someone who displays non-conforming characteristics and 61% said that they associate gender non-conformity with homosexuality. Approximately, 7% reported they had bullied others for not conforming to their gender. Among heterosexuals, 13.6% reported they had been bullied for gender non-conformity as did 42.7% of LGBTQ-identified individuals. Nearly 1-in-4 (23.6%) believed that male cross-dressing is wrong. Nearly 1-in-5 (17.2%) agreed with the statement that those who dress or act like the opposite sex were more likely to be abused or neglected during their development.

Conclusion: Students reported relatively low endorsement of heteronormative attitudes and moderate levels of acceptance toward gender non-conforming persons. The sample may reflect shifting attitudes when compared with outside data sets.

Introduction

Social role theory posits that male and female genders have different roles resulting from biological, ecological, and social differences (Eagly, 1987; Ellemers, 2018; Huang et al., 2018). These specialized roles have shaped our societal conception of masculinity and femininity over time. Behaviors that match stereotypical traits and roles of one’s biological sex are gender conforming and tend to be reinforced, while behaviors that do not match the traits and roles stereotypically assigned to one’s biological sex are gender non-conforming and often discouraged (Thomas and Blakemore, 2013; Spivey et al., 2018). Gender non-conformity is “the extent to which individuals fail to conform to gender-based societal proscriptions concerning appearance, feelings, or behaviors” (Martin-Storey and August, 2016). This includes gender incongruent behavior related to interests, occupation, and traditional gender characteristics within marital relationships or domestic partnerships (Cook et al., 2013).

Negative attitudes toward gender non-conformity are pervasive in American culture (Friedman and Downey, 1999; Skidmore et al., 2006; Schwartz et al., 2016), and contribute to much of the violence and discrimination commonly experienced among sexual minorities (Balsam et al., 2005; Skidmore et al., 2006; Rosa et al., 2018) and those who do not conform to traditional gender norms (Fasoli et al., 2017). This may be due in part to the widespread acceptance of heteronormative attitudes in the United States (Herek, 2009; Baams et al., 2015).

Heteronormativity is narrowly defined as preferential attitudes toward heterosexual relationships. However, heteronormative attitudes are strongly rooted in the idea that males and females have distinct characteristics and roles which are accompanied by fixed behavioral expectations for males and females. The endorsement of heteronormative attitudes may be associated with negative attitudes toward gender non-conformity (Habarth, 2015). The possibility of a correlation is worthy of consideration as gender non-conforming individuals may experience physical and social harm as a result of this bias.

Evidence suggests that heteronormative bias and heterosexism are disseminated through cultural institutions, leading to prevalent bias against sexual minorities (Skidmore et al., 2006; Math and Seshadri, 2013). Early attitudes about gender roles and expectations of conformity are shaped to some extent by parents’ modeled behavior (Halpern and Perry-Jenkins, 2016). It has been posited that negative attitudes may stem from the perception of gender non-conforming behavior as a threat to society’s traditional sex role structure (Whitley, 1987; Rosa et al., 2018), suggesting higher personal gender conformity likely correlates with a negative view of non-conformity. If underlying heteronormative ideologies may be associated with harmful reactionary behavior, this association should be carefully studied and reported.

There is abundant empirical evidence demonstrating that the violation of gender roles is strongly associated with negative reactions from others. Individuals who violate gender roles often face prejudice and discrimination in social and employment situations (Friedman and Downey, 1999; Li et al., 2016). These reactions can be more pronounced toward males exhibiting gender non-conformity as stereotypes of male traits and roles are relatively less flexible than female stereotypes (Diekman et al., 2004). However, in some cases atypical men may be defaulted the “benefit of the doubt” as their status in patriarchal society is higher (Moss-Racusin et al., 2010). Anyone not conforming to gender roles can become the target of discrimination regardless of sexual orientation.

Living as a gender non-conforming individual has been associated with a higher risk of enduring social stressors including stigmatization and poorer health-related quality of life outcomes (Gordon et al., 2017). In a recent study conducted in Massachusetts, 65% of gender non-conforming individuals reported public accommodations discrimination in the past 12 months, especially in transportation, retail, and healthcare (Reisner et al., 2015). Internalized negative attitudes toward gender non-conformity among LGBT individuals who exhibit atypical sex role characteristics are associated with psychological distress, feelings of inadequacy, and mental health problems (Bailey et al., 1997; Skidmore et al., 2006; Schwartz et al., 2016; Hart et al., 2018). In turn, perceived discrimination positively correlates with greater psychiatric morbidity risk including suicidal ideations (Mays and Cochran, 2001; Sutter and Perrin, 2016), an association well-documented in populations when gender non-conformity increases an individual’s visibility as a target for discrimination and social ostracization (Skidmore et al., 2006; Martin-Storey and August, 2016).

Additionally, heteronormative attitudes can negatively affect individuals who are traditionally gender conforming. Gendered norms reflect differences in the value placed on girls versus boys, and this disparity leads to lower self-esteem in individuals who dress and behave according to feminine norms (Sen and Ostlin, 2007; Bhattacharya and Shukla, 2014). Men who experience conflict over violating the male gender role by expressing emotion or displaying affection toward other men are less likely to seek professional psychological help for mental illness and tend to have more negative attitudes toward help-seeking in general (Good et al., 1989; Davis and Liang, 2015). Men have also been found to encounter backlash when engaging in female-dominated communal roles (Croft et al., 2015). While these examples are not comprehensive and there are positive aspects of adhering to traditional norms, it is clear that heteronormative reinforcement of gender roles affects everyone.

College students constitute an important population for researching gender norms as they fall in a life stage characterized by the rapid development of personal values and identity (Potts, 2017). They also represent a more diverse group of students than the subset that pursues graduate education. Surveying an undergraduate population is particularly important for this study as discrimination against LGBT students, many of whom are not gender conforming, commonly occurs on college campuses (Seelman et al., 2017). There is currently no published literature characterizing attitudes toward gender non-conformity or describing its associated correlates within a population of young adults.

A survey of undergraduate students may represent emergent attitudes of an influential new population, and responses may indicate the future direction of general tolerance toward gender non-conformity and an expected trajectory of gender roles in American society. This knowledge will be critical to understanding and navigating societal expectations related to gender. Designing and implementing interventional measures to combat discriminatory attitudes must begin with an in-depth understanding of tolerance within a population and the key factors that contribute to its development.

The purpose of this study was to examine attitudes toward gender non-conformity in conjunction with heteronormative beliefs and the respondent’s own degree of gender conformity in a population of undergraduate students throughout the Mountain West. Data were collected with the purpose of elucidating how attitudes toward gender norms may correlate with intolerant and potentially discriminatory views and behaviors. This knowledge could foster tolerance and sensitivity toward gender non-conforming individuals and associated minority groups. Additionally, the collected data describe the relationship between heterosexism, gender conformity, and tolerance using validated survey instruments which previously have not been correlated. These associations provide valuable new insight into the complex determinants that drive production and propagation of gender reinforcement.

Hypotheses

We hypothesized that there would be a positive association between endorsement of heteronormative attitudes and personal gender conformity and that both heteronormative attitudes and gender conformity would differ by characteristics including biological sex and sexual orientation. We further hypothesized that heteronormative attitudes and personal gender conformity would correlate with tolerance toward gender non-conforming individuals.

Materials and Methods

A cross-sectional internet panel survey of 502 United States college aged adults in the Mountain West was conducted in 2017. Participants were recruited through Qualtrics (Provo, UT, United States), a worldwide software company specializing in market research. Qualtrics operates an actively managed, global proprietary panel of registered members and recruits through social media, web publishers and global partners. Because the study was implemented online without recruiters or interviewers, no personnel training was necessary.

Panelists who met initial screening criteria (age and state of residence) received an email invitation with a link to the survey, as well as information regarding the approximate length of the survey and quantity of reward points (a value of US$ <2.00) that would be credited to their account upon completion. The survey link brought potential participants to an informed consent page. After consenting to participate, respondents were screened using two additional questions to ensure they met all eligibility criteria (18–24 years of age and college enrollment). The study was approved by the [Brigham Young University] Institutional Review Board.

Measurement

The survey consisted of 56 items and was comprised of 10 demographic questions, The Heteronormative Attitudes and Beliefs Survey (HABS), The Traditional Masculinity-Femininity Scale (TMF), and 24 additional questions assessing explicit tolerance. Details on these measures follow.

Demographics

Nine demographic questions, taken from the 2014 General Social Survey (Smith et al., 2015) were included. Racial categories were slightly modified to satisfy IRB requirements and improve clarity. Respondents reported age in years, race, biological sex, marital status, sexual orientation (heterosexual or sexual minority), level of education, perceived social class, political affiliation, religious affiliation, and religiosity.

Heteronormative Attitudes and Beliefs Scale (HABS)

The 16-item HABS was used to measure endorsement of heteronormative attitudes (Habarth, 2015). Respondent’s indicated agreement on a seven-point Likert scale for each item. To calculate overall HABS scores, negatively worded items (#1, 4, 9, 11, 12, 15, 16) were reverse coded and all items were averaged to create a score ranging from 1 to 7, with higher values indicating greater endorsement of heteronormative beliefs. The HABS can be divided into two subscales: the Essential Sex and Gender subscale (Items: #3, 5, 6, 7, 9, 11, 12, 15) which addresses beliefs about gender, and the Normative Behavior subscale (items: #1, 2, 4, 8, 10, 13, 14, 16) which addresses sex role expectations within romantic relationships. Subscale scores were created by averaging relevant items.

Traditional Masculinity-Femininity Scale (TMF)

The TMF measured respondents’ personal gender conformity (Kachel et al., 2016). The scale is comprised of six statements related to self-perception, interests, appearance, attitudes, and beliefs regarding which participants rank themselves from “Totally Masculine” to “Totally Feminine” on a seven-point scale. The score on these six items is averaged to create an overall value for TMF. Scoring of the TMF is dependent on the respondent’s self-reported biological sex such that male respondents’ higher scores on the TMF correspond to higher self-perceived masculinity and female respondents’ higher scores on the TMF correspond to higher self-perceived femininity.

Explicit Tolerance

Explicit tolerance toward individuals with atypical sex role characteristics was assessed using a total of 24 questions primarily developed by the authors. Respondents were asked to indicate agreement with the following 13 statements (on a seven-point Likert scale): “My males friends are masculine,” “Men who are not masculine are good role models,” “I think less of men who have feminine mannerisms,” “Men should not act like women in the workplace,” “I prefer men to be feminine rather than masculine,” “My female friends are feminine,” “Women who are not feminine are good role models,” “I think less of women who have masculine mannerisms,” “Women should not act like men in the workplace,” “I prefer women to be masculine rather than feminine,” “My friends are accepting of people who do not conform to traditional gender roles,” “I feel restricted by the gender label that people attach to me,” and “I feel restricted by the expectations people have of me because of my gender.” The final two questions in this list were from the 7-factor measure of sexual prejudice developed by Dr. Sean G. Massey, each about a tendency to resist heteronormative expectations (Massey, 2009).

The remaining eleven items simply asked respondents to indicate whether they agreed or disagreed with each statement. Possible factors that may influence the development of certain gendered attitudes were addressed (i.e., upbringing, associations). Participants were asked to report how tolerant they perceive their friends and peers to be, as well as whether or not they have witnessed discrimination toward gender non-conforming individuals. Four of these questions were from the open-source 2015 South African Social Attitudes Survey to assess self-reported personal conformity, level of tolerance, and past involvement with bullying related to non-conformity (Roberts et al., 2016). These questions were slightly modified to better fit our target demographic, and several were split into multiple questions for clarity.

Statistical Analysis

Frequencies and proportions were calculated to summarize categorical variables and means and 95% confidence intervals were used for continuous variables. Bivariate associations by sex and sexual orientation were evaluated using a chi-square test for categorical variables and a t-test for difference in means for continuous variables.

Results

A total of 511 people began the survey and 502 completed it. Table 1 shows the demographic characteristics of respondents. The majority of participants were female (83.9%), heterosexual (78.9%) and white, non-hispanic (77.7%). We examined the distribution of demographic characteristics by biological sex and sexual orientation. In general, males and females were not different with respect to demographic variables. One notable exception is that a higher percentage of female respondents (23.3% vs. 8.6%) identified as being “gay, lesbian, or bisexual.” Similarly, the distribution of demographic characteristics by sexual orientation shows that respondents who identified as gay, lesbian, or bisexual reported a higher percentage of liberal or slightly liberal political affiliation (66.7% vs. 27.7%) when compared with heterosexual respondents.

TABLE 1

Table 1. Demographic characteristics of a sample of (n = 502) college-aged students in the Mountain-West.

The average TMF score for all respondents was 5.23 (95% CI: 5.14–5.31) and the average HABS score was 3.42 (95% CI: 3.35–3.59). Table 2 gives the TMF and HABS scores for the total population and separated by sex and sexual orientation. For both the TMF and the HABS scales, heterosexuals averaged higher scores than did females and those identifying with a sexual minority.

TABLE 2

Table 2. Mean scores on the Traditional Masculinity and Femininity Scale and Heteronormative Attitudes and Beliefs for the total population and by biological sex and sexual orientation.

Table 3 presents data on agreement with six statements consistent with heteronormative attitudes and beliefs and seven statement inconsistent with heteronormative attitudes and beliefs. The majority of persons in the sample agreed with the statements “My male friends are masculine (72.1%)” and “my female friends are feminine (81.1%).” Few respondents agreed with the statements, “I think less of men who have feminine mannerisms (14.0%)” and “I think less of women who have masculine mannerisms (7.8%).” Consistent with other results, a smaller percentage of females and those identifying with a sexual minority agreed with statement representing heteronormative attitudes or beliefs. Conversely, most (77.1%) respondents agreed with the statement, “My friends are accepting of people who do not conform to traditional gender roles.” A larger percentage of females and those identifying with a sexual minority agreed with this and other statements inconsistent with heteronormative attitudes and beliefs.

TABLE 3

Table 3. Agreement with statements that are consistent and inconsistent with heteronormative attitudes and beliefs in the total sample and by biological sex and sexual orientation in a sample of college students in the Mountain-West.

Tables 4, 5 present information on 11 questions assessing explicit tolerance. Table 4 provides the percentage of respondents who agreed with each statement. Statements receiving the highest percentage endorsement include, “I have heard negative opinions about people who dress or act like the opposite sex” which was endorsed by 89.4% of the sample and “I personally know someone who does not conform to their gender” (80.6%). A majority (60.7%) of respondents indicated that they associate dressing or acting like the opposite sex with homosexuality. Nearly 1-in-5 (17.2%) agreed with the statement that those who dress or act like the opposite sex were more likely to be abused or neglected during their development. The HABS and TMF scores varied across tolerance statements as would be expected. Higher HABS scores (stronger endorsement of heteronormative attitudes and beliefs) and TMF (stronger endorsement of personal gender conformity) were associated with agreement with statements that expressed less tolerance.

TABLE 4

Table 4. Agreement with statements assessing explicit tolerance in the total sample and by biological sex and sexual orientation in a sample of college students in the Mountain-West^a.

TABLE 5

Table 5. Average Heteronormative Attitudes and Beliefs Scale score (HABS) and Traditional Masculinity and Femininity Scale score (TMF) for those who agreed and disagreed with each statement assessing explicit tolerance.

Discussion

General Observations

Based upon averaged responses to the HABS, TMF, and explicit tolerance questions, students in the sample reported moderate tolerance toward gender non-conformity, moderately high personal conformity, and relatively low endorsement of heteronormative attitudes. Correlations show support for the authors’ hypotheses, indicating there is a relationship between all three variables: gendered self-expression, acceptance of traditional attitudes, and tolerance toward gender non-conformity.

The strength of the correlation between HABS, TMF, and tolerance scores was offset by respondents who did not fall into the two principal clusters: conforming, conventional thinkers with lower tolerance and non-conforming, unconventional thinkers with higher tolerance. Some of these confounding students were both highly tolerant of non-conformity and simultaneously highly conforming themselves. A few were intolerant of their own lower personal conformity, and they perhaps experience some measure of cognitive dissonance or internalized feelings of negativity (Hart et al., 2018). It appears that individual attitudes about conformity and gender are interrelated but do not always align perfectly with the hypothesized model.

Comparing Populations

Our sample was largely female and white, non-hispanic. It is unclear whether females were more likely to be invited to participate in the survey or more likely to respond to an invitation. Regardless, our sample population differs in important ways from the demographic characteristics of the general population of college students in the United States. Specifically, related to biological sex and sexual orientation. Our sample contained a larger proportion of LGBTQ-identified respondents than the national average: 21% compared to 7.9% of individuals aged 18–29 as provided by the 2014 GSS or the Gallup poll’s estimated 8.1% among millennials (Newport, 2018). Both females and those who identify with a sexual minority are likely to feel that a survey about gender issues is more applicable to them, increasing response rates in these populations. Additionally, our results suggest that females and those identifying as lesbian, gay, or bisexual have lower endorsement of heteronormative attitudes. As such, our data likely do not represent the population of United States college students generally.

In the full sample, the mean score on the HABS was 3.42; 3.16 on the normative behavior subscale and 3.96 on the essential sex and gender subscale. A small (n = 84) 2015 study of undergraduate psychology students used to validate the HABS, identified scores of 2.41 on the normative behavior and 3.08 on the essential sex and gender subscale (Habarth, 2015). Similar to our sample, the psychology student volunteers were 76% female, but were more diverse in terms of racial and ethnic minority. Our sample’s higher endorsement of heteronormative attitudes may reflect differences in the general beliefs between students in the Mountain West, a traditionally conservative enclave, and those at the University of Michigan where the first study took place. Additionally, approximately half the students in the validation study were recruited from a gender and sexual identities-focused course which may have attracted students who already had lower heteronormative beliefs or possibly, converted students to be more open-mined with respect to gender and sexual identities.

A second 2017 study of social workers in the United Kingdom (UK) (n = 112) also identified significantly lower endorsement of heteronormative attitudes than observed in our sample (Schaub et al., 2017). The HABS scores, converted to averages, were 2.09 for the total HABS, and 1.93 for the normative beliefs subscale and 2.27 for the essential sex and gender subscale. The United Kingdom sample, like ours, was predominately female (75%), but was significantly more diverse with respect to other demographic characteristics, including approximately 35% of respondents who identified as sexual minorities. Additionally, those who pursue social work as a profession are likely to be more accepting of all persons than the general population.

In our sample, responses on the TMF showed that men were somewhat more gender conforming on average (5.7) than women (5.14). Validation studies for the TMF from German universities (Kachel et al., 2016) identified a mean score of 5.28 in females, similar to the score in our sample. Conversely, the same study identified a TMF score for men of 4.44, significantly lower than we observed. The difference in self-reported gender conformity for men may reflect differences in gender expectations for men in Europe versus the United States.

With respect to explicit tolerance, our sample was generally more tolerant than previous samples. According to the 2015 South African Social Attitudes Survey (SASAS) reported (Roberts et al., 2016), 66.5% of 3,115 respondents agreed that cross-dressing is disgusting. We observed a much lower proportion of respondents endorsing this belief, specifically, 23.8% and 17.7% of our sample agreed cross-dressing was wrong for men and women, respectively. Similarly, the SASAS reported that 32.6% of respondents felt it was entirely natural for some men to want to dress and act feminine while we observed 67.7% endorsement for this statement. The SASAS reported that 6.9% admitted to shouting or teasing someone because of their gender non-conformity, consistent with 7% reporting in our sample. The SASAS sample surveys all ages of the South African population. The relatively tolerant attitudes observed in our sample may reflect the age differences in the population or differences in gender attitudes between South Africa and the United States.

Increasing Numbers of LGBT-Identified Youth

The demographic breakdown of survey respondents showed more sexual minorities among female respondents. This may indicate more openness in identifying as a sexual minority for females than males, perhaps due to increasing societal tolerance of sexual exploration in females. Female sex roles tend to be less stringently reinforced with the advent of modern feminism (Diekman et al., 2004), which may contribute to more flexibility in reporting sexual orientation when LGBTQ identity intersects with gender identity. The Gallup poll shows a sharp increase in individuals between the ages of 19 and 38 identifying as a sexual minority – from 5.2 to 8.1% in the last 6 years (Newport, 2018).

The gender gap between women and men identifying as LGBTQ has expanded from 0.1 to 1.2% across all ages (Newport, 2018), with self-identifying LGBTQ women slightly outnumbering men. This gap was even larger in the data collected for this survey (14.7% more LGBTQ women than men). Regardless of any proposed rationale for this, LGBTQ undergraduate students in the Mountain West seem to mirror a larger trend throughout the United States of increasing self-acceptance or endorsement of sexual fluidity, particularly in females.

Gender Non-conformity and LGBT Identity

There is evidence that gender non-conforming children are likely to be subjected to assumptions of deviant sexual orientation, especially in the case of strongly feminine boys (Thomas and Blakemore, 2013). Gender non-conformity has been previously associated with psychological distress in gay men (Skidmore et al., 2006). This may stem from a stricter enforcement of masculine roles and a patriarchal society’s preference for masculine traits.

Historically, gender non-conformity and sexual non-conformity have not necessarily been linked concepts (Bullough, 2008; Hart et al., 2018). A recent study showed that discriminatory attitudes surfaced when listeners heard gender-atypical vocal cues. Intolerance tended to intensify when individuals reported assuming a non-heterosexual orientation in the speaker (Fasoli et al., 2017), indicating that sexual orientation can compound intolerance but is not necessary to provoke it. Anyone found to be out of conformity with traditional gender roles can become the target of discrimination.

The association between gender non-conformity and homosexuality was further expounded by participants in this survey; approximately 61% reported making the association. This result suggests that peer-perceived gender non-conformity is accompanied by presupposed homosexuality in the majority of cases: a claim which agrees with other recent research and may depend upon judgment criteria (Fasoli et al., 2017). The link between gender non-conformity is pronounced enough that sexual minorities sometimes report they were bullied for their orientation when they were actually mistreated for their gender non-conformity (Bos and Sandfort, 2015).

Approximately 17% of respondents reported an association between gender non-conformity and suspected neglect/abuse during development. Current literature indicates that gender non-conformity is a risk indicator for childhood physical, sexual, and psychological abuse, independent of sexual orientation (Roberts et al., 2012). Additionally, increased physical and emotional abuse have been reported in non-heterosexuals, with gender atypicality as a possible causal factor (Corliss et al., 2002; Rosa et al., 2018). Adult femininity has been associated with childhood sexual abuse in gay and bisexual men (Sandfort et al., 2007). Although the assumption that early abuse or neglect necessarily gave rise to non-conforming behavior may be baseless, the association between gender non-conformity and childhood abuse is rooted in reality. In future studies, it would be important to separate these ideas into separate questions in order to distinguish assumed causation from compassionate understanding.

Peer Perception and Self-Identification

The perception of gender conformity in others may differ from self-reported gender conformity. Kite and Deaux (1987) noted that people often subscribe to an ‘implicit inversion theory’ in which homosexuals are assumed to be similar to heterosexuals of the opposite sex; this assumption stems from belief in a binary model of human gender expression.

While this theory can hold true when perceiving others, homosexuals tend to self-stereotype and most often consider themselves in possession of cisgender or sex-typical characteristics. For example, gay men tend to report higher masculinity and lower femininity than lesbian women on the TMF (Kachel et al., 2016). These two conflicting systems of perception present an interesting dichotomy: openly gay individuals may perceive themselves to be more gender conforming (via self-stereotyping) than peers who prescribe to inversion theory. Because the survey requested self-evaluation of masculinity and femininity on the TMF, data may be incomplete. A future study might include an additional measure of participants’ gender conformity from a fixed outside perspective.

Response Bias

Self-selection and non-response bias among participants who take opt-in surveys has led to unbalanced gender representation in other studies (Hill and Shaw, 2013). In North America, multiple surveys of the general population have observed single, childless males to be prototypical non-responders (Ness et al., 2010; Rueegg et al., 2017) although this is not always the case (Hargittai and Jennrich, 2016). In our sample, a tendency for young men to dismiss surveys may partially explain the deficiency of equal participation among the sexes. Because data were drawn from a balanced population, such a large discrepancy by sex (∼34%) can also indicate refusal to participate by some male subjects.

The likelihood a person will respond to a survey may depend upon factors related to the subject matter of the survey. For example, participation in surveys about health is correlated with individuals’ past medical expenditures and their physical health status (Etter and Perneger, 1997; Ness et al., 2010). Lifestyle and cultural background including immigration status can also play an important role in survey response (Goldberg et al., 2001; Rueegg et al., 2017). In ethics research, the Hawthorne effect and manifestations of social desirability response bias have been well-documented, especially when socially sensitive items are present (Randall et al., 1993; Mortel, 2008; Chen et al., 2015).

Given the politically and socially charged nature of a survey that deals with topics of gender roles and discrimination, this and similar studies are not immune to some participants responding unfairly and others opting out completely (Sedgwick, 2013). When accounting for the relative overrepresentation of women and sexual minorities in this study, it is reasonable to assume that the topic of gender discrimination may appear more interesting or relevant to certain groups (i.e., lesbian women) than others (i.e., heterosexual men).

Despite drawing from an evenly distributed pool of panelists which represented a roughly evenly divided target population, relatively few males elected to respond to the survey. The low response rate may indicate less comfort discussing gender-related topics among men. Given that the male demographic was generally less tolerant, it is possible that some men were reluctant to participate in a study that would solicit their negative opinions. It is also possible that women were simply more eager to respond, perhaps because studies on gender are often designed to document discrimination against women. Relevance of the survey to particular groups may have contributed to oversampling.

Conclusion

There seems to be an association between heteronormative attitudes, personal gender conformity, and tolerance as predicted. Overall, participating students were moderately accepting of gender non-conforming persons and their attitudes were not especially heteronormative. Lesbian and bisexual females were the most accepting of non-conforming persons, while heterosexual males were the least tolerant and held more traditional views about gender expression. LGBT respondents were less conforming and four times as likely to be bullied for non-conformity. Men were generally more conforming as well as more likely than women to be mistreated for gender non-conformity, as male gender roles are often more strictly enforced. The large response disparity among sexes may indicate that men are less comfortable with the topic of gender despite its broad influence.

Despite generally low levels of reported intolerance and heterosexism on average, discrimination persists. Self-reported attitudes influenced by unconscious bias also have a tendency to underestimate the true extent of intolerance (Mortel, 2008). Results of this study may be used in the future to develop interventions aimed at lowering the incidence of discriminatory attitudes and behaviors in society. The apparent association between traditional attitudes, highly conforming behavior, and reduced tolerance will be crucial to inform the design of potential targets for intervention. A baseline understanding of existing attitudes by demographic is also important to focus these approaches on individuals who would most likely benefit. Further research is necessary to better describe and address factors that encourage development of tolerant belief systems and ultimately protect vulnerable populations.

Ethics Statement

The study was carried out in accordance with the recommendations of the Institutional Review Board at Brigham Young University. Survey respondents were informed of their rights as research participants, as well as risks and benefits of participation, and informed that participation in the survey implied consent. The protocol was approved by the Institutional Review Board at Brigham Young University.

Author Contributions

SD conceived of the idea to explore the presented topic. SD and BM formed the hypotheses, assembled validated measures, established research methods, and collected data after acquiring IRB approval. BM, CJ, and GA conducted statistical analysis and designed relevant tables. SD and BM contributed to the final manuscript. BM supervised the project.

Funding

This project is funded with internal research dollars from BM’s account. There is no contributing grant or external funding body.

Conflict of Interest Statement

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Acknowledgments

We thank our colleagues from Brigham Young University, in particular Dr. Kevin M. Shafer Ph.D. for providing insight that greatly assisted in the development of well-founded survey questions. We also thank the original creators of each validated measure: Dr. Janice Habarth for the HABS and Dr. Sven Kachel for the TMFS. Additional thanks go to Dr. Sean G. Massey for use of two survey items, and to the Human Sciences Research Council for providing SASAS data in the public domain which served as a template for four questions.

References

Baams, L., Grossman, A. H., and Russell, S. T. (2015). Minority stress and mechanisms of risk for depression and suicidal ideation among lesbian, gay, and bisexual youth. Dev. Psychol. 51, 688–696. doi: 10.1037/a0038994

PubMed Abstract | CrossRef Full Text | Google Scholar

Bailey, J. M., Kim, P. Y., Hills, A., and Linsenmeier, J. A. W. (1997). Butch, femme, or straight acting? Partner preferences of gay men and lesbians. J. Pers. Soc. Psychol. 73, 960–973. doi: 10.1037/0022-3514.73.5.960

CrossRef Full Text | Google Scholar

Balsam, K. F., Rothblum, E. D., and Beauchaine, T. P. (2005). Victimization over the life span: a comparison of lesbian, gay, bisexual, and heterosexual siblings. J. Consult. Clin. Psychol. 73, 477–487. doi: 10.1037/0022-006X.73.3.477

PubMed Abstract | CrossRef Full Text | Google Scholar

Bhattacharya, A., and Shukla, A. (2014). Gender identity and self esteem among educated young adults. J. Psychosoc. Res. 9, 259–269.

Google Scholar

Bos, H., and Sandfort, T. (2015). Gender nonconformity, sexual orientation, and Dutch adolescents’ relationship with peers. Arch. Sex. Behav. 44, 1269–1279. doi: 10.1007/s10508-014-0461-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Bullough, V. L. (2008). Childhood gender nonconformity and adult homosexuality. J. Gay Lesbian Mental Health 12:7. doi: 10.1300/J529v12n01_02

CrossRef Full Text | Google Scholar

Chen, L. F., Vander Weg, M. W., Hofmann, D. A., and Reisinger, H. S. (2015). The Hawthorne effect in infection prevention and epidemiology. Infect. Control Hosp. Epidemiol. 36, 1444–1450. doi: 10.1017/ice.2015.216

PubMed Abstract | CrossRef Full Text | Google Scholar

Cook, S. H., Sandfort, T. G. M., Nel, J. A., and Rich, E. P. (2013). Exploring the relationship between gender nonconformity and mental health among black South African gay and bisexual men. Arch. Sex. Behav. 42, 327–330. doi: 10.1007/s10508-013-0087-z

PubMed Abstract | CrossRef Full Text | Google Scholar

Corliss, H. L., Cochran, S. D., and Mays, V. M. (2002). Reports of parental maltreatment during childhood in a United States population-based survey of homosexual, bisexual, and heterosexual adults. Child Abuse Negl. 26, 1165–1178. doi: 10.1016/S0145-2134(02)00385-X

PubMed Abstract | CrossRef Full Text | Google Scholar

Croft, A., Schmader, T., and Block, K. (2015). An underexamined inequality: cultural and psychological barriers to men’s engagement with communal roles. Personal. Soc. Psychol. Rev. 19, 343–370. doi: 10.1177/1088868314564789

PubMed Abstract | CrossRef Full Text | Google Scholar

Davis, J. M., and Liang, C. (2015). A test of the mediating role of gender role conflict: latino masculinities and help-seeking attitudes. Psychol. Men Mascul. 16, 23–32. doi: 10.1037/a0035320

CrossRef Full Text | Google Scholar

Diekman, A. B., Goodfriend, W., and Goodwin, S. (2004). Dynamic stereotypes of power: perceived change and stability in gender hierarchies. Sex Roles 50, 201–215. doi: 10.1023/B:SERS.0000015552.22775.44

CrossRef Full Text | Google Scholar

Eagly, A. (1987). Sex Differences in Social Behavior: A Social Role Interpretation. Hillsdale, NJ: Erlbaum.

Google Scholar

Ellemers, N. (2018). Gender stereotypes. Annu. Rev. Psychol. 69, 275–298. doi: 10.1146/annurev-psych-122216-011719

PubMed Abstract | CrossRef Full Text | Google Scholar

Etter, J., and Perneger, T. (1997). Analysis of non-response bias in a mailed health survey. J. Clin. Epidemiol. 50, 1123–1128. doi: 10.1016/S0895-4356(97)00166-2

PubMed Abstract | CrossRef Full Text | Google Scholar

Fasoli, F., Maass, A., Paladino, M. P., and Sulpizio, S. (2017). Gay- and lesbian-sounding auditory cues elicit stereotyping and discrimination. Arch. Sex. Behav. 46, 1261–1277. doi: 10.1007/s10508-017-0962-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Friedman, R. C., and Downey, J. I. (1999). Internalized homophobia and gender-valued self-esteem in the psychoanalysis of gay patients. Psychoanal. Rev. 86, 325–347.

PubMed Abstract | Google Scholar

Goldberg, M., Chastang, J. F., Leclerc, A., Zins, S., Bonenfant, S., Bugel, I., et al. (2001). Socioeconomic, demographic, occupational, and health factors association with participation in a long-term epidemiologie survey: a prospective study of the french gazel cohort and its target population. Am. J. Epidemiol. 154, 373–384. doi: 10.1093/aje/154.4.373

CrossRef Full Text | Google Scholar

Good, G. M., Dell, D. M., and Laurie, L. B. (1989). Male role and gender role conflict: relations to help seeking in men. J. Counsel. Psychol. 36, 295–300. doi: 10.1037//0022-0167.36.3.295

PubMed Abstract | CrossRef Full Text | Google Scholar

Gordon, A., Krieger, N., Okechukwu, C., Haneuse, S., Samnaliev, M., Charlton, B., et al. (2017). Decrements in health-related quality of life associated with gender nonconformity among U.S. adolescents and young adults. Qual. Life Res. 26, 2129–2138. doi: 10.1007/s11136-017-1545-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Habarth, J. (2015). ‘Development of the heteronormative attitudes and beliefs scale’. Psychol. Sex. 6, 166–188. doi: 10.1080/19419899.2013.876444

CrossRef Full Text | Google Scholar

Halpern, H. P., and Perry-Jenkins, M. (2016). Parents’ gender ideology and gendered behavior as predictors of children’s gender-role attitudes: a longitudinal exploration. Sex Roles 74, 527–542. doi: 10.1007/s11199-015-0539-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Hargittai, E., and Jennrich, K. (2016). “The Online Participation Divide,” in: The Communication Crisis in America, And How to Fix It, eds M. Lloyd, and L. A. Friedland (New York, NY: Palgrave Macmillan).

Google Scholar

Hart, T. A., Noor, S. W., Tulloch, T. G., Sivagnanasunderam, B., Vernon, J. R. G., Pantalone, D. W., et al. (2018). The gender nonconformity teasing scale for gay and bisexual men. Psychol. Men Mascul. doi: 10.1037/men0000179

CrossRef Full Text | Google Scholar

Herek, G. M. (2009). Hate crimes and stigma-related experiences among sexual minority adults in the United States: prevalence estimates from a national probability sample. J. Interpers. Violence 24, 54–74. doi: 10.1177/0886260508316477

PubMed Abstract | CrossRef Full Text | Google Scholar

Hill, B. M., and Shaw, A. (2013). The wikipedia gender gap revisited: characterizing survey response bias with propensity score estimation. PLoS One 8:e65782. doi: 10.1371/journal.pone.0065782

PubMed Abstract | CrossRef Full Text | Google Scholar

Huang, J., Kumar, S., and Hu, C. (2018). Gender differences in motivations for identity reconstruction on social network sites. Int. J. Hum. Comput. Interact. 34, 591–602. doi: 10.1080/10447318.2017.1383061

CrossRef Full Text | Google Scholar

Kachel, S., Steffens, M. C., and Niedlich, C. (2016). Traditional masculinity and femininity: validation of a new scale assessing gender roles. Front. Psychol. 7:956. doi: 10.3389/fpsyg.2016.00956

PubMed Abstract | CrossRef Full Text | Google Scholar

Kite, M. E., and Deaux, K. (1987). Gender belief systems: homosexuality and the implicit inversion theory. Psychol. Women Quart. 11, 83–96. doi: 10.1111/j.1471-6402.1987.tb00776.x

CrossRef Full Text | Google Scholar

Li, G., Pollitt, A. M., and Russell, S. T. (2016). Depression and sexual orientation during young adulthood: diversity among sexual minority subgroups and the role of gender nonconformity. Arch. Sex. Behav. 45, 697–711. doi: 10.1007/s10508-015-0515-3

PubMed Abstract | CrossRef Full Text | Google Scholar

Martin-Storey, A., and August, E. G. (2016). Harassment due to gender nonconformity mediates the association between sexual minority identity and depressive symptoms. J. Sex Res. 53, 85–97. doi: 10.1080/00224499.2014.980497

PubMed Abstract | CrossRef Full Text | Google Scholar

Massey, S. G. (2009). Polymorphous prejudice: liberating the measurement of heterosexuals’ attitudes toward lesbians and gay men. J. Homosex. 56, 147–172. doi: 10.1080/00918360802623131

PubMed Abstract | CrossRef Full Text | Google Scholar

Math, S. B., and Seshadri, S. P. (2013). The invisible ones: sexual minorities. Indian J. Med. Res. 137, 4–6.

Google Scholar

Mays, V. M., and Cochran, S. D. (2001). Mental health correlates of perceived discrimination among lesbian, gay, and bisexual adults in the United States. Am. J. Public Health 91, 1869–1876. doi: 10.2105/AJPH.91.11.1869

PubMed Abstract | CrossRef Full Text | Google Scholar

Mortel, T. F. V. D. (2008). Faking it: social desirability response bias in self-report research. Aust. J. Adv. Nurs. 2008, 40–48.

PubMed Abstract | Google Scholar

Moss-Racusin, C. A., Phelan, J. E., and Rudman, L. A. (2010). When men break the gender rules: status incongruity and backlash against modest men. Psychol. Men Mascul. 11, 140–151. doi: 10.1037/a0018093

CrossRef Full Text | Google Scholar

Ness, K. K., Li, C., Mitby, P. A., Radloff, G. A., Mertens, A. C., Davies, S. M., et al. (2010). Characteristics of responders to a request for a buccal cell specimen among survivors of childhood cancer and their siblings. Pediatr. Blood Cancer 2010, 165–170. doi: 10.1002/pbc.22513

PubMed Abstract | CrossRef Full Text | Google Scholar

Newport, F. (2018). In U.S., Estimate of LGBT Population Rises to 4.5% Gallup: Politics. Available at: https://news.gallup.com/poll/234863/estimate-lgbt-population-rises.aspx (accessed October 29, 2018).

Potts, L. C. (2017). The Influence of Social Media Use on Male College Students’ gender Identity and Gendered Performance Dissertations, University of Minnesota, MI.

Google Scholar

Randall, D. M., Huo, Y. P., and Pawelk, P. (1993). Social desirability bias in cross-cultural ethics research. Int. J. Organ. Anal. 1, 185–202. doi: 10.1108/eb028788

CrossRef Full Text | Google Scholar

Reisner, S. L., Hughto, J. W., Dunham, E. E., Heflin, K. J., Begenyi, J. G., Coffey-Esquivel, J., et al. (2015). Legal protections in public accommodations settings: a critical public health issue for transgender and gender-nonconforming people. Milbank Quart. 93, 484–515. doi: 10.1111/1468-0009.12127

PubMed Abstract | CrossRef Full Text | Google Scholar

Roberts, B., Struwig, J., Ngungu, M., and Gordon, S. (2016). Sexual orientation and Gender Identity (SOGI): Tabulation Report Based on the 2015 Round of the South African Social Attitudes Survey (SASAS). Pretoria: Human Sciences Research Council.

Google Scholar

Roberts A. L., Rosario, M., Corliss, H. L., Koenen, K. C., and Austin, S. B. (2012). Childhood gender nonconformity: a risk indicator for childhood abuse and posttraumatic stress in youth. Pediatrics 129, 410–417. doi: 10.1542/peds.2011-1804

PubMed Abstract | CrossRef Full Text | Google Scholar

Rosa, F. A., Magalhães, M. J., Rodríguez-Castro, Y., and Lopez, R. (2018). Prevention of gender violence and working against LGBT prejudices: the intersection between collective action and institutional dynamics. Int. J. Iberian Stud. 31, 45–61. doi: 10.1386/ijis.31.1.45_1

CrossRef Full Text | Google Scholar

Rueegg, C. S., Gianinazzi, M. E., Michel, G., Zwahlen, M., von der Weid, N. X., Kuehni, C. E., et al. (2017). No evidence of response bias in a population-based childhood cancer survivor questionnaire survey — Results from the Swiss Childhood Cancer Survivor Study. PLoS One 12:e0176442. doi: 10.1371/journal.pone.0176442

PubMed Abstract | CrossRef Full Text | Google Scholar

Sandfort, T. G., Melendez, R. M., and Diaz, R. M. (2007). Gender nonconformity, homophobia, and mental distress in Latino gay and bisexual men. J. Sex Res. 44, 181–189. doi: 10.1080/00224490701263819

PubMed Abstract | CrossRef Full Text | Google Scholar

Schaub, J., Willis, P. B., and Dunk-West, P. (2017). Accounting for self, sex and sexuality in UK social Workers’ knowledge base: findings from an exploratory study. Br. J. Soc. Work 47, 427–446. doi: 10.1093/bjsw/bcw015

CrossRef Full Text | Google Scholar

Schwartz, D. R., Stratton, N., and Hart, T. A. (2016). Minority stress and mental and sexual health: examining the psychological mediation framework among gay and bisexual men. Psychol. Sex. Orientat. Gend. Divers. 3, 313.

Google Scholar

Sedgwick, P. (2013). Questionnaire surveys: sources of bias. BMJ 2013:f5265. doi: 10.1136/bmj.f5265

CrossRef Full Text | Google Scholar

Seelman, K. L., Woodford, M. R., and Nicolazzo, Z. (2017). Victimization and microaggressions targeting LGBTQ college students: gender identity as a moderator of psychological distress. J. Ethnic Cult. Divers. Soc. Work Innovat. 26, 112–125. doi: 10.1080/15313204.2016.1263816

CrossRef Full Text | Google Scholar

Sen, G., and Ostlin, P. (2007). Unequal, Unfair, Ineffective and Inefficient. Gender Inequity in Health: why It Exists and How We Can Change It’. Final Report, Geneva: World Health Organisation.

Google Scholar

Skidmore, W. C., Linsenmeier, J. W., and Bailey, J. M. (2006). Gender nonconformity and psychological distress in lesbians and gay men. Arch. Sex. Behav. 35, 685–697. doi: 10.1007/s10508-006-9108-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, T. W., Marsden, P., Hout, M., and Kim, J. (2015). General Social Surveys, 1972–2014. Chicago, IL: NORC at the University of Chicago.

Google Scholar

Spivey, L. A., Huebner, D. M., and Diamond, L. M. (2018). Parent responses to childhood gender nonconformity: effects of parent and child characteristics. Psychol. Sex. Orientat. Gender Divers. 5, 360–370. doi: 10.1037/sgd0000279

CrossRef Full Text | Google Scholar

Sutter, M., and Perrin, P. B. (2016). Discrimination, mental health, and suicidal ideation among LGBTQ people of color. J. Counsel. Psychol. 63:98. doi: 10.1037/cou0000126

PubMed Abstract | CrossRef Full Text | Google Scholar

Thomas, R. N., and Blakemore, J. O. (2013). Adults’ attitudes about gender nonconformity in childhood. Arch. Sex. Behav. 42, 399–412. doi: 10.1007/s10508-012-0023-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Whitley, B E. (1987). The relationship of sex-role orientation to heterosexuals’ attitudes toward homosexuals. Sex Roles 17, 103–113. doi: 10.1007/BF00287903

CrossRef Full Text | Google Scholar