Skip to main content

PERSPECTIVE article

Front. Educ., 23 September 2022
Sec. STEM Education

Reimagining the broader impacts criterion in the NSF graduate research fellowship

  • 1Department of Environmental Science, Policy, and Management, University of California, Berkeley, Berkeley, CA, United States
  • 2Department of Biological Science, California State University–Fullerton, Fullerton, CA, United States
  • 3Department of Biological Sciences, University of Southern California, Los Angeles, CA, United States

For graduate students, securing prestigious fellowships provides incredible benefits such as increased job opportunities and likelihood of receiving awards. These benefits can be particularly life-changing for a graduate student who may come from a marginalized background. However, the inequity in fellowship distribution hinders the success of graduate students, especially those who are marginalized. The majority of the National Science Foundation’s Graduate Research Fellowship Program (GRFP) is white and attend top-ranked institutions. Within the GRFP, there is a clear disconnect between the grantee’s proposed broader impacts and follow-through. To value and support communities, and graduate students of color in the process, the GRFP must be reimagined. In this article, we provide a brief background on the relationship between STEM and marginalized communities, and how broader impacts currently function as a band-aid to the issues of justice, equity, diversity, and inclusion (JEDI) in STEM. We then conclude by providing recommendations to improve the broader impacts section and the awardee selection process.

Introduction

For prospective graduate students considering graduate school — especially those from marginalized backgrounds — access to funding is a substantial concern (Kennedy et al., 2016). These concerns can be alleviated by securing funding such as the National Science Foundation (NSF) Graduate Research Fellowship Program (GRFP)1. The GRFP financially supports awardees pursuing research-based graduate degrees within the United States by providing an annual stipend and cost-of-education allowance over 3 years, resulting in its highly competitive nature (see text footnote 1). The GRFP scores applicants on two main criteria: (1) intellectual merit: the proposal’s potential on advancing knowledge in the applicant’s field and (2) broader impacts: the proposal’s potential to benefit society and contribute to the achievement of specific, desired societal outcomes. Evaluation of these two criteria ensures that the NSF supports high-quality research that advances our current understanding of the world and ultimately benefits society. However, the definition of “high-quality” is subjective and can create bias. For example, for National Institute of Health (NIH) funding, researchers found that Black scientists are 13% less likely to receive funding (Ginther et al., 2011) and less likely to receive funding due to topic choice (Hoppe et al., 2019). If reviewers are not as diverse as the applicant pool, they will fail to understand the barriers marginalized applicants navigate and the practical application for the work outside of basic science. In addition to the racialized bias that may occur, a reviewer’s assessment of applicants may vary. Although NSF instructs reviewers to review based on the “merit review criteria and noting GRFP’s emphasis on potential for significant research achievements,” reviewers may strictly score applicants based on the proposed project and its impact on the applicant’s field.

Applying for the GRFP can be incredibly beneficial for awardees and non-awardees alike. Participants reported feeling more confident in skills needed for success in graduate school such as developing testable hypotheses (Wiener and LeFevre, 2021). However, the chances of receiving this prestigious fellowship are not particularly high, with roughly 2,000 awardees selected from 13,000+ applications in 2020 (NSF GRFP, see text footnote 1). Moreover, the racial disparities in who is awarded the fellowship and an honorable mention is undeniable. From 1994 to 2011, 79.9% of awardees and 83.3% of honorable mentions were white (National Science Foundation [NSF], 2014). During this time, 7.9% of awardees were Hispanic, 10.3% were Asian, and 4.2% were Black (National Science Foundation [NSF], 2014). Within this, it’s difficult to further understand the racial/ethnic disparities as (1) NSF does not report information on applicants, (2) the term “Hispanic” hides racial disparities by clumping in Indigenous, Black, and non-Black Hispanic individuals as one, and (3) terms like Asian and Black hide ethnic identity by creating racial monoliths (e.g., Nguyen et al., 2022) and Indigenous applicants are left out altogether. Lastly, we see similar gaps in representation in the educational background and institutions of current fellows, with 8.9% of awardees attending community college as an undergraduate and 94.5% of awardees and 94.1% of honorable mentions attending universities with very high research activity (R1 universities, e.g., University of California, Berkeley) (National Science Foundation [NSF], 2014).

Due to systemic barriers, Black, Indigenous, and People of Color (BIPOC) in STEM are highly underrepresented compared to their white counterparts (Garrison, 2013; Riegle-Crumb et al., 2019). In an effort to limit disparity, institutions distributing grants often require an outreach or broader impacts section. This encourages applicants to conduct outreach into marginalized communities to hopefully increase participation in, and diversification of, their respective fields. Bottom-up approaches like this have been used in academia to remedy inequities in the representation and retention of systematically excluded groups in STEM (Ching et al., 2020). However, one of the issues with this bottom-up approach is the lack of top-down accountability and support in these ventures. The lack of accountability toward outreach for GRFP fellows may lead to detrimental effects such as the tokenization of marginalized communities at the hands of the academy (National Science Foundation [NSF], 2014). We argue that the current framework of the GRFP, specifically the broader impacts section, does not protect or help our most marginalized and underserved communities. Instead, it allows for further inequity and harm.

We do not claim the GRFP to be the sole solution to the many systemic issues in STEM. However, with the positionality that this program holds, this award can serve as a place to begin the conversation about (in)equity in academia. In this article, we will briefly give a snapshot of the history between STEM and marginalized communities, how broader impacts do not properly address the issues of diversity and inclusion in STEM, and how we see the future of the award, with recommendations for change.

Positionality statement

It is important for us to highlight and center our positionality for this article which is why we interrupted the article rather than end with it. Our positionalities have heavily influenced our decision to produce this work and shed light on this important issue. We all come from marginalized backgrounds with unique lived experiences and identities such as Black, Latin, Queer, first-generation, neurodivergent, and low-income. Because of these identities, we feel a need to address the broader impacts section as a larger issue of justice and equity. We have approached this work with our intersectional identities and recognize that other valuable perspectives may have been missed. We hope that by leveraging our experiences in white-dominated academia we can shed light on inequitable funding and create attainable solutions that ultimately benefit individuals from marginalized backgrounds.

Biosciences and marginalized communities

Colonialism is embedded in the science we practice (Trisos et al., 2021). The colonization of knowledge and its dissemination is maintained by centering white, cisgender, heterosexual male European scientists (Trisos et al., 2021). Many of these men have been deemed the “pioneers” in environmental and naturalist spaces (Finney, 2014), implying that nature and “correct” ecological knowledge is solely produced by them.

Disciplines like ecology have benefited from the use of colonized land to establish research sites. This legacy can be seen, for example, by (a) the geographic distribution of bird species named after European men (Trisos et al., 2021) and (b) the location of field stations. Most field stations in Caribbean, Central America, and South America originated after a nation’s independence from European colonialism under a brand of neocolonialism that scientists profited from (Ahmad-Gawel et al., 2021; Airhart, 2022). Field stations were typically formed in areas that had lasting colonial infrastructures such as plantations (Ahmad-Gawel et al., 2021; Airhart, 2022). Field stations that were founded on these grounds enable the practice of parachute science, where scientists from higher-income nations conduct research without engaging the community through collaborations like scientific partnerships, education programs, or the sharing of data (Ahmad-Gawel et al., 2021; Airhart, 2022; van Woesik et al., 2022).

The proposals of well-meaning broader impacts often contain ripples of colonization. The issue with proposing broader impacts statements that center on “vulnerable” communities is that these communities are viewed through a savior lens. These “damage-centered” proposals create a fictitious image that these communities are broken and in need of help (Tuck, 2009), which may lead to the tokenism, the including of minority groups as a symbolic effort, of said community. Whether it is marginalized communities or principal investigators with marginalized identities who are being tokenized by academia, the scientific community can begin to correct this injustice by holistically investing in the success of marginalized groups (Miriti et al., 2020; Schell et al., 2020).

Disparities in representation and funding

The way we propose broader impacts is a consequence of who is represented at the graduate and faculty levels. The NSF reports that 24% of baccalaureate and 13.6% of doctorate degrees in science and engineering are awarded to underrepresented minorities (National Science Foundation [NSF], and National Center for Science and Engineering Statistics [NCSES], 2019). We see similar gaps for faculty in biology, with only 25% of tenure-track and 15% of full professors being underrepresented minorities (Kozlowski et al., 2022). Among these numbers, Black (6%) and Indigenous (1%) faculty representation are especially low (Kozlowski et al., 2022). Socioeconomic status is a significant driver of the representation of academic faculty. Children of doctoral recipients that grow up in wealthy urban neighborhoods with parents in academia are 25x more likely to have full support in pursuing academic positions (Morgan et al., 2021). Socioeconomic status coupled with low racial diversity contributes to the lack of adequate representation in the academy (Stevens et al., 2021).

One of the reasons marginalized people are not well represented in academia is due to evaluation criteria for tenure (Corneille et al., 2019; Miriti et al., 2020; Schell et al., 2020). Publications and grants are valued over the impact of research on, or in collaboration with, local communities. Moreover, service is often overlooked by the academy (Corneille et al., 2019), with women of color taking on a disproportionate amount of service (Corneille et al., 2019; Miriti et al., 2020; Schell et al., 2020).

Biases surrounding how and whose work is valued in the academy often work against talented BIPOC academics that balance producing publications and service work aimed at transforming the academia for BIPOC scholars (Corneille et al., 2019). For example, proposals, awards, and funding rates from the NSF report that white principal investigators (PIs) were awarded above the overall funding rate at 31.3% for all racial/ethnic groups while Asian and Black PIs were below the funding rate at 22.4 and 26.5%, respectively (Chen et al., 2022). We also see this in NIH-funded research, with white PIs funded at double the rate of Black PIs (Stevens et al., 2021). In addition to disparities in funding, systemic racism’s existence and pervasiveness is often denied, leading to the continuation of institutional practices that disproportionately harm Black and Indigenous scholars. Berhe et al.’s (2021) “hostile obstacle course” illuminates the constant levels of discrimination awaiting scholars of marginalized backgrounds as they reach for academic success. Academic isolation, bullying, and implicit biases in fellowships, awards, and peer review processes steadily contribute to this hostile obstacle course (McGee and Bentley, 2017; Barber et al., 2020; Berhe et al., 2021). If we are to make any substantial change, academia and funding institutions must prioritize investment in and support the advancement of marginalized scholars.

Empty broader impacts

The “broader impacts” criterion was meant to replace two of the four previous NSF funding criteria, “utility” and “effect on infrastructure” (Rothenberg, 2010; Davis and Laas, 2014). 89% of proposals in the new system mentioned a broader impact on science, and 66% of proposals mentioned a broader impact on society (Roberts, 2009). Although broader impacts aims are mandated as part of the application, the likelihood of achieving these impacts is not always taken into consideration. For example, between 2000 and 2010, of the 82 NSF proposals that focused on increasing involvement from marginalized communities, only 39 proposals, less than half, actually accomplished the work (Watts et al., 2015). These previous studies underscore how following through on broader impacts has generally not been a priority over time for NSF-funded proposals. Additionally, with a lack of data on broader impact completion for GRFP awardees, we see that there is less accountability with regards to the GRFP’s broader impacts than other NSF grants. Overall, we argue that the broader impacts section does not properly address the needs of communities or hold accountability for awardees.

The disconnect between broader impact and community needs

Similar to Hoppe et al.’s (2019) study, there is a mismatch between what white researchers think marginalized communities need in terms of outreach and what communities actually need. When writing the broader impacts section of the GRFP, individuals may be pushed to create “out the box” solutions to systemic issues, despite simple more community-focused solutions being necessary, leading to a clear separation in the broader impacts of the GRFP and the realized impacts on society/communities. This separation stems from a lack of understanding of community needs and the necessity for researchers to articulate broad impacts aims. When researchers write about supporting marginalized communities with no previous relationship to said community, they do nothing more than exploit them to receive grants and fellowships, in turn, creating the notion of academic commodification. This commodification manifests as researchers advance in their career while communities are left behind following the project’s completion without having their needs heard or met. NSF’s funding history creates a positive feedback loop where “successful” broader impacts statements stand on a non-existent foundation that does not engage with the communities they aim to impact, does not fulfill its stated goals in any substantive way, and, instead reproduces existing inequities.

Previous recommendations to bridge this separation include targeted training of outreach to marginalized communities, encouraging high-quality dissemination of research results to the public, and increasing diverse leadership within research projects (Landry et al., 2001; Intemann, 2009; Roberts, 2009). Targeted mentoring and training of marginalized communities were recommended using the social justice rationale conceptualized by Intemann (2009) to promote participation and interest while diversifying white-dominated STEM spaces. Dissemination of research or project results is key to gaining a sense of how successful broader impacts are. Proposed impacts should be readily available for public view, actively supported by the targeted community, and based on previous successful research (Roberts, 2009). In the next section, we suggest tangible pathways and recommendations to increase liability between proposed and realized broader impacts.

New directions and recommendations

In order to move forward toward true justice, equity, diversity, and inclusion (JEDI), we must differentiate between “being involved” and “being heard.” Going forward, GRFP applicants must involve community leaders in their application and thoroughly listen to the community’s needs. A more inclusive model for the GRFP application should be grounded in this form of inclusivity and horizontal leadership style between applicant and community leader. Moreover, transparency and accountability are needed for progress to occur. To this degree, we bring forward five recommendations, categorized into assessments, implementation, and broadcasting, that the NSF could incorporate to make the first steps toward solving the identified issues.

Assessments

Diversify reviewers

Diversity leads to a stronger and more robust field of science (Plaut, 2010; Campbell et al., 2013; AlShebli et al., 2018). However, this has not scaled up to the review process. What is considered important in terms of research and impact is left open to reviewers and this has led to inequities in funding success, particularly for Black scientists (Hoppe et al., 2019). We reemphasize that reviewers of the GRFP must be diverse in terms of, but not limited to, race, ethnicity, gender, sexuality, class, neurodivergence, and physical ability in combination with appointment (e.g., government researchers, non-profits) and home-institution (e.g., HBCU, predominately undergraduate institution). Diversity in appointment type is needed to ensure that reviewers have experience in applied broader impacts projects to review the proposed broader impact’s feasibility and likelihood for success.

Correcting reviewer bias

The assumption that tenure-track and tenured faculty members can effectively and holistically evaluate applicants, both on intellectual merit and broader impacts, is a blind spot created by the nature of academia. Although reviewers are able to critically evaluate research due to their expertise in their respective fields, not all reviewers are equally equipped to evaluate the impact of broader impacts due to the lack of emphasis and value tenure evaluation places on outreach. Moreover, it is unrealistic to assume that reviewers, who may encompass privileged identities, will not allow any bias in their reviews. Thus, we emphasize that NSF should revamp their current anti-racist training for all reviewers by, for example, explicitly denouncing colorblind racial ideology, which can be positively associated with anti-Black prejudice and negatively associated with anti-racism (Yi et al., 2022), and creating an equity-based scoring rubrics to inhibit biases within reviewing. Lastly, to prevent bias that may occur even with these preventive measures, all reviews should be given feedback by other colleagues to (1) catch wrongful scoring due to potential bias and (2) prevent harmful reviews from reaching applicants. Preventing harmful reviews that may contain microaggressions from reaching applicants, particularly those who come from a marginalized background, is crucial as this can influence an individual’s mental health (Anderson, 2017; Auguste et al., 2021), productivity (Steele, 1997; Torres et al., 2010), and more generally, their sense of belonging (Lewis et al., 2021). Individuals that do catch harmful reviews should inform NSF officials of said review so (a) NSF officials can inform the reviewer of the harmful language used and (b) potentially remove the reviewer from further being involved in the review process depending on the rhetoric used and history of issues with said reviewer.

Implementation

Community partnership

Many applicants propose broader impacts with a specific community in mind. However, very little applicants have discussed these plans with actual community leaders or organizations doing similar work and thus, have any community support for the proposed broader impacts. We strongly encourage all applicants of the GRFP, especially current graduate students, to contact and have an open conversation with organizations and community leaders when crafting broader impacts. We believe that proposing community-centered broader impacts with no intent of completing them and without listening to the community contributes to the larger white-supremacy culture of academia and taking this step is one way to combat the culture. An active conversation with community leaders is important for identifying the needs of a community and where the proposed work fits in the ongoing efforts in the community, which will in turn create stronger plans with substantial communal impact.

National Science Foundation supplemental funding and letter of support

Individuals who propose high-quality broader impacts for their GRFP application immediately encounter obstacles in the form of funding. We call on NSF to allocate funds for GRFP fellows to implement their proposed broader impacts, as this will likely significantly increase follow through. This is important as awardees, especially those from marginalized backgrounds with experiences that would create strong service plans, may lack appropriate support and infrastructure to accomplish their proposed broader impacts. If implemented, NSF should require awardees to submit a letter of support from a community leader or organization supporting their work to access this supplemental funding. This letter should address what the applicant has proposed in their application and detail the letter writer’s enthusiasm for the proposed activities, confirm an established relationship, and discuss how the proposed broader impacts section dovetails with or expands on the work currently being done. This will ensure that all stakeholders, including the community, are aware and agree with the proposed broader impacts.

Broadcasting

Publicization of successful broader impacts

Transparency is crucial for moving any field forward to understand what works, what does not, and where there is room to expand. With this in mind, we expand on Roberts (2009) suggestion to strictly require, not encourage, all awardees of the GRFP to publicize their proposed broader impacts and broadcast their actualized broader impacts on an appropriate medium. These mediums could include open-access journal articles, personal websites, and video platforms such as YouTube. These efforts could promote credibility between researchers and community leaders/members along with providing templates for related community service activities. Lastly, NSF should request survey completion from community leaders that detail proposal completion and realized community impact.

Conclusion

To critically reform our institutions, we must reevaluate the traditions we perpetuate. Many traditions — such as tenure evaluation and graduate student stipends — have dramatic consequences on diversity and inclusion (Marin-Spiotta et al., 2020; Schell et al., 2020) as well as student mental health (Assembly, 2014; Barreira et al., 2018; Evans et al., 2018; Mackie and Bates, 2019; Coffino et al., 2021). Unsurprisingly, these norms disproportionately harm individuals from marginalized backgrounds (Smith et al., 2007; Grogan, 2019; Silbiger and Stubler, 2019).

The academy has a long way to go before the “hostile obstacle course” is dismantled. This paper contributes to the growing body of literature on routes of reformation by tackling a place where graduate students, especially those from marginalized backgrounds, experience inequity, and discrimination. As graduate students of color who encompass intersecting marginalized identities and that have (applied for) the GRFP, we feel the pain that our colleagues face regarding fellowship inequity and financial hardship. We believe that the broader impacts criterion in the GRFP can be one way to begin repairing the polluted relationship between institutions and marginalized communities but only if these activities are done right and with full engagement and participation by the communities in question. For this reason, we clarify that we are not proposing an outreach plan be required in the GRFP as this would result in disingenuous broader impacts. Instead, we are stating that applicants who choose to propose broader impacts for a specific community actually involve the community through partnership in project creation and completion. Overall, the recommendations put forward in this article are meant to serve as one pillar in a plethora of solutions to move academia forward in academic JEDI work and outreach into marginalized communities.

Data availability statement

The original contributions presented in this study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.

Author contributions

COE and BQ: project conceptualization, writing—original draft, and writing—review and editing. DO-Z: writing—original draft and writing—review and editing. All authors contributed to the article and approved the submitted version.

Funding

COE was supported by the UC Berkeley’s Chancellor Fellowship, and the National Science Foundation Graduate Research Fellowship (Grant No. DGE-2146752). BQ was supported by the California Sea Grant Graduate Research Fellowship, the National Geographic Level 1 (Grant No. EC-93122R-22) and the Council on Oceanic Affairs, Science and Technology Graduate Student Research Award. DO-Z was supported by the graduated TA funding at USC and the USC Wrigley Institute Summer Graduate Fellowship.

Acknowledgments

This project’s conception and completion were done at the University of California, Berkeley, California State University, Fullerton, and the University of Southern California. These institutions sit on the ancestral and unceded lands of the Ohlone and Tongva people, respectively. These lands of what is now considered Berkeley, Fullerton, and Los Angeles, California continue to be of great importance to their respective Indigenous people, and we recognize that we benefit from the use and occupation of these lands. We would like to thank the many folks who have both created and facilitated these conversations in an effort to make academia a safer space for underrepresented folks like us; we see you, we are in solidarity with you, and we thank you for your hard work. It does not go unseen. We would like to thank Dr. Jorge Ramos, Alexandria Taylor Cervantes, and Ari Perez for their invaluable support and for stimulating discussions around this topic that created this manuscript. We would also like to thank Alycia Ellington, Melissa Edwards, Samantha Krelig, and Dr. Damian Elias for their invaluable feedback on an early version of this manuscript and two reviewers for their helpful comments that improved this manuscript. The opinions and conclusions in this article are those of the authors and do not reflect the views of the National Science Foundation.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Footnotes

  1. ^ www.nsfgrfp.org

References

Ahmad-Gawel, M., Farrell, M., and Terebiznik, M. (2021). The History And Legacy Of Colonialism In Tropical Field Biology. Available Online at: https://brews.eeb.utoronto.ca/files/2021/06/20210528-BREWS-summary.pdf. (accessed April 07, 2022).

Google Scholar

Airhart, M. (2022). Legacy of Colonialism Influences Science in the Caribbean. News.utexas.edu. Available Online at: https://news.utexas.edu/2022/06/02/legacy-of-colonialism-influences-science-in-the-caribbean/. (accessed April 07, 2022).

Google Scholar

AlShebli, B. K., Rahwan, T., and Woon, W. L. (2018). The preeminence of ethnic diversity in scientific collaboration. Nat. Commun. 9:5163. doi: 10.1038/s41467-018-07634-8

PubMed Abstract | CrossRef Full Text | Google Scholar

Anderson, A. (2017). “It Just Weighs in the Back of Your Mind”: Microaggressions in Science. Chicago, IL: DePaul University.

Google Scholar

Assembly, U. C. B. G. (2014). Graduate Student Happiness And Well-Being Report. Berkeley, CA: Berkeley.

Google Scholar

Auguste, E. E., Cruise, K. R., and Jimenez, M. C. (2021). The Effects of Microaggressions on Depression in Young Adults of Color: Investigating the Impact of Traumatic Event Exposures and Trauma Reactions. J. Trauma. Stress 34, 985–994. doi: 10.1002/jts.22675

PubMed Abstract | CrossRef Full Text | Google Scholar

Barber, P. H., Hayes, T. B., Johnson, T. L., and Márquez-Magaña, L., and 10,234 signatories. (2020). Systemic racism in higher education. Science 369, 1440–1441. doi: 10.1126/science.abd7140

PubMed Abstract | CrossRef Full Text | Google Scholar

Barreira, P., Basilico, M., and Bolotnyy, V. (2018). Graduate Student Mental Health: Lessons From American Economics Departments. Cambridge: Harvard University.

Google Scholar

Berhe, A. A., Barnes, R. T., Hastings, M. G., Mattheis, A., Schneider, B., Williams, B. M., et al. (2021). Scientists from historically excluded groups face a hostile obstacle course. Nat. Geosci. 15, 2–4. doi: 10.1038/s41561-021-00868-0

CrossRef Full Text | Google Scholar

Campbell, L. G., Mehtani, S., Dozier, M. E., and Rinehart, J. (2013). Gender-heterogeneous working groups produce higher quality science. PLoS One 8:e79147. doi: 10.1371/journal.pone.0079147

PubMed Abstract | CrossRef Full Text | Google Scholar

Chen, C. Y., Kahanamoku, S. S., Tripati, A., Alegado, R. A., Morris, V. R., Andrade, K., et al. (2022). Decades of systemic racial disparities in funding rates at the National Science Foundation. OSF [Preprint]. doi: 10.31219/osf.io/xb57u

CrossRef Full Text | Google Scholar

Ching, C. D., Felix, E. R., Fernandez Castro, M., and Trinidad, A. (2020). Achieving Racial Equity From the Bottom-Up? The Student Equity Policy in the California Community Colleges. Educ. Pol. 34, 819–863. doi: 10.1177/0895904818802092

CrossRef Full Text | Google Scholar

Coffino, J. A., Spoor, S. P., Drach, R. D., and Hormes, J. M. (2021). Food insecurity among graduate students: Prevalence and association with depression, anxiety and stress. Public Health Nutr. 24, 1889–1894. doi: 10.1017/S1368980020002001

PubMed Abstract | CrossRef Full Text | Google Scholar

Corneille, M., Lee, A., Allen, S., Cannady, J., and Guess, A. (2019). Barriers to the advancement of women of color faculty in STEM: The need for promoting equity using an intersectional framework. Equal. Divers. Incl. 38, 328–348. doi: 10.1108/EDI-09-2017-0199

CrossRef Full Text | Google Scholar

Davis, M., and Laas, K. (2014). “Broader impacts” or “responsible research and innovation”? A comparison of two criteria for funding research in science and engineering. Sci. Eng. Ethics 20, 963–983. doi: 10.1007/s11948-013-9480-1

PubMed Abstract | CrossRef Full Text | Google Scholar

Evans, T. M., Bira, L., Gastelum, J. B., Weiss, L. T., and Vanderford, N. L. (2018). Evidence for a mental health crisis in graduate education. Nat. Biotechnol. 36, 282–284. doi: 10.1038/nbt.4089

PubMed Abstract | CrossRef Full Text | Google Scholar

Finney, C. (2014). Black Faces, White Spaces: Reimagining the Relationship of African Americans to the Great Outdoors. Chapel Hill: UNC Press Books. doi: 10.5149/northcarolina/9781469614489.001.0001

CrossRef Full Text | Google Scholar

Garrison, H. (2013). Underrepresentation by race-ethnicity across stages of U.S. science and engineering education. CBE Life Sci. Educ. 12, 357–363. doi: 10.1187/cbe.12-12-0207

PubMed Abstract | CrossRef Full Text | Google Scholar

Ginther, D. K., Schaffer, W. T., Schnell, J., Masimore, B., Liu, F., Haak, L. L., et al. (2011). Race, ethnicity, and NIH research awards. Science 333, 1015–1019. doi: 10.1126/science.1196783

PubMed Abstract | CrossRef Full Text | Google Scholar

Grogan, K. E. (2019). How the entire scientific community can confront gender bias in the workplace. Nat. Ecol. Evol. 3, 3–6. doi: 10.1038/s41559-018-0747-4

PubMed Abstract | CrossRef Full Text | Google Scholar

Hoppe, T. A., Litovitz, A., Willis, K. A., Meseroll, R. A., Perkins, M. J., Hutchins, B. I., et al. (2019). Topic choice contributes to the lower rate of NIH awards to African-American/black scientists. Sci. Adv. 5:eaaw7238. doi: 10.1126/sciadv.aaw7238

PubMed Abstract | CrossRef Full Text | Google Scholar

Intemann, K. (2009). Why Diversity Matters: Understanding and Applying the Diversity Component of the National Science Foundation’s Broader Impacts Criterion. Soc. Epistemol. 23, 249–266. doi: 10.1080/02691720903364134

CrossRef Full Text | Google Scholar

Kennedy, M. S., Lanier, S. K., Ehlert, K. M., High, K. A., Pegues, K. K., and Sharp, J. L. (2016). “Understanding the role of knowledge related to financial resources on decisions to attend graduate school,” in 2016 IEEE Frontiers in Education Conference (FIE), (Piscataway: IEEE Press), 1–5. doi: 10.1109/FIE.2016.7757509

CrossRef Full Text | Google Scholar

Kozlowski, D., Larivière, V., Sugimoto, C. R., and Monroe-White, T. (2022). Intersectional inequalities in science. Proc. Natl. Acad. Sci. U.S.A. 119:e2113067119. doi: 10.1073/pnas.2113067119

PubMed Abstract | CrossRef Full Text | Google Scholar

Landry, R., Amara, N., and Lamari, M. (2001). Climbing the Ladder of Research Utilization: Evidence from Social Science Research. Sci. Commun. 22, 396–422. doi: 10.1177/1075547001022004003

CrossRef Full Text | Google Scholar

Lewis, J. A., Mendenhall, R., Ojiemwen, A., Thomas, M., Riopelle, C., Harwood, S. A., et al. (2021). Racial Microaggressions and Sense of Belonging at a Historically White University. Am. Behav. Sci. 65, 1049–1071. doi: 10.1177/0002764219859613

CrossRef Full Text | Google Scholar

Mackie, S. A., and Bates, G. W. (2019). Contribution of the doctoral education environment to PhD candidates’ mental health problems: A scoping review. High. Educ. Res. Dev. 38, 565–578. doi: 10.1080/07294360.2018.1556620

CrossRef Full Text | Google Scholar

Marin-Spiotta, E. T., Barnes, R., Asefaw Berhe, A. G., Hastings, M., Mattheis, A., Schneider, B., et al. (2020). Hostile climates are barriers to diversifying the geosciences. Adv. Geosci. 53, 117–127. doi: 10.5194/adgeo-53-117-2020

CrossRef Full Text | Google Scholar

McGee, E. O., and Bentley, L. (2017). The Troubled Success of Black Women in STEM. Cogn. Instr. 35, 265–289. doi: 10.1080/07370008.2017.1355211

CrossRef Full Text | Google Scholar

Miriti, M. N., Bailey, K., Halsey, S. J., and Harris, N. C. (2020). Hidden figures in ecology and evolution. Nat. Ecol. Evol. 4:1282. doi: 10.1038/s41559-020-1270-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Morgan, A., LaBerge, N., Larremore, D., Galesic, M., Brand, J. E., and Clauset, A. (2021). Socioeconomic Roots of Academic Faculty. SocArXiv [Preprint]. doi: 10.31235/osf.io/6wjxc

PubMed Abstract | CrossRef Full Text | Google Scholar

National Science Foundation [NSF] (2014). Evaluation of the National Science Foundation’s Graduate Research Fellowship Program. Final Report. Washington DC: National Science Foundation.

Google Scholar

National Science Foundation [NSF], and National Center for Science and Engineering Statistics [NCSES] (2019). Women, minorities, and persons with disabilities in science and engineering: 2019. Special Report NSF 19-304. Alexandria: National Science Foundation.

Google Scholar

Nguyen, K. H., Akiona, A. K., Chang, C. C., Chaudhary, V. B., Cheng, S. J., Johnson, S. M., et al. (2022). Who are we? Highlighting Nuances in Asian American Experiences in Ecology and Evolutionary Biology. Bull. Ecol. Soc. Am. 103, 1–8. doi: 10.1002/bes2.1939

CrossRef Full Text | Google Scholar

Plaut, V. C. (2010). Diversity Science: Why and How Difference Makes a Difference. Psychol. Inq. 21, 77–99. doi: 10.1080/10478401003676501

CrossRef Full Text | Google Scholar

Riegle-Crumb, C., King, B., and Irizarry, Y. (2019). Does STEM Stand Out? Examining Racial/Ethnic Gaps in Persistence Across Postsecondary Fields. Educ. Res. 48, 133–144. doi: 10.3102/0013189X19831006

CrossRef Full Text | Google Scholar

Roberts, M. R. (2009). Realizing Societal Benefit from Academic Research: Analysis of the National Science Foundation’s Broader Impacts Criterion. Soc. Epistemol. 23, 199–219. doi: 10.1080/02691720903364035

CrossRef Full Text | Google Scholar

Rothenberg, M. (2010). Making Judgements About Grant Proposals: A Brief History of the Merit Review Criteria at the National Science Foundation. Technol. Innov. 12, 189–195. doi: 10.3727/194982410X12895770313952

PubMed Abstract | CrossRef Full Text | Google Scholar

Schell, C. J., Guy, C., Shelton, D. S., Campbell-Staton, S. C., Sealey, B. A., Lee, D. N., et al. (2020). Recreating Wakanda by promoting Black excellence in ecology and evolution. Nat. Ecol. Evol. 4, 1285–1287. doi: 10.1038/s41559-020-1266-7

PubMed Abstract | CrossRef Full Text | Google Scholar

Silbiger, N. J., and Stubler, A. D. (2019). Unprofessional peer reviews disproportionately harm underrepresented groups in STEM. PeerJ 7:e8247. doi: 10.7717/peerj.8247

PubMed Abstract | CrossRef Full Text | Google Scholar

Smith, W. A., Allen, W. R., and Danley, L. L. (2007). “Assume the Position You Fit the Description”: Psychosocial Experiences and Racial Battle Fatigue Among African American Male College Students. Am. Behav. Sci. 51, 551–578. doi: 10.1177/0002764207307742

CrossRef Full Text | Google Scholar

Steele, C. M. (1997). A threat in the air: How stereotypes shape intellectual identity and performance. Am. Psychol. 52, 613–629. doi: 10.1037//0003-066x.52.6.613

PubMed Abstract | CrossRef Full Text | Google Scholar

Stevens, K. R., Masters, K. S., Imoukhuede, P. I., Haynes, K. A., Setton, L. A., Cosgriff-Hernandez, E., et al. (2021). Fund Black scientists. Cell 184, 561–565. doi: 10.1016/j.cell.2021.01.011

PubMed Abstract | CrossRef Full Text | Google Scholar

Torres, L., Driscoll, M. W., and Burrow, A. L. (2010). Racial Microaggressions and Psychological Functioning Among Highly Achieving African-Americans: A Mixed-Methods Approach. J. Soc. Clin. Psychol. 29, 1074–1099. doi: 10.1521/jscp.2010.29.10.1074

CrossRef Full Text | Google Scholar

Trisos, C. H., Auerbach, J., and Katti, M. (2021). Decoloniality and anti-oppressive practices for a more ethical ecology. Nat. Ecol. Evol. 5, 1205–1212. doi: 10.1038/s41559-021-01460-w

PubMed Abstract | CrossRef Full Text | Google Scholar

Tuck, E. (2009). Suspending Damage: A Letter to Communities. Harv. Educ. Rev. 79, 409–428. doi: 10.17763/haer.79.3.n0016675661t3n15

CrossRef Full Text | Google Scholar

van Woesik, R., Shlesinger, T., Grottoli, A. G., Toonen, R. J., Vega Thurber, R., Warner, M. E., et al. (2022). Coral-bleaching responses to climate change across biological scales. Glob. Change Biol. 28, 4229–4250. doi: 10.1111/gcb.16192

PubMed Abstract | CrossRef Full Text | Google Scholar

Watts, S. M., George, M. D., and Levey, D. J. (2015). Achieving Broader Impacts in the National Science Foundation, Division of Environmental Biology. Bioscience 65, 397–407. doi: 10.1093/biosci/biv006

CrossRef Full Text | Google Scholar

Wiener, E. A., and LeFevre, G. H. (2021). Using the NSF Graduate Research Fellowship Proposal to Train Original Scientific Writing Skills in First-Year Graduate Students: A Demonstrated Project at the University of Iowa. Environ. Eng. Sci. 39, 197–201. doi: 10.1089/ees.2021.0225

CrossRef Full Text | Google Scholar

Yi, J., Neville, H. A., Todd, N. R., and Mekawi, Y. (2022). Ignoring race and denying racism: A meta-analysis of the associations between colorblind racial ideology, anti-Blackness, and other variables antithetical to racial justice. J. Couns. Psychol. doi: 10.1037/cou0000618 [Epub ahead of print].

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: NSF GRFP, broader impacts, justice, equity, STEM, fellowships

Citation: Estien CO, Quintana B and Olivares-Zambrano D (2022) Reimagining the broader impacts criterion in the NSF graduate research fellowship. Front. Educ. 7:977836. doi: 10.3389/feduc.2022.977836

Received: 24 June 2022; Accepted: 06 September 2022;
Published: 23 September 2022.

Edited by:

Alexander Gates, Rutgers University, United States

Reviewed by:

Jessica Castillo Vardaro, San José State University, United States
Katherine A. Wilkinson, San José State University, United States

Copyright © 2022 Estien, Quintana and Olivares-Zambrano. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Cesar O. Estien, Y2VzYXJvZXN0aWVuQGdtYWlsLmNvbQ==

ORCID: Cesar O. Estien, orcid.org/0000-0001-8410-7371; Brandon Quintana, orcid.org/0000-0002-5448-7606; Daniel Olivares-Zambrano, orcid.org/0000-0003-2454-622X

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.