Building an adverse outcome pathway network for estrogen-, androgen- and steroidogenesis-mediated reproductive toxicity

Introduction: Adverse Outcome Pathways (AOPs) can support both testing and assessment of endocrine disruptors (EDs). There is, however, a need for further development of the AOP framework to improve its applicability in a regulatory context. Here we have inventoried the AOP-wiki to identify all existing AOPs related to mammalian reproductive toxicity arising from disruption to the estrogen, androgen, and steroidogenesis modalities. Core key events (KEs) shared between relevant AOPs were also identified to aid in further AOP network (AOPN) development.

Methods: A systematic approach using two different methods was applied to screen and search the entire AOP-wiki library. An AOPN was visualized using Cytoscape. Manual refinement was performed to remove AOPS devoid of any KEs and/or KERs.

Results: Fifty-eight AOPs relevant for mammalian reproductive toxicity were originally identified, with 42 AOPs included in the final AOPN. Several of the KEs and KE relationships (KERs) described similar events and were thus merged to optimize AOPN construction. Sixteen sub-networks related to effects on hormone levels or hormone activity, cancer outcomes, male and female reproductive systems, and overall effects on fertility and reproduction were identified within the AOPN. Twenty-six KEs and 11 KERs were identified as core blocks of knowledge in the AOPN, of which 19 core KEs are already included as parameters in current OECD and US EPA test guidelines.

Discussion: The AOPN highlights knowledge gaps that can be targeted for further development of a more complete AOPN that can support the identification and assessment of EDs.

1 Introduction

Minimizing potential human health risks from endocrine disruptors (EDs) has been a highly prioritized issue in the European Union (EU) for several years (European Parliament, 2013, 2019; European Commission, 2018b) and is specifically highlighted in the European Chemicals strategy for sustainability (European Commission, 2020). EDs are exogenous substances that interfere with the normal function of the endocrine system to cause adverse health effects in an intact organism, or its progeny, or in (sub)populations (WHO/IPCS, 2002). Since the endocrine system regulates tissue and organ development and function, disruption can lead to a range of serious health effects, including reproductive, developmental, and metabolic disorders, cardiovascular diseases, and cancers (WHO/UNEP, 2013; Gore et al., 2015; Duh-Leong et al., 2023). Thus, endocrine disruption represents a mode of action (MoA) that can lead to various toxicities. EDs exert their toxicity through mechanisms such as direct interference with hormone receptors, as well as interference with hormone synthesis, transport, or metabolism. While the endocrine system comprises many different hormones, signalling pathways and organ systems, regulatory assessment of EDs in the EU currently focuses on substances that interact with the estrogen, androgen, thyroid or steroidogenesis (EATS) modalities. The reason is that there is relatively good mechanistic understanding of how perturbations of the EATS modalities may result in adverse effects and which types of effects may arise (ECHA/EFSA/JRC, 2018). There are also several standardized in vivo and in vitro test guidelines available from the OECD and US Environmental Protection Agency (EPA) that include relevant endpoints to investigate EATS-related mechanisms and EATS-mediated adverse effects.

Scientific criteria for identifying EDs have been implemented for biocides and plant protection products in the EU (European Commission, 2017; 2018a) and recently in the European legislation for Classification Labelling and Packaging (CLP) (European Commission, 2023). These criteria stipulate that a substance should be considered an ED if: 1) it shows an adverse effect in an intact organism or its progeny, 2) it has an endocrine MoA, and 3) the adverse effect is a consequence of the endocrine MoA. Consequently, identification of EDs requires a high degree of mechanistic understanding, including understanding of the links between early mechanisms and adverse health effects, to establish an endocrine MoA and perform a MoA analysis (ECHA/EFSA/JRC, 2018). The Adverse Outcome Pathway (AOP) framework is particularly well suited for this purpose, as it provides information on all three criteria.

The AOP framework provides a harmonized approach to describe a causal chain of events linking a molecular initiating event (MIE) to key events (KE) at different levels of biological organization, ultimately leading to an adverse outcome (AO) through defined key event relationships (KER) (Ankley et al., 2010; Villeneuve et al., 2014; Ankley and Edwards, 2018). AOPs thus provide a structured format to summarise available evidence for, and confidence in, the causal links between MIEs and AOs; i.e., they are valuable tools for MoA analysis in ED assessment and for developing Integrated Approaches to Testing and Assessment (IATA) (Browne et al., 2017; OECD, 2017; Audouze et al., 2021; Svingen et al., 2022; Bajard et al., 2023; Wiklund et al., 2023). Development of AOPs is currently overseen by the OECD’s Advisory Group on Emerging Science in Chemicals Assessment (ESCA) in collaboration with the Society for the Advancement of AOPs (SAAOP) and AOP Knowledge Base Coordination Group. Fully developed AOPs can be endorsed by the OECD Working Party on Hazard Assessment (WPHA) and/or Working Group of the National Coordinators for the Test Guidelines Program (WNT) after technical review according to a process described in the AOP Developers’ Handbook (OECD, 2023). For the AOPs to be endorsable, it is important that the peer review is overseen either by the OECD AOP Development Programme or by a scientific journal that has a written agreement with the OECD to handle AOP Reports. With the latter option, an acceptance of the journal submission would make it automatically eligible to be considered for endorsement by the WNT and WPHA. To take full advantage of the potential of AOPs for practical applications, such as ED identification and assessment, the need for more complex AOP networks (AOPNs) of inter-connected AOPs is recognized (Knapen et al., 2018). AOPNs provide further insight into different pathways that are connected in some way, either by contributing to the same AO or by sharing common KEs. This methodology also allows for identifying core KEs and KERs, i.e., events that are central to the development of a specific AO and/or shared by many AOPs. Core KE(R)s may be especially interesting to identify in a MoA analysis, target for testing or use as basis for development of new test methods. AOPNs can also support hazard and risk assessment of chemical mixtures, by providing frameworks for assessing the combined effects of chemicals affecting the same target tissue via different mechanisms (Villeneuve et al., 2018; Beronius et al., 2020).

For AOPs to have practical application, they should be described in a harmonized way and be publicly available. The AOP wiki (https://aopwiki.org/) provides such a repository of AOPs, and several AOPs describing perturbations to hormonal pathways leading to adverse effects are already included in the wiki (Audouze et al., 2021; Ravichandran et al., 2022; Wiklund et al., 2023). However, there is a need for further refinement of existing AOPs to improve overall confidence, as well as to develop additional AOPs describing relevant MoAs that are still missing. This includes reproductive toxicity where effects of EDs on both male and female reproductive systems have been well documented (Schwartz et al., 2019; 2021; Duursen van et al., 2020; Sharma et al., 2020; Rodprasert et al., 2021; You and Song, 2021; Delbes et al., 2022; Marlatt et al., 2022), yet where we still lack fundamental knowledge allowing us to predict with high confidence in vivo outcomes based on data from alternative test methods (Svingen et al., 2022).

The aim of this study was to conduct a systematic inventory of the AOP wiki to identify currently available AOPs that are relevant for mammalian reproductive toxicity and human health. The work was limited to AOPs relevant for EAS modalities. The study also set out to identify core KEs and KERs, i.e., KE(R)s shared by several of the identified AOPs and provide a basis for further AOP development to close gaps and support regulatory identification and assessment of EDs.

2 Materials and methods

We applied an inclusive approach to capture all AOPs in the AOP wiki with relevance for EAS-mediated reproductive toxicity in mammals. The applied methodology was based on that developed and described by Wiklund et al. (2023), as outlined in Figure 1.

Figure 1

Figure 1. Outline of the methodology.

2.1 Development of key terms for identification of relevant AOPs

Key terms were derived from the following parameters listed in the ECHA/EFSA Guidance for the identification of EDs in the context of Regulations (EU) No 528/2012 and (EC) No 1107/2009 (ECHA/EFSA/JRC, 2018):

• in vitro mechanistic parameters

• in vivo mechanistic parameters for EAS modalities for mammals, fish, amphibians, birds

• EAS-mediated parameters for mammals, fish, amphibians, birds

• parameters sensitive to, but not diagnostic of, EATS for mammals, fish, amphibians, birds

Parameters for non-mammals (fish, amphibians, and birds) were included as key terms since AOPs described for non-mammal vertebrates may include early KEs relevant for mammals. Key terms are listed in Supplementary Material.

2.2 Manual screening of AOPs in the AOP wiki

The AOP wiki was screened to identify all AOPs relevant for mammalian reproductive toxicity mediated by EAS modalities. All AOPs in the AOP wiki were manually screened by reviewing each AOP, including reviewing the description of the KEs in the AOP, and cross-checking against the key terms. The screening was carried out independently by two reviewers in parallel on November 8, November 9, December 8 and 13 December 2022. Disagreements were resolved by discussion.

Relevant AOPs were identified based on the following inclusion and exclusion criteria using expert judgement:

Inclusion criteria:

• the AOP is relevant for reproductive toxicity mediated by EAS modalities, and

• the AOP describes effects related to identified key terms, and

• the AOP is relevant for mammalian or non-mammalian vertebrates, and

• the AOP is included in the AOP wiki with or without description of KEs or KER.

Exclusion criterion:

• The AOP was only relevant for invertebrate species.

2.3 Search of AOP wiki using key terms

To ensure that no relevant AOPs were overlooked in the manual screening, a search using the key terms listed in Supplementary Material was conducted in the AOP wiki as a subsequent step. This was considered appropriate due to potential errors and mismatches in information entered into the AOP wiki. The steps of the search are outlined in Figure 4. The searches were conducted by one reviewer on December 18–21, 2022.

First, the full texts of the AOP pages were searched by one key term at a time. The identified AOPs were listed. In the next step, the KE pages were searched by one key term at a time. The identified KEs were listed, and the relevance was assessed using the following criteria using expert judgement:

Inclusion criteria:

• the AOP, KE or KER is relevant for reproductive toxicity mediated by EAS modalities, and

• the AOP, KE or KER describes effects related to identified key terms, and

• the AOP, KE or KER is relevant for mammalian or non-mammalian vertebrates, and

• the AOP is included in the AOP wiki with or without description of KEs or KER.

Exclusion criteria:

• The key term was mentioned in the full text of an AOP-, KE- or KER-page but the AOP, KE or KER was clearly not relevant for reproductive toxicity mediated by EAS modalities, or

• The AOP was only relevant for invertebrate species.

The relevance was recorded. Thereafter AOPs that included the relevant KEs were identified and listed. Next, KER pages were searched by one key term at time. The identified KERs were listed and the relevance of the KERs was assessed using the same criteria as previously. Thereafter AOPs that included the relevant KERs were identified and listed. The lists of AOPs from the searches of the AOP, KE and KER pages were combined into one list and the relevance of the AOPs were assessed using the same criteria as previously.

2.4 Combination of results from manual screening and key term search

The lists of identified AOPs from the manual screening and the key term search were compared and combined. An additional check of the AOP wiki was done on 21 December 2022, to identify any relevant AOPs added after the screening and search. The AOP list was cross-checked by two additional reviewers and disagreements resolved before it was finalised.

2.5 Visualisation of the included AOPs in Cytoscape

The identified AOPs and their connections to each other were visualized using the Cytoscape software. Three tab-delimited files containing basic information relating to all KEs, KERs and KE components were downloaded from the AOP wiki on 23 January 2023. The IDs for the included AOPs were recorded in a separate file. The four files were imported into R-studio (https://www.rstudio.com/) and combined using an R script to produce one file with information on the included AOPs in a format suitable for import into Cytoscape (https://cytoscape.org) (Wiklund et al., 2023).

The file with the AOPs was imported into Cytoscape to visualise the included AOPs (Supplementary Material).

2.6 Identification and combination of similar KEs and KERs

The AOP wiki contains many KEs that are the same, or very similar, but have been entered into the AOP wiki as separate KEs by different AOP developers. These KEs must be identified and combined in the input file for Cytoscape to create the final AOPN in Cytoscape, and to facilitate analyses of links between AOPs, and of core blocks of knowledge. The similar KEs were identified based on information in the AOP wiki and expert judgement. The steps in the methodology are outlined in Figure 2 and described below.

Figure 2

Figure 2. Steps in the methodology to identify similar KEs and KERs.

An Excel file with all KEs in the included AOPs in Cytoscape was downloaded from Cytoscape. The Excel file with the KEs included information from the AOP wiki on the Key event components Process and Object for each KE if available in the KE page in the AOP wiki. The Process describes the underlying biological system (e.g., receptor signalling). The Object is the subject of the perturbation (e.g., a specific biological receptor that is activated or inhibited). KEs that shared the same Process and Object description were first identified. Thereafter KE titles were compared for KEs that lacked Process and Object descriptions. Based on this a draft list of similar KEs were identified. The similarity of the KEs was confirmed by analysing the information on the KE pages and the AOP pages that included the KEs.

Similar KEs were combined and given a new KE title based on the title of the original KEs and adjusted according to the guidance for KE titles in the AOP Developers’ handbook (OECD, 2023). The KE ID of the combined KE included the IDs for all original KEs. A combined KE was labelled as MIE or AO based on the label of the original KEs. In cases where at least one of the original KEs was MIE or AO, the combined KE received that label.

An Excel file including all KERs in the included AOPs was downloaded from Cytoscape to identify the similar KERs. The similar KEs were first identified in the Excel file with KERs and thereafter could the corresponding similar KERs be identified.

The similar KEs and KERs were combined for the purpose of this study in Excel files and Cytoscape network but the information in AOP wiki was not changed.

2.7 Visualisation of the final AOPN in cytoscape

The file prepared using the R script that formed the input data for Cytoscape was manually modified by combining the similar KEs. The input file with the combined KEs was imported into Cytoscape to visualise the final AOPN (Supplementary Material).

2.8 Identification of core blocks of knowledge in the AOPN

Core blocks of knowledge are defined as KEs or KERs that are shared across various identified AOPs. The following criteria were used to identify core KEs and core KERs:

Criteria for core KEs:

• The KE is included in three or more AOPs, or the KE is included in two AOPs, is connected by three or more KERs and describes a central biological process as assessed by expert knowledge of the biological processes involved and the information in the AOP wiki, and

• The KE has a mammalian taxonomical applicability domain

Criteria for core KERs:

• The KER is included in three or more AOPs, and

• The KER has a mammalian taxonomical applicability domain

The following methodology was used to identify the core KEs and KERs. The input file for Cytoscape with the combined KEs was used to identify how many AOPs contained each of the KEs. The number of AOPs connected to each KE was recorded in an Excel file. The number of KERs connected to each KE was identified using the network analysis function in Cytoscape that calculated the degree of a node (KE) which is the number of edges (KERs) linked to the node. See also Villeneuve et al., 2018 for a discussion of network analytics. The number of connected KERs was recorded in the same Excel file as the number of AOPs. The taxonomical applicability domain described in the AOP wiki for the KEs was also noted in the Excel file. KEs that were included in two AOPs and connected by three or more KERs were analysed and based on expert knowledge of the biological processes involved and the information in the AOP wiki it was decided whether the KE describes a central biological process and should be considered a core KE. The identified core KEs based on the criteria and the described methodology were noted in the Excel file (Supplementary Material).

The input file for Cytoscape with the combined KEs was used to identify how many AOPs contained each of the KERs. The number of AOPs connected to each KER was recorded in an Excel file. The taxonomical applicability domain described in the AOP wiki for the KERs was also noted in the Excel file. The identified core KERs based on the criteria and the described methodology were noted in the Excel file (Supplementary Material).

2.9 Mapping of core blocks of knowledge in the AOPN to parameters in OECD and US EPA test guidelines

To identify whether the core blocks of knowledge in the AOPN are included in the current tests for identification of endocrine disruptors, the identified core KEs were mapped against parameters in OECD and US EPA test guidelines described in ECHA/EFSA/JRC (2018).

3 Results

3.1 Manual screening of AOPs in the AOP wiki

A total of 56 AOPs were included based on the manual screening of the AOP wiki for AOPs relevant for mammalian reproductive toxicity mediated by EAS modalities (Figure 4).

3.2 Search of AOP wiki using key terms

The key term search of the AOP and KE pages identified 239 AOPs and 503 individual KEs, respectively. Out of the identified KEs, 179 were considered relevant for mammalian reproductive toxicity. The relevant KEs were included in 104 AOPs. In addition, 702 KERs were identified in the search of the KER pages, and 269 were considered relevant. The relevant KERs were included in 78 AOPs. By combining the lists of AOPs from the searches of the AOP, KE and KER pages, 261 unique AOPs were identified. Out of these, 57 were considered relevant for inclusion in an AOPN describing EAS-mediated reproductive toxicity (Figure 3).

Figure 3

Figure 3. Results for search of AOP wiki using key terms.

3.3 Combining results from manual screening and search using key terms

The list of AOPs identified by manual screening was compared to the search using key terms. The lists were identical except for one additional AOP (ID 476), which had been added to the AOP wiki after the manual screening and before the key term search. Checking of recently added AOPs identified one additional relevant AOP that had been added to the AOP wiki after the key term search (ID 477). This resulted in inclusion of in total 58 AOPs (Figure 4).

Figure 4

Figure 4. Combining results from manual screening and search using key terms.

The final list of 58 AOPs is outlined in Table 1 and in Supplementary Material. Importantly, no assessment of completeness or reliability of the included AOPs was performed since the aim was to identify all relevant AOPs as a starting point for further analysis and development. As shown in Supplementary Material, only four of the AOPs have been endorsed by WPHA/WNT and three are under review.

Table 1

Table 1. Fifty-eight AOPs were identified as relevant from the AOP wiki.

3.4 Initial visualisation of the included AOPs in cytoscape

The 58 included AOPs and their connections to each other were visualised using Cytoscape. Manual analysis of the AOPs in Cytoscape showed 5 networks and 3 single AOPs not connected to any of the networks. Thirteen AOPs did not include any KERs and 3 AOPs included neither KEs nor KERs (Supplementary Material).

3.5 Identification and combination of similar KEs and KERs

Similar KEs in the included AOPs were identified based on information in the AOP wiki and expert judgement. Sixty-eight KEs were identified to be similar to a different KE and were combined in order to create the final AOPN (Table 2 and Supplementary Material). Thirty-five KERs were identified to be similar to a different KER (Table 3 and Supplementary Material).

Table 2

Table 2. Similar KEs that were combined to create the final AOPN.

Table 3

Table 3. Similar KERs in the final AOPN.

3.6 Visualisation of the final AOPN in cytoscape

The included AOPs before the combination of similar KEs included five networks and three single AOPs. Combination of the similar KEs connected the five networks and the three single AOPs resulted in a final large AOPN in Cytoscape that included all identified AOPs, except for the ones that did not have any KEs or KERs. Figure 5 gives on overview of the final AOPN (a high-resolution figure is provided in Supplementary Material). Table 4 summarises the AOPs, KEs and KERs in the final AOPN. The AOPs, KEs and KERs are listed in Supplementary Material.

Figure 5

Figure 5. Overview of the final AOPN. MIEs are shown in green, AOs in red and other KEs in blue. Subnetworks are labelled with numbers, see Table 5.

Table 4

Table 4. Summary of the final AOPN.

3.7 Subnetworks

Several subnetworks can be identified from the large AOPN (Table 5; Figure 5). Nine subnetworks describe effects on hormone levels or hormone activity, two subnetworks are related to cancer outcomes, three are related to the male reproductive system, one is related to the female reproductive system and one to overall effects on fertility and reproduction. The subnetworks include between 1-22 KEs and 1-20 AOPs each (Table 5). Specific KEs and AOPs in each subnetwork is in Supplementary information.

Table 5

Table 5. Subnetworks identified including the number of KEs and AOPs included in each subnetwork.

3.8 Identification of core blocks of knowledge in the AOPN

Overall, 26 KEs and 11 KERs were identified as core blocks of knowledge in the AOPN (Tables 6, 7; Supplementary Material). Only KEs and KERs relevant for mammalian reproductive toxicity were considered for identification of core blocks of knowledge.

Table 6

Table 6. Core KEs in the AOPN.

Table 7

Table 7. Core KERs in the AOPN.

3.9 Mapping of core blocks of knowledge in the AOPN to parameters in OECD and US EPA test guidelines

Out of the 26 KEs identified as core blocks of knowledge in the AOPN, 19 were found to be included as parameters in current OECD and US EPA test guidelines (Table 8).

Table 8

Table 8. Core KEs included in current OECD Guidelines for the testing of chemicals and US EPA test guidelines.

4 Discussion

This paper describes an AOPN for mammalian reproductive toxicity mediated by the EAS modalities. The construction of the network was based on a systematic inventory of the AOP wiki, where a total of 58 single AOPs were identified as relevant and 42 of these contained sufficient information to be connected into one large network. The network includes 23 MIEs, 22 AOs and 145 other KEs, demonstrating the complexity and interconnectivity of mammalian reproductive toxicity mediated by endocrine mechanisms. The AOPN provides a basis for different applications, such as the identification of needs for future development of KEs, AOs or KERs that are relevant for ED assessment but are currently missing. To this end, we made an initial organisation of the AOPN and identified several subnetworks that describe effects on different hormone pathways and on specific AOs, including effects on male and female reproduction and endocrine-related cancers. Additional filters can be added to the AOPN to refine it further for different applications, for example, to highlight areas of the network relevant for specific taxa or life stages (Knapen et al., 2018), or focus on AOs that are of specific relevance for a certain assessment.

We specifically used the AOPN to identify core KEs and KERs that are common for several existing AOPs and that may be considered central events in EAS-mediated reproductive toxicity. Out of the 26 identified core KEs, 19 are already included as parameters measured in current OECD and US EPA test guidelines, indicating that they are relevant for regulatory ED testing and assessment. Further analyses of the core events for which standard tests are lacking are needed to ascertain their relevance, as well as the practicality and feasibility of measuring them, before any recommendations can be made regarding development and standardization of new tests. Additional potential applications of the AOPN include use as a framework for investigating connections between different pathways within the network that can influence effects in target organs, as well as for assessing combined effects of mixtures containing EDs.

A rigorous multi-step process was developed to identify relevant AOPs for inclusion in the network. This methodology should be useful for creating other AOPNs. It includes searches of the AOP wiki by two different methods, i.e., manually screening each AOP in the wiki by two reviewers and searching the wiki pages using pre-defined search terms, carried out by one reviewer. The results were then cross-checked by a third party and discussed until consensus was reached. Both methods identified the same AOPs in this case and it may seem unnecessarily complex to do both. However, exploring both methods is merited from a wider perspective. Manual review of each AOP in the wiki by an expert can reduce the risk of missing potentially relevant AOPs, as well as prevent the inclusion of irrelevant or unsuitable AOPs. The current AOP wiki is small enough to allow for a manual screening process. As more AOPs are added in the future, however, an efficient search methodology using key terms will be necessary. One limitation in searching the AOP wiki using key terms is that the present format of the wiki does not allow for applying strategies to search for several key terms or phrases simultaneously. Instead, the separate AOP, KE and KER pages must be searched individually using all search terms; a time-consuming process that also increases the risk for potential errors. Future developments to the AOP wiki should enable efficient search strategies to make more efficient use of all the available information (Wiklund et al., 2023).

The identification of AOPs for inclusion in the network relied to a significant extent on expert judgment regarding the relevance of specific AOPs (or parts of AOPs) for describing EAS-mediated reproductive toxicity. For example, the screening of the AOP wiki initially resulted in several differences in the AOPs identified as relevant by the two reviewers, which had to be resolved by discussions. It is therefore likely that AOPNs created by different people will identify slightly different AOPNs, even if developed for the same toxicity outcome(s). This underscores the importance of applying a structured approach and transparent reporting.

To visualize the AOPN, we used a computational workflow to automatically process, filter, and format the AOP data for use in Cytoscape (Wiklund et al., 2023). Visualization in Cytoscape allowed us to identify KEs that were similar or identical, as well as KE(R)s that were missing or incorrectly described in the wiki. The automated workflow facilitates updating and regenerating networks once such issues have been resolved, as it standardises and speeds up the process. Here, similar KEs were combined by reviewing the similarity between KE titles and descriptions, and application of expert judgment. This approach was considered appropriate for the purposes of this project, but it should be noted that whenever this practice is used, it needs to be carefully considered to be fit for purpose to ensure that no critical information from individual KE descriptions is lost. In this project the information in the AOP wiki for each combined KE will be analysed and used in further development of AOPs. Similarly, single KEs that were identified as relevant for this project, but were not part of an AOP, were excluded in the final AOPN but will be considered in during continued AOP(N) development.

New AOPs are continuously being added to the wiki and an additional manual screening of the AOP wiki was performed in August 2023 to identify any relevant AOPs that had been added after the initial AOP search. Four new relevant AOPs were identified: AOP 495 “Androgen receptor activation leading to prostate cancer,” AOP 496 “Androgen receptor agonism leading to reproduction dysfunction in zebrafish,” AOP 503 “Activation of uterine estrogen receptor-alfa leading to endometrial adenocarcinoma, via epigenetic modulation,” and AOP 504 “SULT1E1 inhibition leading to uterine adenocarcinoma via increased estrogen availability at target organ level.” All four AOPs include some KEs and AOs that were not previously described in the AOPN and will be considered when the AOPN is further developed.

Other AOPNs describing perturbations to different endocrine pathways have recently been described, albeit for different purposes and with different scopes. Several studies describe the development of AOPNs containing novel pathways as an alternative to postulating single AOPs, for example, related to disrupted female pubertal onset (Franssen et al., 2022), male reproductive tract abnormalities (Palermo et al., 2021), and for effects on male and female reproductive function in fish (Ankley et al., 2023; Morshead et al., 2023). Others describe AOPNs for specific types of endocrine mediated toxicities and stressors, such as exploring male reproductive toxicity of silver nanoparticles (Kose et al., 2023) and inorganic arsenic (Chai et al., 2021), or the impact of phthalates on female reproduction (Pogrmic-Majkic et al., 2022). In contrast, the AOPN developed here combines existing AOPs related to mammalian reproductive toxicity and provides a broad view of mechanisms and effects related to disruption of the EAS modalities for the purpose of further AOP development. Similar networks have been described by Wiklund et al. (2023) and Ravichandran et al. (2022), however these works focus primarily on development of methods for AOPN construction, filtering, and analyses.

There are limitations that need to be considered when using this and other AOPNs for further scientific or regulatory applications. Importantly, many AOPs in the AOP wiki are not yet fully developed, peer-reviewed, or finally endorsed by the OECD. This is also reflected in the AOPs included in this network; only four of the AOPs have been endorsed by WPHA/WNT and three are currently under review, although many are mature with respect to their development status. Consequently, there is no guarantee that all AOPs included in a network are of sufficient quality to justify using them as basis for conclusions on toxicological hazards. Any information in the AOP wiki, including the AOPN described herein, must therefore be carefully assessed for reliability before the information is used for scientific or regulatory purposes. Such assessment has not yet been conducted for the AOPN we have elaborated here, and it should thus only be viewed as a starting point for further analyses and AOP developments, activities that are currently being conducted.

Another limitation of using AOPNs is that the AOP wiki does not include AOPs for all mechanisms and AOs relevant for different toxicities. Any AOPN must therefore be assumed to be missing information necessary to, for example, reliably identify all relevant core KE(R)s. Indeed, we acknowledge that there are several putative or complete AOPs relevant for EAS-mediated reproductive toxicity published in the open literature but not necessarily entered into the wiki. For example, there are several AOPs describing effects on spermatogenesis and the development of the male reproductive tract, as well as nipple retention in rodents, or prostate and testis tumours caused by androgen receptor (AR) antagonism, estrogen receptor (ER) agonism or reduced testosterone levels via different mechanisms such as inhibition of aromatase, oxidative stress, AhR signalling, and retinoic acid signalling (Christiansen et al., 2020; Draskau et al., 2020; Gray et al., 2020; Johnson et al., 2020; Kortenkamp, 2020; Yokel, 2020; Palermo et al., 2021; Silva da et al., 2021; Myden et al., 2022; Pedersen et al., 2022; Kose et al., 2023). A partial AOP for decreased gonadotropin-releasing hormone (GnRH) expression in hypothalamus leading to reduced testosterone production has been postulated (Lu et al., 2023). There are also published putative AOPs for female reproductive toxicity, including disrupted folliculogenesis and follicle maturation, decreased ovulation, disrupted puberty onset in girls, uterine tumours, and breast cancer causally linked to disrupted hypothalamic–pituitary–gonadal (HPG) axis signalling, ER activation, estrogen metabolism, and aromatase inhibition (Del’haye et al., 2022; Franssen et al., 2022; Hernandez-Jerez et al., 2023; Johansson et al., 2020; Myden et al., 2022; Wikoff et al., 2016). Apart from the challenge of finding AOPs published in the literature, such AOPs cannot be included in the AOPN using the computational automated process and must be manually added.

In conclusion, the AOPN developed here summarises AOPs for mammalian reproductive toxicity via disruption of the EAS modalities currently available in the wiki. It will form the basis for further research and AOP development, including deeper analyses of the subnetworks and core KE(R)s to identify specific areas of prioritization. Such future activities entail, for example, identifying central KERs and developing them further to increase the quantitative understanding, as well as analysing the extent to which EAS-mediated effects relevant for regulatory ED assessment are covered by current AOPs to inform further AOP development. The AOPN is being further refined and applied in ongoing projects with the aim to provide a more complete AOPN and practical examples showcasing how this methodology can be used to support the identification and assessment of EDs.

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Author contributions

JZ: Investigation, Methodology, Writing–original draft, Writing–review and editing. MD: Investigation, Writing–review and editing. HJ: Investigation, Writing–review and editing. TS: Writing–review and editing, Funding Acquisition. AB: Conceptualization, Investigation, Methodology, Supervision, Writing–original draft, Writing–review and editing, Funding Acquisition.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by a grant from the European Food Safety Authority (EFSA, grant agreement number GP/EFSA/PREV/2022/01).

Acknowledgments

The authors would like to thank Linus Wiklund, Karolinska Institutet for his help with generating the AOPN in Cytoscape.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/ftox.2024.1357717/full#supplementary-material

References

Ankley, G. T., Bennett, R. S., Erickson, R. J., Hoff, D. J., Hornung, M. W., Johnson, R. D., et al. (2010). Adverse outcome pathways: a conceptual framework to support ecotoxicology research and risk assessment. Environ. Toxicol. Chem. 29, 730–741. doi:10.1002/etc.34

PubMed Abstract | CrossRef Full Text | Google Scholar

Ankley, G. T., and Edwards, S. W. (2018). The adverse outcome pathway: a multifaceted framework supporting 21st century toxicology. Curr. Opin. Toxicol. 9, 1–7. doi:10.1016/j.cotox.2018.03.004

PubMed Abstract | CrossRef Full Text | Google Scholar

Ankley, G. T., Santana-Rodriguez, K., Jensen, K. M., Miller, D. H., and Villeneuve, D. L. (2023). AOP report: adverse outcome pathways for aromatase inhibition or androgen receptor agonism leading to male-biased sex ratio and population decline in fish. Environ. Toxicol. Chem. 42, 747–756. doi:10.1002/etc.5581

PubMed Abstract | CrossRef Full Text | Google Scholar

Audouze, K., Zgheib, E., Abass, K., Baig, A. H., Forner-Piquer, I., Holbech, H., et al. (2021). Evidenced-based Approaches to support the development of endocrine-mediated adverse outcome pathways: challenges and opportunities. Front. Toxicol. 3, 787017. doi:10.3389/ftox.2021.787017

PubMed Abstract | CrossRef Full Text | Google Scholar

Bajard, L., Adamovsky, O., Audouze, K., Baken, K., Barouki, R., Beltman, J. B., et al. (2023). Application of AOPs to assist regulatory assessment of chemical risks – case studies, needs and recommendations. Environ. Res. 217, 114650. doi:10.1016/j.envres.2022.114650

PubMed Abstract | CrossRef Full Text | Google Scholar

Beronius, A., Zilliacus, J., Hanberg, A., Luijten, M., van der Voet, H., and van Klaveren, J. (2020). Methodology for health risk assessment of combined exposures to multiple chemicals. Food Chem. Toxicol. 143, 111520. doi:10.1016/j.fct.2020.111520

PubMed Abstract | CrossRef Full Text | Google Scholar

Browne, P., Noyes, P. D., Casey, W. M., and Dix, D. J. (2017). Application of adverse outcome pathways to U.S. EPA’s endocrine disruptor screening Program. Environ. Health Perspect. 125, 096001. doi:10.1289/EHP1304

PubMed Abstract | CrossRef Full Text | Google Scholar

Chai, Z., Zhao, C., Jin, Y., Wang, Y., Zou, P., Ling, X., et al. (2021). Generating adverse outcome pathway (AOP) of inorganic arsenic-induced adult male reproductive impairment via integration of phenotypic analysis in comparative toxicogenomics database (CTD) and AOP wiki. Toxicol. Appl. Pharmacol. 411, 115370. doi:10.1016/j.taap.2020.115370

PubMed Abstract | CrossRef Full Text | Google Scholar

Christiansen, S., Axelstad, M., Scholze, M., Johansson, H. K. L., Hass, U., Mandrup, K., et al. (2020). Grouping of endocrine disrupting chemicals for mixture risk assessment - evidence from a rat study. Environ. Int. 142, 105870. doi:10.1016/j.envint.2020.105870

PubMed Abstract | CrossRef Full Text | Google Scholar

Delbes, G., Blázquez, M., Fernandino, J. I., Grigorova, P., Hales, B. F., Metcalfe, C., et al. (2022). Effects of endocrine disrupting chemicals on gonad development: mechanistic insights from fish and mammals. Environ. Res. 204, 112040. doi:10.1016/j.envres.2021.112040

PubMed Abstract | CrossRef Full Text | Google Scholar

Del’haye, G. G., Nulmans, I., Bouteille, S. P., Sermon, K., Wellekens, B., Rombaut, M., et al. (2022). Development of an adverse outcome pathway network for breast cancer: a comprehensive representation of the pathogenesis, complexity and diversity of the disease. Arch. Toxicol. 96, 2881–2897. doi:10.1007/s00204-022-03351-w

PubMed Abstract | CrossRef Full Text | Google Scholar

Draskau, M. K., Spiller, C. M., Boberg, J., Bowles, J., and Svingen, T. (2020). Developmental biology meets toxicology: contributing reproductive mechanisms to build adverse outcome pathways. Mol. Hum. Reprod. 26, 111–116. doi:10.1093/molehr/gaaa001

PubMed Abstract | CrossRef Full Text | Google Scholar

Duh-Leong, C., Maffini, M. V., Kassotis, C. D., Vandenberg, L. N., and Trasande, L. (2023). The regulation of endocrine-disrupting chemicals to minimize their impact on health. Nat. Rev. Endocrinol. 19, 600–614. doi:10.1038/s41574-023-00872-x

PubMed Abstract | CrossRef Full Text | Google Scholar

Duursen van, M. B. M., Boberg, J., Christiansen, S., Connolly, L., Damdimopoulou, P., Filis, P., et al. (2020). Safeguarding female reproductive health against endocrine disrupting chemicals—the FREIA project. IJMS 21, 3215. doi:10.3390/ijms21093215

PubMed Abstract | CrossRef Full Text | Google Scholar

European Chemical Agency (ECHA) and European, Food Safety Authority (EFSA) with the technical support of the Joint Research Centre (JRC), Andersson, N., Arena, M., Auteri, D., Barmaz, S., Grignard, E., Kienzler, A., et al. (2018). Guidance for the identification of endocrine disruptors in the context of Regulations (EU) No 528/2012 and (EC) No 1107/2009. EFSA J. 16 (6), e05311. doi:10.2903/j.efsa.2018.5311

PubMed Abstract | CrossRef Full Text | Google Scholar

European Commission (2017). Commission delegated regulation (EU) 2017/2100. Brussels: Publications Office of the European Union. Available from: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32017R2100&qid=1696765119217.

Google Scholar

European Commission (2018a). Commission regulation (EU) 2018/605. Brussels: Publications Office of the European Union. Available from: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32018R0605.

Google Scholar

European Commission (2018b). Towards a comprehensive European Union framework on endocrine disruptors EN. Brussels: Publications Office of the European Union. Available from: https://eur-lex.europa.eu/legal-content/en/TXT/?uri=CELEX%3A52018DC0734.

Google Scholar

European Commission (2020). The EU chemical strategy for sustainability towards a toxic-free environment. Brussels: Communication from the Commission. Available from: https://eur-lex.europa.eu/resource.html?uri=cellar:f815479a-0f01-11eb-bc07-01aa75ed71a1.0003.02/DOC_1&format=PDF.

Google Scholar

European Commission (2023). Commission delegated regulation (EU) 2023/707. Brussels: Publications Office of the European Union. Available from: https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:32023R0707&from=EN.

Google Scholar

European Parliament (2013). European Parliament resolution of 14 March 2013 on the protection of public health from endocrine disrupters (2012/2066(INI)). European Parliament. Available from: http://www.europarl.europa.eu/sides/getDoc.do?pubRef=-//EP//NONSGML+TA+P7-TA-2013-0091+0+DOC+PDF+V0//EN.

Google Scholar

European Parliament (2019). European Parliament resolution of 18 April 2019 on a comprehensive European Union framework on endocrine disruptors (2019/2683(RSP)). European Parliament. Available from: https://www.europarl.europa.eu/doceo/document/TA-8-2019-0441_EN.html.

Google Scholar

Franssen, D., Svingen, T., Lopez Rodriguez, D., Van Duursen, M., Boberg, J., and Parent, A.-S. (2022). A putative adverse outcome pathway network for disrupted female pubertal onset to improve testing and regulation of endocrine disrupting chemicals. Neuroendocrinology 112, 101–114. doi:10.1159/000515478

PubMed Abstract | CrossRef Full Text | Google Scholar

Gore, A. C., Chappell, V. A., Fenton, S. E., Flaws, J. A., Nadal, A., Prins, G. S., et al. (2015). EDC-2: the endocrine society’s second scientific statement on endocrine-disrupting chemicals. Endocr. Rev. 36, E1–E150. doi:10.1210/er.2015-1010

PubMed Abstract | CrossRef Full Text | Google Scholar

Gray, L. E., Furr, J. R., Lambright, C. S., Evans, N., Hartig, P. C., Cardon, M. C., et al. (2020). Quantification of the uncertainties in extrapolating from in vitro androgen receptor antagonism to in vivo hershberger assay endpoints and adverse reproductive development in male rats. Toxicol. Sci. 176, 297–311. doi:10.1093/toxsci/kfaa067

PubMed Abstract | CrossRef Full Text | Google Scholar

Hernandez-Jerez, A. F., Adriaanse, P., Aldrich, A., Berny, P., Coja, T., Duquesne, S., et al. (2023). Development of adverse outcome pathways relevant for the identification of substances having endocrine disruption properties Uterine adenocarcinoma as adverse outcome. EFSA J. 21, e07744. doi:10.2903/j.efsa.2023.7744

PubMed Abstract | CrossRef Full Text | Google Scholar

Johansson, H. K. L., Damdimopoulou, P., van Duursen, M. B. M., Boberg, J., Franssen, D., de Cock, M., et al. (2020). Putative adverse outcome pathways for female reproductive disorders to improve testing and regulation of chemicals. Arch. Toxicol. 94, 3359–3379. doi:10.1007/s00204-020-02834-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Johnson, K. J., Passage, J., Lin, H., Sriram, S., and Budinsky, R. A. (2020). Dioxin male rat reproductive toxicity mode of action and relative potency of 2,3,7,8-tetrachlorodibenzo-p-dioxin and 2,3,7,8-tetrachlorodibenzofuran characterized by fetal pituitary and testis transcriptome profiling. Reprod. Toxicol. 93, 146–162. doi:10.1016/j.reprotox.2020.02.008

PubMed Abstract | CrossRef Full Text | Google Scholar

Knapen, D., Angrish, M. M., Fortin, M. C., Katsiadaki, I., Leonard, M., Margiotta-Casaluci, L., et al. (2018). Adverse outcome pathway networks I: development and applications. Enviro Toxic Chem. 37, 1723–1733. doi:10.1002/etc.4125

PubMed Abstract | CrossRef Full Text | Google Scholar

Kortenkamp, A. (2020). Which chemicals should be grouped together for mixture risk assessments of male reproductive disorders? Mol. Cell Endocrinol. 499, 110581. doi:10.1016/j.mce.2019.110581

PubMed Abstract | CrossRef Full Text | Google Scholar

Kose, O., Mantecca, P., Costa, A., and Carrière, M. (2023). Putative adverse outcome pathways for silver nanoparticle toxicity on mammalian male reproductive system: a literature review. Part Fibre Toxicol. 20, 1. doi:10.1186/s12989-022-00511-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Lu, T., Mortimer, M., Li, F., Li, Z., Chen, L., Li, M., et al. (2023). Putative adverse outcome pathways of the male reproductive toxicity derived from toxicological studies of perfluoroalkyl acids. Sci. Total Environ. 873, 162439. doi:10.1016/j.scitotenv.2023.162439

PubMed Abstract | CrossRef Full Text | Google Scholar

Marlatt, V. L., Bayen, S., Castaneda-Cortès, D., Delbès, G., Grigorova, P., Langlois, V. S., et al. (2022). Impacts of endocrine disrupting chemicals on reproduction in wildlife and humans. Environ. Res. 208, 112584. doi:10.1016/j.envres.2021.112584

PubMed Abstract | CrossRef Full Text | Google Scholar

Morshead, M. L., Jensen, K. M., Ankley, G. T., Vliet, S., LaLone, C. A., Aller, A. V., et al. (2023). Putative adverse outcome pathway development based on physiological responses of female fathead minnows to model estrogen versus androgen receptor agonists. Aquat. Toxicol. 261, 106607. doi:10.1016/j.aquatox.2023.106607

PubMed Abstract | CrossRef Full Text | Google Scholar

Myden, A., Hill, E., and Fowkes, A. (2022). Using adverse outcome pathways to contextualise (Q)SAR predictions for reproductive toxicity - a case study with aromatase inhibition. Reprod. Toxicol. 108, 43–55. doi:10.1016/j.reprotox.2022.01.004

PubMed Abstract | CrossRef Full Text | Google Scholar

OECD (2017). Guidance document for the use of adverse outcome pathways in developing integrated Approaches to testing and assessment (IATA). OECD series on testing and assessment. Paris: OECD Publishing. doi:10.1787/44bb06c1-en

CrossRef Full Text | Google Scholar

OECD (2023). AOP Developers' handbook supplement to the guidance document for developing and assessing adverse outcome pathways (AOPs) [ENV/JM/MONO(2013)6, second edition]. Available from: https://aopwiki.org/handbooks/4.

Google Scholar

Palermo, C. M., Foreman, J. E., Wikoff, D. S., and Lea, I. (2021). Development of a putative adverse outcome pathway network for male rat reproductive tract abnormalities with specific considerations for the androgen sensitive window of development. Curr. Res. Toxicol. 2, 254–271. doi:10.1016/j.crtox.2021.07.002

PubMed Abstract | CrossRef Full Text | Google Scholar

Pedersen, E. B., Christiansen, S., and Svingen, T. (2022). AOP key event relationship report: linking androgen receptor antagonism with nipple retention. Curr. Res. Toxicol. 3, 100085. doi:10.1016/j.crtox.2022.100085

PubMed Abstract | CrossRef Full Text | Google Scholar

Pogrmic-Majkic, K., Samardzija Nenadov, D., Tesic, B., Fa Nedeljkovic, S., Kokai, D., Stanic, B., et al. (2022). Mapping DEHP to the adverse outcome pathway network for human female reproductive toxicity. Arch. Toxicol. 96, 2799–2813. doi:10.1007/s00204-022-03333-y

PubMed Abstract | CrossRef Full Text | Google Scholar

Ravichandran, J., Karthikeyan, B. S., and Samal, A. (2022). Investigation of a derived adverse outcome pathway (AOP) network for endocrine-mediated perturbations. Sci. Total Environ. 826, 154112. doi:10.1016/j.scitotenv.2022.154112

PubMed Abstract | CrossRef Full Text | Google Scholar

Rodprasert, W., Toppari, J., and Virtanen, H. E. (2021). Endocrine disrupting chemicals and reproductive health in boys and men. Front. Endocrinol. 12, 706532. doi:10.3389/fendo.2021.706532

PubMed Abstract | CrossRef Full Text | Google Scholar

Schwartz, C. L., Christiansen, S., Hass, U., Ramhøj, L., Axelstad, M., Löbl, N. M., et al. (2021). On the use and interpretation of areola/nipple retention as a biomarker for anti-androgenic effects in rat toxicity studies. Front. Toxicol. 3, 730752. doi:10.3389/ftox.2021.730752

PubMed Abstract | CrossRef Full Text | Google Scholar

Schwartz, C. L., Christiansen, S., Vinggaard, A. M., Axelstad, M., Hass, U., and Svingen, T. (2019). Anogenital distance as a toxicological or clinical marker for fetal androgen action and risk for reproductive disorders. Arch. Toxicol. 93, 253–272. doi:10.1007/s00204-018-2350-5

PubMed Abstract | CrossRef Full Text | Google Scholar

Sharma, A., Mollier, J., Brocklesby, R. W. K., Caves, C., Jayasena, C. N., and Minhas, S. (2020). Endocrine-disrupting chemicals and male reproductive health. Reprod Med. Biol. 19, 243–253. doi:10.1002/rmb2.12326

PubMed Abstract | CrossRef Full Text | Google Scholar

Silva da, J., Gonçalves, R. V., de Melo, F. C. S. A., Sarandy, M. M., and da Matta, S. L. P. (2021). Cadmium exposure and testis susceptibility: a systematic review in murine models. Biol. Trace Elem. Res. 199, 2663–2676. doi:10.1007/s12011-020-02389-0

PubMed Abstract | CrossRef Full Text | Google Scholar

Svingen, T., Schwartz, C. L., Rosenmai, A. K., Ramhøj, L., Johansson, H. K. L., Hass, U., et al. (2022). Using alternative test methods to predict endocrine disruption and reproductive adverse outcomes: do we have enough knowledge? Environ. Pollut. 304, 119242. doi:10.1016/j.envpol.2022.119242

PubMed Abstract | CrossRef Full Text | Google Scholar

Villeneuve, D. L., Angrish, M. M., Fortin, M. C., Katsiadaki, I., Leonard, M., Margiotta-Casaluci, L., et al. (2018). Adverse outcome pathway networks II: network analytics. Enviro Toxic Chem. 37, 1734–1748. doi:10.1002/etc.4124

PubMed Abstract | CrossRef Full Text | Google Scholar

Villeneuve, D. L., Crump, D., Garcia-Reyero, N., Hecker, M., Hutchinson, T. H., LaLone, C. A., et al. (2014). Adverse outcome pathway (AOP) development I: strategies and principles. Toxicol. Sci. 142, 312–320. doi:10.1093/toxsci/kfu199

PubMed Abstract | CrossRef Full Text | Google Scholar

WHO (World Health Organization)/IPCS (International Programme on Chemical Safety). 2002. Global assessment on the state of the science of endocrine disruptors. World Health Organization. Available from: https://iris.who.int/handle/10665/67357.

Google Scholar

WHO (World Health Organization)/UNEP (United Nations Environment Programme) (2013). in The state-of-the-science of endocrine disrupting chemicals - 2012. Editors Å. Bergman, J. J. Heindel, S. Jobling, K. A. Kidd, and R. T. Zoeller (Geneva: UNEP/WHO). Available from: https://www.who.int/publications/i/item/9789241505031.

Google Scholar

Wiklund, L., Caccia, S., Pípal, M., Nymark, P., and Beronius, A. (2023). Development of a data-driven approach to Adverse Outcome Pathway network generation: a case study on the EATS-modalities. Front. Toxicol. 5, 1183824. doi:10.3389/ftox.2023.1183824

PubMed Abstract | CrossRef Full Text | Google Scholar

Wikoff, D. S., Rager, J. E., Haws, L. C., and Borghoff, S. J. (2016). A high dose mode of action for tetrabromobisphenol A-induced uterine adenocarcinomas in Wistar Han rats: a critical evaluation of key events in an adverse outcome pathway framework. Regul. Toxicol. Pharmacol. 77, 143–159. doi:10.1016/j.yrtph.2016.01.018

PubMed Abstract | CrossRef Full Text | Google Scholar

Yokel, R. A. (2020). Aluminum reproductive toxicity: a summary and interpretation of scientific reports. Crit. Rev. Toxicol. 50, 551–593. doi:10.1080/10408444.2020.1801575

PubMed Abstract | CrossRef Full Text | Google Scholar

You, H. H., and Song, G. (2021). Review of endocrine disruptors on male and female reproductive systems. Comp. Biochem. Physiology Part C Toxicol. Pharmacol. 244, 109002. doi:10.1016/j.cbpc.2021.109002

CrossRef Full Text | Google Scholar