- 1Research Department, Qualiblood s.a., Namur, Belgium
- 2Faculty of Medicine, Department of Pharmacy, Namur Research Institute for Life Sciences (NARILIS), Namur Thrombosis and Hemostasis Center (NTHC), University of Namur, Namur, Belgium
- 3Department of Obstetrics and Gynecology, University of Liège, Liège, Belgium
Many factors must be considered and discussed with women when initiating a contraceptive method and the risk of venous thromboembolism (VTE) is one of them. In this review, we discuss the numerous strategies that have been implemented to reduce the thrombotic risk associated with combined oral contraceptives (COCs) from their arrival on the market until today. Evidences suggesting that COCs were associated with an increased risk of VTE appeared rapidly after their marketing. Identified as the main contributor of this risk, the dosage of the estrogen, i.e., ethinylestradiol (EE), was significantly reduced. New progestins were also synthetized (e.g., desogestrel or gestodene) but their weak androgenic activity did not permit to counterbalance the effect of EE as did the initial progestins such as levonorgestrel. Numerous studies assessed the impact of estroprogestative combinations on hemostasis and demonstrated that women under COC suffered from resistance towards activated protein C (APC). Subsequently, the European Medicines Agency updated its guidelines on clinical investigation of steroid contraceptives in which they recommended to assess this biological marker. In 2009, estradiol-containing COCs were marketed and the use of this natural form of estrogen was found to exert a weaker effect on the synthesis of hepatic proteins compared to EE. In this year 2021, a novel COC based on a native estrogen, i.e., estetrol, will be introduced on the market. Associated with drospirenone, this preparation demonstrated minor effects on coagulation proteins as compared with other drospirenone-containing COCs. At the present time, the standard of care when starting a contraception, consists of identifying the presence of hereditary thrombophilia solely on the basis of familial history of VTE. This strategy has however been reported as poorly predictive of hereditary thrombophilia. One rationale and affordable perspective which has already been considered in the past could be the implementation of a baseline screening of the prothrombotic state to provide health care professionals with objective data to support the prescription of the more appropriate contraceptive method. While this strategy was judged too expensive due to limited laboratory solutions, the endogenous thrombin potential-based APC resistance assay could now represent an interesting alternative.
Manuscript
When oral contraceptives became generally available during the early 1960s, their use rapidly increased and in 2019, it was estimated that over 150 million women were using the pill worldwide (1). With such a large number of subjects on this medication, and with a majority using combined estrogen-progestin products, even a small increase in risk of serious side effects affects the lives of many women. Moreover, as contraceptive therapies are administered to healthy young women with the aim to prevent unwanted pregnancies, the occurrence of side effects should be as low as possible and risk minimization strategies should be implemented accordingly.
Introduction: The History of Combined Oral Contraceptives
Evidence suggesting that oral contraceptives were associated with an increased risk of venous thromboembolism events (VTE) appeared rapidly after they were marketed (Figure 1). The first case of VTE was reported in 1961 in a 40-year-old woman who had been given Enovid®, an association of 150 µg of mestranol and 10 mg of norethynodrel for the control of endometriosis (2, 3). This association of an estrogen with a progestogen marked the beginning of the combined hormonal contraceptives (CHCs) era which were initially only given by the oral route. In the subsequent years, it was reported that the occurrence of VTE was higher with combined oral contraceptives (COCs) containing more than 50 µg of estrogen, either mestranol or ethinylestradiol (EE), compared to preparations containing a lower dosage (4). Following the publication of these reports, the British Committee on Safety of Drugs, one of the leading instance for drug safety at that period, issued, in 1969, a statement indicating that the dose of estrogen contained in oral contraceptives was positively associated with an increased risk of VTE (5). The dosage of estrogen was then reduced from 75 µg, or more, to 50 µg and afterwards to 30 and 20 µg. At the present time, some COCs even contain 10 µg of EE (e.g., Lo-Loestrin® Fe) (6). Comparisons of COCs containing 50 and 30 µg of EE on blood coagulation, fibrinolysis and platelets confirmed the estrogen dose-dependent effect. Enhanced platelet activity, increased levels of factor II, VII, VIII, IX and X, fibrinogen and soluble fibrin and decreased levels of antithrombin (AT) and vessel wall fibrinolytic activator were observed with both preparations, but they were less pronounced with 30 µg COC preparations (3, 6–8) (Figure 2).
Figure 1 The history of combined oral contraceptive (COC) and the related risk of venous thromboembolism (VTE). Discovery of estrogen and progestin compound (in orange) - marketing authorization for combined oral contraceptives (in red) – authorities’ statement (in blue) – assay development (in green). APC, activated protein C resistance; aPTT, activated partial thromboplastin time; CHMP, Committee for Medicinal Products for Human Use; CHC, combined hormonal contraceptives; CMA, chlormadinone acetate; COC, combined oral contraceptives; CPA, cyproterone acetate; DNG, dienogest; DRSP, drospirenone; DSG, desogestrel; EE, ethinylestradiol; EMA, European Medicines Agency; ETP, endogenous thrombin potential; E2, 17β-estradiol; E2V, estradiol valerate; E4, estetrol; GSD, gestodene; LNG, levonorgestrel; NETA, norethisterone acetate; NGM, norgestimate; NOMAC, nomegestrol acetate; PRAC, Pharmacovigilance Risk Assessment Committee; VTE, venous thromboembolism event.
Figure 2 Coagulation, fibrinolytic and anticoagulant systems. The green rectangle refers to the coagulation system, the blue rectangle refers to the fibrinolytic system and the red rectangle refers to the anticoagulant system. Tissue factor (TF) plays an important role in the initiation of the coagulation process. Combined with activated factor VII, the complex activates FIX and FX. Subsequently, FIXa and FXa form two complexes with activated FV and activated FVIII respectively, leading to the conversion of prothrombin into thrombin. Once formed, thrombin cleaves fibrinogen to form the fibrin clot which is then degraded by the fibrinolytic system whose the main effector is plasmin. This releases fibrin degradation products and D-dimers. Thrombin also activates the protein C system in order to down regulate its own production. Indeed, once activated by thrombin, protein C forms a complex with protein S in order to inactivate factor Va and factor VIIIa, the two main co-factors of the intrinsic (IXa-VIIIa) and the prothrombinase (Xa-Va) complexes. The generation of thrombin is also regulated by other protease inhibitors like antithrombin (AT) and tissue factor pathway inhibitor, widely known as TFPI. Inherited and acquired thrombophilia can disrupt the coagulation, the fibrinolytic or the anticoagulant system leading to an increased risk of venous thromboembolism. Coagulation factors impacted by inherited thrombophilia are marked with the DNA-symbol and those impacted by the intake of combined oral contraceptives (COC) are marked with the drug-symbol. APC, activated protein C; TF, tissue factor; TFPI, tissue factor pathway inhibitor.
The progestogen compound found in oral contraceptives also changed over time with several pharmacomodulations aiming at providing different estrogenic, androgenic, glucocorticoid or mineralocorticoid profiles (9). Indeed, endogenous progesterone, synthetized in the ovarian corpus luteum, possesses antiestrogenic, antiandrogenic and antimineralocorticoid activities. Thus, synthetic progestogens used for contraception also mimicked some of these properties (10). Overall, these compounds are characterized by a 4-ring steroid skeleton and are classified based on their structure (Table 1). The first progestogens, synthetized in 1951, were norethynodrel and norethisterone acetate (also known as norethindrone acetate). They are characterized by a 19-nortestosterone structure and are regarded as estranes (carbon-18). Shortly afterwards, in 1959, 17-hydroxyprogesterone derivatives categorized as pregnanes (carbon-21) were also synthetized. These included chlormadinone acetate and cyproterone acetate. In 1966, other 19-nortestosterone derivatives were discovered with norgestrel and levonorgestrel but differed from norethynodrel and norethisterone acetate as they possess a 17-carbon structure. They are better known as gonanes. During the 1980s, three new progestogens, derived from levonorgestrel, were developed, that are desogestrel, gestodene and norgestimate. Drospirenone, dienogest and nomegestrol acetate are, for their part, considered to be the new progestogens. They were designed to bind more specifically to the progestogen receptors and to a lesser extent to the other steroid receptors in order to reduce undesirable effects. Regarding their structure, dienogest is a gonane derivative, nomegestrol acetate is a norpregnane (carbon-20) derivative and drospirenone is unique in its category and derivates from spironolactone (11–15) (Table 1). Combined oral contraceptives were usually classified into three generations, related to their arrival on the market. First generation contained high doses of EE (50 µg or more) associated with norethynodrel and with norethisterone acetate. They are no longer used in COC preparations. Second and third generations contain a lower dose of EE (20 or 30 µg). The associated progestogen is levonorgestrel in 2nd generation COCs and desogestrel, gestodene or norgestimate in 3rd generation COCs. Actually, this nomenclature was introduced by the pharmaceutical companies with the aim of boosting sales since the idea of a “new” generation suggests improvements and better efficacy and/or safety profile, the two latter being not supported by epidemiological data (16). This misleading classification led to inconsistencies like norgestimate-contained COC, categorized as 3rd generation, which is in fact a prodrug of levonorgestrel and its 3-oxime metabolite, renamed norelgestromin by the pharmaceutical company (17). Although it is tempting to turn then to a chemical classification, this is not the Holy Grail since among compounds with nearly similar chemical structure, e.g. levonorgestrel and gestodene, the pharmacodynamic action when binding to the different steroid receptors may differ (18). Therefore, a pharmacodynamic classification should be preferred considering the activities of the progestogen when associated with an estrogen, the potency of the latter being determinant for the total estrogenicity of the association.
Table 1 Progestogens - Discovery, chemical structure, androgenic activity, associated estrogen compound in combined oral contraceptives (COC) and classification under generation.
Discussion
Third Generation and New Oral Contraceptives Controversy
Going back into the 80s, the main reason that led to the development of new progestogens was related to the side effects induced by the combination of EE with levonorgestrel or norethisterone acetate, such as acne, hirsutism and weight gain (19). The decreased androgenic activity of desogestrel, gestodene and norgestimate has certainly permitted to reduce these adverse effects. However, an increased risk of VTE was observed compared to levonorgestrel as reported by 4 independent epidemiological studies in 1995-1996 (20–23). Although these results had been debated due to possible impact of confounding factors and bias, such as healthy user bias, introduction bias, duration of oral contraceptive use, COC switching, prescribing bias, diagnosis suspicion and referral bias or the source of funding, the increased risk with these progestogens has been subsequently confirmed by other investigations (24–29). As earlier studies suggested that the increased risk of VTE associated with COCs was only estrogen dose-dependent, the most plausible explanations at that time were these biases. Nevertheless, the meta-analysis of Kemmeren et al. published in 2001, revealed that even after stratifying for various factors like first time user; age, (i.e. younger and older than 25 years); duration of use, (i.e. less or more than 1 year); confirmation status of VTE cases and source of funding, (i.e. industry or non-industry sponsored study); the risk remained more elevated with the so-called 3rd generation COCs compared to the 2nd generation COCs (30).
This phenomenon was also observed with COCs containing EE associated with drospirenone and cyproterone acetate. Unlike levonorgestrel, desogestrel, gestodene and norgestimate, the latter two progestins are completely devoid of any androgenic or glucocorticoid effects (31). Cyproterone acetate possesses even the highest antiandrogenic activity which makes this molecule the ideal candidate to treat severe acne and hirsutism in women (18). Drospirenone, on the other hand, differs from the other progestogen by its chemical structure derived from spironolactone conferring an antimineralocorticoid activity. This allows to offset the fluid retention induced by estrogens and prevent weight gain during COC therapy (32). The development of these two progestogens with antiandrogenic and antimineralocorticoid properties provided us with compounds closer to progesterone permitting the reduction of the above-mentioned adverse effects but on the flip side of the coin, they clearly led to an increased risk of VTE when associated with EE (33, 34).
As evidence demonstrated that COCs with the same estrogen dose but different progestogens were associated with differential VTE risk, it was suggested that the progestogen compound might play a role in thrombosis development. However, as progestin only contraceptives do not interfere with coagulation protein synthesis, the difference in VTE risk specific to each COC could only be attributed to a distinctive modulation of the procoagulant effect of EE, exerted by the progestogens (35, 36). This modulation is actually related to the activity of the progestogen compound on hormonal receptors and especially on androgen receptors (37). Levonorgestrel, characterized by a strong androgenic activity, balances out to a certain degree the estrogen-dependent alteration in hemostasis and hepatic protein synthesis. Consequently, levonorgestrel further offsets the procoagulant effect induced by EE compared to desogestrel, gestodene, norgestimate, drospirenone and cyproterone acetate, which have a weaker androgenic or even an antiandrogenic activity (11, 14, 18). An interaction between androgen receptors and estrogens responsive elements could be a hypothesis to explain this phenomenon (38). It could prevent the activation of target genes coding for hepatic proteins such as coagulation factors, thus modulating the effect of EE (38). Ultimately, the estrogenicity of a COC is the sum of both the estrogen and the progestogen contribution and excessive estrogenicity was reported to increase the risk of VTE (Figure 3) (39). The biomarker that best reflects the estrogenicity is the sex hormone binding globulin (SHBG), a carrier protein for estrogen and testosterone, produced by the liver, and whose synthesis is highly estrogen sensitive (39). The oral intake of EE alone leads to a significant dose-dependent increase in SHBG whereas progestogens induce a decrease of SHBG, the extent being dependent of its androgenic activity (39). Thus, progestogens with a potent androgenic activity cause a more pronounced reduction in SHBG levels than less androgenic or antiandrogenic ones. As a consequence, the so-called 3rd generation COCs and those containing EE combined with drospirenone or cyproterone acetate induce a drastic increase in SHBG levels compared to the so-called 2nd generation COCs (39–41).
Figure 3 Concept of estrogenicity with combined oral contraceptives. CMA, chlormadinone acetate; CPA, cyproterone acetate; DNG, dienogest; DRSP, drospirenone; DSG, desogestrel; EE, ethinylestradiol; E2, estradiol; E2V, estradiol valerate; E4, estetrol; GSD, gestodene; LNG, levonorgestrel; NETA, norethisterone acetate; NGM, norgestimate; NOMAC, nomegestrol acetate.
As a relationship has been observed between SHBG levels and the increased risk of VTE associated with COC use, the assessment of this liver protein represents an important biomarker to consider during the development of steroid contraceptives (42, 43). However, SHBG is not a coagulation protein and other biological variables better reflecting the impact of COCs on hemostasis would seem more appropriate to reflect the potential induced prothrombotic switch (44).
Acquired Activated Protein C Resistance With Oral Contraceptives: A Key Factor in Venous Thromboembolism Risk
In the 1990s, it was estimated that VTE affected 1 per 1,000 people annually, and that family history of thrombosis was often found in these patients (45). However, the main inherited thrombophilia investigated at that time such as deficiency of antithrombin, protein C and protein S accounted for only 5- to 10% of the cases (45). This suggested that other genetic defects predisposed to the development of VTE and had yet to be identified. In 1993, Dahlbäck et al. started to investigate the protein C - protein S anticoagulant pathway (46). They developed an activated partial thromboplastin time (aPTT)-based method to determine the sensitivity of a patient’s plasma towards exogenous activated protein C (APC). The aPTT assay is based on the principle that in citrated plasma, the addition of phospholipids, activator of factor XII (e.g., silica) and calcium chloride allow for formation of a stable clot. The time from activation to formation of a stable clot is recorded in seconds, and represents the aPTT (47). After the addition of APC, they noted that plasma from patients with thrombosis and family history of thrombosis had a shorter prolongation of the aPTT clotting time compared with plasma from healthy individuals (46). Therefore, as APC is expected to delay the aPTT in normal plasma, due to its ability to inactivate factor Va and VIIIa, the observed phenomenon was defined as APC resistance. To ease the expression of results, an APC sensitivity ratio, defined as the aPTT (+APC) divided by the aPTT (-APC), was calculated and is depicted in equation 1:
The more resistant a sample is to APC, the lower the numerator (+APC condition) compared to the denominator (-APC condition) and therefore the closer the ratio is to zero (48). These findings were confirmed by others (49, 50) and the phenotype of APC resistance was latter associated with a mutation in the coding region of factor V, better known as Factor V Leiden mutation (51). This mutation abolishes one of the APC-cleavage sites on FVa which leads to a slowdown inactivation of FVa. This further prevents FVa to be converted into a functional APC cofactor needed for FVIIIa inactivation and, as a consequence, the inactivation of both FVa and FVIIIa are delayed (52). The discovery of this genetic mutation indirectly permitted to better understand the etiology of COC-induced VTE events. Indeed, many patients were found to have a resistance to APC without carrying a FV Leiden mutation, suggesting either the existence of other genetic mutations or the existence of acquired factors capable of interfering with the inhibitory activity of APC (51). In the study of Koster et al. healthy men had a more pronounced anticoagulant response to APC than women, suggesting a possible influence of female sexual hormones (49). It was then assumed that a poor response to APC could explain, at least in part, the procoagulant state observed in users of oral contraceptives. This was confirmed in 1995 by Henkens et al. and Olivieri et al. who demonstrated that COC therapy could induce acquired APC resistance independently from genetic mutation of the factor V Leiden (53, 54). Although these results were tremendous and important to support the observed increased risk of VTE with COCs and conditions leading to APC resistance, other tests which account for the entire coagulation process were developed.
In 1997, Nicolaes et al. reported on a new method based on the continuous measurement of thrombin generation over time, in the presence and absence of exogenous APC (55). Thrombin generation assay (TGA) is based on the potential of a plasma to generate thrombin over time, after activation of coagulation by addition of phospholipids, tissue factor and calcium. The resulting thrombin generation curve reflects all the pro- and -anticoagulant reactions that regulate both thrombin formation and inhibition. In contrast to the aPTT assay, which only assesses the initiation phase of the coagulation, TGA is a global assay investigating the initiation, the propagation and the termination phase of the coagulation. The addition of APC induces a lowering of thrombin generation which is quantitated by the endogenous thrombin potential (ETP), corresponding to the area under the thrombin generation curve (Figure 4). This test was therefore referred as the ETP-based APC resistance assay and results were expressed as normalized APC sensitivity ratio (nAPCsr). This unit corresponds to the ratio of the ETP measured in presence and absence of APC divided by the same ratio determined in a reference plasma (Equation 2).
Figure 4 Thrombin generation curves in absence (continuous line) and in presence of APC (dotted lines) of a healthy pooled plasma (blue) and women using combined oral contraceptives containing either ethinylestradiol (EE) with drospirenone (green), EE with desogestrel (yellow), EE with levonorgestrel (red), or estetrol with drospirenone (pink). The area under the curve represents the endogenous thrombin potential (ETP) parameter. In presence of APC, the ETP is higher with the use of combined oral contraceptives (e.g., drospirenone or desogestrel) compared to the healthy pooled plasma (composed of men and women not using hormonal contraception), leading to a resistance towards the APC. APC, activated protein C; DRSP, drospirenone; DSG, desogestrel; EE, ethinylestradiol; E4, estetrol; HPP, healthy pooled plasma; LNG, levonorgestrel.
The obtained ratio stands between 0 and 10 and conversely to the aPTT-based assay, the higher the nAPCsr, the more resistant the patient is to APC. A comparison between both tests is shown in Table 2.
Depending on the test used, i.e., aPTT-based or ETP-based APC resistance assay, the differences observed between non-users and COC users were not the same. The ETP-based APC resistance assay revealed to be more sensitive to COC impact on hemostasis and significant differences were observed between COC preparations (e.g., levonorgestrel-containing product versus desogestrel- or gestodene-containing product) (Figure 4) (56, 57). Indeed, these two assays are not sensitive to the same factors: the aPTT-based assay is more sensitive towards levels of prothrombin and FVIII while the ETP-based assay is most influenced by free tissue factor pathway inhibitor (TFPI) and free protein S levels (58). As these latter factors are much more impacted by COCs than the two formers, it may in part explain the inconsistent results between these two functional APC resistance assays (59, 60). Following the widespread use of this biomarker to evaluate the increased risk of VTE associated with COCs in the early 2000s, the Committee for Medicinal Products for Human Use (CHMP) of the European Medicines Agency (EMA) stated, in 2005, that APC resistance should be investigated during the development of new steroid contraceptives (42). Nevertheless, the lack of standardization of this method has remained a problem for many years, and this has been reflected in highly variable results from one study to another, as depicted in Figure 5. Recently, Douxfils et al. developed and validated a new ETP-based APC resistance method aiming to provide a harmonized scale of nAPCsr. This permits to reduce the inter-laboratory variability and allowed lab-to-lab and study-to-study comparison and evaluation (61). In addition, the typical information obtained by thrombin generation investigation is available, providing much more information than the APC resistance itself. As it enables the assessment of the global coagulation process, this assay is also sensitive towards other factors of thrombogenicity like the prothrombin G20210A mutation, antithrombin and protein S deficiencies or FVIII levels (62–65). The ETP-based APC resistance assay may thus provide information on hemostatic functions which are linked to an increased risk of thrombosis to help the prescriber in clinical decision making.
Figure 5 Synthesis of studies from 1997 to 2020 investigating the impact of oral contraceptives on the activated protein C (APC) resistance, when expressed as normalized APC sensitivity ratio (nAPCsr). The X-axis represents nAPCsr in absolute values and the Y-axis represents the studies included (first author, year, sample size). Studies are cited multiple times depending on the investigated combined oral contraceptives. Blue squares represent nAPCsr values (± SD) for “no-COC user” group; green squares represents nAPCsr values (± SD) for “EE-LNG user” group; orange squares represents nAPCsr values (± SD) for “EE-DSG and EE-GSD user” group; red squares represents nAPCsr values (± SD) for “EE-DRSP user” group; pink squares represents nAPCsr values (± SD) for “EE-CPA user” group; purple squares represents nAPCsr values (± SD) for “E2/NOMAC or E2/DNG user” group and the grey square represents nAPCsr value (± SD) for “E4/DRSP user” group. The size of the square is related to the sample size. The clearest square are chromogenic-based ETP-based APC resistance studies and the darkest ones are calibrated automated thrombogram-based studies. The validated and standardized ETP-based APC resistance assay is represented by a diamond. APC, activated protein C; COC, combined oral contraceptive; CPA, cyproterone acetate; DSG, desogestrel; DNG, dienogest; DSPR, drospirenone; EE, ethinylestradiol; E2, estradiol; GSD, gestodene; LNG, levonorgestrel; nAPCsr, normalized activated protein C sensitivity ratio; NOMAC, nomegestrol acetate; SD, standard deviation.
Towards a Safer Alternative With Estradiol-Based COC
The estrogen component remained unchanged for a long time, with the majority of COCs containing EE. Nevertheless, to further improve the tolerability of COCs and to broaden the choice for COC users, attempts have been made to replace EE with natural estradiol (E2) (66, 67).
The contraceptive efficacy of COCs is primarily derived from the action of the progestogen compound but the estrogenic moiety is also an important contributor of the efficacy of COCs. Indeed, estrogens are partly responsible for suppressing the follicle-stimulating hormone, they potentiate the activity of the progestin component, by increasing progestin receptor concentration and they stabilize the endometrium so that irregular and unwanted bleeding can be minimized (68, 69). Although these desired effects on the reproductive organs, the occurrence of thrombotic events for which estrogen was held responsible, led to a drastic reduction in EE dosage, as stated above. However, reducing the amount of estrogen, up to 10 µg of EE, with the aim to improve safety resulted in unacceptable changes in bleeding patterns compared to higher doses (69). Therefore, the development of COCs containing natural estrogen, i.e., E2 was then suggested as an alternative of EE (69). The interest of using E2, as the estrogen component in COCs was raised in the 1970s with the aim of improving the tolerability. Moreover, several studies showed that E2 impacted to a lesser extent the synthesis of hepatic protein compared to EE (70–72).
Because of its low oral bioavailability, E2 is either in a micronized form or esterified. Estradiol valerate (E2V) presents similar pharmacokinetic and pharmacodynamic characteristics to that of E2 as it is rapidly converted to E2 in the intestines and the liver (1 mg of E2V yields 0.75 mg E2) (73). Indeed, the cleavage of E2V to E2 and the valeric acid occurs during absorption by the intestinal mucosa and in the course of the first pass effect. This gives rise to E2 and its metabolites estrone (E1) and estriol (E3) (69).
First E2-containing COCs, introduced in the 1980s, were monophasic preparations containing between 1 and 3 mg of micronized E2. Although these preparations demonstrated effective ovulation inhibition and provided excellent contraceptive efficacy, these benefits were outweighed by unacceptable bleeding irregularities (69). An inappropriate estrogen-progestogen ratio or a suboptimal E2 dosage was pointed out as the plausible explanation for this failure in cycle control (67, 74). To address this issue, a preparation was developed in which E2V was combined with dienogest, in a four-phasic dosing regimen incorporating an estrogen step-down and a progestin step-up over 26 days (66, 75). The treatment consists of the administration of E2V 3 mg for 2 days – E2V 2 mg/dienogest 2 mg for 5 days - E2V 2 mg/dienogest 3 mg for 17 days - E2V 1 mg for 2 days - and placebo for 2 days (66). This dynamic dosing regimen was designed to ensure estrogen dominance in the first part of the cycle and progestin dominance in the mid to late part of the cycle, thereby optimizing the control of bleeding (76). Ahrendt et al. demonstrated that this regimen certainly improved the cycle control and appeared to be associated with shorter and lighter bleeding compared with EE/levonorgestrel (67). Furthermore, unlike other progestogens, dienogest is a 19 nor-testosterone derivative, with a 17-cyanomethyl instead of an ethinyl group at the C-17 position (77) and possesses therefore a strong affinity for progesterone receptors, displays an antiandrogenic activity and lacks estrogenic, glucocorticoid and androgenic properties. This suggested that this progestogen would exert only minor metabolic effects (78). Studies of Junge et al. and Klipping et al. confirmed the minimal impact of this preparation on lipid, hemostasis and carbohydrate metabolism (75, 78). This E2-containing OC became globally available in 2009 under the trade name Qlaira®. A few years later, in 2011, a new monophasic pill containing 1.5 mg of micronized 17β-estradiol and 2.5 mg nomegestrol acetate was introduced in the European market, under the tradename Zoely®, and consisted of a 24- days regimen followed by a 4-day placebo (79). Nomegestrol acetate is a progesterone derivative, and more specifically, a 19-norpregnane, possessing an antiestrogenic activity on the endometrium and a moderate antiandrogenic activity. Through this enhanced selectivity profile, this preparation was expected to provide acceptable cycle control and limit cardiovascular and metabolic side effects. This was confirmed by Agren et al. and Gaussem et al. who revealed that E2/nomegestrol acetate had a similar safety and tolerability profile to EE/levonorgestrel (80, 81). As these studies were based on biological and pharmacological data with no attempts to correlate hemostatic changes with VTE risk, epidemiological data on the risk of VTE associated with these E2-containing COCs were requested by the regulatory agencies. Two large international active surveillance studies, the INAS-SCORE (NCT01009684) and the PRO-E2 (NCT01650168) were initiated to assess the risk of short and long-term use of E2V/dienogest and E2/nomegestrol acetate respectively (82, 83). In comparison with COC-levonorgestrel users, the incidence of VTE was slightly lower in users of E2V/dienogest and E2/nomegestrol acetate (Table 3). This suggests that EE/levonorgestrel is not the only option for minimizing the risk of VTE associated with COC use, but estradiol-containing product is equally safe (86). This also reflects that those biological investigations may, at least in part, correlate with epidemiological data. This also permit to put the pharmacodynamics data requested by the EMA during the development of steroid contraceptives into a more clinical context.
Table 3 Estimated risk of venous thromboembolism events (VTE) with combined oral contraceptives (COC).
A Novel Combined Oral Contraceptive Based on a Native Estrogen, Estetrol
Estetrol (E4) was discovered in the mid-1960s by Diczfalusy and co-workers by investigating the metabolism of E2 in early pregnancy (87). This steroid molecule, characterized by 4 hydroxyl groups, is exclusively synthetized in the fetal liver which is the only organ capable of both 15α- and 16α-hydroxylation. Estetrol is present in maternal blood and urine from the ninth week of gestation and reaches the maternal circulation through the placenta (88). Produced in increasing quantities during the fetal lifespan, it was suggested that E4 could be a safe estrogenic steroid for human use. Pharmacokinetic studies demonstrated an interesting profile with a good oral bioavailability, no metabolization into active metabolites, i.e. E3, E2 or E1, and a half-life time around 28 hours, suggesting suitability for once daily administration (87). From a pharmacodynamic point of view, E4 showed a high selectivity for the estrogens receptors (ER) and weak interactions with glucocorticoids, progesterone and testosterone receptors (87). The binding affinity for both estrogen α and β receptors (ERα and ERβ) was moderate with a four to five-fold higher affinity for ERα. Like the other estrogens, E4 activates the nuclear ERα but in contrast with other estrogens, it antagonizes the activity of membrane ERα, involved in more rapid signaling pathways. Estrogens can act through this distinctly different pathway by inducing rapid extra-nuclear activity via a small pool of ERα located closed to the membrane. This process is defined as membrane-initiated steroid signaling (MISS) and may results in the activation of intracellular signaling pathways (e.g., PI3K, MAPK), the activation of multiple kinases and the production of a variety of downstream second messengers (e.g., nitric oxide, calcium flux, cyclic adenosine monophosphate), directly influencing cell activities that contribute to the regulation of cell survival and proliferation. Interaction of nuclear and MISS pathways remains to date poorly recognized but the kinases activated by the MISS pathway can, in turn, phosphorylate various transcription factors, including ERs and coregulators, and therefore indirectly modulate the transcriptional activity in the nucleus (89–92) (Figure 6). Animal and human studies demonstrated that E4 behaves as an agonist in bones, uterus, and brain (hot flush, ovulation inhibition, etc.) through nuclear ERα but as an antagonist of ERα-dependent MISS pathway, and especially in the endothelium (considered as one of the NO synthase activation pathways) (87, 89, 93) With this mode of action, E4 has been recognized as a New Active Substance (NAS) by the European Medicines Agency (EMA) and can be described as the first Native Estrogen with Specific action in Tissues (NEST), a classification which differs from the selective estrogen receptor modulators (SERM) (94). A pharmacological comparison between E4, EE and E2 is shown in Table 4.
Figure 6 Interaction between estrogens, i.e., estradiol (E2) and estetrol (E4) and estrogen receptors alpha (ERα). Estradiol activates both membrane and nuclear actions of ERα while E4 is an agonist of nuclear activity but an antagonist of the ERα-dependent MISS pathway. Nuclear activity is the result of an interaction between estrogens, i.e., E2 or E4, and the ERα located in the cytoplasm. This binding leads to the dimerization and the translocation of the complex into the nucleus, where it interacts with ERE DNA sequences in target genes. The ERα-dependent MISS pathway consists of a rapid nongenomic activity playing an important role in the endothelial effect of estrogens. Palmitoylation of ERα allows them to anchor to the plasma membrane caveolae where they associate with caveolin-1 (Cav-1). Upon E2 stimulation, ERα is de-palmitoylated and dissociated from Cav-1, to interact with protein kinase (Src and PI3K), G-coupled protein ai (Gai) leading to signaling cascade (Akt, Pka, ERK1/2) and endothelial NO synthase activation. On the other hand, E4 is devoid of ERα MISS activity and even, is also able to antagonize E2-induced MISS effect, especially in the endothelium. AP1, activator protein 1; Cav-1, caveolin 1; CREB, cAMP-response element-binding; Elk1, ETS like-1 protein; ERK, extracellular signal-regulated kinases; eNOS, endothelial nitric oxide synthase; ER, estrogen receptor; ERE, estrogen responsive element; E2, estradiol; E4, estetrol; G, G protein (sub-unit ai); MISS, membrane-initiated steroid signaling; PI3K, phosphoinositide 3-kinase; RTK, receptor tyrosine kinase; SRF, serum response factor.
These pharmacological properties made E4 an appropriate candidate for contraception in women of childbearing age or hormonal replacement therapy in menopausal women. Based on the first pre-clinical and clinical data, multiple E4/drospirenone and E4/levonorgestrel dose combinations were investigated and compared to 20 µg of EE in association with 3 mg of drospirenone, for their effects on ovulation inhibition and hemostatic biomarkers (95). Regardless of the dose, i.e., 5 mg, 10 mg or 20 mg of E4 and the progestogen, i.e., either levonorgestrel or drospirenone, E4-containing COCs effectively blocked ovulation and induced minor effects on hemostasis markers (95). In the meantime, an open-label, multi-center, randomized, dose-finding study (FIESTA) was performed to assess bleeding pattern and cycle control of E4 combined with either drospirenone or levonorgestrel (96). The combination of 15 mg E4 with 3 mg drospirenone proved to be the most efficacious with respect to bleeding and cycle control and showed the most satisfaction among the users (96, 97). Further hemostasis investigations revealed that this novel E4-containing COC had a very low impact on the coagulation and fibrinolytic systems (98).
In light of the clinical efficacy and safety data from the Phase II program, the association of E4 at the dose of 15 mg with 3 mg of drospirenone (monophasic 24 + 4 regimen) was selected for phase III development (96). The E4 Female Response concerning Efficacy and safety of Estetrol/Drospirenone as Oral contraceptive in Multicentric study (FREEDOM) Phase III program consisted of two open-label, single arm studies, one performed in Europe and Russia and the other one in US and Canada totaling 3,725 women. The studies confirmed the contraceptive efficacy, a good bleeding profile and cycle control and also reported a high satisfaction rate (99). This led to the approval of E4/drospirenone by several regulatory agencies since the beginning of 2021 (100, 101).
State-of-the-Art and Perspectives
The European Medicines Agency Referral: What Needs To Be Done?
In 2013, France informed the EMA, pursuant to Article 31 of Directive 2001/83/EC, of their consideration that the benefit-risk balance of CHCs had become unfavorable in the currently authorized indication due to the increased risk of VTE. The Pharmacovigilance Risk Assessment Committee (PRAC) was then requested to give a recommendation on whether the indication of medicinal products containing chlormadinone acetate, desogestrel, dienogest, drospirenone, etonogestrel, gestodene, norelgestromin, norgestimate, and nomegestrol acetate should be restricted and/or any other regulatory measures taken. In the context of this referral, all pharmacoepidemiology studies on CHCs were reviewed in order to assess the estimated relevant risk of VTE associated with each CHC preparation (Table 3). Oral contraceptives considered as the safest in terms of VTE risk were preparations containing EE associated with either levonorgestrel, norethisterone acetate or norgestimate. The highest estimated incidence of VTE was observed with COCs containing EE associated with gestodene, desogestrel or drospirenone (i.e., 9-12 VTE/10,000 women a year) but compared with pregnancy and postpartum period (i.e., 20 VTE/10,000 women a year), it remained lower (84, 85). It was also highlighted that the risk of VTE was higher during the first year of use or following a restart after a one-month period without treatment (84).
As a risk minimization strategy, the PRAC considered that modifications in the summary of product characteristics (SmPC) were required in order to strengthen information relative to the associated risk of VTE. In addition, they recommended the implementation of educational measures to increase healthcare professionals and women awareness regarding the contraindications and the risk factor of VTE and they mentioned that the individual’s risk should be re-evaluated periodically as risk factor for VTE can change over the course of a lifetime (84). On this basis, several guidelines offer support in tailoring contraceptive therapies according to the patient’s profile. There are the US Medical Eligibility Criteria for contraceptive use (102), the World Health Organization Medical Eligibility Criteria for contraceptive use (Fifth Edition, 2015) (103) and the UK Medical Eligibility Criteria for contraceptive use (UKMEC 2016) (104).
The Challenge of Identifying Women at Higher Risk of VTE, Depending on Their Hormonal Status
Many factors must be considered and discussed with the women when choosing a contraceptive method. In addition to the efficacy, the tolerability and the additional health benefit, the risk of VTE is an important element that must be evaluated. At the present time, this risk is only assessed based on clinical characteristics and does not rely on formal algorithm including phenotypic coagulation screening with laboratory tests. The standard of care, when starting a contraception, consists of identifying the presence of hereditary thrombophilia solely on the basis of familial history of VTE; a strategy which has been reported to be of low sensitivity and predictive value (105, 106). Indeed, identifying a thrombosis within the family does not necessarily mean that there is an underlying thrombophilia. Genetic risk factors alone contribute to only 30% of the family history of VTE (107). Moreover, exclusion of the main hereditary thrombophilia does not mean that a woman will not suffer from thrombotic event under COC use (107). Venous thromboembolism is a multifactorial disease whose occurrence depends on the interaction between gene defects and environmental factors (Figure 2) (105). As a result, exposure of high-risk situation such as surgery, trauma, immobilization (e.g., casts, long-range travel/flights), pregnancy or hormonal therapy may trigger a thrombotic event in individuals either in absence or presence of genetic mutations, suggesting that the evaluation should be on the phenotypic rather than the genotypic thrombophilia expression.
There are five well-known genetic thrombophilia that can be divided in two main categories: gain of function mutations and loss of function mutations. Gain of function mutations include prothrombin mutation G20210A and factor V Leiden, which are the more frequent genetic risk factors observed in the Caucasian population. The prevalence reaches 2% for G20210A mutation and 5% for FV Leiden mutation. In contrast, they are much rarer in African and Asian populations (108). The risk of first VTE event is 3- to 7-fold higher in heterozygous carriers while it may reach a relative risk of 30 to 80 in homozygous carriers (109). Mutations, that confer a loss of function, concern deficiencies of protein C, protein S and antithrombin. These mutations are less frequent with a prevalence below 1% but they are associated with a 10- to 50-fold risk of first VTE (109). The presence of one of the above mutations with COCs leads to a synergistic and amplificative (rather than an additive) prothrombotic effect (110). Hugon-Rodin et al. and Khialani et al. investigated the joint effect of COCs and genetic mutation, e.g., FV Leiden mutation or G20210A mutation. Both research groups have calculated a synergy index (SI), reflecting the amplificative effect of the combination of a genetic mutation with COCs above the simple addition of the independent risk alone (110, 111). Based on this, Khialani and co-workers estimated the odds ratios at 19.3 and 24.0 in carriers of FV Leiden mutation and G20210A mutation when using the pill, respectively (110).
Consequently, there is a need of being able to identify the baseline risk of VTE in women before introducing hormonal contraceptives (112). In 2015, Gene Predictis® launched the Pill Protect® on the Swiss market (113). This diagnostic device is based on an algorithm which considers nine polymorphisms and four clinical risk factors associated with VTE development as well as the potential COC that could be prescribed (Table 5). To assess the performance of this test, a comparison was performed to the “current” practice, which was based on oral anamnesis of the patient, and to the genotyping for FV Leiden and G20210A mutation.1 Results of the ROC curves analyses, reflected by the area under the curve, was higher (i.e., 0.71) with the Pill Protect® compared to the oral anamnesis of the patient (i.e., 0.61) or the simple genotyping of FV Leiden and G20210A mutation (i.e., 0.67). These data revealed the usefulness of this prognostic device and reopened the reflection of performing biological investigations before introduction of a contraceptive method (114). Although this method is promising, the algorithm does not take into account a deficiency of protein S, protein C or antithrombin and in addition, many users of COCs developing VTE do not have a recognized hereditary coagulation problem but show instead a high responsiveness to estrogenic compounds (118). An interesting approach would be to have one or several biomarkers to establish the “coagulability status” of the patient, revealing phenotypic rather than just genotypic particularities.
Global sensitive assays like the ETP-based APC resistance assay could be potential candidates. One rationale and affordable perspective could be the screening of the coagulability state in order to provide objective data for the gynecologist to support the prescription of the most appropriate contraceptive method. In case of an abnormal result, which suspects the presence of an underlying pathology, the women can be referred to a hematologist for further investigations. This is of particular importance since the identification of coagulopathies may drive the behavior of both the patient and the healthcare professionals for the entire lifetime of the woman. Subsequently, a second testing after a sequence of one cycle of hormonal treatment would allow identifying women with an abnormal rise of the nAPCsr which may reveal an over-sensitivity to the estrogenic effect of COC or particularities in the metabolism of the concerned COC.
A global screening test would represent a more appropriate and cheaper alternative than a full thrombophilia tests panel for assessing the risk since, this test does not only focus on the inherited coagulopathies but also assesses the individual sensitivity towards COCs. Furthermore, information on the coagulability status could not only reduce the risk of COC-induced thrombosis but also the incidence of thrombotic events in situations associated with elevated thrombotic risk. It has to be reminded that venous thromboembolisms and pulmonary embolisms are associated with a significant mortality but also with a high morbidity rate leading to expense costs for the diagnosis, the treatment and the management of any thrombotic related disability such as recurrent VTE, post thrombotic syndrome or chronic pulmonary hypertension. All of these lead to severe impairment of the affected women, an important financial burden within personal expenses, healthcare resources and societal costs (112). Obviously, such strategies need to be evaluated by proper epidemiological and cost-effectiveness studies but with the advent of new technologies permitting the global assessment of the coagulation process, there is a new era for management of women willing to get the most appropriate and safe contraceptive method based on their individualized profile.
Conclusion
Over the last 60 years, efforts have been made to reduce the risk of venous thromboembolism events associated with combined oral contraceptives, and today, all strategies seem to be moving towards the safe use of these products. With novel formulations on the market, i.e., estradiol- and estetrol-based combined oral contraceptives, the association of ethinylestradiol with levonorgestrel should no longer be the only option for minimizing the risk of venous thromboembolism associated with combined oral contraceptives use. This has not been discussed in this review but there are obviously alternatives to estroprogestative combinations, e.g., progestin-only pills or intra-uterine devices and as a perspective, a review discussing in details the medical eligibility criteria for contraceptive use as well as the different hormonal methods of contraception, would be of great interest. In addition to the development of safer products, attempts are being made to improve the management of patients who desire to start a contraceptive therapy. The proposal of a global screening test before the initiation of a contraceptive therapy could significantly reduce the 22,000 cases of thrombosis observed each year in Europe following the use of combined oral contraceptives (114).
Author Contributions
LM and JD made substantial contributions to the literature search and to the writing of the manuscript. HH, J-MD, and UG contributed to the final version of the manuscript. LM achieved the adjustments after the review by other authors and gave final approval of the submitted version of the manuscript. JD was in charge of supervising the project. All authors contributed to the article and approved the submitted version.
Funding
This project was financed by the Walloon Region in Belgium (government source) – convention 8031.
Conflict of Interest
UG is senior consultant of Mithra Pharmaceuticals, Liège, Belgium. JD is CEO and founder of QUALIblood s.a. and reports personal fees from Daiichi-Sankyo, Diagnostica Stago, DOASense, Gedeon Richter, Mithra Pharmaceuticals, Norgine, Portola, Roche and Roche Diagnostics.
The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
- ^ It has to be noted that the genotyping of FV Leiden and G20210A mutations is not part of the current practice.
References
1. United Nations, Department of Economic and Social Affairs, Population Division (2019). Contraceptive Use by Method 2019: Data Booklet (ST/ESA/SER.A/435).
2. Jordan WM, Anand JK. Pulmonary Embolism. Lancet (1961) 278:1146–7. doi: 10.1016/S0140-6736(61)91061-3
3. Stadel B. Oral Contraceptives and Cardiovascular Disease (First of Two Parts). N Engl J Med (1981) 305:612–18. doi: 10.1056/NEJM198109103051104
4. Inman WHW, Vessey MP, Westerholm B, Engelund A. Thromboembolic Disease and the Steroidal Content of Oral Contraceptives: A Report to the Committee on Safety of Drugs. Br Med J (1970) 2:209–9. doi: 10.1136/bmj.2.5703.203
5. Vessey MP, Inman WHW. Speculation About Mortality Trends From Venous Thromboembolism Disease in England and Wales and Their Relation to the Pattern of Oral Contraceptive Usage. J Obstetrics Gynaecology Br Commonwealth (1973) 80:562–6. doi: 10.1111/j.1471-0528.1973.tb15981.x
6. Meade TW, Haines AP, North WRS, Chakrabarti R, Howarth DJ, Stirling Y. Haemostatic, Lipid, and Blood-Pressure Profiles of Women on Oral Contraceptives Containing 50 µg or 30 µg Oestrogen. Lancet (1977) 948–51. doi: 10.1016/S0140-6736(77)90888-1
7. Wessler S, Gitel SN, Wan LS, Pasternack BS. Estrogen-Containing Oral Contraceptives Agents: A Basis for Their Thrombogenicity. JAMA (1976) 236:2179–82. doi: 10.1001/jama.1976.03270200017021
8. Bonnar J. Coagulation Effects of Oral Contraception. Am J Obstet Gynecol (1987) 157:1042–8. doi: 10.1016/S0002-9378(87)80129-1
9. Wiegratz I, Kuhl H. Metabolic and Clinical Effects of Progestogens. Eur J Contracept Reprod Health Care (2006) 11:153–61. doi: 10.1080/13625180600772741
10. Blanco-Molina MA, Lozano M, Cano A, Cristobal I, Pallardo LP, Lete I. Progestin-Only Contraception and Venous Thromboembolism. Thromb Res (2012) 129:e257–62. doi: 10.1016/j.thromres.2012.02.042
11. Regidor PA. The Clinical Relevance of Progestogens in Hormonal Contraception: Present Status and Future Developments. Oncotarget (2018) 9:34628–538. doi: 10.18632/oncotarget.26015
12. Sitruk-Ware R. New Progestagens for Contraceptive Use. Hum Reprod Update (2006) 12:169–78. doi: 10.1093/humupd/dmi046
13. Sitruk-Ware R. Pharmacological Profile of Progestins. Maturitas (2008) 61:151–7. doi: 10.1016/j.maturitas.2008.11.011
14. Lawrie TA, Helmerhorst FM, Maitra NK, Kulier R, Bloemenkamp K, Gulmezoglu AM. Types of Progestogens in Combined Oral Contraception: Effectiveness and Side-Effects. Cochrane Database Syst Rev (2011) (5):CD004861. doi: 10.1002/14651858.CD004861.pub2
15. Kuhl H. Pharmacology of Estrogens and Progestogens: Influence of Different Routes of Administration. Climacteric (2005) 8(Suppl 1):3–63. doi: 10.1080/13697130500148875
16. Creinin MD, Jensen JT. Oral Contraceptive Generations - Time to Stop Using a Marketing Myth to Define Nomenclature. Contraception (2020) 102:143–4. doi: 10.1016/j.contraception.2020.05.017
17. Kuhnz W, Beier S. Comparative Progestational and Androgenic Activity of Norgestimate and Levonorgestrel in the Rat. Contraception (1994) 49:275–89. doi: 10.1016/0010-7824(94)90045-0
19. LeBlanc ES, Laws A. Benefits and Risks of Third-Generaiton Oral Contraceptives. J Gen Internal Med (1999) 14:625–32. doi: 10.1046/j.1525-1497.1999.08108.x
20. World Health Organization Collaborative Study of Cardiovascular Disease and Steroid Hormone Contraception. Effect of Different Progestagens in Low Oestrogen Oral Contraceptives on Venous Thromboembolic Disease. Lancet (1995) 346:1582–8. doi: 10.1016/S0140-6736(95)91927-9
21. Jick H, Jick S, Gurewich V, Myers MW, Vasilakis C. Risk of Idiopathic Cardiovascular Death and Nonfatal Venous Thromboembolism in Women Using Oral Contraceptives With Differing Progestagen Components. Lancet (1995) 346:1589–93. doi: 10.1016/S0140-6736(95)91928-7
22. Spitzer WO, Lewis MA, Heinemann LAJ, Thorogood M, Macrae KD. Third Generation Oral Contraceptives and Risk of Venous Thromboembolic Disorders: An International Case-Control Study. BMJ (1996) 312:83–8. doi: 10.1136/bmj.312.7023.83
23. Bloemenkamp K, Rosendaal F, Helmerhorst F, Büller H, Vandenbroucke JP. Enhancement by Factor V Leiden Mutation of Risk of Deep-Vein Thrombosis Associated With Oral Contraceptives Containing a Thirg-Generation Progestogen. Lancet (1995) 346:1593–6. doi: 10.1016/S0140-6736(95)91929-5
24. Farmer RDT, Lawrenson RA, Thompson CR, Kennedy JG, Hambleton IR. Population-Based Study of Risk of Venous Thromboembolism Associated With Various Oral Contraceptives. Lancet (1997) 349:83–8. doi: 10.1016/S0140-6736(96)07496-X
25. Suissa S, Blais L, Spitzer WO, Cusson J, Lewis M, Heinemann L. First-Time Use of Newer Oral Contraceptives and the Risk of Venous Thromboembolism. Contraception (1997) 56:141–6. doi: 10.1016/S0010-7824(97)00119-4
26. Heinemann LAJ. The Changing Scene - an Unnecessary Pill Crisis. Hum Reprod Update (1999) 5:746–55. doi: 10.1093/humupd/5.6.746
27. Spitzer WO. The Aftermath of a Pill Scare: Regression to Reassurance. Hum Reprod Update (1999) 5:736–45. doi: 10.1093/humupd/5.6.736
28. Lewis MA, Heinemann LAJ, Macrae KD, Bruppacher R, Spitzer WO. The Increased Risk of Venous Thromboembolism and the Use of Third Generation Progestagens: Role of Bias in Observational Research. Contraception (1996) 54:5–13. doi: 10.1016/0010-7824(96)00112-6
29. de Bastos M, Stegeman BH, Rosendaal FR, Van Hylckama Vlieg A, Helmerhorst FM, Stijnen T, et al. Combined Oral Contraceptives: Venous Thrombosis. Cochrane Database Syst Rev (2014) (3):CD010813. doi: 10.1002/14651858.CD010813.pub2
30. Kemmeren JM, Algra A, Grobbee DE. Third Generation Oral Contraceptives and Risk of Venous Thrombosis: Meta-Analysis. BMJ (2001) 323:131–4. doi: 10.1136/bmj.323.7305.131
31. Sitruk-Ware R. Pharmacology of Different Progestogens: The Special Case of Drospirenone. Climacteric (2005) 8 Suppl 3:4–12. doi: 10.1080/13697130500330382
32. Foidart JM. Added Benefits of Drospirenone for Compliance. Climacteric (2005) 8 Suppl 3:28–34. doi: 10.1080/13697130500330309
33. Rosendaal FR, Van Hylckama Vlieg A, Tanis BC, Helmerhorst FM. Estrogens, Progestogens and Thrombosis. J Thromb Haemost (2003) 1:1371–80. doi: 10.1046/j.1538-7836.2003.00264.x
34. van Vliet HA, Winkel TA, Noort I, Rosing J, Rosendaal FR. Prothrombotic Changes in Users of Combined Oral Contraceptives Containing Drospirenone and Cyproterone Acetate. J Thromb Haemost (2004) 2:2060–2. doi: 10.1111/j.1538-7836.2004.00983.x
35. Fruzzetti F, Cagnacci A. Venous Thrombosis and Hormonal Contraception: What’s New With Estradiol-Based Hormonal Contraceptives? Open Access J Contracept (2018) 9:75–9. doi: 10.2147/OAJC.S179673
36. Tepper NK, Whiteman MK, Marchbanks PA, James AH, Curtis KM. Progestin-Only Contraception and Thromboembolism: A Systematic Review. Contraception (2016) 94:678–700. doi: 10.1016/j.contraception.2016.04.014
37. Kuhl H. Effects of Progestogens on Haemostasis. Maturitas (1996) 24:1–19. doi: 10.1016/0378-5122(96)00994-2
38. Peters AA, Buchanan G, Ricciardelli C, Bianco-Miotto T, Centenera MM, Harris JM, et al. Androgen Receptor Inhibits Estrogen Receptor-Alpha Activity and Is Prognostic in Breast Cancer. Cancer Res (2009) 69:6131–40. doi: 10.1158/0008-5472.CAN-09-0452
39. Odlind V, Milsom I, Persson I, Victor A. Can Changes in Sex Hormone Binding Globulin Predict the Risk of Venous Thromboembolism With Combined Oral Contraceptive Pills? Acta Obstet Gynecol Scand (2002) 81:482–90. doi: 10.1080/j.1600-0412.2002.810603.x
40. van Rooijen M, Silveira A, Hamsten A, Bremme K. Sex Hormone–Binding Globulin—A Surrogate Marker for the Prothrombotic Effects of Combined Oral Contraceptives. Am J Obstetrics Gynecol (2004) 190:332–7. doi: 10.1016/S0002-9378(03)00950-5
41. van Vliet HA, Frolich M, Christella M, Thomassen LG, Doggen CJ, Rosendaal FR, et al. Association Between Sex Hormone-Binding Globulin Levels and Activated Protein C Resistance in Explaining the Risk of Thrombosis in Users of Oral Contraceptives Containing Different Progestogens. Hum Reprod (2005) 20:563–8. doi: 10.1093/humrep/deh612
42. European Medicines Agency. Guideline on Clinical Investigation of Steroid Contraceptives in Women - EMEA/CPMP/EWP/519/98 Rev, Vol. 1. London:EMEA (2005).
43. Raps M, Helmerhorst F, Fleischer K, Thomassen S, Rosendaal F, Rosing J, et al. Sex Hormone-Binding Globulin as a Marker for the Thrombotic Risk of Hormonal Contraceptives. J Thromb Haemost (2012) 10:992–7. doi: 10.1111/j.1538-7836.2012.04720.x
44. Stegeman BH, Helmerhorst FM, Vos HL, Rosendaal FR, Van Hylckama Vlieg A. Sex Hormone-Binding Globulin Levels Are Not Causally Related to Venous Thrombosis Risk in Women Not Using Hormonal Contraceptives. J Thromb Haemost (2012) 10:2061–7. doi: 10.1111/j.1538-7836.2012.04878.x
45. Dahlbäck B. Physiological Anticoagulation: Resistance to Activated Protein C and Venous Thromboembolism. J Clin Invest 94 (1994) 94:923–7. doi: 10.1172/JCI117458
46. Dahlbäck B, Carlsson M, Svensson PJ. Familial Thrombophilia Due to a Previously Unrecognized Mechanism Characterized by Poor Anticoagulant Response to Activated Protein C: Prediction of a Cofactor to Activated Protein C. Proc Natl Acad Sci (1993) 90:1004–8. doi: 10.1073/pnas.90.3.1004
47. Roshal M, Reyes Gil M. Activated Partial Thromboplastin Time. In: Transfusion Medicine and Hemostasis. Elsevier (2019). p. 779–81.
48. Griffin JH, Evatt B, Wideman C, Fernandez JA. Anticoagulant Proteinc C Pathway in Majority of Thrombophilic Patients. Blood (1993) 82:1989–93. doi: 10.1182/blood.V82.7.1989.1989
49. Koster T, Rosendaal FR, de Ronde H, Briët E, Vandenbroucke JP, Bertina RM. Venous Thrombosis Due to Poor Anticoagulant Response to Activated Protein C-Leiden Thrombophilia Study. Lancet (1993) 342:1503–6. doi: 10.1016/S0140-6736(05)80081-9
50. Svensson PJ, Dahlback B. Resistance to Activated Protein C as a Basis for Venous Thrombosis. N Engl J Med (1994) 330:517–22. doi: 10.1056/NEJM199402243300801
51. Bertina RM, Koeleman BPC, Koster T, Rosendaal FR, . Dirven RJ, de Ronde H, et al. Mutation in Blood Coagulation Factor V Associated With Resistance to Activated Protein C. Nature (1994) 364:64–7. doi: 10.1038/369064a0
52. Segers O, Castoldi E. Chapter 6 Factor V Leiden and Activated Protein C Resistance. Adv Clin Chem (2009) 49:121–57. doi: 10.1016/S0065-2423(09)49006-1
53. Henkens CM, Bom VJ, Seinen AJ, van der Meer J. Sensitivity to Activated Protein C; Influence of Oral Contraceptives and Sex. Thromb Haemost (1995) 73:402–4. doi: 10.1055/s-0038-1653788
54. Olivieri O, Friso S, Manzato F, Guella A, Bernardi F, Lunghi B, et al. Resistance to Activated Protein C in Healthy Women Taking Oral Contraceptives. Br J Haematol (1995) 91:465–70. doi: 10.1111/j.1365-2141.1995.tb05323.x
55. Nicolaes GA, Thomassen MC, Tans G, Rosing J, Hemker HC. Effect of Activated Protein C on Thrombin Generation and on the Thrombin Potential in Plasma of Normal and APC-Resistant Individuals. Blood Coagul Fibrinolysis (1997) 8:28–38. doi: 10.1097/00001721-199701000-00006
56. Curvers J, Thomassen MC, Nicolaes GA, Van Oerle R, Hamulyak K, Hemker HC, et al. Acquired APC Resistance and Oral Contraceptives: Differences Between Two Functional Tests. Br J Haematol (1999) 105:88–94. doi: 10.1111/j.1365-2141.1999.01302.x
57. Kuhl H, Bremser H, Taubert H. Serum Levels and Pharmacokinetics of Norethisterone After Ingestion of Lynestrenol: Its Relation to Dose and Stage of the Menstrual Cycle. Contraception (1982) 26:303–15. doi: 10.1016/0010-7824(82)90078-6
58. de Visser MC, van Hylckama Vlieg A, Tans G, Rosing J, Dahm AE, Sandset PM, et al. Determinants of the APTT- and ETP-Based APC Sensitivity Tests. J Thromb Haemost (2005) 3:1488–94. doi: 10.1111/j.1538-7836.2005.01430.x
59. Tchaikovski S, Tans G, Rosing J. Venous Thrombosis and Oral Contraceptives: Current Status. Womens Health (Lond) (2006) 2:761–72. doi: 10.2217/17455057.2.5.761
60. Castoldi E, Rosing J. APC Resistance: Biological Basis and Acquired Influences. J Thromb Haemost (2010) 8:445–53. doi: 10.1111/j.1538-7836.2009.03711.x
61. Douxfils J, Morimont L, Delvigne AS, Devel P, Masereel B, Haguet H, et al. Validation and Standardization of the ETP-Based Activated Protein C Resistance Test for the Clinical Investigation of Steroid Contraceptives in Women: An Unmet Clinical and Regulatory Need. Clin Chem Lab Med (2020) 58:294–305. doi: 10.1515/cclm-2019-0471
62. Lavigne-Lissalde G, Sanchez C, Castelli C, Alonso S, Mazoyer E, Bal Dit Sollier C, et al. Prothrombin G20210A Carriers the Genetic Mutation and a History of Venous Thrombosis Contributes to Thrombin Generation Independently of Factor II Plasma Levels. J Thromb Haemost (2010) 8:942–9. doi: 10.1111/j.1538-7836.2010.03773.x
63. Marco A, Brocal C, Martirena F, Lucas J, Marco P. Clinical and Biological Factors That Contribute to Thrombin Generation in Prothrombin G20210A Carriers: A Case-Control Study in a Single Thrombophilia Center. Thromb Res (2012) 129:e266–8. doi: 10.1016/j.thromres.2012.03.009
64. Szlam F, Sreeram G, Solomon C, Levy JH, Molinaro RJ, Tanaka KA. Elevated Factor VIII Enhances Thrombin Generation in the Presence of Factor VIII-Deficiency, Factor XI-Deficiency or Fondaparinux. Thromb Res (2011) 127:135–40. doi: 10.1016/j.thromres.2010.10.017
65. Duchemin J, Pan-Petesch B, Arnaud B, Blouch MT, Abgrall JF. Influence of Coagulation Factors and Tissue Factor Concentration on the Thrombin Generation Test in Plasma. Thromb Haemost (2008) 99:767–73. doi: 10.1160/TH07-09-0581
66. Zeun S, Lu M, Uddin A, Zeiler B, Morrison D, Blode H. Pharmacokinetics of an Oral Contraceptive Containing Oestradiol Valerate and Dienogest. Eur J Contracept Reprod Health Care (2009) 14:221–32. doi: 10.1080/13625180902850039
67. Ahrendt HJ, Makalova D, Parke S, Mellinger U, Mansour D. Bleeding Pattern and Cycle Control With an Estradiol-Based Oral Contraceptive: A Seven-Cycle, Randomized Comparative Trial of Estradiol Valerate/Dienogest and Ethinyl Estradiol/Levonorgestrel. Contraception (2009) 80:436–44. doi: 10.1016/j.contraception.2009.03.018
68. Lobo RA, Stanczyk FA. New Knowledge in the Physiology of Hormonal Contraceptives. Am J Obstet Gynecol (1994) 170:1499–507. doi: 10.1016/S0002-9378(94)05011-8
69. Fruzzetti F, Bitzer J. Review of Clinical Experience With Estradiol in Combined Oral Contraceptives. Contraception (2010) 81:8–15. doi: 10.1016/j.contraception.2009.08.010
70. Lindberg U, Crona N, Stigendal L, Teger-Nilsson A, Silfverstolpe G. A Comparison Between Effects of Estradiol Valerate and Low Dose Ethinyl Estradiol on Haemostasis Parameters. Thromb Haemostasis (1989) 61:256.
71. Mashchak CA, Lobo RA, Dozono-Takano R, Eggena P, Nakamura RM, Brenner PF, et al. Comparison of Pharmacodynamic Properties of Various Estrogen Formulations. Am J Obstetrics Gynecol (1982) 144:511–8. doi: 10.1016/0002-9378(82)90218-6
72. Wiegratz I, Lee JH, Kutschera E, Winkler UH, Kuhl H. Effect of Four Oral Contraceptives on Hemostatic Parameters. Contraception (2004) 70:97–106. doi: 10.1016/j.contraception.2004.03.004
73. Qlaira: Summary of Product Characteristics (SmPC) (2018). Available at: https://www.medicines.org.uk/emc/medicine/21700/SPC/Qlaira#gref (Access date 27/04/2021).
74. Fruzzetti F, Tremollieres F, Bitzer J. An Overview of the Development of Combined Oral Contraceptives Containing Estradiol: Focus on Estradiol Valerate/Dienogest. Gynecol Endocrinol (2012) 28:400–8. doi: 10.3109/09513590.2012.662547
75. Klipping C, Duijkers I, Parke S, Mellinger U, Serrani M, Junge W. Hemostatic Effects of a Novel Estradiol-Based Oral Contraceptive: An Open-Label, Randomized, Crossover Study of Estradiol Valerate/Dienogest Versus Ethinylestradiol/Levonorgestrel. Drugs R D (2011) 11:159–70. doi: 10.2165/11591200-000000000-00000
76. Borgelt LM, Martell CW. Estradiol Valerate/Dienogest: A Novel Combined Oral Contraceptive. Clin Ther (2012) 34:37–55. doi: 10.1016/j.clinthera.2011.11.006
77. Ruan X, Seeger H, Mueck AO. The Pharmacology of Nomegestrol Acetate. Maturitas (2012) 71:345–53. doi: 10.1016/j.maturitas.2012.01.007
78. Junge W, Mellinger U, Parke S, Serrani M. Metabolic and Haemostatic Effects of Estradiol Valerate/Dienogest, a Novel Oral Contraceptive: A Randomized, Open-Label, Single-Centre Study. Clin Drug Investig (2011) 31:573–84. doi: 10.2165/11590220-000000000-00000
79. Christin-Maitre S, Laroche E, Bricaire L. A New Contraceptive Pill Containing 17b-Estradiol and Nomegestrol Acetate. Womens Health (2013) 9:13–23. doi: 10.2217/whe.12.70
80. Agren UM, Anttila M, Maenpaa-Liukko K, Rantala ML, Rautiainen H, Sommer WF, et al. Effects of a Monophasic Combined Oral Contraceptive Containing Nomegestrol Acetate and 17beta-Oestradiol Compared With One Containing Levonorgestrel and Ethinylestradiol on Haemostasis, Lipids and Carbohydrate Metabolism. Eur J Contracept Reprod Health Care (2011) 16:444–57. doi: 10.3109/13625187.2011.604450
81. Gaussem P, Alhenc-Gelas M, Thomas JL, Bachelot-Loza C, Remones V, Ali FD, et al. Haemostatic Effects of a New Combined Oral Contraceptive, Nomegestrol Acetate/17beta-Estradiol, Compared With Those of Levonorgestrel/Ethinyl Estradiol. A Double-Blind, Randomised Study. Thromb Haemost (2011) 105:560–7. doi: 10.1160/TH10-05-0327
82. Jensen J, Bitzer J, Serrani M. Comparison of the Pharmacologic and Clinical Profiles of New Combined Oral Contraceptives Containing Estradiol. Open Access J Contraception (2013) 4:39–50. doi: 10.2147/OAJC.S50693
83. Reed S, Heinemann K. Prospective Controlled Cohort Study on the Safety of a Monophasic Oral Contraceptive Containing Nomegestrol Acetate (2.5mg) and 17β-Estradiol (1.5mg) (PRO-E2). Eur J Contracept Reprod Health Care (2021) 26(6):439–46. doi: 10.1080/13625187.2021.1987410
84. European Medicines Agency. Assessment Report for Combined Hormonal Contraceptives Containing Medicinal Products-EMA/739865/2013. ISGE series. Springer. London: EMA (2014).
85. Heit JA, Kobbervig CE, James AH, Petterson TM, Bailey KR, Melton LJ III. Trends in the Incidence of Venous Thromboembolism During Pregnancy or Postpartum: A 30-Years-Based Study. Ann Internal Med (2005) 143:697–706. doi: 10.7326/0003-4819-143-10-200511150-00006
86. Dinger J, Do Minh T, Heinemann K. Impact of Estrogen Type on Cardiovascular Safety of Combined Oral Contraceptives. Contraception (2016) 94:328–39. doi: 10.1016/j.contraception.2016.06.010
87. Coelingh Bennink HJ, Holinka CF, Diczfalusy E. Estetrol Review: Profile and Potential Clinical Applications. Climacteric (2008) 11 Suppl 1:47–58. doi: 10.1080/13697130802073425
88. Holinka CF, Diczfalusy E, Coelingh Bennink HJ. Estetrol: A Unique Steroid in Human Pregnancy. J Steroid Biochem Mol Biol (2008) 110:138–43. doi: 10.1016/j.jsbmb.2008.03.027
89. Abot A, Fontaine C, Buscato M, Solinhac R, Flouriot G, Fabre A, et al. The Uterine and Vascular Actions of Estetrol Delineate a Distinctive Profile of Estrogen Receptor Alpha Modulation, Uncoupling Nuclear and Membrane Activation. EMBO Mol Med (2014) 6:1328–46. doi: 10.15252/emmm.201404112
90. Arnal JF, Lenfant F, Metivier R, Flouriot G, Henrion D, Adlanmerini M, et al. Membrane and Nuclear Estrogen Receptor Alpha Actions: From Tissue Specificity to Medical Implications. Physiol Rev (2017) 97:1045–87. doi: 10.1152/physrev.00024.2016
91. Zhang D, Trudeau VL. Integration of Membrane and Nuclear Estrogen Receptor Signaling. Comp Biochem Physiol A Mol Integr Physiol (2006) 144:306–15. doi: 10.1016/j.cbpa.2006.01.025
92. Gérard C, Mestdagt M, Tskitishvili E, Communal L, Gompel A, Silva E, et al. Combined Estrogenic and Anti-Estrogenic Properties of Estetrol on Breast Cancer May Provide a Safe Therapeutic Window for the Treatment of Menopausal Symptoms. Oncotarget (2015) 6:17621–36. doi: 10.18632/oncotarget.4184
93. Valera MC, Noirrit-Esclassan E, Dupuis M, Fontaine C, Lenfant F, Briaux A, et al. Effect of Estetrol, a Selective Nuclear Estrogen Receptor Modulator, in Mouse Models of Arterial and Venous Thrombosis. Mol Cell Endocrinol (2018) 477:132–9. doi: 10.1016/j.mce.2018.06.010
94. Foidart JM, Gaspard U, Pequeux C, Jost M, Gordenne V, Tskitishvili E, et al. Unique Vascular Benefits of Estetrol, a Native Fetal Estrogen With Specific Actions in Tissues (NEST). Sex Steroids’ Effects Brain Heart Vessels (2019) 169–95. doi: 10.1007/978-3-030-11355-1_12
95. Mawet M, Maillard C, Klipping C, Zimmerman Y, Foidart JM, Coelingh Bennink HJ. Unique Effects on Hepatic Function, Lipid Metabolism, Bone and Growth Endocrine Parameters of Estetrol in Combined Oral Contraceptives. Eur J Contracept Reprod Health Care (2015) 20:463–75. doi: 10.3109/13625187.2015.1068934
96. Apter D, Zimmerman Y, Beekman L, Mawet M, Maillard C, Foidart JM, et al. Bleeding Pattern and Cycle Control With Estetrol-Containing Combined Oral Contraceptives: Results From a Phase II, Randomised, Dose-Finding Study (FIESTA). Contraception (2016) 94:366–73. doi: 10.1016/j.contraception.2016.04.015
97. Apter D, Zimmerman Y, Beekman L, Mawet M, Maillard C, Foidart JM, et al. Estetrol Combined With Drospirenone: An Oral Contraceptive With High Acceptability, User Satisfaction, Well-Being and Favourable Body Weight Control. Eur J Contracept Reprod Health Care (2017) 22:260–7. doi: 10.1080/13625187.2017.1336532
98. Douxfils J, Klipping C, Duijkers I, Kinet V, Mawet M, Maillard C, et al. Evaluation of the Effect of a New Oral Contraceptive Containing Estetrol and Drospirenone on Hemostasis Parameters. Contraception (2020) 102:396–402. doi: 10.1016/j.contraception.2020.08.015
99. Grandi G, Del Savio MC, Lopes da Silva-Filho A, Facchinetti F. Estetrol (E4): The New Estrogenic Component of Combined Oral Contraceptives. Expert Rev Clin Pharmacol (2020) 13:327–30. doi: 10.1080/17512433.2020.1750365
100. European Medicines Agency. CHMP Summary of Positive Opinion for Lydisilka. Amsterdam: EMA (2021).
101. European Medicines Agency. CHMP Summary of Positive Opinion for Drovelis. Amsterdam: EMA (2021).
102. Center for Disease Control and Prevention. U.S. Medical Eligibility Criteria for Contraceptive Use. MMWR Recomm Rep (2016) 65.
104. The Faculty of Sexual and Reproductive Healthcare. UK Medical Eligibility Criteria for Contreceptive Use (UKMEC). (2016) FSRH.
105. Cosmi B, Legnani C, Bernardi F, Coccheri S, Palareti G. Role of Family History in Identifying Women With Thrombophilia and Higher Risk of Venous Thromboembolism During Oral Contraception. Arch Intern Med (2003) 163. doi: 10.1001/archinte.163.9.1105
106. Suchon P, Al Frouh F, Henneuse A, Ibrahim M, Brunet D, Barthet MC, et al. Risk Factors for Venous Thromboembolism in Women Under Combined Oral Contraceptive. The Pill Genetic Risk Monitoring (PILGRIM) Study. Thromb Haemost (2016) 115:135–42. doi: 10.1160/TH15-01-0045
107. Hannaford PC. Epidemiology of the Contraceptive Pill and Venous Thromboembolism. Thromb Res (2011) 127:S30–4. doi: 10.1016/S0049-3848(11)70009-3
108. Hotoleanu C. Genetic Risk Factors in Venous Thromboembolism. Adv Exp Med Biol (2017) 906:253–72. doi: 10.1007/5584_2016_120
109. Mannucci PM, Franchini M. Classic Thrombophilic Gene Variants. Thromb Haemost (2015) 114:885–9. doi: 10.1160/TH15-02-0141
110. Khialani D, le Cessie S, Lijfering WM, Cannegieter SC, Rosendaal FR, van Hylckama Vlieg A. The Joint Effect of Genetic Risk Factors and Different Types of Combined Oral Contraceptives on Venous Thrombosis Risk. Br J Haematol (2020) 191:90–7. doi: 10.1111/bjh.16666
111. Hugon-Rodin J, Horellou MH, Conard J, Gompel A, Plu-Bureau G. Type of Combined Contraceptives, Factor V Leiden Mutation and Risk of Venous Thromboembolism. Thromb Haemost (2018) 118:922–8. doi: 10.1055/s-0038-1641152
112. Morimont L, Dogné J-M, Douxfils J. Letter to the Editors-in-Chief in Response to the Article of Abou-Ismail, Et Al. Entitled “Estrogen and Thrombosis: A Bench to Bedside Review” (Thrombosis Research 192 (2020) 40–51). Thromb Res (2020) 193:221–3. doi: 10.1016/j.thromres.2020.08.006
113. Michaud J, Tanackovic G. About Pill Protect®. Swiss Med Weekly (2016) 146. doi: 10.4414/smw.2016.14392
114. McDaid A, Logette E, Buchillier V, Muriset M, Suchon P, Pache TD, et al. Risk Prediction of Developing Venous Thrombosis in Combined Oral Contraceptive Users. PloS One (2017) 12:e0182041. doi: 10.1371/journal.pone.0182041
115. Morange PE, Tregouet DA. Current Knowledge on the Genetics of Incident Venous Thrombosis. J Thromb Haemost (2013) 11 Suppl 1:111–21. doi: 10.1111/jth.12233
116. Kaur S, Ali A, Siahbalaei Y, Ahmad U, Pandey AK, Singh B. Could Rs4379368 be a Genetic Marker for North Indian Migraine Patients With Aura?: Preliminary Evidence by a Replication Study. Neurosci Lett (2019) 712:134482. doi: 10.1016/j.neulet.2019.134482
117. Morange PE, Oudot-Mellakh T, Cohen W, Germain M, Saut N, Antoni G, et al. KNG1 Ile581Thr and Susceptibility to Venous Thrombosis. Blood (2011) 117:3692–4. doi: 10.1182/blood-2010-11-319053
Keywords: contraception, combined oral contraceptives, venous thromboembolism, activated protein C resistance, standard of care, risk factors, hemostasis
Citation: Morimont L, Haguet H, Dogné J-M, Gaspard U and Douxfils J (2021) Combined Oral Contraceptives and Venous Thromboembolism: Review and Perspective to Mitigate the Risk. Front. Endocrinol. 12:769187. doi: 10.3389/fendo.2021.769187
Received: 01 September 2021; Accepted: 08 November 2021;
Published: 09 December 2021.
Edited by:
Jung Ryeol Lee, Seoul National University, South KoreaReviewed by:
Sarah Cipriani, Università degli Studi di Firenze, ItalyFrancesco Carlomagno, Sapienza University of Rome, Italy
Dong-Yun Lee, Sungkyunkwan University, South Korea
Copyright © 2021 Morimont, Haguet, Dogné, Gaspard and Douxfils. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Laure Morimont, bGF1cmUubW9yaW1vbnRAcXVhbGlibG9vZC5ldQ==