Skip to main content

PERSPECTIVE article

Front. Glob. Womens Health, 20 January 2023
Sec. Sex and Gender Differences in Disease
This article is part of the Research Topic Highlights in Sex and Gender Differences in Disease 2021/22 View all 4 articles

Addressing persistent evidence gaps in cardiovascular sex differences research – the potential of clinical care data

  • 1Division of Pharmacoepidemiology and Clinical Pharmacology, Utrecht Institute for Pharmaceutical Sciences, Utrecht University, Utrecht, Netherlands
  • 2Laboratory for Experimental Cardiology, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands
  • 3Julius Center for Health Sciences and Primary Care, University Medical Center Utrecht, Utrecht University, Utrecht, Netherlands

Women have historically been underrepresented in cardiovascular clinical trials, resulting in a lack of sex-specific data. This is especially problematic in two situations, namely those where diseases manifest differently in women and men and those where biological differences between the sexes might affect the efficacy and/or safety of medication. There is therefore a pressing need for datasets with proper representation of women to address questions related to these situations. Clinical care data could fit this bill nicely because of their unique broad scope across both patient groups and clinical measures. This perspective piece presents the potential of clinical care data in sex differences research and discusses current challenges clinical care data-based research faces. It also suggests strategies to reduce the effect of these limitations, and explores whether clinical care data alone will be sufficient to close evidence gaps or whether a more comprehensive approach is needed.

Introduction

Women have historically been underrepresented in cardiovascular trials, leading to scarcity of sex-specific data (1). This has resulted in a lack of knowledge on how to best diagnose and treat women with cardiovascular disease, regardless of whether they suffer from subtypes common in both sexes like heart failure and coronary heart disease (2, 3) or ones that occur more frequently in women such as Tako Tsubo cardiomyopathy and spontaneous coronary artery dissection (4, 5). In addition, current treatment guidelines often recommend the same treatment and dosages for women and men, despite known sex differences in drug metabolism (6) that relate to a 1.5–1.7 times higher risk of adverse drug reactions (ADRs) in women receiving cardiovascular medications (7). Importantly, the underrepresentation of women in cardiovascular trials has remained despite more than 20 years of effort to increase enrolment of women in these trials (8, 9). In addition, trials often do not present their safety and efficacy findings stratified by sex (1012), further complicating research aiming to unravel sex-specific effects (13, 14). Hence, researchers need to look elsewhere for data to address these persisting evidence gaps. We argue that clinical care data could fit the bill nicely because of their unique broad scope across patient groups, time periods, and clinical measures. In this perspective piece, we will describe the potential of clinical care data for sex differences research and their inherent challenges, using ADRs as an example. We are aware that scarcity of data affects many facets of the sex differences research field, but believe the ADR case to be sufficiently representative to serve as an illustration of the potential of clinical care data. We will also discuss the future perspective and explore whether clinical care data alone will be sufficient to close existing evidence gaps or whether a more comprehensive approach is needed.

Generating evidence where there is none: the potential of clinical care datasets

The main attraction of clinical care datasets is their potential to generate evidence in a relatively short time period, without the need for laborious and expensive data collection associated with clinical trials and cohort studies. In addition, they are a direct reflection of the patient population seen in daily care with proper representation of subgroups like women, the elderly, and those with multimorbidity. Work from our own group has illustrated how a clinical care dataset comprised of 110,000 cardiac outpatients (15) can address questions about cardiovascular disease prediction (16), risk assessment (17), and treatment (18, 19) in women. This illustrates that there are many areas where clinical care data can contribute, but for the sake of brevity we will focus on the case of ADRs. Attempts at elucidating sex-specific ADRs based on trial data have been hampered by the limited incidence of ADRs in combination with the underrepresentation of women in these trials (20). Pharmacovigilance data have hinted at sex-specific ADR combinations (2123), such as a higher number of ACEI-related cough complaints in women (21). However, these studies are limited by their lack of information on sex-specific prescription rates. As a result, it is unclear whether the observed differences truly signal sex differences in ADR risk or are driven by differences in prescription rates between women and men. Two studies based on hospital data have supported the pharmacovigilance observations (24, 25), illustrating that clinical care date could be a valuable alternative source of information in this research area.

Challenges in working with clinical care datasets

Clinical care data also come with their unique quirks that set them apart from data collected for research purposes (2630). The most important difference is the reason behind data collection. Clinical care data is collected primarily for the purpose of delivering clinical care (28), meaning data collection is driven by medical need. This is inherently different from research datasets, where data is collected with the purpose of answering specific research questions.

Having medical need as the driver for data collection has various effects on the data, which can be divided into the comprehensiveness and the quality of the data (28). Comprehensiveness describes whether the dataset contains all relevant information about a single patient (28). Often clinical care datasets only capture a snapshot of the patient that contains the information clinically relevant at that time and thus do not tell a complete story. Information may remain out of reach, either because clinical care centres cannot collect information on patients that never visit or those that leave after being treated, or because one part of the system (hospitals) cannot access other parts (general practitioners) of the system, or because there is no medical reason to collect certain information. It may also be impossible to record certain information, for example due to time constraints or because equipment is not available, or because certain conditions do not yet exist as a designated diagnosis term or code (26, 29, 30). Existing beliefs about for example the likelihood that certain medication-ADR combinations occur in a sex-specific manner could also compromise comprehensiveness if either patients of one sex are more likely to report the ADR or physicians are more likely to specifically collect information on this ADR from one sex compared to the other due to this belief.

Quality is about how well the collected information reflects the truth about a single patient. Data entry in clinical care datasets is performed by healthcare professionals for healthcare professionals and is not subjected to extensive quality control. Entered information may be incorrect, inaccurate, incomplete, or incomprehensible (29, 30). These quality issues can arise both unintentionally (randomly) and systematically. Examples of the former are typos or something not being entered by accident. Examples of the latter are reimbursement coding systems that tend to mislabel certain conditions, diagnostic codes that change over time (29, 30), or the use of ambiguous abbreviations in free text summaries. Another important aspect of quality is whether the recorded information can be operationalised. For example, information recorded in free text format cannot be used without properly developed text retrieval methods (29). This is especially relevant for ADRs, as these are often only recorded within free text fields.

These considerations lie at the basis of deciding whether a clinical care dataset is fit for purpose, meaning that the information collected is of sufficient comprehensiveness and quality to answer the research question posed (26). Another concept that ties in with this is validity, which is about whether the size of random and systematic error interferes with drawing sound conclusions (27). In other words, if a dataset contains too many random errors such as typos or systematic errors such as mislabelling the condition of interest, it cannot reliably answer the research question. Taken together, these concepts offer researchers a crude guide for deciding whether or not to use clinical care data. However, this crude guide is not always sufficient to navigate the many nuances and grey areas surrounding the use of clinical care data. There are some published examples on how to deal with these kind of trade-offs (3133) and a short guide on doing research with clinical care data (34), which we encourage readers to consult. However, the situation of sex differences research is unique in that in some areas the only information available comes from clinical care datasets. In this case, the opportunity to create new insights may easily outweigh potential limitations or drawbacks of a clinical data source. Nevertheless, there are four important questions to consider:

(1) Does the dataset cover the population of interest and collects the information required to answer the research question of interest?

(2) Are all members of the population of interest equally likely to be included and followed up in the dataset?

(3) Is missing data on relevant parameters not related to the exposure or outcome of interest?

(4) Can you reliably infer causality by correction for confounding (in the case of causal research)?

If the answer to any of these is “no”, the clinical data source cannot be used to answer the research question of interest. Sometimes the issue identified based on these questions can be mitigated to create the best possible alternative. For example, a lack of information on relevant outcome measures like ADRs (question 1) could be solved by operationalising the free text fields that contain this information. In cases where follow-up is not uniform across all individuals of the population of interest (question 2), passive follow-up through record linkage may be a solution. Several approaches to missing data (question 3) exist and these can address a variety of situations (35), except if missingness is truly related to the exposure or outcome of interest (not missing at random). Lastly, the choice of study design may reduce (unmeasured) confounding (question 4), which will be discussed in the next section.

Of course, choosing the best possible alternative will always be connected to inherent limitations. However, being hung up on those limitations and therefore abandoning all projects that cannot be performed under perfect conditions is unrealistic and undermines the potential advantages clinical care data can bring. In addition, these four questions can serve as a tool to separate clinically relevant questions that can be answered with clinical care data from those that cannot. This not only highlights the potential of clinical care datasets, but also identifies which clinically relevant questions still require a cohort study or clinical trial to be answered and thus should have priority on the research agenda.

Accessing clinical care data can also be challenging due to ethical issues surrounding patient privacy and safety. In the case of structured data, this can be mitigated by de-identifying potentially sensitive data. For example, records can be assigned a random record number instead of using patient numbers, dates of birth can be recoded into year of birth, and postal codes can be recoded into area codes. There are also algorithms available that can remove identifying information like names and dates from medical text (36). Another option is to adhere to a common data model, where the raw patient data remains with the local data owner but the structure and content (e.g., variable names, variable meanings) are standardised to a specific format also known by the researcher. The researcher can then prepare analysis scripts and let the local data owner run them, which means the researcher themselves never get direct access to the data and any sensitive information stored there (37, 38).

The future perspective on clinical care data for sex differences research

There are two main developments that are important for the future of clinical care data-based research. The first are methodological advances that can mitigate the effect of data quality issues, such as more advanced text mining tools to extract information from free text fields. This is especially relevant for text that is not written in English, as currently available tools based on the English language may not function as well when applied to other languages (39). Moreover, clinical care data may require the development and application of novel study designs or analysis methods to deal with (unmeasured) confounding. The propensity score methods that originated in the counterfactual approach are one example (40), another is the use of self-controlled designs (41) or negative controls (42) in pharmacoepidemiologic studies of medication safety and effectiveness.

The second are improvements at the data-entry end, as better quality data input can potentially prevent many of the current issues from existing in the first place (28). In addition, such improvements can radically reduce the time needed for data cleaning and organising (‘data wrangling’) that currently takes up 60%–80% of time allocated for data science projects (43). There are many different ways to improve data entry, including stimulating healthcare professionals to adhere to data entry protocols, creating a data collection infrastructure that supports healthcare professionals in reliable data entry, or building tools that automatically turn messy speech or free text data into structured variables, among others (26, 28, 44). These should ideally be implemented with input from all parties involved, creating a feedback loop between researchers and healthcare professionals resulting in better quality data in the long term. This way, several of the current inherent limitations of clinical care data will slowly be filtered out, further pushing the balance towards the potential of these datasets to shed light on currently understudied topics in sex differences research.

Closing existing evidence gaps, can clinical care data do it alone?

When faced with a daunting lack of sex-specific data, clinical care datasets may currently be the only resource one can turn to. Although clinical care data-based work generates momentum for sex differences research and pushes important sex-related questions into the limelight, its influence somehow does not reach daily clinical practice and the patients that may benefit.

In the current evidence-based medicine landscape, observational data only has a small role to play compared with clinical trials, which are considered the pinnacle of reliable evidence (45). This would mean that clinical care data can at most have a modest contribution in improving daily practice, even though they have so much potential. Clever study designs that incorporate the strengths of clinical care data into clinical trial settings, such as registry-based trials (46), have been suggested and applied to expand the sphere of influence clinical care data can exert. This innovative approach to study design could also be valuable for sex differences research, especially because there are questions that cannot be answered with clinical care data alone. For example, observational studies have hinted at benefits of sex-specific dosage but can never fully correct for the influences of confounding by indication and residual confounding (13, 47). Narrowing down the optimal dosing practice for each sex requires proper randomisation and dose-finding trials. In these situations, clinical care data can contribute by informing the field about which specific medications might merit additional trials, directing the limited resources available to the most relevant questions. Additionally, they could serve as the selection pool from which trial participants are included in these trials. However, this will only work in combination with other improvements that combat the underrepresentation of women and lack of sex-stratified reporting. Otherwise, the percentage of women participating in clinical trials may remain too low for meaningful sex-specific analyses, illustrated by the recent Low-Dose Colchicine 2 trial where only 15% of participants was female (48).

Discussion

Summarising, questions regarding sex-specific medication dosage need a combination of clinical care and clinical trial data to be answered. However, clinical care data-based evidence should be given more credit in other fields of sex differences research, especially regarding ADRs. Clinical trials may be able to distinguish true ADR risk from any nocebo effects thanks to randomisation (49), but are otherwise not the best place to look for ADR data. With their highly specific study populations and relatively short follow-up times, trials are not powered to pick up on ADRs. Especially those that are rare or mainly occur in patient subgroups unlikely to meet the inclusion criteria. In addition, trials often actively exclude patients experiencing ADRs during the run-in period. Pharmacovigilance databases fill this gap, but lack information on prescription rates and patient-level characteristics. The latter in particular complicates the translation of pharmacovigilance findings to the clinic, because it is impossible to characterise the patient population the results pertain to. Clinical care data could have a big role to play here, especially when data entry becomes more standardised and of better quality.

However, caution is also advised because not all questions can be answered with clinical care data. It is important to realise that large amounts of data do not automatically guarantee proper quality data, especially because clinical care data are inherently different from data collected for research purposes. Researchers should always check whether a given clinical care dataset is fit for purpose. This perspective provides a four-question checklist that serves as the starting point for a fitness for purpose check, and we encourage researchers to use this checklist both when designing their own clinical care data-based studies and when reading clinical care data-based work from others.

To conclude, at the moment clinical care data offer many opportunities to generate interesting and relevant insights regarding existing evidence gaps, even though it cannot close them all without additional trial data. In addition, a fitness for purpose check is vital to ensure clinical care data-based research creates valid and reliable results. Nevertheless, as the quality of clinical care data and its research is only expected to grow in the future, the potential will further outshine the pitfalls, making it a valuable source for sex differences research.

Data availability statement

All datasets analyzed for this study are included in the manuscript.

Author contributions

SB, NO and HR conceived the idea. SB wrote the manuscript, NO and HR critically revised the manuscript. All authors contributed to the article and approved the submitted version.

Funding

This work was supported by the Dutch Cardiovascular Alliance consortium DCVA IMPRESS (2020B004) and ERC Consolidator grant UCARE (866478). The funders were not involved in the writing of this manuscript.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Scott PE, Unger EF, Jenkins MR, Southworth MR, McDowell TY, Geller RJ, et al. Participation of women in clinical trials supporting FDA approval of cardiovascular drugs. J Am Coll Cardiol. (2018) 71(18):1960–9. doi: 10.1016/j.jacc.2018.02.070

PubMed Abstract | CrossRef Full Text | Google Scholar

2. Dunlay SM, Roger VL, Redfield MM. Epidemiology of heart failure with preserved ejection fraction. Nat Rev Cardiol. (2017) 14(10):591–602. doi: 10.1038/nrcardio.2017.65

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Mehta LS, Beckie TM, DeVon HA, Grines CL, Krumholz HM, Johnson MN, et al. Acute myocardial infarction in women: a scientific statement from the American heart association. Circ. (2016) 133(9):916–47. doi: 10.1161/CIR.0000000000000351

CrossRef Full Text | Google Scholar

4. Hayes SN, Kim ESH, Saw J, Adlam D, Arslanian-Engoren C, Economy KE, et al. Spontaneous coronary artery dissection: current state of the science: a scientific statement from the American heart association. Circ. (2018) 137(19):e523–e57. doi: 10.1161/CIR.0000000000000564

CrossRef Full Text | Google Scholar

5. Kato K, Lyon AR, Ghadri JR, Templin C. Takotsubo syndrome: aetiology, presentation and treatment. Heart. (2017) 103(18):1461–9. doi: 10.1136/heartjnl-2016-309783

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Soldin OP, Mattison DR. Sex differences in pharmacokinetics and pharmacodynamics. Clin Pharmacokinet. (2009) 48(3):143–57. doi: 10.2165/00003088-200948030-00001

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Rosano GM, Lewis B, Agewall S, Wassmann S, Vitale C, Schmidt H, et al. Gender differences in the effect of cardiovascular drugs: a position document of the working group on pharmacology and drug therapy of the ESC. Eur Heart J. (2015) 36(40):2677–80. doi: 10.1093/eurheartj/ehv161

PubMed Abstract | CrossRef Full Text | Google Scholar

8. Harris DJ, Douglas PS. Enrollment of women in cardiovascular clinical trials funded by the national heart, lung, and blood institute. N Engl J Med. (2000) 343(7):475–80. doi: 10.1056/NEJM200008173430706

PubMed Abstract | CrossRef Full Text | Google Scholar

9. Lam CSP. How to incorporate sex and gender into the design of cardiovascular clinical trials. Circ. (2022) 145(7):499–501. doi: 10.1161/CIRCULATIONAHA.121.058771

CrossRef Full Text | Google Scholar

10. Blauwet LA, Hayes SN, McManus D, Redberg RF, Walsh MN. Low rate of sex-specific result reporting in cardiovascular trials. Mayo Clin Proc. (2007) 82(2):166–70. doi: 10.1016/S0025-6196(11)60993-2

PubMed Abstract | CrossRef Full Text | Google Scholar

11. Blauwet LA, Redberg RF. The role of sex-specific results reporting in cardiovascular disease. Cardiol Rev. (2007) 15(6):275–8. doi: 10.1097/CRD.0b013e318158b45b

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Schreuder MM, Boersma E, Kavousi M, Visser LE, Roos-Hesselink JW, Versmissen J, et al. Reporting of sex-specific outcomes in trials of interventions for cardiovascular disease: has there been progress? Maturitas. (2021) 144:1–3. doi: 10.1016/j.maturitas.2020.09.007

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Bots SH, den Ruijter HM. Recommended heart failure medications and adverse drug reactions in women. Circ. (2019) 139(12):1469–71. doi: 10.1161/CIRCULATIONAHA.118.037585

CrossRef Full Text | Google Scholar

14. Bots SH, Groepenhoff F, Eikendal ALM, Tannenbaum C, Rochon PA, Regitz-Zagrosek V, et al. Adverse drug reactions to guideline-recommended heart failure drugs in women: a systematic review of the literature. JACC Heart Fail. (2019) 7(3):258–66. doi: 10.1016/j.jchf.2019.01.009

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Bots SH, Siegersma KR, Onland-Moret NC, Asselbergs FW, Somsen GA, Tulevski II, et al. Statins are associated with a large reduction in all-cause mortality in women from a cardiac outpatient population. Open Heart (2022) 9:e001900. doi: 10.1136/openhrt-2021-001900

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Groepenhoff F, Eikendal ALM, Onland-Moret NC, Bots SH, Menken R, Tulevski II, et al. Coronary artery disease prediction in women and men using chest pain characteristics and risk factors: an observational study in outpatient clinics. BMJ Open. (2020) 10(4):e035928. doi: 10.1136/bmjopen-2019-035928

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Siegersma KR, Groepenhoff F, Onland-Moret NC, Tulevski II, Hofstra L, Somsen GA, et al. New York Heart association class is strongly associated with mortality beyond heart failure in symptomatic women. Eur Heart J Qual Care Clin Outcomes. (2021) 7(2):214–5. doi: 10.1093/ehjqcco/qcaa091

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Bots SH, Onland-Moret NC, Jancev M, Hollander M, Tulevski II, Hofstra L, et al. Statins are associated with a large reduction in all-cause mortality in women from a cardiac outpatient population. Open Heart. (2022) 9:e001900. doi: 10.1136/openhrt-2021-001900

PubMed Abstract | CrossRef Full Text | Google Scholar

19. Bots SH, Onland-Moret NC, Tulevski II, van der Harst P, Cramer MJM, Asselbergs FW, et al. Heart failure medication dosage and survival in women and men seen at outpatient clinics. Heart. (2021) 107(21):1748–55. doi: 10.1136/heartjnl-2021-319229

PubMed Abstract | CrossRef Full Text | Google Scholar

20. Pilote L, Raparelli V. Participation of women in clinical trials: not yet time to rest on our laurels. J Am Coll Cardiol. (2018) 71(18):1970–2. doi: 10.1016/j.jacc.2018.02.069

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Alharbi FF, Kholod AAV, Souverein PC, Meyboom RH, de Groot MCH, de Boer A, et al. The impact of age and sex on the reporting of cough and angioedema with renin-angiotensin system inhibitors: a case/noncase study in VigiBase. Fundam Clin Pharmacol. (2017) 31(6):676–84. doi: 10.1111/fcp.12313

PubMed Abstract | CrossRef Full Text | Google Scholar

22. de Vries ST, Denig P, Ekhart C, Burgers JS, Kleefstra N, Mol PGM, et al. Sex differences in adverse drug reactions reported to the national pharmacovigilance centre in The Netherlands: an explorative observational study. Br J Clin Pharmacol. (2019) 85(7):1507–15. doi: 10.1111/bcp.13923

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Yu Y, Chen J, Li D, Wang L, Wang W, Liu H. Systematic analysis of adverse event reports for sex differences in adverse drug events. Sci Rep. (2016) 6:24955. doi: 10.1038/srep24955

PubMed Abstract | CrossRef Full Text | Google Scholar

24. Rodenburg EM, Stricker BH, Visser LE. Sex-related differences in hospital admissions attributed to adverse drug reactions in The Netherlands. Br J Clin Pharmacol. (2011) 71(1):95–104. doi: 10.1111/j.1365-2125.2010.03811.x

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Zopf Y, Rabe C, Neubert A, Gassmann KG, Rascher W, Hahn EG, et al. Women encounter ADRs more often than do men. Eur J Clin Pharmacol. (2008) 64(10):999–1004. doi: 10.1007/s00228-008-0494-6

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Verheij RA, Curcin V, Delaney BC, McGilchrist MM. Possible sources of bias in primary care electronic health record data use and reuse. J Med Internet Res. (2018) 20(5):e185. doi: 10.2196/jmir.9134

PubMed Abstract | CrossRef Full Text | Google Scholar

27. Saracci R. Epidemiology in wonderland: big data and precision medicine. Eur J Epidemiol. (2018) 33(3):245–57. doi: 10.1007/s10654-018-0385-9

PubMed Abstract | CrossRef Full Text | Google Scholar

28. Weiner MG, Embi PJ. Toward reuse of clinical data for research and quality improvement: the end of the beginning? Ann Intern Med. (2009) 151(5):359–60. doi: 10.7326/0003-4819-151-5-200909010-00141

PubMed Abstract | CrossRef Full Text | Google Scholar

29. Hersh WR, Weiner MG, Embi PJ, Logan JR, Payne PR, Bernstam EV, et al. Caveats for the use of operational electronic health record data in comparative effectiveness research. Med Care. (2013) 51(8 Suppl 3):S30–7. doi: 10.1097/MLR.0b013e31829b1dbd

PubMed Abstract | CrossRef Full Text | Google Scholar

30. Overhage JM, Overhage LM. Sensible use of observational clinical data. Stat Methods Med Res. (2013) 22(1):7–13. doi: 10.1177/0962280211403598

PubMed Abstract | CrossRef Full Text | Google Scholar

31. Chubak J, Pocobelli G, Weiss NS. Tradeoffs between accuracy measures for electronic health care data algorithms. J Clin Epidemiol. (2012) 65(3):343–9.e2. doi: 10.1016/j.jclinepi.2011.09.002

PubMed Abstract | CrossRef Full Text | Google Scholar

32. von Lucadou M, Ganslandt T, Prokosch HU, Toddenroth D. Feasibility analysis of conducting observational studies with the electronic health record. BMC Med Inform Decis Mak. (2019) 19(1):202. doi: 10.1186/s12911-019-0939-0

PubMed Abstract | CrossRef Full Text | Google Scholar

33. Weiskopf NG, Weng C. Methods and dimensions of electronic health record data quality assessment: enabling reuse for clinical research. J Am Med Inform Assoc. (2013) 20(1):144–51. doi: 10.1136/amiajnl-2011-000681

PubMed Abstract | CrossRef Full Text | Google Scholar

34. Bots SH, Groenwold RHH, Dekkers OM. Using electronic health record data for clinical research: a quick guide. Eur J Endocrinol. (2022) 186(4):E1–e6. doi: 10.1530/EJE-21-1088

PubMed Abstract | CrossRef Full Text | Google Scholar

35. Van Buuren S. Flexible imputation of missing data: Boca Raton, Florida, United States of America: CRC press; (2018).

36. Menger V, Scheepers F, van Wijk LM, Spruit M. DEDUCE: a pattern matching method for automatic de-identification of Dutch medical text. Telemat and Inform. (2018) 35(4):727–36. doi: 10.1016/j.tele.2017.08.002

CrossRef Full Text | Google Scholar

37. Dodd C, Gini R, Sturkenboom M, Hoxhaj V, Hollestelle M, Thurin N, et al. Report on existing common data models and proposals for ConcePTION (D7.5). Zenodo, 2020.

38. OHDSI CDM Working Group. OMOP Common Data Model. 2021. https://ohdsi.github.io/CommonDataModel/index.html

39. Dombrowski Q. Preparing non-English texts for computational analysis. Modern Lanugages Open. (2020) 1:45. doi: 10.3828/mlo.v0i0.294

CrossRef Full Text | Google Scholar

40. Elze MC, Gregson J, Baber U, Williamson E, Sartori S, Mehran R, et al. Comparison of propensity score methods and covariate adjustment: evaluation in 4 cardiovascular studies. J Am Coll Cardiol. (2017) 69(3):345–57. doi: 10.1016/j.jacc.2016.10.060

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Hallas J, Pottegård A. Use of self-controlled designs in pharmacoepidemiology. J Intern Med. (2014) 275(6):581–9. doi: 10.1111/joim.12186

PubMed Abstract | CrossRef Full Text | Google Scholar

42. Lipsitch M, Tchetgen Tchetgen E, Cohen T. Negative controls: a tool for detecting confounding and bias in observational studies. Epidemiol. (2010) 21(3):383–8. doi: 10.1097/EDE.0b013e3181d61eeb

CrossRef Full Text | Google Scholar

43. Press G. Cleaning Big Data: Most Time-Consuming, Least Enjoyable Data Science Task, Survey Says. 2016. https://www.forbes.com/sites/gilpress/2016/03/23/data-preparation-most-time-consuming-least-enjoyable-data-science-task-survey-says/(accessed 11 March 2021).

44. Meystre SM, Lovis C, Bürkle T, Tognola G, Budrionis A, Lehmann CU. Clinical data reuse or secondary use: current Status and potential future progress. Yearb Med Inform. (2017) 26(1):38–52. doi: 10.15265/IY-2017-007

PubMed Abstract | CrossRef Full Text | Google Scholar

45. Murad MH, Asi N, Alsawas M, Alahdab F. New evidence pyramid. Evidence Based Med. (2016) 21(4):125–7. doi: 10.1136/ebmed-2016-110401

CrossRef Full Text | Google Scholar

46. James S, Rao SV, Granger CB. Registry-based randomized clinical trials–a new clinical trial paradigm. Nat Rev Cardiol. (2015) 12(5):312–6. doi: 10.1038/nrcardio.2015.33

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Santema BT, Ouwerkerk W, Tromp J, Sama IE, Ravera A, Regitz-Zagrosek V, et al. Identifying optimal doses of heart failure medications in men compared with women: a prospective, observational, cohort study. Lancet. (2019) 394(10205):1254–63. doi: 10.1016/S0140-6736(19)31792-1

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Nidorf SM, Fiolet ATL, Mosterd A, Eikelboom JW, Schut A, Opstal TSJ, et al. Colchicine in patients with chronic coronary disease. N Engl J Med. (2020) 383(19):1838–47. doi: 10.1056/NEJMoa2021372

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Gupta A, Thompson D, Whitehouse A, Collier T, Dahlof B, Poulter N, et al. Adverse events associated with unblinded, but not with blinded, statin therapy in the anglo-scandinavian cardiac outcomes trial—lipid-lowering arm (ASCOT-LLA): a randomised double-blind placebo-controlled trial and its non-randomised non-blind extension phase. Lancet. (2017) 389(10088):2473–81. doi: 10.1016/S0140-6736(17)31075-9

PubMed Abstract | CrossRef Full Text | Google Scholar

Keywords: real world evidence (RWE), sex differences, cardiovascular disease, electronic health records (EHR), women, epidemiology

Citation: Bots SH, Onland-Moret NC and den Ruijter HM (2023) Addressing persistent evidence gaps in cardiovascular sex differences research – the potential of clinical care data. Front. Glob. Womens Health 3:1006425. doi: 10.3389/fgwh.2022.1006425

Received: 29 July 2022; Accepted: 21 December 2022;
Published: 20 January 2023.

Edited by:

Cheryl Carcel, University of New South Wales, Australia

Reviewed by:

Paula Munoz Venturelli, Universidad del Desarrollo, Chile

© 2023 Bots, Onland-Moret and den Ruijter. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Sophie H. Bots cy5oLmJvdHNAdXUubmw=

Specialty Section: This article was submitted to Sex and Gender Differences in Disease, a section of the journal Frontiers in Global Women's Health

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.