Marieke Bak
Vince Istvan Madai
Marie-Christine Fritzsche
Michaela Th. Mayrhofer
Stuart McLennan- 1Department of Ethics, Law and Humanities, Amsterdam UMC, University of Amsterdam, Amsterdam, Netherlands
- 2QUEST Center for Responsible Research, Berlin Institute of Health (BIH), Charité Universitätsmedizin Berlin, Berlin, Germany
- 3School of Computing and Digital Technology, Faculty of Computing, Engineering and the Built Environment, Birmingham City University, Birmingham, United Kingdom
- 4Institute of History and Ethics in Medicine, TUM School of Medicine, Technical University of Munich, Munich, Germany
- 5ELSI Services and Research, Biobanking and BioMolecular Resources Research Infrastructure European Research Infrastructure Consortium (BBMRI-ERIC), Graz, Austria
Artificial intelligence (AI) in healthcare promises to make healthcare safer, more accurate, and more cost-effective. Public and private actors have been investing significant amounts of resources into the field. However, to benefit from data-intensive medicine, particularly from AI technologies, one must first and foremost have access to data. It has been previously argued that the conventionally used “consent or anonymize approach” undermines data-intensive medicine, and worse, may ultimately harm patients. Yet, this is still a dominant approach in European countries and framed as an either-or choice. In this paper, we contrast the different data governance approaches in the EU and their advantages and disadvantages in the context of healthcare AI. We detail the ethical trade-offs inherent to data-intensive medicine, particularly the balancing of data privacy and data access, and the subsequent prioritization between AI and other effective health interventions. If countries wish to allocate resources to AI, they also need to make corresponding efforts to improve (secure) data access. We conclude that it is unethical to invest significant amounts of public funds into AI development whilst at the same time limiting data access through strict privacy measures, as this constitutes a waste of public resources. The “AI revolution” in healthcare can only realise its full potential if a fair, inclusive engagement process spells out the values underlying (trans) national data governance policies and their impact on AI development, and priorities are set accordingly.
Introduction
The growth of digital health data and increasing computational capabilities have created significant opportunities for the use of artificial intelligence (AI) technology in healthcare. With the ability to learn from large volumes of clinical, -omics, and other health data, AI has the potential to support a wide range of activities: diagnosis, clinical decision making, personalized medicine, clinical research, drug development, administrative processes, and the mitigation of health disparities (Shibata & Wada, 2011; Fleming, 2018; Shortliffe & Sepúlveda, 2018; Davenport & Kalakota, 2019; Fiske, Henningsen, & Buyx, 2019; Liu et al., 2019; Schork, 2019; Woo, 2019). If data-intensive medicine can realize continuous improvement of healthcare quality and thereby reduce patient harm, improve health, empower personal decision making, and increase equity, it would fulfil the core ethical principles of healthcare (ABIM Foundation, 2002; Beauchamp & Childress, 2013; McLennan et al., 2018).
The potential opportunities of AI have led many countries, particularly in the European Union (EU), to invest significant financial and human resources in AI initiatives. In the past few years, previously unseen amounts of public and private investment have flowed into AI applications (KPMG, 2018; CB Insights, 2019). National AI strategies with large, dedicated budgets were published by many EU countries (Righi et al., 2022), e.g., the German federal government promised to allocate 3 billion EUR in funding between 2020–2025 (Die Bundesregierung, 2018). Funding for healthcare and medical AI-related research projects through the EU Horizon 2020 scheme increased between 2014–2020, although large differences in investments can be seen between Member States (around 80 million EUR was awarded to projects in each of the top-funded countries and around 100.000 EUR in countries receiving the lowest amount of funding) (De Nigris et al., 2020, p. 27). To guide the responsible design of these new AI systems in healthcare and beyond, several ethical and legal instruments were newly created by the European Commission (EC), such as the proposed Artificial Intelligence Act (EC, 2021), the Guidelines for Trustworthy AI (EC, 2019), and the updated Medical Device Regulation (EC, 2020), to complement the General Data Protection Regulation (GDPR) which remains the key legal instrument regarding data usage for AI development (EC, 2016).
The use of health data for AI development raises important data privacy concerns, both at an individual and group level (McLennan et al., 2018; Mittelstadt 2019). Thus, there is a tension between incentives and actions that promote AI and incentives and actions that limit access to the required data: “the data hunger of AI runs up against the norm of personal data minimization” (Sorell et al., 2022). This leads to complex dilemmas. All the resources and efforts currently devoted to AI development could go to waste if the issue of data access is not adequately addressed. In this context, it is noteworthy that the proposed EU AI Act requires, for example, the highest levels of data quality and quantity for sufficient training, validation, and testing as well as the necessary heterogeneity to cover relevant patient (sub)populations and variants in the intended clinical setting (Art. 10). This requires broad access to healthcare data, and tools not fulfilling these requirements would not be permitted. Countries must thus decide how to balance the positive goals of secondary-use activities like healthcare AI with mitigating associated privacy risks. These trade-offs raise issues of resource allocation and justice that have so far been largely neglected in policy debates and the scholarly literature. In this perspective article, we provide an overview of these macro-level ethical trade-offs related to data use for healthcare AI. While we remain neutral on how one should value data privacy and access, we conclude by providing procedural recommendations that allow this decision to be made in a fair manner.
Variation in European Union Data Governance
Health-related AI applications are in crucial need of patient data during the development of the AI model in the training, validation and test phases. These health data are often initially collected for a different purpose than AI development, and this secondary use requires a valid ethical and legal basis. In Europe, the central legal instrument in this domain remains the GDPR which is directly enforceable in all EU Member States and applies to all EU citizens. The GDPR has the dual aim of protecting personal data, meaning data that can be traced back to living individuals without unreasonable effort, and achieving a higher level of harmonization of data protection practices.
As a result of political compromises, however, the GDPR leaves it open in several places for Member States to issue derogations in their national law when it concerns public interest, scientific or historical research purposes or statistical purposes. (Heckmann and Scheurer, 2021). This may include deciding on what constitutes sufficient methods of pseudonymization, when data can be considered fully non-identifiable, what further restrictions should be imposed on processing sensitive data for research purposes, and what are sufficient safeguards and conditions for processing data under the research exemption (Shabani et al., 2018). In addition to the GDPR, national health and biobanking laws might also have implications for data protection requirements and ultimately access to health data and data governance. (Bak et al., 2020; Kindt et al., 2021; Slokenberga et al., 2021) As a result, there remains a wide variation of data governance approaches across Europe and the actual balance between data protection rules and access requirements is struck at country-level. In this regard more conservative Germany and more liberal Finland are examples of countries that differ in their approaches to data governance.
The Finnish approach to data access is evident in its Act on the Secondary Use of Health and Social Data (Ministry of Social Affairs and Health, 2019) which provides the basis for the national data permit authority FinData to facilitate access to and sharing of patient data. The country has adopted a national policy oriented towards big data and open data to transform the technical and governance infrastructure for AI and other computer science research (Aula, 2019). In Finland, consent is not legally required for including personal data in national health registries, but data access is controlled through detailed policies and security procedures (Vrijenhoek et al., 2021). Moreover, the Biobank Act (2012) which is currently undergoing further reform, allows samples and related data to be used for research purposes without (re-)consent for every research project, and biobank samples can be linked to health data from national registries. Being the frontrunner in developing a national AI strategy already in 2017, Finland is among the most digitally developed EU countries and provides an online service which citizens use to view their health information from different sources (EC, 2019; Jormanainen et al., 2019). There is an explicit focus on public education and awareness, including a free online AI course. As in other Nordic countries, Finland´s national AI strategy generally reflects the core values of trust, openness, and transparency (Robinson, 2020).
This contrasts with the German approach that has traditionally been geared toward comprehensive control and where health data research is usually conducted with patient consent. For example, consent is the legal basis for any processing of data stored in the newly launched electronic patient record (elektronische Patientenakte or ePA) whose use is voluntary, and which gives patients full control over their data (Molnar-Gabor et al., Forthcoming 2021). Data processing for scientific research in the public interest might take place without consent, if organizational and technical provisions are met, as specified in the Federal Data Protection Act (Molnár-Gábor et al., 2018). In 2018, the German State Minister for Digitalization stated that the country’s strict data protection laws block development in the healthcare sector (Kaiser, 23 December 2018). Indeed, in practice, this research exemption seems hardly ever used. A recent interview study with researchers, data protection officers and research ethics committee representatives in the state of Bavaria, found that German law was perceived as vague and was differently interpreted across federal states and institutions (McLennan et al., 2022a). This resulted in secondary health data research usually only taking place when consent had been obtained or data were fully anonymized.
Trade-Offs in Realizing the Potential of Artificial Intelligence in Healthcare
Data Privacy Versus Data Access
This variation in data governance approaches can hamper (inter-)national data sharing and makes it difficult to create disease registries and to develop AI tools (De Lange et al., 2019; McLennan et al., 2019; Haneef et al., 2020). The disagreement over the interpretation of certain provisions in the GDPR, including research exemptions, is not easily solved as it stems from different viewpoints on how to balance foundational values like informational self-determination versus solidarity (Hoffman et al., 2012; van Veen, 2018). Whether (national) strategies should focus on data privacy or data access is a difficult question linked to various ethical dilemmas. Namely, what we might identify as a more liberal approach to data access might have in turn serious implications for fundamental rights to privacy. A restrictive approach, on the other hand, might undermine data-intensive medicine and in turn cause harm by biasing models and leading to wasted investments into AI development.
Governments and institutions taking a more liberal approach to data governance, i.e., interpreting the GDPR generously by focusing on its harmonization and data sharing aim, may face complex ethical issues and public resistance. For instance, the care.data program in the United Kingdom famously collected health data for secondary use without informed consent and with limited options for opt-out, which adversely affected public trust in health data initiatives (Vezyridis & Timmons, 2017). Innovations in AI may promise to improve the quality of care and lower costs, but the need for detailed personal information as input data exacerbates known concerns about issues like data privacy, bias and discrimination (Mittelstadt & Floridi, 2016; Price & Cohen, 2019).
Those with a more restrictive view on data governance generally use the “consent or anonymize” mind set: personal data may only be used if informed consent is obtained or the information is fully anonymized (Mostert et al., 2016). However, requiring (re-)consent can lead to significant administrative and financial hurdles that delay important activities or even make them unfeasible (Tu et al., 2004; Jansen et al., 2007). Requiring (re-)consent may also lead to major selection biases that undermine data representativeness, which can lead to biased AI models that in turn harm patients and exacerbate existing health inequalities (Vayena et al., 2018). In addition, while consent may protect the privacy of persons whose data are used to train and test AI models (that is, if the information is clear and unambiguously presented and the patient is in a position to make a reasoned decision), it does not protect the privacy of others who did not consent but can still have inferences drawn about them based on rules derived from a cohort of consenting individuals (Barocas et al., 2014).
Furthermore, although anonymized data is out of scope of the GDPR, data anonymization is not free of technical, legal and ethical challenges. Full anonymization has become increasingly difficult due to the potential of cross-linking datasets and the inclusion of highly personal data like genetic sequences (Gymrek et al., 2013). Further, irreversible anonymization may involve removing essential information needed to perform secondary activities like research. Additionally, some authors argue that anonymization is merely possible in a specific context for a short period of time and requires regular reassessments to determine whether the status of anonymization can still be upheld, making it equally resource intense as asking consent (Sariyar and Schlünder, 2016). Even if full anonymization was possible and/or feasible, it offers no guarantees that AI models based on such “anonymous” data do not harm the individuals who donated their data (Barocas et al., 2014).
In Europe, concerns have been raised for several years about the “overprotection” of personal data under (draft versions of) the GDPR, which are still relevant given the varying interpretations of the regulation (Ploem et al., 2013; Author Anonymous, 2015; Timmers et al., 2019). In a recent open letter by genetic researchers, a similar concern was voiced about access to digital sequence information that can be used for public health, as policy negotiations are feared to favour data sovereignty and limit data sharing under the Convention on Biological Diversity (DSI, 2022). The broader debate on informational self-determination versus scientific data research dates back well into the previous century. Yet, when it comes to AI, we sometimes seem to forget that data access is the most important prerequisite for any AI innovation. This omission may lead to a situation where some policies follow the current trend of pouring tremendous resources into health AI developments when, at the same time, the success of the funded research is effectively made impossible due to the country´s specific interpretation of the GDPR and relevant national law.
Overprotection or Overinvestment?
The potential of healthcare AI in Europe is limited when countries’ data governance approaches are overly strict, ambiguous, or contradicting. Haneef et al. (2020) surveyed the use of AI by national public health institutes and found it limited in practice, reportedly due to the complexity of data regulation laws coupled with lack of human resources and the absence of a robust data governance framework in various countries and institutions. Enabling researchers to create AI applications that help improve care, requires giving them greater access to patient data, albeit conditional and within a secure environment. The EU and several Member States seek to achieve a win on all fronts, i.e., they want to become both a leading player in health AI as well as provide maximum protection regarding health data privacy. However, policy-makers must realize that hard choices are unavoidable to be able to strike the right balance in data governance.
Public resources are generally finite, so whether the right to health is best fulfilled by prioritizing investment in AI-driven technologies over data infrastructure development or other healthcare spending, is ethically relevant. As we indicated above, a country that takes a very restrictive approach to data access needs to take this into account when allocating funds. Future legislation such as the proposed EU AI act could essentially ban AI in healthcare applications if developers do not have broad access to relevant healthcare data and therefore cannot meet generalization and bias mitigation requirements. Thus, development of robust technological data management and governance structures, such as the proposed European Health Data Space (EHDS) and standards for interoperability of health records that promise to improve data access and usability (Shabani, 2022), should then be established prior or at least in parallel to the creation of specific AI tools. The European Investment Bank claims that the EU is limiting innovation by underinvesting in AI, quoting an investment gap of up to 10 billion EUR (Verbeek & Lundqvist, 2021), but we disagree with this general statement. Rather, investing in AI-driven healthcare technology that cannot prosper due to unresolved data governance issues would rather constitute an overinvestment, i.e., an unjust waste of resources.
Moreover, resources allocated to health AI may come at the expense of non-AI solutions. Since the value of AI remains uncertain and many health interventions in the field of AI are—thus far—of limited real-world effectiveness (D’Amour et al., 2020; Skorburg et al., 2021), it has been argued that policy-makers should not allocate resources to AI tools exclusively, especially when these resources could strengthen existing evidence-based solutions and help to overcome structural barriers to care (Skorburg et al., 2021). This dilemma is well-known in the field of public health. For instance, in the field of HIV prevention in low- and middle-income countries, the development of pharmaceutical PrEP (Pre-Exposure Prophylaxis) led to fears that funding for the free provision of condoms would be curtailed. However, PrEP, was never intended to be a stand-alone intervention and its combined use with condoms has proven to be more effective and acceptable than either intervention on its own (Bak et al., 2018). Similarly, the discussion around AI in medicine has shifted away from the complete replacement of physicians and their judgement to more synergistic uses of AI (i.e. doctors plus AI) (Mazzanti et al., 2018; Dos Santos et al., 2019). Thus, if actors decide to invest in health AI, this needs to be accompanied with investment into not only data access structures but also the surrounding healthcare system that interacts with the AI tool. Nonetheless, this might be difficult given resource constraints. How then should we decide what constitutes just resource allocation for health AI?
Towards a Fair Prioritization for Health Artificial Intelligence
Most of the literature on AI ethics focuses only on the fairness concerns inherent to this upcoming technology (e.g., related to bias and discrimination in the models), rather than on the trade-offs between data privacy and access and the resulting questions of resource allocation. For example, in the high-level expert guidance on Trustworthy AI by the EC, seven key requirements are listed that should be implemented by model developers and about which end-users should be informed (EC, 2019). By emphasizing the requirements of the AI system itself, however, the EC narrows the ethical debate to the interaction with a specific application. While such principlist guidelines can help sensitize professionals to the built-in values of AI applications, they do not provide a solution to the wider moral dilemmas that arise from value conflicts and resource limitations (Bak, 2020).
Discussions about ethical requirements for AI should thus be preceded by a broader ethical debate about these priorities: rather than just holding AI to account, our public investments in AI should be accountable. The policy and planning cycle of health intervention development helps illustrate our point (Figure 1). While the focus of most ethicists and policy-makers has been on step 3 (the design of the AI solution) and to a lesser extent steps 4 and 5 (implementation and evaluation), we want to refocus the debate on steps 1 and 2 of the cycle (identification of health needs and subsequent priority-setting). Our suggestion is in line with recommendations from the World Economic Forum that the creation of national AI strategies should start with a SWOT (strengths, weaknesses, opportunities, and threats) analysis, as was done in Finland, to keep policy goals in line with resource constraints and needs of citizens (Madzou et al., 2019). This is ultimately a political discussion, as is any debate on technology that involves choices between competing values.
FIGURE 1. Procedural fairness for priority-setting in health AI, with special attention for steps 1 and 2. Adapted from the Policy Cycle (Howlett & Giest, 2015).
The conditions of such societal debate can be found in the work of the American philosopher Norman Daniels (2007), who argues that when there is no consensus on substantive values, we should focus on procedural values. Fair process is important as it allows healthcare organizations to pursue their (research) policies with a mandate from society. This idea was formalized into a model known as Accountability for Reasonableness (A4R) which proposes key conditions for the legitimacy of decision-making in public health (Daniels & Sabin, 1997). It is beyond the scope of this paper to discuss the A4R framework in detail but it has been found valuable for the field of digital health (Wong, 2020) and was used for drafting the Montreal Declaration for Responsible Development of AI, which launched in 2017 after an extensive public deliberation process (Dilhac et al., 2018; Brall et al., 2019). We support the idea that A4R or similar procedural fairness frameworks should be used in deliberations about resource allocation for health AI.
Decision-makers in EU countries should structurally engage an inclusive group of researchers, data subjects, clinicians, and other relevant stakeholders, to deliberate the trade-offs between data privacy and the value of AI. We want to emphasize we do not suggest favouring any of the two approaches but propose that inclusive engagement or “data democracy” is needed to ensure that decisions empower affected communities and are sensitive to their specific needs, which in turn may help to promote public trust (Ienca et al., 2018; Kalluri, 2020; Nyrup, 2021). Ethicists may join the process to help explain and clarify complex moral questions (McLennan et al., 2022b). This of course requires transparent insight into the available budgets and competing needs. All in all, if such reflections lead to a country explicitly deciding to focus on a strict, conditional or liberal approach to data privacy and/or data access, that decision is morally legitimate if it fulfils conditions of procedural fairness, e.g. accountability and transparency.
Conclusion
The development and implementation of AI for healthcare comes with trade-offs: striving for all-embracing data privacy has proven incompatible with the desire to realize the full potential of AI for medical purposes. We have outlined that countries need to implement digital health strategies that are consistent, which requires an examination of the core values that underlie the national data governance frameworks. In a nutshell, they should deliberate with their citizens and be able to explain to them why they have set certain priorities, and the chosen balance between specific data privacy and data access conditions should be reflected in the national and ultimately European AI budgets. Failing to do so is leading to distributive justice concerns that should not be overlooked in debates on the ethical aspects of health-related AI.
Data Availability Statement
The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.
Author Contributions
SM, MB, MF and VM conceived the initial idea of the paper. MB prepared the initial draft with the assistance of SM. MF, VM and MM reviewed the draft and critically revised it for important intellectual content. All authors read and approved the final version of the article.
Author Disclaimer
Where authors are identified as personnel of the Biobanking and BioMolecular resources Research Infrastructure (BBMRI-ERIC), the authors alone are responsible for the views expressed in this article and they do not necessarily represent the decisions, policy or views of BBMRI-ERIC.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
ABIM Foundation (2002). Medical Professionalism in the New Millennium: a Physician Charter. Ann. Intern Med. 136 (3), 243–246. doi:10.7326/0003-4819-136-3-200202050-00012
Aula, V. (2019). Institutions, Infrastructures, and Data Friction‑Reforming Secondary Use of Health Data in Finland. Big Data Society 6 (2).
Bak, M. A. R. (2020). Computing Fairness: Ethics of Modeling and Simulation in Public Health. Simulation 98 (2), 103–111. doi:10.1177/0037549720932656
Bak, M. A. R., Ploem, M. C., Ateşyürek, H., Blom, M. T., Tan, H. L., and Willems, D. L. (2020). Stakeholders' Perspectives on the Post-mortem Use of Genetic and Health-Related Data for Research: a Systematic Review. Eur. J. Hum. Genet. 28 (4), 403–416. doi:10.1038/s41431-019-0503-5
Bak, M. A. R., van Dam, A., and Janssens, R. (2018). Awareness and Acceptability of Pre-exposure Prophylaxis (PrEP) Among Men Who Have Sex with Men in Kazakhstan: a Mixed Methods Study. Central Asian J. Med. Sci. 4 (2), 102–115.
Barocas, S., Nissenbaum, H., Lane, J, Stodden, V, Bender, S, and Nissenbaum, H. (2014). Big Data’s End Run Around Anonymity and Consent. Priv. big data, public good Fram. Engagem. 1, 44–75. doi:10.1017/cbo9781107590205.004
Beauchamp, T. L., and Childress, J. F. (2013). Principles of Biomedical Ethics. 7th ed. Oxford: Oxford University Press.
Brall, C., Schröder-Bäck, P., and Maeckelberghe, E. (2019). Ethical Aspects of Digital Health from a Justice Point of View. Eur. J. public health 29, 18–22. doi:10.1093/eurpub/ckz167
CB Insights (2019). Global Healthcare Report Q2 2019. Available at: https://www.cbinsights.com/research/report/healthcare-trends-q2-2019.
D’Amour, A., Heller, K., Moldovan, D., Adlam, B., Alipanahi, B., Beutel, A., et al. (2020). Underspecification Presents Challenges for Credibility in Modern Machine Learning. arXiv [Preprint]. Available at: https://arxiv.org/abs/2011.03395.
Daniels, N., and Sabin, J. (1997). Limits to Health Care: Fair Procedures, Democratic Deliberation, and the Legitimacy Problem for Insurers. Philosophy Public Aff. 26, 303–350. doi:10.1111/j.1088-4963.1997.tb00082.x
Davenport, T., and Kalakota, R. (2019). The Potential for Artificial Intelligence in Healthcare. Future Healthc. J. 6, 94–98. doi:10.7861/futurehosp.6-2-94
De Lange, D. W., Guidet, B., Andersen, F. H., Artigas, A., Bertolini, G., Moreno, R., et al. (2019). Huge Variation in Obtaining Ethical Permission for a Non-interventional Observational Study in Europe. BMC Med. Ethics. 20 (1). doi:10.1186/s12910-019-0373-y
De Nigris, S., Craglia, M., Nepelski, D., Hradec, J., Gómez-González, E., Gomez, E., et al. (2020). AI Watch: AI Uptake in Health and Healthcare 2020. Luxembourg: Publications Office of the European Union. 978-92-76-26936-6. EUR 30478 EN, (JRC122675. doi:10.2760/948860
Die Bundesregierung (2018). Strategie Künstliche Intelligenz der Bundesregierung. Berlin: German Government.
Dilhac, M., Abrassart, C., and Voarino, N. (2018). Report On the Montréal Declaration for a Responsible Development of Artificial Intelligence. Univ. Montréal. Available at: https://www.montrealdeclaration-responsibleai.com/.
DSI Scientific Network (2022). Open Letter. Available at: https://www.dsiscientificnetwork.org/open-letter/.
European Commission (2019). Ethics Guidelines for Trustworthy AI. https://ec.europa.eu/digital-single-market/en/news/ethics-guidelines-trustworthy-ai.
European Commission (2021). Proposal for a Regulation of the European Parliament and of the Council Laying Down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act) and Amending Certain Union Legislative Acts.
European Commission (2016). Regulation (EU) 2016/679 of the European Parliament and of the Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Protection Regulation) (Text with EEA Relevance). OJ L 119/1.
European Commission (2020). Regulation (EU) 2017/745 of the European Parliament and of the Council of 5 April 2017 on Medical Devices, Amending Directive 2001/83/EC, Regulation (EC) No 178/2002 and Regulation (EC) No 1223/2009 and Repealing Council Directives 90/385/EEC and 93/42/EEC (Text with EEA Relevance). Text EEA relevance.
Fiske, A., Henningsen, P., and Buyx, A. (2019). Your Robot Therapist Will See You Now: Ethical Implications of Embodied Artificial Intelligence in Psychiatry, Psychology, and Psychotherapy. J. Med. Internet. Res. 21, e13216. doi:10.2196/13216
Fleming, N. (2018). How Artificial Intelligence Is Changing Drug Discovery. Nature 557, S55–S57. doi:10.1038/d41586-018-05267-x
Gymrek, M., McGuire, A. L., Golan, D., Halperin, E., and Erlich, Y. (2013). Identifying Personal Genomes by Surname Inference. Science 339, 321–324. doi:10.1126/science.1229566
Haneef, R., Delnord, M., Vernay, M., Bauchet, E., Gaidelyte, R., Van Oyen, H., et al. (2020). Innovative Use of Data Sources: A Cross-Sectional Study of Data Linkage and Artificial Intelligence Practices across European Countries. Arch. Public Health. 78 (1), 55–11. doi:10.1186/s13690-020-00436-9
Heckmann, D., and Scheurer, M. (2021). “Datenschutzrecht,” in Praxiskommentar Internetrecht. Juris. Editors D. Heckmann, and A. Paschke.
Hoffman, S., and Podgurski, A. (2012). Balancing Privacy, Autonomy, and Scientific Needs in Electronic Health Records Research. SMUL Rev. 65, 85.
Howlett, M., and Giest, S. (2015). “The Policy-Making Process,” in Routledge Handbook of Public Policy. Editors E. Araral, S. Fritzen, M. Howlett, M. Ramesh, and X. Wu (London: Routledge), 17–18.
Jansen, T. C., Kompanje, E. J. O., Druml, C., Menon, D. K., Wiedermann, C. J., and Bakker, J. (2007). Deferred Consent in Emergency Intensive Care Research: what if the Patient Dies Early? Use the Data or Not? Intensive Care Med. 33, 894–900. doi:10.1007/s00134-007-0580-8
Jormanainen, V., Parhiala, K., Niemi, A., Erhola, M., Keskimäki, I., and Kaila, M. (2019). Half of the Finnish Population Accessed Their Own Data: Comprehensive Access to Personal Health Information Online Is a Corner-Stone of Digital Revolution in Finnish Health and Social Care. Finn. J. eHealth Welf. 11 (4). doi:10.23996/fjhw.83323
Kaiser, T. (2018). Dorothee Bär will Datenschutz für Patienten lockern. Die Welt. Available at: https://www.welt.de/wirtschaft/article186013534/Dorothee-Baer-will-Datenschutz-fuer-Patienten-lockern.html.
Kalluri, P. (2020). Don't Ask if Artificial Intelligence Is Good or Fair, Ask How it Shifts Power. Nature 583, 169. doi:10.1038/d41586-020-02003-2
Kindt, E., Fontanillo Lopez, C. A., Czarnocki, J., Kanevskaia, O., and Herveg, J. (2021). Study on the Appropriate Safeguards Required under Article 89(1) of the GDPR for the Processing of Personal Data for the Scientific Research. Prep. by Milieu under lead KU-Leuven under Contract No EDPS/2019/02-08 benefit EDPB.
KPMG Enterprise (2018). Venture Pulse: Q1’18 Global Analysis of Venture Funding. Available at: https://home.kpmg/xx/en/home/insights/2018/04/venture-pulse-q1-18-global-analysis-of-venture-funding.html.
Ienca, M., Ferretti, A., Hurst, S., Puhan, M., Lovis, C., and Vayena, E. (2018). Considerations for Ethics Review of Big Data Health Research: A Scoping Review. PloS one 13 (10), e0204937.
Liu, X., Faes, L., Kale, A. U., Wagner, S. K., Fu, D. J., Bruynseels, A., et al. (2019). A Comparison of Deep Learning Performance against Health-Care Professionals in Detecting Diseases from Medical Imaging: a Systematic Review and Meta-Analysis. Lancet Digital Health 1, e271–e297. doi:10.1016/s2589-7500(19)30123-2
Madzou, L., Shukla, P., Caine, M., Campbell, T. A., Davis, N., Firth-Butterfield, K., et al. (2019). A Framework for Developing a National Artificial Intelligence Strategy. World Econ. Forum White Pap. Available at: https://www3.weforum.org/docs/WEF_National_AI_Strategy.pdf.
Mazzanti, M., Shirka, E., Gjergo, H., and Hasimi, E. (2018). Imaging, Health Record, and Artificial Intelligence: Hype or Hope? Curr. Cardiol. Rep. 20 (6), 48–49. doi:10.1007/s11886-018-0990-y
McLennan, S., Fiske, A., Tigard, D., Müller, R., Haddadin, S., and Buyx, A. (2022a). Embedded Ethics: a Proposal for Integrating Ethics into the Development of Medical AI. BMC Med. Ethics 23 (1), 6–10. doi:10.1186/s12910-022-00746-3
McLennan, S., Kahrass, H., Wieschowski, S., Strech, D., and Langhof, H. (2018). The Spectrum of Ethical Issues in a Learning Health Care System: a Systematic Qualitative Review. Int. J. Qual. Health Care. 30 (3), 161–168. doi:10.1093/intqhc/mzy005
McLennan, S., Rachut, S., Lange, J., Fiske, A., Heckmann, D., and Buyx, A. (2022b). Practices and Attitudes of Bavarian Stakeholders Regarding the Secondary-Use of Health Data for Research Purposes during the COVID-19 Pandemic: a Qualitative Interview Study. JMIR Prepr. 14/04/2022:38754.
McLennan, S., Shaw, D., and Celi, L. A. (2019). The Challenge of Local Consent Requirements for Global Critical Care Databases. Intensive Care Med. 45 (2), 246–248. doi:10.1007/s00134-018-5257-y
Ministry of Social Affairs and Health, Finland (2019). Act on the Secondary Use of Health and Social Data.
Mittelstadt, B. D., and Floridi, L. (2016). The Ethics of Big Data: Current and Foreseeable Issues in Biomedical Contexts, Sci. Eng. Ethics, 22, 2, 445–480. The Ethics of Biomedical Big Data. Springer. doi:10.1007/978-3-319-33525-4_19
Mittelstadt, B. (2019). The Ethics of Biomedical 'Big Data' Analytics. Philos. Technol. 32 (1), 17–21. doi:10.1007/s13347-019-00344-z
Molnár-Gábor, F. (2018). Germany: a Fair Balance between Scientific Freedom and Data Subjects’ Rights? Hum. Genet. 137 (8), 619–626.
Molnar-Gabor, F., Sellner, J., Pagil, S., Slokenberga, S., Tzortzatou, O., and Nyström, K. (Forthcoming 2021). Harmonization after the GDPR? Divergences in the Rules for Genetic and Health Data Sharing in Four Member States and Ways to Overcome Them by EU Measures: Insights from Germany, Greece, Latvia and Sweden. Seminars in Cancer Biology.
Mostert, M., Bredenoord, A. L., Biesaart, M. C. I. H., and Van Delden, J. J. M. (2016). Big Data in Medical Research and EU Data Protection Law: Challenges to the Consent or Anonymise Approach. Eur. J. Hum. Genet. 24 (7), 956–960. doi:10.1038/ejhg.2015.239
Nyrup, R. (2021). From General Principles to Procedural Values: Responsible Digital Health Meets Public Health Ethics. Front. Digit. Health 3, 690417. doi:10.3389/fdgth.2021.690417
Pinto dos Santos, D., Giese, D., Brodehl, S., Chon, S. H., Staab, W., Kleinert, R., et al. (2019). Medical Students' Attitude towards Artificial Intelligence: a Multicentre Survey. Eur. Radiol. 29 (4), 1640–1646. doi:10.1007/s00330-018-5601-1
Ploem, M. C., Essink-Bot, M. L., and Stronks, K. (2013). Proposed EU Data Protection Regulation Is a Threat to Medical Research. BMJ 346, f3534. doi:10.1136/bmj.f3534
Price, W. N., and Cohen, I. G. (2019). Privacy in the Age of Medical Big Data. Nat. Med. 25 (1), 37–43. doi:10.1038/s41591-018-0272-7
Righi, R., Pineda, C., Cardona, M., Soler Garrido, J., Papazoglou, M., and Samoili, S. (2022). AI Watch Index 2021. Luxembourg: Publications Office of the European Union: Joint Research Centre (JRC), European Commission.
Robinson, S. C. (2020). Trust, Transparency, and Openness: How Inclusion of Cultural Values Shapes Nordic National Public Policy Strategies for Artificial Intelligence (AI). Technol. Soc. 63, 101421. doi:10.1016/j.techsoc.2020.101421
Sariyar, M., and Schlünder, I. (2016). Reconsidering Anonymization-Related Concepts and the Term "Identification" against the Backdrop of the European Legal Framework. Biopreservation Biobanking 14 (5), 367–374. doi:10.1089/bio.2015.0100
Schork, N. J. (2019). Artificial Intelligence and Personalized Medicine. Cancer Treat. Res. 178, 265–283. doi:10.1007/978-3-030-16391-4_11
Shabani, M., and Borry, P. (2018). Rules for Processing Genetic Data for Research Purposes in View of the New EU General Data Protection Regulation. Eur. J. Hum. Genet. 26, 149–156. doi:10.1038/s41431-017-0045-7
Shabani, M. (2022). Will the European Health Data Space Change Data Sharing Rules? Science 375 (6587), 1357–1359. doi:10.1126/science.abn4874
Shibata, T., and Wada, K. (2011). Robot Therapy: A New Approach for Mental Healthcare of the Elderly – A Mini-Review. Gerontology 57, 378–386. doi:10.1159/000319015
Shortliffe, E. H., and Sepúlveda, M. J. (2018). Clinical Decision Support in the Era of Artificial Intelligence. JAMA 320, 2199–2200. doi:10.1001/jama.2018.17163
Skorburg, J. A., and Yam, J. (2021). Is There an App for that?: Ethical Issues in the Digital Mental Health Response to COVID-19. AJOB Neurosci., 1–14. doi:10.1080/21507740.2021.1918284
Slokenberga, S., Tzortzatou, O., and Reichel, J. (2021). GDPR and Biobanking: Individual Rights, Public Interest and Research Regulation across Europe. Cham, Switzerland: Springer Nature, 434.
Sorell, T., Rajpoot, N., and Verrill, C. (2022). Ethical Issues in Computational Pathology. J. Med. Ethics. 48 (4), 278–284. doi:10.1136/medethics-2020-107024
Timmers, M., Van Veen, E.-B., Maas, A. I. R., and Kompanje, E. J. O. (2019). Will the EU Data Protection Regulation 2016/679 Inhibit Critical Care Research? Med. Law Rev. 27 (1), 59–78. doi:10.1093/medlaw/fwy023
Tu, J. V., Willison, D. J., Silver, F. L., Fang, J., Richards, J. A., Laupacis, A., et al. (2004). Impracticability of Informed Consent in the Registry of the Canadian Stroke Network. N. Engl. J. Med. 350, 1414–1421. doi:10.1056/nejmsa031697
Van Veen, E.-B. (2018). Observational Health Research in Europe: Understanding the General Data Protection Regulation and Underlying Debate. Eur. J. Cancer 104, 70–80. doi:10.1016/j.ejca.2018.09.032
Vayena, E., Blasimme, A., and Cohen, I. G. (2018). Machine Learning in Medicine: Addressing Ethical Challenges. PLoS Med. 15 (11), e1002689. doi:10.1371/journal.pmed.1002689
Verbeek, A., and Lundqvist, M. (2021). Artificial Intelligence, Blockchain and the Future of Europe. Innovation Finance Advis. part Eur. Invest. Bank’s Advis. Serv., https://www.eib.org/en/publications/artificial-intelligence-blockchain-and-the-future-of-europe-report.
Vezyridis, P., and Timmons, S. (20172017). Understanding the care.Data Conundrum: New Information Flows for Economic Growth. BD&S 4, 2053951716688490. doi:10.1177/2053951716688490
Vrijenhoek, T., Tonisson, N., Kääriäinen, H., Leitsalu, L., and Rigter, T. (2021). Clinical Genetics in Transition-A Comparison of Genetic Services in Estonia, Finland, and the Netherlands. J. Community Genet. 12 (2), 277–290. doi:10.1007/s12687-021-00514-7
Wong, P.-H. (2020). Democratizing Algorithmic Fairness. Philos. Technol. 33, 225–244. doi:10.1007/s13347-019-00355-w
Keywords: digital health, data access, data privacy, ethics, artificial intelligence, fairness, resource allocation
Citation: Bak M, Madai VI, Fritzsche M-C, Mayrhofer MT and McLennan S (2022) You Can’t Have AI Both Ways: Balancing Health Data Privacy and Access Fairly. Front. Genet. 13:929453. doi: 10.3389/fgene.2022.929453
Received: 26 April 2022; Accepted: 23 May 2022;
Published: 13 June 2022.
Edited by:
Gabriele Werner-Felmayer, Innsbruck Medical University, AustriaReviewed by:
Tatyana Novossiolova, Center for the Study of Democracy, BulgariaMarietjie Botes, University of Luxembourg, Luxembourg
Copyright © 2022 Bak, Madai, Fritzsche, Mayrhofer and McLennan. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Stuart McLennan, stuart.mclennan@tum.de