Skip to main content

PERSPECTIVE article

Front. Health Serv., 15 September 2022
Sec. Implementation Science
This article is part of the Research Topic Perspectives and Opinions in Health Services View all 14 articles

Realizing the potential of artificial intelligence in healthcare: Learning from intervention, innovation, implementation and improvement sciences

  • 1School of Health and Welfare, Halmstad University, Halmstad, Sweden
  • 2Department of Health, Medicine and Caring Sciences, Linköping University, Linköping, Sweden
  • 3Department of Learning, Informatics, Management and Ethics, Medical Management Centre, Karolinska Institutet, Stockholm, Sweden
  • 4Centre for Health Innovation, Leadership and Learning, Nottingham University Business School, Nottingham, United Kingdom
  • 5Centre for Health Economics and Policy Innovation, Imperial College Business School, London, United Kingdom

Introduction: Artificial intelligence (AI) is widely seen as critical for tackling fundamental challenges faced by health systems. However, research is scant on the factors that influence the implementation and routine use of AI in healthcare, how AI may interact with the context in which it is implemented, and how it can contribute to wider health system goals. We propose that AI development can benefit from knowledge generated in four scientific fields: intervention, innovation, implementation and improvement sciences.

Aim: The aim of this paper is to briefly describe the four fields and to identify potentially relevant knowledge from these fields that can be utilized for understanding and/or facilitating the use of AI in healthcare. The paper is based on the authors' experience and expertise in intervention, innovation, implementation, and improvement sciences, and a selective literature review.

Utilizing knowledge from the four fields: The four fields have generated a wealth of often-overlapping knowledge, some of which we propose has considerable relevance for understanding and/or facilitating the use of AI in healthcare.

Conclusion: Knowledge derived from intervention, innovation, implementation, and improvement sciences provides a head start for research on the use of AI in healthcare, yet the extent to which this knowledge can be repurposed in AI studies cannot be taken for granted. Thus, when taking advantage of insights in the four fields, it is important to also be explorative and use inductive research approaches to generate knowledge that can contribute toward realizing the potential of AI in healthcare.

Introduction

Artificial intelligence (AI) is widely seen as critical for tackling fundamental challenges faced by health systems, including increasing demand and higher costs, workforce pressures and limited resources, and the need to deliver high-quality patient outcomes and experiences (13). AI is an umbrella term that refers to the application of machine learning and other cognitive technologies to perform tasks or reasoning processes that are usually associated with human intelligence (4). In recent years, there have been promising advances in AI-based applications in healthcare, drawing on enhanced computing power and vast amounts of digital data becoming available for analysis (5).

AI includes techniques to improve the ability to detect and predict various conditions, with implications for screening, assessment and clinical decision-making (6). AI can be used to improve health by identifying individual treatments or treatment elements most likely to provide benefit for a particular person, thus promoting personalized healthcare (7). AI can also be incorporated into digital tools, such as smartphone apps and health wearables, to create novel interventions, thus reducing reliance on care processes and actions taken by healthcare professionals (8). Nevertheless, healthcare has been slow to make use of AI compared with other societal sectors (911).

AI has predominantly been viewed through a rather narrow technology-centric lens, with research focusing on the design of the technology and its interaction with the immediate users (1214). However, some of the major challenges in AI are faced in the “last mile” of the AI research and development (R&D) process, i.e., the implementation and routine use of AI-based applications in clinical settings (15, 16). Research is scant on the factors that influence the implementation and routine use of AI in healthcare, how AI may interact with the context in which it is implemented, and how it can contribute to wider health system goals (17).

Deploying and using AI in healthcare could benefit from the extensive knowledge about health technologies and new practices that has been generated in four established fields of science: intervention, innovation, implementation, and improvement sciences. First, AI-based applications, e.g., AI incorporated into digital tools, can function as an intervention with the aim of improving patient health outcomes by means of better detection, prevention, treatment, and monitoring of health and ill-health. Second, AI-based applications in healthcare represent an innovation when adopted and used in clinical practice because they introduce novel processes and practices. Third, implementation of innovations and new interventions in healthcare typically require supportive strategies because there are often barriers to their use in the form of healthcare professionals' existing habits, routines, work processes and professional cultures that tend to be difficult to change. Fourth, how AI-based applications will contribute to the improvement goals of the broader health system and fit with overall care delivery practices and processes need to be considered.

We propose that AI development can benefit from knowledge generated in these four scientific fields to realize the potential of AI and accelerate its use in healthcare. Thus, the aim of this paper is to briefly describe intervention, innovation, implementation, and improvement sciences, and to identify potentially relevant knowledge from the four fields that can be utilized for understanding and/or facilitating the use of AI in healthcare. The paper is based on the authors' experience and expertise in the four fields and a selective literature review.

Utilizing knowledge from the four fields

Intervention science

Intervention science is the study of purposive efforts (i.e., interventions) to change the natural order of things or a foreseeable sequence of events. Intervene literally means “to come between,” from Latin inter (“between”) and venire (“to come”) (18). Health intervention science starts with the premise that each intervention, such as an AI-based application, is seeking to address a specific health issue. The aim is to establish the extent to which or whether a desirable outcome is achieved. The development of evidence for various treatments, therapies, procedures, and actions to improve health-related outcomes is an important goal for intervention studies in healthcare contexts (19). It is also important to assess the appropriateness, acceptability, and feasibility of interventions because these characteristics influence the degree to which it is possible to use these interventions in routine practice (2022).

An important goal of health intervention research is to contribute to a more evidence-based healthcare practice, which is relevant to the study of AI-based applications in healthcare, i.e., evidence for their effectiveness in having an impact on various health-related problems. However, interventions also need to account for risks and other aspects beyond the intended health-related goals, thus balancing the need for evidence with other meaningful and value-creating outcomes (19), e.g., person-centered care and shared decision-making.

Interventions need to address health issues in a way that makes it possible to put them into routine healthcare use if proven effective (19). Intervention science involves both efficacy studies (can it work?) conducted under ideal controlled conditions to establish internal validity, and effectiveness studies (does it work in practice?) conducted under more realistic real-world conditions, with more emphasis on external validity (while still retaining internal validity) (22). External validity is threatened if interventions are delivered in resource-intensive pilot studies that are difficult to scale up (23, 24) or if the interventions are provided by unrepresentative healthcare professionals (e.g., perhaps having very experienced staff or receiving extensive training in delivering the intervention) and if the patients are atypical of routine practice (e.g., due to restrictive exclusion criteria) (25). Like other interventions, AI-supported interventions should be investigated in effectiveness research after efficacy has been established.

Innovation science

Innovation science is the study of how problem-solving ideas, processes, products, and services are developed, diffused, and adopted by various stakeholders, ranging from individuals through organizations to whole systems. The aim is to understand how innovations can contribute to increased value, productivity, profitability, competitiveness and other desirable goals (26). Innovation can be conceptualized in several dimensions: stages of the innovation process (e.g., R&D, efficacy and market validation, regulatory approval, adoption, diffusion), level of analysis (e.g., individuals, organizations, and systems), and type (e.g., product versus process innovations and incremental versus radical innovations). Innovation is new knowledge incorporated into ideas, processes, products and services. However, an innovation does not need to be objectively new; it is sufficient that it is perceived as new in a specific context by individual adopters (e.g., healthcare professionals) or adopting units (e.g., a hospital) (27).

An important strand of innovation research focuses on adoption and diffusion, exploring the factors that influence the way in which innovations are brought into use. Factors may be related to the attributes of innovations themselves or to the wider context for adoption (27). Typically, the innovation literature argues that innovations are more likely to be adopted if they are perceived to have low complexity but high compatibility with existing values, beliefs, past experiences, and needs of potential users (28). Adoption has also been linked with the relative advantage of the innovation over existing processes or practices (e.g., the innovation is more economical), trialability (the degree to which an innovation may be experimented with on a limited basis), and observability (the degree to which the results of an innovation are visible) (27).

Adoption of certain innovations may often be more challenging than the R&D process (29). This is particularly the case in healthcare, as shown in an increasing body of innovation research accounting for the specificities of the healthcare sector (30). This research emphasizes the importance of a thorough understanding of contextual conditions, such as the way key stakeholders, including healthcare professionals, patients, and managers, influence adoption decisions (31, 32). This is relevant to the use of AI in healthcare because the system within which AI innovations are being introduced is complex and highly regulated.

Other areas within innovation science center on service innovations (33) and business model innovations (34). AI systems built into physical products, such as health wearables or which enhance the processes involved in providing a healthcare service, have the potential to alter or disrupt existing service and business models. A strand of innovation research addresses issues such as user involvement and how leadership, strategy, and management influence success (35), and how organizations innovate in their value propositions and their underlying operating models (36).

Implementation science

Implementation science as a field emerged in response to the challenges of putting evidence-based interventions and innovations into routine practice. The focus is on studying barriers and facilitators to implementing evidence-based practices (e.g., interventions, programs, and services) and evaluating the effectiveness of strategies to support implementation of such practices. The aim is to reduce the knowing-doing gap in healthcare and other sectors of society, thus improving patient and population outcomes (37). The word “implementation” is derived from the Latin implere, meaning to fulfill or carry into effect, which provides a basis for a broad definition of implementation science as the study of the uptake of innovations and interventions into everyday use in healthcare and other settings (38).

Implementation science has established the importance of considering implementation from the outset and planning to create conditions conducive for implementation (39). Process models have been developed in the field to describe important activities, including various supportive strategies (i.e., interventions directed at healthcare professionals and/or the organization), to be undertaken during the implementation process (40). Preparing for implementation is likely to be just as important when various AI-based applications are considered for use in healthcare settings.

Implementation science has largely focused on implementation of various evidence-based practices, typically different forms of health interventions with support for their efficacy and effectiveness established in empirical research (41). However, a key lesson in implementation science is that evidence is not sufficient to ascertain real-world use. Rather, there is a need for implementation strategies to support implementation. Taxonomies of strategies and their effectiveness to influence implementation outcomes have been assembled in the field, but the results tend to be highly context-dependent (42).

Frameworks have been developed in the field to identify and structure determinants (i.e., barriers and facilitators) of implementation success. The field has borrowed the concept of innovation attributes from innovation science (40), but has added healthcare-specific attributes such as perceptions of evidence strength and quality and source of the intervention (e.g., developed externally or internally) (43). Knowledge about the determinants provides input for selecting the most appropriate strategies to overcome barriers and/or harness facilitators (44).

Outcomes in implementation science include adoption (i.e., decision or action to use an intervention), fidelity (degree to which an intervention was implemented as intended), sustainability, and cost. There is some overlap with intervention science because the acceptability, appropriateness, and feasibility of an intervention are considered proximal outcomes that predict adoption and other more distal outcomes such as sustainability (20).

Improvement science

Improvement science refers to the study and practice of achieving improvements in complex systems, such as healthcare. The field has a similar aim to implementation science, understanding the gap between ideal and actual care and bridging this gap by improving healthcare quality within local practices, processes, and culture. However, improvement science extends beyond implementation of evidence-based practices to consider the quality of wider system performance (e.g., safety, timeliness, effectiveness, efficiency, equality, patient-centeredness) (45). The field has grown out of the wider quality improvement movement, which entered healthcare in the late 1980s (46, 47).

Improvement science provides a holistic approach to health system improvement, of which an AI system or application may be just one complex intervention within a wider multifaceted attempt to improve a system. Improvement approaches advocate a process that begins with exploring the problems and opportunities within a specific setting, which could inform what AI-based applications might be relevant and what features would be required to make them useful and effective. The next step involves identifying and testing potential interventions (e.g., AI-based applications) alongside other interventions that may be required to improve quality using a process of informed iterative development until an improvement goal is achieved. This is followed by embedding a process of continual improvement to sustain initial improvements and respond to emerging problems and opportunities (48).

The importance of understanding local context and its influence on outcomes is a cornerstone of improvement science (49). Understanding, influencing, and adapting to local context, e.g., practices, processes and cultures, is critical to improvement. Thus, the people within each local system, e.g., healthcare professionals, managers, and patients, are seen as important stakeholders to achieve improvement. Improvement approaches aim to enable them to take a structured, systematic approach to navigating the change process (48).

Improvement science offers both a way of thinking and a methodological toolkit that might be useful to understand, adapt, and apply AI-based applications in various healthcare contexts. A range of approaches and tools are used to understand problems and to inform and evaluate solution designs and efforts to facilitate their application in practice, e.g., Plan-Do-Study-Act cycles, Six-Sigma, Root Cause Analysis, Process Mapping, and simulation (5053). These approaches and tools can be used to enable people to understand their local contexts and define important outcomes (e.g., improved patient safety, patient outcomes, reduced costs) and to intervene in the health system to improve overall performance (54).

Discussion

The four fields of intervention, innovation, implementation, and improvement sciences have generated a wealth of often-overlapping knowledge, some of which we propose have considerable relevance for understanding and/or facilitating the use of AI in healthcare (Table 1). Thus far, AI research has largely focused on engineering, computer science and programming (1214). However, this research does not ascertain the adoption and subsequent use of AI in everyday healthcare. Implementation and use of new interventions and innovations in healthcare often face considerable organizational inertia and skepticism or even resistance from leaders, physicians and nurses (38, 39, 43). Thus, the four fields have an important role in the future of AI in healthcare because they generate knowledge based on studying interventions and innovations in the real-world context in which they are introduced and used. Research is needed to investigate the effectiveness of AI-based applications when efficacy studies have established that they work. Real-world evidence of AI-based applications is important because it provides a more comprehensive understanding of how new practices will work under realistic healthcare conditions and makes it possible to establish whether they contribute to the intended improvements in care quality and other desirable outcomes.

TABLE 1
www.frontiersin.org

Table 1. The four scientific fields' aims, research characteristics, and relevance for AI in healthcare.

Knowledge from the four fields is primarily relevant to the latter stages of the innovation process, which is often described in terms of three overarching stages, from invention to development and realization. The development stage typically encompasses various forms of prototyping, testing and efficacy studies conducted under more controlled conditions (55, 56). Knowledge generated in intervention and innovation sciences is important for this stage. The realization stage can be distinguished into introduction, operation and refinement (55, 56). Implementation science knowledge is particularly useful when introducing AI, while improvement science knowledge is useful for improving operation and refining AI systems and AI-based applications. However, the stages are interdependent and knowledge from the four fields largely overlaps. For example, implementation science involves studies of various implementability characteristics (e.g., feasibility), which has more to do with planning than with realization. Conversely, intervention science involves studies of effectiveness conducted under real-world conditions, which is more relevant in the realization stage than the planning stage.

Intervention science underscores the relevance of taking a broad perspective on intervention goals. Hence, the effectiveness of AI-based applications should not be in conflict with other important goals, such as patient involvement in their care or trusting communication between the healthcare professional and patient. Implementation science points to the importance of understanding the use of interventions in routine practice, e.g., how AI-derived information is interpreted and used by healthcare professionals. Similarly, improvement science emphasizes the relevance of studying AI-based applications in a larger context of how they can contribute to wider health system goals. Intervention and implementation sciences highlight the importance of the acceptability, appropriateness, and feasibility of interventions to enable their routine use in healthcare. These outcomes and others described in implementation science such as fidelity, sustainability, and costs are important to investigate with regard to AI-based applications.

The four fields address the influence of context on interventions and innovations to varying degrees. The use of AI in healthcare represents a sociotechnical system that requires contextual understanding of the interrelations of social and technical aspects of the organization as a whole (57). Applications of AI in healthcare can circumvent traditional workflow and care delivery pathways (58). Improvement science is particularly concerned with how practices are integrated within the local context and how they might interact with and/or disrupt existing work practices and processes.

Innovation, implementation, and improvement sciences further emphasize the role of stakeholders and other contextual influences, which is relevant because the decisions involved in the introduction and use of some AI-based applications in healthcare may involve many stakeholders and have widespread or disruptive impact across the health system. On the other hand, there may also be AI-based applications that are simple, uncontroversial, involve few stakeholders, and have limited impact outside the immediate processes in which the applications are used. Implementation determinants tend to be multi-factorial and multi-level (43), which suggests the relevance of using strategies to support AI implementation that address multiple determinants at different levels of the health system.

The development and deployment of AI represents a complex sociotechnical process that spans work associated with data acquisition, algorithm selection and development, organizational design, professional education, and associated governance and regulatory activities (59). This sociotechnical complexity complicates the study and practice of AI in healthcare. New studies drawing on empirical and theoretical knowledge from the four fields will need to consider whether and how to distinguish between the general requirements of any AI system and the specific requirements for any particular type of AI-based application. AI is not one single type of technology but rather encompasses many technologies covering a range of practical applications (10, 60). For example, AI-based applications may, or may not, be perceived as complex and/or compatible (i.e., two key innovation attributes), depending on what the application is and what context it is used in; e.g., breast cancer or cataract screening vs. algorithms to help decision-making about mental health therapies. This may limit the usefulness of generalizable findings, and it is likely to also be important to investigate determinants in relation to specific AI-based applications.

There might be a need to develop new theoretical approaches or augment and re-contextualize existing ones from the four fields. Frameworks have been developed for implementation of healthcare technologies, e.g., the Non-adoption, Abandonment, Scale-up, Spread, Sustainability (NASSS) framework (61), but it has been shown that existing frameworks do not consider all of the specific issues relevant to AI systems and AI-based applications (17). Development of bespoke AI frameworks would benefit from interdisciplinary work by researchers in the four fields and collaboration with healthcare professionals, AI developers, patients, policymakers, and other stakeholders.

This paper has addressed knowledge from intervention, innovation, implementation and improvement sciences of potential importance for understanding and/or facilitating AI use in healthcare. However, the scope of the paper has obvious limitations and it does not address everything that might have relevance when introducing and using AI in healthcare, e.g., issues related to data integrity, transparency, governance and reimbursement. AI has a wide range of applications beyond healthcare and health, including in domains such as agriculture, engineering, commerce, marketing, finance, gaming, education, navigation, and transportation (62). The broad use of AI in many different sectors and areas of life requires multidisciplinary knowledge from many fields other than those covered in this paper to address issues such as ethics, fairness, equity, accountability, protection of privacy and respect, transparency, trustworthiness and auditing (6365).

In conclusion, the four fields of intervention, innovation, implementation, and improvement sciences have generated many insights of potential relevance for understanding and/or facilitating the use of AI in healthcare. Knowledge derived from these fields provides a head start for research on the use of AI in healthcare, but the extent to which this knowledge can be repurposed in AI studies cannot be taken for granted. Thus, when taking advantage of insights in the four fields, it is important to also be explorative and use inductive research approaches to generate knowledge that can contribute toward realizing the potential of AI in healthcare.

Data availability statement

The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author/s.

Author contributions

PN conceptualized the study, but all aspects were discussed with the other authors and he drafted the first version of the manuscript with input from all authors. All authors discussed further drafts, revised the manuscript, and approved the final manuscript.

Funding

The funders for this study are the Swedish Government Innovation Agency Vinnova (grant 2019-04526) and the Knowledge Foundation (grant 20200208 01H).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

1. Lee JC. The perils of artificial intelligence in healthcare: disease diagnosis and treatment. J Comput Biol Bioinform Res. (2019) 9:1–6. doi: 10.5897/JCBBR2019.0122

CrossRef Full Text | Google Scholar

2. Topol EJ. High-performance medicine: the convergence of human and artificial intelligence. Nat Med. (2019) 25:44–56. doi: 10.1038/s41591-018-0300-7

PubMed Abstract | CrossRef Full Text | Google Scholar

3. Lawry T. AI in Health. Boca Raton, FL: CRC Press. (2020).

Google Scholar

4. European Union,. A Definition of AI: Main Capabilities Scientific Disciplines. (2018). Available online at: https://ec.europa.eu/futurium/en/system/files/ged/ai_hleg_definition_of_ai_18_december_1.pdf (accessed January 12, 2022).

Google Scholar

5. Secinaro S, Calandra D, Secinaro A, Muthurangu V, Biancone P. The role of artificial intelligence in healthcare: a structured literature review. BMC Med Inform Decis Mak. (2021) 21:125. doi: 10.1186/s12911-021-01488-9

PubMed Abstract | CrossRef Full Text | Google Scholar

6. Graham S, Depp C, Lee EE, Nebeker C, Tu X, Kim HC, et al. Artificial intelligence for mental health and mental illnesses: an overview. Curr Psychiatry Rep. (2019) 21:116. doi: 10.1007/s11920-019-1094-0

PubMed Abstract | CrossRef Full Text | Google Scholar

7. Bickman L. Improving mental health services: a 50-year journey from randomized experiments to artificial intelligence and precision mental health. Adm Policy Ment Health. (2020) 47:795–843. doi: 10.1007/s10488-020-01065-8

PubMed Abstract | CrossRef Full Text | Google Scholar

8. D'Alfonso S. AI in mental health. Curr Opin Psychol. (2020) 36:112–7. doi: 10.1016/j.copsyc.2020.04.005

PubMed Abstract | CrossRef Full Text | Google Scholar

9. De Nigris S, Craglia M, Nepelski D, Hradec J, Gomez-Gonzales E, Gomez Gutierrez E, et al. AI Watch: AI Uptake in Health and Healthcare. Luxembourg: Luxembourg: Publications Office of the European Union (2020). doi: 10.2760/948860

CrossRef Full Text | Google Scholar

10. Shaw J, Rudzicz F, Jamieson T, Goldfarb A. Artificial intelligence and the implementation challenge. J Med Internet Res. (2019) 21:e13659. doi: 10.2196/13659

PubMed Abstract | CrossRef Full Text | Google Scholar

11. He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K. The practical implementation of artificial intelligence technologies in medicine. Nat Med. (2019) 25:30–6. doi: 10.1038/s41591-018-0307-0

PubMed Abstract | CrossRef Full Text | Google Scholar

12. Semenov I, Koaitas G. Development of a clinical decision support system for the patients of a laboratory service. Stud Health Technol Inform. (2016) 228:90–4. doi: 10.3233/978-1-61499-678-1-90

PubMed Abstract | CrossRef Full Text | Google Scholar

13. Stead WW. Clinical implications and challenges of artificial intelligence and deep learning. JAMA. (2018) 320:1107–8. doi: 10.1001/jama.2018.11029

PubMed Abstract | CrossRef Full Text | Google Scholar

14. Tamposis I, Tsougos I, Karatzas A, Vassiou K. Vlychou, M, Tzortzis V. PCaGuard: a software platform to support optimal management of prostate cancer. Appl Clin Inform. (2022) 13:91–9. doi: 10.1055/s-0041-1741481

PubMed Abstract | CrossRef Full Text | Google Scholar

15. Coiera E. The last mile: where artificial intelligence meets reality. J Med Internet Res. (2019) 21:e16323. doi: 10.2196/16323

PubMed Abstract | CrossRef Full Text | Google Scholar

16. Li RC, Asch SM, Shah NH. Developing a delivery science for artificial intelligence in healthcare. npj Digit Med. (2020) 3:107. doi: 10.1038/s41746-020-00318-y

PubMed Abstract | CrossRef Full Text | Google Scholar

17. Gama F, Tyskbo D, Nygren J, Barlow J, Reed J, Svedberg P. Implementation frameworks for artificial intelligence translation into healthcare practice: a scoping review. JMIR. (2022) 24:e32215. doi: 10.2196/32215

PubMed Abstract | CrossRef Full Text | Google Scholar

18. Hawe P, Potvin L. What is population health intervention research? Can J Public Health. (2009) 100(Suppl):I8–I14. doi: 10.1007/BF03405503

CrossRef Full Text | Google Scholar

19. Sidani S. Health Intervention Research: Understanding Research Design and Methods. London: Sage (2014).

Google Scholar

20. Proctor E, Silmere H, Raghavan R, Hovmand P, Aarons G, Bunger A, et al. Outcomes for implementation research: conceptual distinctions, measurement challenges, and research agenda. Adm Policy Ment Health. (2011) 38:65–76. doi: 10.1007/s10488-010-0319-7

PubMed Abstract | CrossRef Full Text | Google Scholar

21. Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: medical Research Council guidance. BMJ. (2015) 350:h1258. doi: 10.1136/bmj.h1258

PubMed Abstract | CrossRef Full Text | Google Scholar

22. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: update of medical research council guidance. BMJ. (2021) 374:n2061. doi: 10.1136/bmj.n2061

PubMed Abstract | CrossRef Full Text | Google Scholar

23. Bate P, Robert G. Where next for policy evaluation? Insights from researching national health service modernization. Policy Polit. (2003) 31:249–62. doi: 10.1332/030557303765371735

CrossRef Full Text | Google Scholar

24. Sanderson I. Evaluation, policy learning, and evidence-based policy making. Public Adm. (2002) 80:1–22. doi: 10.1111/1467-9299.00292

PubMed Abstract | CrossRef Full Text | Google Scholar

25. Black N. Why we need observational studies to evaluate the effectiveness of health care. BMJ. (1996) 312:1215–8. doi: 10.1136/bmj.312.7040.1215

PubMed Abstract | CrossRef Full Text | Google Scholar

26. Fagerberg J, Verspagen B. Innovation studies – the emerging structure of a new scientific field. Res Policy. (2008) 38:218–33. doi: 10.1016/j.respol.2008.12.006

CrossRef Full Text | Google Scholar

27. Rogers E. Diffusion of Innovations. 5th edition. New York: Free Press (2003).

Google Scholar

28. Gourville J. Eager sellers and stony buyers. Harvard Bus Rev. (2006) 84:98–106.

PubMed Abstract | Google Scholar

29. May C, Finch T. Implementing, embedding, and integrating practices: an outline of normalization process theory. Sociology. (2009) 43:535–554. doi: 10.1177/0038038509103208

CrossRef Full Text | Google Scholar

30. Barlow J. Managing Innovation in Healthcare. London: World Scientific (2017).

Google Scholar

31. Denis J, Hebert Y, Langley A, Lozeau D, Trottier L. Explaining diffusion patterns for complex health care innovations. Health Care Manage Rev. (2002) 27:60–73. doi: 10.1097/00004010-200207000-00007

PubMed Abstract | CrossRef Full Text | Google Scholar

32. Greenhalgh T, Robert G, Bate P, Macfarlane F, Kyriakidou O. Diffusion of Innovations in Service Organisations: A Systematic Literature Review. Malden, MA: Blackwell (2005).

Google Scholar

33. Gustafsson A, Snyder H, Witell L. Service innovation: a new conceptualization and path forward. J Serv Res. (2020) 23:111–5. doi: 10.1177/1094670520908929

CrossRef Full Text | Google Scholar

34. Ramdani B, Binsaif A, Boukrami E. Business model innovation: a review and research agenda. N Engl J Entrepreneurship. (2019) 22:89–108. doi: 10.1108/NEJE-06-2019-0030

CrossRef Full Text | Google Scholar

35. Carlborg P, Kindström D, Kowalkowski C. The evolution of service innovation research: a critical review and synthesis. Serv Ind J. (2014) 34:373–98. doi: 10.1080/02642069.2013.780044

CrossRef Full Text | Google Scholar

36. Foss NJ, Saebi T. fifteen years of research on business model innovation how far have we come, and where should we go? J Manage. (2017) 43:200–27. doi: 10.1177/0149206316675927

CrossRef Full Text | Google Scholar

37. Harvey G, Kitson A. PARIHS revisited: from heuristic to integrated framework for the successful implementation of knowledge into practice. Implement Sci. (2016) 11:33. doi: 10.1186/s13012-016-0398-2

PubMed Abstract | CrossRef Full Text | Google Scholar

38. Brownson RC, Colditz GA, Proctor EK. Dissemination and Implementation Research in Health. New York: Oxford University Press (2012).

Google Scholar

39. Straus SE, Tetroe J, Graham ID. Knowledge Translation in Health Care: Moving from Evidence to Practice. Chichester: Wiley-Blackwell/BMJ. (2009).

Google Scholar

40. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. (2015) 10:53. doi: 10.1186/s13012-015-0242-0

PubMed Abstract | CrossRef Full Text | Google Scholar

41. Nilsen P, Birken SA. Prologue. In: Nilsen P, Birken SA, editors. Handbook on Implementation Science. Cheltenham, UK: Edward Elgar (2020) pp. 1–6.

Google Scholar

42. Leeman J, Birken SA, Powell BJ, Rohweder C, Shea CM. Beyond “implementation strategies”: classifying the full range of strategies used in implementation science and practice. Implement Sci. (2017) 12:125. doi: 10.1186/s13012-017-0657-x

PubMed Abstract | CrossRef Full Text | Google Scholar

43. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. (2009) 4:50. doi: 10.1186/1748-5908-4-50

PubMed Abstract | CrossRef Full Text | Google Scholar

44. Michie S, Atkins L, West R. The Behaviour Change Wheel: A Guide to Designing Interventions. London: Silverback (2014).

PubMed Abstract | Google Scholar

45. Institute of Medicine. Crossing the Quality Chasm: A New Health System for the 21st Century. Washington, DC: National Academies Press (2001).

Google Scholar

46. Batalden PB, Davidoff F. What is “quality improvement” and how can it transform healthcare? Qual Saf Health Care. (2007) 16:2–3. doi: 10.1136/qshc.2006.022046

PubMed Abstract | CrossRef Full Text | Google Scholar

47. Macrae C, Stewart K. Can we import improvements from industry to healthcare? BMJ. (2019) 364:l1039. doi: 10.1136/bmj.l1039

PubMed Abstract | CrossRef Full Text | Google Scholar

48. Reed JE, Howe C, Doyle C, Bell D. Simple rules for evidence translation in complex systems: a qualitative study. BMC Med. (2018) 16:92. doi: 10.1186/s12916-018-1076-9

PubMed Abstract | CrossRef Full Text | Google Scholar

49. Marshall M, Pronovost P, Dixon-Woods M. Promotion of improvement as a science. Lancet. (2013) 381:P419–P421. doi: 10.1016/S0140-6736(12)61850-9

PubMed Abstract | CrossRef Full Text | Google Scholar

50. Reed JE, Card AJ. The problem with plan-do-study-act cycles. BMJ Qual Saf. (2016) 25:147–52. doi: 10.1136/bmjqs-2015-005076

PubMed Abstract | CrossRef Full Text | Google Scholar

51. Peerally MF, Carr S, Waring J, Dixon-Woods M. The problem with root cause analysis. BMJ Qual Saf. (2017) 26:417–22. doi: 10.1136/bmjqs-2016-005511

PubMed Abstract | CrossRef Full Text | Google Scholar

52. Antonacci G, Reed JE, Lennox L, Barlow J. The use of process mapping in healthcare quality improvement projects. Health Serv Manage Res. (2018) 31:74–84. doi: 10.1177/0951484818770411

PubMed Abstract | CrossRef Full Text | Google Scholar

53. Macrae C, Draycott T. Delivering high-reliability in maternity care: in situ simulation as a source of organizational resilience. Saf Sci. (2019) 117:490–500. doi: 10.1016/j.ssci.2016.10.019

CrossRef Full Text | Google Scholar

54. Boaden R, Harvey G, Moxham C, Proudlove NC. Quality Improvement: Theory and Practice in Healthcare. Coventry, UK: NHS Institute for Innovation and Improvement (2008).

Google Scholar

55. Pichlak M. Innovation generation process and its determinants. Int J Contemp Manag. (2015) 14:51–66.

Google Scholar

56. Tohidi H, Jabbari H. Different stages of innovation process. Procedia Technol. (2012) 1:574–8. doi: 10.1016/j.protcy.2012.02.125

CrossRef Full Text | Google Scholar

57. Holton R, Boyd R. ‘Where are the people? What are they doing? Why are they doing it?' (Mindell) Situating artificial intelligence within a socio-technical framework. J Sociol. (2021) 57:179–95. 10.1177/1440783319873046

Google Scholar

58. Hermes ED, Lyon AR, Schueller SM, Glass JE. Measuring the implementation of behavioral intervention technologies: re-characterization of established outcomes. J Med Internet Res. (2019) 21:e11752. doi: 10.2196/11752

PubMed Abstract | CrossRef Full Text | Google Scholar

59. Macrae C. Learning from the failure of autonomous and intelligent systems: accident, safety and sociotechnical sources of risk. Risk Anal. (2021). doi: 10.1111/risa.13850

PubMed Abstract | CrossRef Full Text | Google Scholar

60. Davenport T, Kalakota R. The potential for artificial intelligence in healthcare. Future Healthc J. (2019) 6:94–8. doi: 10.7861/futurehosp.6-2-94

PubMed Abstract | CrossRef Full Text | Google Scholar

61. Greenhalgh T, Wherton J, Papoutsi C, Lynch J, Hughes G, A'Court C, et al. Beyond adoption: a new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J Med Internet Res. (2017) 19:e367. doi: 10.2196/jmir.8775

PubMed Abstract | CrossRef Full Text | Google Scholar

62. Yigitcanlar T, Corchado JM, Mehmood R, Li RYM, Mossberger K, Desouza K. Responsible urban innovation from local government Artificial Intelligence (AI): A conceptual framework and research agenda. J Open Innovat Technol Market Complex. (2021) 7:71. doi: 10.3390/joitmc7010071

CrossRef Full Text | Google Scholar

63. Yigitcanlar T, Mehmood R, Corchado JM. Green Artificial Intelligence: Towards an efficient, sustainable and equitable technology for smart cities and futures. Sustainability. (2021) 13:8952. doi: 10.3390/su13168952

CrossRef Full Text | Google Scholar

64. Dwivedi Y, Hughes L, Ismagilova E, Aarts G, Coombs C, Crick T, et al. Artificial Intelligence (AI): Multidisciplinary perspectives on emerging challenges, opportunities, and agenda for research, practice and policy. Int J Inf Manage. (2019) 57:101994. doi: 10.1016/j.ijinfomgt.2019.08.002

CrossRef Full Text | Google Scholar

65. Jobin A, Ienca M, Vayena E. The global landscape of AI ethics guidelines. Nat Mach Intell. (2019) 1:389–99. doi: 10.1038/s42256-019-0088-2

CrossRef Full Text | Google Scholar

Keywords: artificial intelligence, intervention, innovation, implementation, improvement

Citation: Nilsen P, Reed J, Nair M, Savage C, Macrae C, Barlow J, Svedberg P, Larsson I, Lundgren L and Nygren J (2022) Realizing the potential of artificial intelligence in healthcare: Learning from intervention, innovation, implementation and improvement sciences. Front. Health Serv. 2:961475. doi: 10.3389/frhs.2022.961475

Received: 04 June 2022; Accepted: 22 August 2022;
Published: 15 September 2022.

Edited by:

Xiaolin Wei, University of Toronto, Canada

Reviewed by:

Rashid Mehmood, King Abdulaziz University, Saudi Arabia
Tony Kuo, University of California, Los Angeles, United States
Sandeep Reddy, Deakin University, Australia

Copyright © 2022 Nilsen, Reed, Nair, Savage, Macrae, Barlow, Svedberg, Larsson, Lundgren and Nygren. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Per Nilsen, per.nilsen@liu.se

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.