P. E. Antoniou
D. Economou
A. Athanasiou
G. Tsoulfas- 1Lab of Medical Physics and Digital Innovations, Department of Medicine, School of Health Sciences, Aristotle University of Thessaloniki, Thessaloniki, Greece
- 2School of Computer Science, University of Westminster, London, United Kingdom
- 3Department of Transplantation Surgery, Ippokrateio General Hospital/Aristotle University of Thessaloniki, Thessaloniki, Greece
Editorial on the Research Topic
Immersive media in connected health—volume II
Immersive media, particularly Extended Reality (XR), is at the forefront of revolutionizing the healthcare industry. Healthcare provides XR with “silver bullet” use cases that add value and societal effect to the technology. Healthcare interventions frequently require imaging or visualization to be applied correctly, and the sensation of presence that XR can provide is crucial as a training aid for healthcare learners. From anatomy to surgical training, multimodal immersion in the reality of a medical situation increases the impact of an XR resource compared to the usual approach. Thus, healthcare has become a specialized focus for the immersive media sector, with a multitude of development and research underway. This research subject, which followed on from the previous one, yielded an eclectic group of works spanning the gamut of immersive media applications in healthcare. The underlying theme in these works remains a consistent focus on calibrating, validating, verifying, and standardizing procedures, instruments, and technologies in order to constantly rigorously streamline the means and materials that will integrate immersive technologies in healthcare. In that spirit, we share the findings from this research topic as a motivator for rigorous and evidence-based use of immersive media in digital and connected health.
Introduction
This research topic is the follow through to a previous one that opened with the statement: “According to fortune business insights the market size of eXtended Reality (XR) […] is estimated to grow to 30.4 bil. USD by 2027” (1). Three years and a pandemic later, in 2023, the global XR market was valued at 131.54 bil. USD with projected combined aggregate growth rate (CAGR) of 32% per annum (2). Academically, a Google scholar search with the key words “Healthcare” and “extended reality” provided 8,550 hits with more than half of them (4,590) in 2023 and 2024 on the 22/04/2024. The next day (23/04/2024) the same search produced 10 more hits for a total 8,560 hits (4,600 between 2023 and 2024). These simple metrics demonstrate that immersive media, specifically virtual, augmented and mixed reality (comprising the eXtended Reality—XR—spectrum) are in the forefront of disrupting the healthcare sector.
It would be easy to dismiss this boom as the peak of the inflated expectations in the Gartner hype cycle (3), however, unlike other disruptors (e.g., generative AI), XR has been around for quite some time. While the preliminary technology attempts of the 1980s are now only historically and philosophically identified as VR technologies (4), they did serve, with their commercial failure, as a kind of inoculation against the initial hype spike. In fact, healthcare has become a bespoke target for the immersive media industry, exactly as a response to the wild promises of ubiquitous “virtual citizenship” that still does not find widespread reach (5).
Healthcare offers to immersive media (especially XR) the “silver bullet”, use cases that provide value and impact to this technology. Almost all healthcare interventions require some kind of imaging reference to appropriately apply. The capacity for seeing, together with the patient, the actual medical images, e.g., overlayed on a surgical field, is an invaluable aid in the operating theatre. Furthermore, the visual impact and sense of presence that XR can offer is invaluable as an educational aid for the healthcare learner. From anatomy to surgical training, the multisensory immersion in the reality of a medical case multiplies the educational impact of an XR resource against the standard study material (6, 7).
In that environment, this research topic, following through on the previous one, garnered an eclectic collection of works spanning the spectrum of immersive media use cases in healthcare.
Contributions' outline
Immersivity of available clinical neuroimaging during neurological surgery presents as a key issue in real-time surgical guidance and is incorporated through directions such as neuronavigation, live AR enhancement and integration (8). Surgical immersion through these efforts suffers from real time deformations of the operative field as the operation progresses. Therefore the need for quick, robust and reliable reacquisition of neuroimaging during surgery should be eventually addressed (9), especially as more intricate immersive media become available for intraoperative use (10). Chrisochoides et al. perform a comparative review of physics-based deformable registration methods for image-guided neurosurgery and find that currently a combination of approximation-based and geometry-based point and element outlier rejection improves the rigid registration error margins and approximate time constraints for real operative scenarios. The authors raise questions and open problems for the robust estimation and improvement of registration error due to sparse, noisy, and incomplete data.
Moving on to the field of collaborative and assistive robotics, which, along with various converging technologies, have seen rapid developments enhancing their usability and clinical applicability (11), while implementations in XR environments and gamification (12) expand their potential through immersiveness, empowerment and improved overall user experience. Although the role of emotions and affective states are considered crucial to the learning process, their implications on rehabilitation process have not been sufficiently studied (13). Rodrigues et al. investigate usability and user experience of a system integrating augmented reality technology to a collaborative robot for rehabilitation, aiming at studying factors like motivation and adherence to the treatment, the quality of the movement achieved and repeatability. Their analyses showed that the cohort of users found the system easy and enjoyable while expert opinion algo gave a positive outlook.
While studying user experience and affective analytics can help steer XR development through the iterative process (14), on the other hand, incorporating an a priori introduction of co-creation methodologies for immersive content such as Virtual, Augmented or Mixed Reality (VR/AR/MR) resources is considered relevant not only in the development of rehabilitation and applied healthcare (15) but also in healthcare education (6). Antoniou et al. in their work study the formulation of evidence-based, optimized workflows that streamline the process of creating immersive content and allow for rapid expansion of innovative educational approaches in healthcare curricula. They study the views of healthcare educators and healthcare education developers after participation in a series of co-creation sessions. Their aim, based on the insight received, was to determine best practice for design and development of XR educational resources.
Immersive media interventions for attention deficit disorders are prolific given XR's attention enhancing experience (16). Goh et al., in their work published in this topic, employed a VR classroom to validate a continuous performance cognitive attention test on a large sample of neurotypical male and female children between the ages of 6 and 13. The dataset collected also produced an evidence based progression of neurotypical attention performance through developmental years highlighting gender-specific performance variances. The database produced is also a valid benchmark that can be used as comparison with children being assessed for ADHD or other neurocognitive conditions.
Concluding remarks
From this brief overview, It becomes clear that, while the subjects diverge, the overarching theme in these works retains a consistent direction towards calibration, validation, verification and standardisation of methods, instruments and technologies. In short, this research topic focuses not so much on “just another pilot study” but on the constant endeavours for rigorous streamlining of the means and materials that will integrate immersive technologies in healthcare. In that spirit we invite the reader to explore and hopefully utilise this research to their future endeavours for immersive media in digital and connected health.
Author contributions
PA: Writing – original draft, Writing – review & editing. DE: Writing – review & editing. GT: Writing – review & editing. AA: Writing – original draft, Writing – review & editing.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
1. Antoniou PE, Economou D, Athanasiou A, Tsoulfas G. Immersive media in connected health. Front Digit Health. (2021) 3:697336. doi: 10.3389/fdgth.2021.697336
2. Available online at: https://www.fortunebusinessinsights.com/extended-reality-market-106637 (accessed on April 30, 2024).
3. Available online at: https://en.wikipedia.org/wiki/Gartner_hype_cycle (accessed on April 30, 2024).
4. Wright R. Virtual reality. Sciences (New York). (1987) 27(6):8–10. doi: 10.1002/j.2326-1951.1987.tb02976.x
5. Available online at: https://www.nytimes.com/2022/10/09/technology/meta-zuckerberg-metaverse.html (accessed on April 30, 2024).
6. Pickering JD, Panagiotis A, Ntakakis G, Athanassiou A, Babatsikos E, Bamidis PD. Assessing the difference in learning gain between a mixed reality application and drawing screencasts in neuroanatomy. Anat Sci Educ. (2022) 15(3):628–35. doi: 10.1002/ase.2113
7. Ntakakis G, Plomariti C, Frantzidis C, Antoniou PE, Bamidis PD, Tsoulfas G. Exploring the use of virtual reality in surgical education. World J Transplant. (2023) 13(2):36. doi: 10.5500/wjt.v13.i2.36
8. Antoniou PE, Athanasiou A, Bamidis PD. Virtual and Augmented Reality in Neuroscience. doi: 10.1049/pbhe019e_ch4
9. Drakopoulos F, Tsolakis C, Angelopoulos A, Liu Y, Yao C, Kavazidi K, et al. Adaptive physics-based non-rigid registration for immersive image-guided neuronavigation systems. Front Digit Health. (2021) 2:22–40. doi: 10.3389/fdgth.2020.613608
10. Antoniou PE, Economou D, Athanasiou A, Tsoulfas G. Editorial: immersive media in connected health. Front Digit Health. (2021) 3:697336. doi: 10.3389/fdgth.2021.697336
11. Nizamis K, Athanasiou A, Almpani S, Dimitrousis C, Astaras A. Converging robotic technologies in targeted neural rehabilitation: a review of emerging solutions and challenges. Sensors. (2021) 21(6):2084. doi: 10.3390/s21062084
12. Mitsopoulos K, Fiska V, Tagaras K, Papias A, Antoniou P, Nizamis K, et al. Neurosuitup: system architecture and validation of a motor rehabilitation wearable robotics and serious game platform. Sensors. (2023) 23(6):3281. doi: 10.3390/s23063281
13. Athanasiou A, Antoniou PE, Pandria N, Astaras A, Nizamis K, Mitsopoulos K, et al. Affect detection in rehabilitation using wearable robotics, multiple biosensors and serious gaming: a concept using the NeuroSuitUp platform. In: 4th International Conference on Medical Education Informatics, MEI 2021. (2021).
14. Antoniou PE, Arfaras G, Pandria N, Athanasiou A, Ntakakis G, Babatsikos E. Biosensor real-time affective analytics in virtual and mixed reality medical education serious games: cohort study. JMIR Serious Games. (2020) 8(3):e17823. doi: 10.2196/17823
15. Antoniou PE, Bamidis PD. 3D printing and virtual and augmented reality in medicine and surgery: tackling the content development barrier through co-creative approaches. In: Suri J, Tsioukas V, Papadopoulos VN, editors. 3D Printing: Applications in Medicine and Surgery. Amsterdam, Oxford, Cambridge: Elsevier (2022) 2. p. 77–99.
16. Romero-Ayuso D, Toledano-González A, Rodríguez-Martínez MDC, Arroyo-Castillo P, Triviño-Juárez JM, González P, et al. Effectiveness of virtual reality-based interventions for children and adolescents with ADHD: a systematic review and meta-analysis. Children. (2021) 8(2):70. doi: 10.3390/children8020070
Keywords: extended reality, medical education, rehabilitation, assistive robotics, co-creation, ADHD, neurosurgery
Citation: Antoniou PE, Economou D, Athanasiou A and Tsoulfas G (2024) Editorial: Immersive media in connected health—volume II. Front. Digit. Health 6:1425769. doi: 10.3389/fdgth.2024.1425769
Received: 30 April 2024; Accepted: 6 May 2024;
Published: 20 May 2024.
Edited and Reviewed by: Toshiyo Tamura, Waseda University, Japan
© 2024 Antoniou, Economou, Athanasiou and Tsoulfas. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: P. E. Antoniou, cGFudG9uaW9Ab3RlbmV0Lmdy
†These authors share first authorship
‡These authors have contributed equally to this work