Skip to main content

OPINION article

Front. Aging Neurosci., 18 December 2024
Sec. Neurocognitive Aging and Behavior
This article is part of the Research Topic Progress in the Assessment and Intervention of Neurocognitive Aging and Neurodegenerative Diseases View all 7 articles

Integrating music therapy and video games in cognitive interventions: innovative applications of closed-loop EEG

\r\nYing Wang&#x;Ying Wang1Kexin Zhang&#x;Kexin Zhang1Hao Yu&#x;Hao Yu2Xianglong Wan,Xianglong Wan3,4Tiange Liu,Tiange Liu3,4Danyang LiDanyang Li2Dingna Duan,Dingna Duan3,4Xueguang Xie,Xueguang Xie3,4Dong Wen,
Dong Wen3,4*
  • 1School of Information Science and Engineering, Yanshan University, Qinhuangdao, China
  • 2Department of Sports, University of Science and Technology Beijing, Beijing, China
  • 3School of Intelligence Science and Technology, University of Science and Technology Beijing, Beijing, China
  • 4Key Laboratory of Perception and Control of Intelligent Bionic Unmanned Systems, Ministry of Education, Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing, China

1 Introduction

Cognitive function refers to the mental abilities involved in acquiring, manipulating, and applying information, including but not limited to attention, memory, reasoning, language, spatial and executive functions (Ni et al., 2022). These cognitive abilities can deteriorate with age or due to certain medical conditions, leading to symptoms like memory loss, slowed thinking, and concentration difficulties (Unbehaun et al., 2021). Cognitive impairment often serves as an early indicator of diseases like Alzheimer's and Parkinson's disease (PD) (Litvan et al., 2011).

Therapeutic interventions like video games (VGs) and music therapy (MT) have demonstrated effectiveness in preventing or mitigating cognitive decline and enhancing cognitive function. VGs, known for their engaging and action-oriented nature, can foster improvements in cognitive skills through social and participatory elements (Wiley et al., 2021). In contrast, MT utilizes music to stimulate neuroplasticity, thereby enhancing cognitive function (Fang et al., 2017). The combination of MT and VGs provides a more robust therapeutic intervention than either approach alone, yielding a synergistic effect with substantial therapeutic potential (Martin-Moratinos et al., 2023). Music video games (MVGs) have also shown promise in preventing or mitigating cognitive decline and enhancing cognitive function.

In recent years, cognitive interventions based on electroencephalography (EEG) have gained considerable attention in psychology and neuroscience. These interventions utilize EEG to monitor brain activity, assess the effects of cognitive training (Rajakumar and Mohan, 2024), and guide the optimization of therapeutic strategies (Taya et al., 2015). Traditional open-loop EEG systems primarily record and analyze brain activity but lack a time feedback mechanism (Jin et al., 2024). In contrast, closed-loop EEG can monitor brain states in real time (Zhang et al., 2023), allowing for timely adjustments to intervention strategies and providing a more personalized and practical cognitive training experience (Dangi et al., 2013). As a result, closed-loop EEG-based music video game therapy (MVGT) shows excellent clinical potential in cognitive interventions.

This paper summarizes and analyzes cognitive intervention methods that combine MT and VGs, including the application of EEG in assessing intervention effectiveness. We explore EEG analysis techniques and present our perspective on the developmental trends of closed-loop EEG-based MVGT in cognitive interventions, aiming to offer valuable insights for future research.

2 Cognitive intervention combining music therapy and video games

2.1 Music therapy

MT stimulates various areas of the brain and promotes neural plasticity (Stegemoller, 2014). Active MT involves participants enhancing neural connections through learning instruments or engaging in music activities (Bégel et al., 2017). In contrast, passive MT activates sensory, motor, cognitive, language, and emotional regions in both hemispheres of the brain while participants listen to music performed by others (Moreira et al., 2023).

MT is an effective cognitive intervention that not only improves cognitive function (Xue et al., 2023) but also significantly reduces anxiety and depression (Lyu et al., 2018), enhancing overall quality of life. Factors such as music, rhythm, and task difficulty influence its effects (Schwartz et al., 2017). MT has been shown to benefits various patient populations, including those with dementia (Moreno-Morales et al., 2020), attention deficit hyperactivity disorder (Martin-Moratinos et al., 2023), and PD (Barnish and Barran, 2020), effectively enhancing their cognitive abilities.

However, despite its advantages, MT typically requires guidance from a professional music therapist (Li et al., 2015). Participants often need a therapist to implement effective MT independently (Li et al., 2019), which limits their ability to apply MT into daily life.

2.2 Video game therapy

A comprehensive 68-year study has shown that moderate participation in VGs between the ages of 11 and 79 can enhance cognitive abilities (Altschul and Deary, 2020). The research found that video game training significantly improves cognitive function in older adults, particularly in visual-spatial working memory and episodic memory. Additionally, video game therapy has shown positive outcomes in patients, markedly enhancing overall cognitive function in individuals with schizophrenia (Shi et al., 2023) and improving executive function and information processing speed in those with mild cognitive impairment (Menascu et al., 2021).

However, during cognitive interventions involving gaming, while players may experience improvements in specific cognitive skills, they may also experience negative emotional outcomes (Miller and Mandryk, 2016). Prolonged gaming can result in fatigue, anxiety, or frustration (Kuperczko et al., 2022), especially when confronting challenging tasks. If these emotional issues are not addressed, they may adversely affect the players' overall experience and mental health.

2.3 Music video game therapy

Integrating music with VGs through MVGT presents a promising avenue for cognitive intervention. Music is closely linked to emotions, motivation, and reward within the gaming context (Loizou et al., 2014). By designing music-based VGs, players can enjoy an engaging experience while benefiting from the therapeutic qualities of music (Ticker, 2017). Research indicates that MVGs, which combines music as a motivating factor with gameplay mechanics, can effectively improve memory and spatial awareness in patients with cognitive impairments (Vargas et al., 2020), making them suitable for long-term training.

Moreover, MVGs also facilitate coordination between auditory and motor skills. For instance, rhythm games can be utilized in rehabilitation training for patients with PD (Dalla Bella, 2022), helping to improve their motor abilities. Music also aids participants in concentrating better and focusing on specific game tasks. In a music attention training game, users must follow rhythm and speed, following the music to perform and improvise (Chalkiadakis, 2022). Research indicates that this type of game significantly enhances participants' selective attention, underscoring the considerable potential of MVGs in cognitive intervention.

Overall, by combining the benefits of music therapy and video games, MVGs represent a promising approach to enhancing cognitive abilities in participants. Despite their significant potential, MVGT faces important limitations that must be addressed. For instance, personalized treatment plans and standardized procedures for MVGs still need to be fully developed. Additionally, variations in players' musical and gaming preferences and learning styles may affect the effectiveness of interventions (Liu et al., 2016). Therefore, it is essential to develop innovative assessment and guidance strategies to optimize the implementation process of MVGs.

3 The integration of electroencephalography and music video game therapy

Cognitive function is closely linked to neural connections between different brain regions (Park and Friston, 2013). EEG provides real-time insights into brain activity and is widely recognized as an essential indicator for assessing changes in cognitive abilities (van der Hiele et al., 2007). By analyzing EEG signals, researchers can detect physiological changes in patients' brains (Ribas et al., 2013), enbaling a more objective evaluation of treatment effects. The combination of EEG with MVGs offers a fresh perspective for cognitive assessment and intervention guidance. Two main approaches for integrating EEG with MVGs are open-loop and closed-loop EEG systems, each presenting unique opportunities for cognitive intervention.

Research using open-loop EEG with MVGs demonstrates significant improvements in cognitive function. For instance, one study involved participants engaged in MVGs, while researchers analyzed their EEG data to compare power spectral density and individual alpha frequency to assess changes in attention levels (GomezRomero-Borquez et al., 2023). This study examined the alpha asymmetry between the left and right hemispheres of the brain. The results showed that MVGs significantly enhanced participants' attention. Additionally, another study revealed that compared to casual social games, music rhythm games elicited higher theta/alpha EEG values (Ribas et al., 2013). This research also revealed enhanced connectivity in the alpha and beta1 bands between the bilateral temporal lobes. In contrast, connectivity between the frontal and occipital lobes decreased, indicating that participants exhibited higher attention levels and greater focus on auditory attention during music rhythm games.

While these findings highlight the potential of MVGs for cognitive intervention, practical applications require dynamic adjustments to the game training content based on participants' cognitive states (Mortazavi et al., 2024) to maximize the game's effectiveness and achieve optimal cognitive intervention outcomes. However, open-loop EEG cannot provide real-time feedback on cognitive states (Farkhondeh Tale Navi et al., 2022), limiting the ability to dynamically assess and adjust player performance during gameplay, which hampers responsiveness to changes in cognitive needs (Ehrlich et al., 2019). Consequently, future research should explore more effective real-time feedback mechanisms to enhance the flexibility and effectiveness of cognitive interventions.

In contrast, EEG-based closed-loop music video game therapy leverages real-time feedback, offering multiple advantages in clinical applications. The closed-loop system captures participants' EEG signals in real-time, monitoring changes in attention (Li et al., 2011), emotional state (Ehrlich et al., 2019), and cognitive load (Koenig et al., 2011) and dynamically adjusting the game's difficulty or the music's tempo based on these signals (Schlette, 2023). This real-time feedback mechanism ensures flexibility and adaptability in the intervention. Moreover, the collected EEG signals can be utilized for Neurofeedback Training, enhancing the overall effectiveness of cognitive training (Jirayucharoensak et al., 2019). Research indicates that this training yields significantly better outcomes than interventions without Neurofeedback Training. Additionally, the closed-loop system can design personalized treatment plans based on the unique EEG patterns of each participant (Carè et al., 2024), thereby improving the specificity and effectiveness of the intervention. Therefore, EEG-based closed-loop music video game cognitive interventions provide participants with more personalized and effective rehabilitation strategies.

In summary, the closed-loop system, through real-time monitoring and feedback, can more accurately address the specific needs of cognitive interventions, thereby enhancing the effectiveness of music video game therapy. However, EEG-based music video games remain a relatively new research area in cognitive interventions, with limited research and applications currently available.

4 Current challenges and future research prospects

Research indicates that EEG plays a crucial role in enhancing the effectiveness of cognitive interventions (Wan et al., 2024), particularly as closed-loop EEG can provide personalized treatment plans for each participant. However, several challenges must be addressed to fully realize this adaptive and personalized treatment level.

4.1 The importance of cross-subject and cross-task EEG analysis

EEG signals exhibit high variability and non-stationarity across subjects (Jimenez-Guarneros and Gomez-Gil, 2020), which can lead to mismatched data distributions among samples. Current research primarily focuses on single tasks, which limits the generalization capability of EEG analysis models to other tasks within the same cognitive domain (Zhong et al., 2024). Therefore, cross-subject and cross-task EEG signal analysis is essential for effectively assessing the impact of cognitive interventions. The cross-subject analysis utilizes data from other individuals to calibrate a new subject (Wu et al., 2022). In contrast, cross-task analysis employs labeled data from similar or related tasks to calibrate new tasks.

To evaluate the effects of EEG-based cognitive interventions more effectively, it is crucial to establish a general EEG analysis model applicable across different subjects and tasks within the same cognitive domain (Zhou et al., 2022). By integrating closed-loop EEG technology, EEG signals can be analyzed more accurately across different subjects and tasks (Walter, 2015). Recording the EEG patterns of subjects during specific cognitive tasks and comparing the signals of different subjects performing the same task can help identify critical factors influencing cognitive performance (Jimenez-Guarneros and Gomez-Gil, 2020). Additionally, analyzing EEG signals from different cognitive tasks helps reveal the dynamic changes in how the brain processes various types of information (Wen et al., 2023). This approach enhances data collection flexibility and provides essential support for personalized cognitive intervention programs.

4.2 Individualization of intervention programs

The individualized intervention plan is designed to adjust the selection of music and VGs based on each patient's cognitive needs and abilities (Cicerone et al., 2019). Different music and game content types may have varying effects on each participant (Choi et al., 2020), making a tailored approach significantly more effective for cognitive intervention (Buzzi et al., 2019). In this process, closed-loop EEG technology plays a crucial role by allowing real-time monitoring and analysis of each participant's brain signals, providing precise feedback for personalized interventions (Carè et al., 2024). This method enhances patient engagement and satisfaction and facilitates the smooth treatment progress. By utilizing closed-loop EEG, we can more effectively identify individual differences, optimize intervention plans, and improve the effectiveness and sustainability of the interventions.

4.3 Effectiveness of integrated cognitive intervention therapies

Future research should focus on the effectiveness of integrated intervention therapies (Jung et al., 2020) to explore their impact on cognitive function. Studies have shown that combining music video games with cognitive training can significantly enhance short-term memory, attention, and inhibitory control in older adults (Lin et al., 2020). Furthermore, integrating music games with exercise therapy has been found to promote social interaction, engagement, and memory recall among dementia patients with dementia (Unbehaun et al., 2021). Therefore, it is recommended that future studies conduct further investigations into integrated cognitive interventions to assess their potential to enhance cognitive function systematically. Comprehensive cognitive intervention therapy will help us understand the impact of different cognitive intervention therapies on cognitive training to optimize the intervention program and promote improving cognitive health.

5 Conclusion

In conclusion, closed-loop EEG-based MVGT presents promising opportunities for cognitive intervention. We recommend collecting participants' EEG data during the interventions to facilitate ongoing adjustments and monitor the progress of treatment and rehabilitation. Future research should focus on the following key themes: (1) cross-subject and cross-task EEG signal analysis; (2) personalized intervention therapies; (3) integrated cognitive intervention therapies; (4) obtaining sufficient experimental data; (5) exploring the relationship between EEG signal features and task performance. From our perspective, in-depth research in this field will contribute to more effective cognitive intervention methods.

Author contributions

YW: Writing – original draft, Writing – review & editing, Resources. KZ: Writing – original draft, Writing – review & editing. HY: Writing – original draft, Writing – review & editing. XW: Writing – review & editing, Funding acquisition. TL: Writing – review & editing. DL: Writing – review & editing. DD: Writing – review & editing. XX: Writing – review & editing. DW: Writing – original draft, Writing – review & editing, Funding acquisition, Supervision.

Funding

The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research was funded by National Natural Science Foundation of China (62276022 and 62206014) and National Key Research and Development Program of China (2023YFF1203702).

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

Altschul, D. M., and Deary, I. J. (2020). Playing analog games is associated with reduced declines in cognitive function: a 68-year longitudinal cohort study. J. Gerontol.: Series B 75, 474–482. doi: 10.1093/geronb/gbz149

PubMed Abstract | Crossref Full Text | Google Scholar

Barnish, M. S., and Barran, S. M. (2020). A systematic review of active group-based dance, singing, music therapy and theatrical interventions for quality of life, functional communication, speech, motor function and cognitive status in people with Parkinson's disease. BMC Neurol. 20:3. doi: 10.1186/s12883-020-01938-3

PubMed Abstract | Crossref Full Text | Google Scholar

Bégel, V., Di Loreto, I., Seilles, A., and Dalla Bella, S. (2017). Music games: potential application and considerations for rhythmic training. Front. Hum. Neurosci. 11:273. doi: 10.3389/fnhum.2017.00273

PubMed Abstract | Crossref Full Text | Google Scholar

Buzzi, M. C., Buzzi, M., Perrone, E., and Senette, C. (2019). Personalized technology-enhanced training for people with cognitive impairment. Univers. Access Inf. Soc. 18, 891–907. doi: 10.1007/s10209-018-0619-3

Crossref Full Text | Google Scholar

Carè, M., Chiappalone, M., and Cota, V. R. (2024). Personalized strategies of neurostimulation: from static biomarkers to dynamic closed-loop assessment of neural function. Front. Neurosci. 18:1363128. doi: 10.3389/fnins.2024.1363128

PubMed Abstract | Crossref Full Text | Google Scholar

Chalkiadakis, E. (2022). Developing and evaluating a musical attention control training computer game application (master's thesis). Utrecht University, Utrecht, Netherlands.

Google Scholar

Choi, E., Shin, S., Ryu, J., Jung, K., Kim, S., and Park, M. (2020). Commercial video games and cognitive functions: video game genres and modulating factors of cognitive enhancement. Behav. Brain Funct. 16:2. doi: 10.1186/s12993-020-0165-z

PubMed Abstract | Crossref Full Text | Google Scholar

Cicerone, K. D., Goldin, Y., Ganci, K., Rosenbaum, A., Wethe, J. V., Langenbahn, D. M., et al. (2019). Evidence-based cognitive rehabilitation: systematic review of the literature from 2009 through 2014. Arch. Phys. Med. Rehabil. 100, 1515–1533. doi: 10.1016/j.apmr.2019.02.011

PubMed Abstract | Crossref Full Text | Google Scholar

Dalla Bella, S. (2022). Rhythmic serious games as an inclusive tool for music-based interventions. Ann. N. Y. Acad. Sci. 1517, 15–24. doi: 10.1111/nyas.14878

PubMed Abstract | Crossref Full Text | Google Scholar

Dangi, S., Orsborn, A. L., Moorman, H. G., and Carmena, J. M. (2013). Design and analysis of closed-loop decoder adaptation algorithms for brain-machine interfaces. Neural Comput. 25, 1693–1731. doi: 10.1162/NECO_a_00460

PubMed Abstract | Crossref Full Text | Google Scholar

Ehrlich, S. K., Agres, K. R., Guan, C., and Cheng, G. (2019). A closed-loop, music-based brain-computer interface for emotion mediation. PLoS ONE 14:e213516. doi: 10.1371/journal.pone.0213516

PubMed Abstract | Crossref Full Text | Google Scholar

Fang, R., Ye, S., Huangfu, J., and Calimag, D. P. (2017). Music therapy is a potential intervention for cognition of alzheimer's disease: a mini-review. Transl. Neurodegener. 6:9. doi: 10.1186/s40035-017-0073-9

PubMed Abstract | Crossref Full Text | Google Scholar

Farkhondeh Tale Navi, F., Heysieattalab, S., Ramanathan, D. S., Raoufy, M. R., and Nazari, M. A. (2022). Closed-loop modulation of the self-regulating brain: a review on approaches, emerging paradigms, and experimental designs. Neuroscience 483, 104–126. doi: 10.1016/j.neuroscience.2021.12.004

PubMed Abstract | Crossref Full Text | Google Scholar

GomezRomero-Borquez, J., Del Puerto-Flores, J. A., and Del-Valle-Soto, C. (2023). Mapping eeg alpha activity: assessing concentration levels during player experience in virtual reality video games. Future Internet 15:264. doi: 10.3390/fi15080264

Crossref Full Text | Google Scholar

Jimenez-Guarneros, M., and Gomez-Gil, P. (2020). Custom domain adaptation: a new method for cross-subject, eeg-based cognitive load recognition. IEEE Signal Process. Lett. 27, 750–754. doi: 10.1109/LSP.2020.2989663

Crossref Full Text | Google Scholar

Jin, W., Zhu, X., Qian, L., Wu, C., Yang, F., Zhan, D., et al. (2024). Electroencephalogram-based adaptive closed-loop brain-computer interface in neurorehabilitation: a review. Front. Comput. Neurosci. 18:1431815. doi: 10.3389/fncom.2024.1431815

PubMed Abstract | Crossref Full Text | Google Scholar

Jirayucharoensak, S., Israsena, P., Pan-ngum, S., Hemrungrojn, S., and Maes, M. (2019). A game-based neurofeedback training system to enhance cognitive performance in healthy elderly subjects and in patients with amnestic mild cognitive impairment. Clin. Interv. Aging 14, 347–360. doi: 10.2147/CIA.S189047

PubMed Abstract | Crossref Full Text | Google Scholar

Jung, Y. H., Lee, S., Kim, W. J., Lee, J. H., Kim, M. J., and Han, H. J. (2020). Effect of integrated cognitive intervention therapy in patients with mild to moderate Alzheimer's disease. Dementia Neurocogn. Disord. 19:86. doi: 10.12779/dnd.2020.19.3.86

PubMed Abstract | Crossref Full Text | Google Scholar

Koenig, A., Novak, D., Omlin, X., Pulfer, M., Perreault, E., Zimmerli, L., et al. (2011). Real-time closed-loop control of cognitive load in neurological patients during robot-assisted gait training. IEEE Trans. Neural Syst. Rehabil. Eng. 19, 453–464. doi: 10.1109/TNSRE.2011.2160460

PubMed Abstract | Crossref Full Text | Google Scholar

Kuperczko, D., Kenyeres, P., Darnai, G., Kovacs, N., and Janszky, J. (2022). Sudden gamer death: non-violent death cases linked to playing video games. BMC Psychiatry 22:5. doi: 10.1186/s12888-022-04373-5

PubMed Abstract | Crossref Full Text | Google Scholar

Li, H., Wang, H., Chou, F., and Chen, K. (2015). The effect of music therapy on cognitive functioning among older adults: a systematic review and meta-analysis. J. Am. Med. Dir. Assoc. 16, 71–77. doi: 10.1016/j.jamda.2014.10.004

PubMed Abstract | Crossref Full Text | Google Scholar

Li, H., Wang, H., Lu, C., Chen, T., Lin, Y., and Lee, I. (2019). The effect of music therapy on reducing depression in people with dementia: a systematic review and meta-analysis. Geriatr. Nurs. 40, 510–516. doi: 10.1016/j.gerinurse.2019.03.017

PubMed Abstract | Crossref Full Text | Google Scholar

Li, Y., Li, X., Ratcliffe, M., Liu, L., Qi, Y., and Liu, Q. (2011). “A real-time EEG-based BCI system for attention recognition in ubiquitous environment,” in Proceedings of 2011 International Workshop on Ubiquitous Affective Awareness and Intelligent Interaction (UAAII '11) (New York, NY: Association for Computing Machinery), 33–40. doi: 10.1145/2030092.2030099

Crossref Full Text | Google Scholar

Lin, Y., Mao, H., Lin, K. N., Tang, Y. L., Yang, C., and Chou, J. (2020). Development and evaluation of a computer game combining physical and cognitive activities for the elderly. IEEE Access 8, 216822–216834. doi: 10.1109/ACCESS.2020.3041017

Crossref Full Text | Google Scholar

Litvan, I., Aarsland, D., Adler, C. H., Goldman, J. G., Kulisevsky, J., Mollenhauer, B., et al. (2011). Mds task force on mild cognitive impairment in Parkinson's disease: critical review of pd-mci. Mov. Disord. 26, 1814–1824. doi: 10.1002/mds.23823

PubMed Abstract | Crossref Full Text | Google Scholar

Liu, S., Schad, D. J., Kuschpel, M. S., Rapp, M. A., and Heinz, A. (2016). Music and video gaming during breaks: influence on habitual versus goal-directed decision making. PLoS ONE 11:e150165. doi: 10.1371/journal.pone.0150165

PubMed Abstract | Crossref Full Text | Google Scholar

Loizou, G., Karageorghis, C. I., and Bishop, D. T. (2014). Interactive effects of video, priming, and music on emotions and the needs underlying intrinsic motivation. Psychol. Sport Exerc. 15, 611–619. doi: 10.1016/j.psychsport.2014.06.009

Crossref Full Text | Google Scholar

Lyu, J., Zhang, J., Mu, H., Li, W., Champ, M., Xiong, Q., et al. (2018). The effects of music therapy on cognition, psychiatric symptoms, and activities of daily living in patients with Alzheimer's disease. J. Alzheimer's Dis. 64, 1347–1358. doi: 10.3233/JAD-180183

PubMed Abstract | Crossref Full Text | Google Scholar

Martin-Moratinos, M., Bella-Fernandez, M., and Blasco-Fontecilla, H. (2023). Effects of music on attention-deficit/hyperactivity disorder (ADHD) and potential application in serious video games: systematic review. J. Med. Internet Res. 25:e37742. doi: 10.2196/37742

PubMed Abstract | Crossref Full Text | Google Scholar

Menascu, S., Aloni, R., Dolev, M., Magalashvili, D., Gutman, K., Dreyer-Alster, S., et al. (2021). Targeted cognitive game training enhances cognitive performance in multiple sclerosis patients treated with interferon beta 1-a. J. Neuroeng. Rehabil. 18:3. doi: 10.1186/s12984-021-00968-3

PubMed Abstract | Crossref Full Text | Google Scholar

Miller, M. K., and Mandryk, R. L. (2016). “Differentiating in-game frustration from at-game frustration using touch pressure,” in Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (ISS '16) (New York, NY: Association for Computing Machinery), 225–234. doi: 10.1145/2992154.2992185

Crossref Full Text | Google Scholar

Moreira, S. V., Justi, F. R. D. R., Gomes, C. F. D. A., and Moreira, M. (2023). Music therapy enhances episodic memory in Alzheimer's and mixed dementia: a double-blind randomized controlled trial. Healthcare 11:2912. doi: 10.3390/healthcare11222912

PubMed Abstract | Crossref Full Text | Google Scholar

Moreno-Morales, C., Calero, R., Moreno-Morales, P., and Pintado, C. (2020). Music therapy in the treatment of dementia: a systematic review and meta-analysis. Front. Med. 7:160. doi: 10.3389/fmed.2020.00160

PubMed Abstract | Crossref Full Text | Google Scholar

Mortazavi, F., Moradi, H., and Vahabie, A. (2024). Dynamic difficulty adjustment approaches in video games: a systematic literature review. Multimed. Tools Appl. 83, 83227–83274. doi: 10.1007/s11042-024-18768-x

Crossref Full Text | Google Scholar

Ni, X., Wu, F., Song, J., An, L., Jiang, Q., Bai, T., et al. (2022). Chinese expert consensus on assessment of cognitive impairment in the elderly. Aging Med. 5, 154–166. doi: 10.1002/agm2.12222

PubMed Abstract | Crossref Full Text | Google Scholar

Park, H., and Friston, K. (2013). Structural and functional brain networks: from connections to cognition. Science 342:1238411. doi: 10.1126/science.1238411

PubMed Abstract | Crossref Full Text | Google Scholar

Rajakumar, K. D., and Mohan, J. (2024). A systematic review on effect of music intervention on cognitive impairment using eeg, fmri, and cognitive assessment modalities. Results Eng. 22:102224. doi: 10.1016/j.rineng.2024.102224

Crossref Full Text | Google Scholar

Ribas, L. M., Rocha, F. T., Ortega, N. R. S., Da Rocha, A. F., and Massad, E. (2013). Brain activity and medical diagnosis: an eeg study. BMC Neurosci. 14:109. doi: 10.1186/1471-2202-14-109

PubMed Abstract | Crossref Full Text | Google Scholar

Schlette, L. (2023). Increasing engagement in a mact game through feedback and adaptability (master's thesis). Utrecht University, Utrecht, Netherlands.

Google Scholar

Schwartz, R. W., Ayres, K. M., and Douglas, K. H. (2017). Effects of music on task performance, engagement, and behavior: a literature review. Psychol. Music 45, 611–627. doi: 10.1177/0305735617691118

PubMed Abstract | Crossref Full Text | Google Scholar

Shi, S., Cui, S., Yao, Y., Ge, M., Yang, M., Sheng, X., et al. (2023). Smartphone video games improve cognitive function in patients with chronic schizophrenia: a randomized controlled trial. Eur. Arch. Psychiatry Clin. Neurosci. 274, 929–939. doi: 10.1007/s00406-023-01660-4

PubMed Abstract | Crossref Full Text | Google Scholar

Stegemoller, E. L. (2014). Exploring a neuroplasticity model of music therapy. J. Music Ther. 51, 211–227. doi: 10.1093/jmt/thu023

PubMed Abstract | Crossref Full Text | Google Scholar

Taya, F., Sun, Y., Babiloni, F., Thakor, N., and Bezerianos, A. (2015). Brain enhancement through cognitive training: a new insight from brain connectome. Front Syst. Neurosci. 9:44. doi: 10.3389/fnsys.2015.00044

PubMed Abstract | Crossref Full Text | Google Scholar

Ticker, C. (2017). Music and the mind: music's healing powers. Musical Offerings 8, 1–12. doi: 10.15385/jmo.2017.8.1.1

Crossref Full Text | Google Scholar

Unbehaun, D., Taugerbeck, S., Aal, K., Vaziri, D. D., Lehmann, J., Tolmie, P., et al. (2021). Notes of memories: fostering social interaction, activity and reminiscence through an interactive music exergame developed for people with dementia and their caregivers. Hum. Comput. Interact 36, 439–472. doi: 10.1080/07370024.2020.1746910

Crossref Full Text | Google Scholar

van der Hiele, K., Vein, A. A., Reijntjes, R. H. A. M., Westendorp, R. G. J., Bollen, E. L. E. M., van Buchem, M. A., et al. (2007). EEG correlates in the spectrum of cognitive decline. Clin. Neurophysiol. 118, 1931–1939. doi: 10.1016/j.clinph.2007.05.070

PubMed Abstract | Crossref Full Text | Google Scholar

Vargas, A., Díaz, P., and Zarraonandia, T. (2020). “Using virtual reality and music in cognitive disability therapy,” in Proceedings of the 2020 International Conference on Advanced Visual Interfaces (AVI '20) (New York, NY: Association for Computing Machinery), 1–9. doi: 10.1145/3399715.3399916

Crossref Full Text | Google Scholar

Walter, C. B. (2015). EEG workload prediction in a closed-loop learning environment (PhD's thesis). Eberhard Karls Universität Tübingen, Tübingen, Germany.

PubMed Abstract | Google Scholar

Wan, X., Zhang, Y., Liu, T., Li, D., Yu, H., and Wen, D. (2024). Exercise therapy of mild cognitive impairment: EEG could enhance efficiency. Front. Aging Neurosci. 16:1373273. doi: 10.3389/fnagi.2024.1373273

PubMed Abstract | Crossref Full Text | Google Scholar

Wen, D., Pang, Z., Wan, X., Li, J., Dong, X., and Zhou, Y. (2023). Cross-task-oriented eeg signal analysis methods: our opinion. Front. Neurosci. 17:1153060. doi: 10.3389/fnins.2023.1153060

PubMed Abstract | Crossref Full Text | Google Scholar

Wiley, K., Robinson, R., and Mandryk, R. L. (2021). The making and evaluation of digital games used for the assessment of attention: systematic review. JMIR Serious Games 9:e26449. doi: 10.2196/26449

PubMed Abstract | Crossref Full Text | Google Scholar

Wu, D., Xu, Y., and Lu, B. (2022). Transfer learning for eeg-based brain-computer interfaces: a review of progress made since 2016. IEEE Trans. Cogn. Dev. Syst. 14, 4–19. doi: 10.1109/TCDS.2020.3007453

Crossref Full Text | Google Scholar

Xue, B., Meng, X., Liu, Q., and Luo, X. (2023). The effect of receptive music therapy on older adults with mild cognitive impairment and depression: a randomized controlled trial. Sci. Rep. 13:6. doi: 10.1038/s41598-023-49162-6

PubMed Abstract | Crossref Full Text | Google Scholar

Zhang, Q., Hu, S., Talay, R., Xiao, Z., Rosenberg, D., Liu, Y., et al. (2023). A prototype closed-loop brain–machine interface for the study and treatment of pain. Nat. Biomed. Eng. 7, 533–545. doi: 10.1038/s41551-021-00736-7

PubMed Abstract | Crossref Full Text | Google Scholar

Zhong, X., Wang, Q., Liu, D., Chen, Z., Liao, J., Sun, J., et al. (2024). EEG-DG: a multi-source domain generalization framework for motor imagery eeg classification. IEEE J. Biomed. Health Inform. 1–12. doi: 10.1109/JBHI.2024.3431230

PubMed Abstract | Crossref Full Text | Google Scholar

Zhou, Y., Xu, Z., Niu, Y., Wang, P., Wen, X., Wu, X., et al. (2022). Cross-task cognitive workload recognition based on eeg and domain adaptation. IEEE Trans. Neural Syst. Rehabil. Eng. 30, 50–60. doi: 10.1109/TNSRE.2022.3140456

PubMed Abstract | Crossref Full Text | Google Scholar

Keywords: music therapy, video games, cognitive function, EEG, combination

Citation: Wang Y, Zhang K, Yu H, Wan X, Liu T, Li D, Duan D, Xie X and Wen D (2024) Integrating music therapy and video games in cognitive interventions: innovative applications of closed-loop EEG. Front. Aging Neurosci. 16:1498821. doi: 10.3389/fnagi.2024.1498821

Received: 19 September 2024; Accepted: 29 November 2024;
Published: 18 December 2024.

Edited by:

Long Xu, Capital Medical University, China

Reviewed by:

Ilaria Pozzato, The University of Sydney, Australia

Copyright © 2024 Wang, Zhang, Yu, Wan, Liu, Li, Duan, Xie and Wen. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Dong Wen, YWl3ZDE2OCYjeDAwMDQwO3VzdGIuZWR1LmNu

These authors have contributed equally to this work

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.