Walton Wider1
Jasmine Adela Mutang2*
Bee Seok Chua2
Nicholas Tze Ping Pang3
Leilei Jiang4Muhammad Ashraf Fauzi5
Lester Naces Udang6,7*- 1Faculty of Business and Communications, INTI International University, Nilai, Negeri Sembilan, Malaysia
- 2Faculty of Psychology and Education, Universiti Malaysia Sabah, Kota Kinabalu, Sabah, Malaysia
- 3Faculty of Medicine and Health Sciences, Universiti Malaysia Sabah, Kota Kinabalu, Sabah, Malaysia
- 4Faculty of Education and Liberal Arts, INTI International University, Nilai, Negeri Sembilan, Malaysia
- 5Faculty of Industrial Management, Universiti Malaysia Pahang Al-Sultan Abdullah, Pekan, Pahang, Malaysia
- 6Faculty of Liberal Arts, Shinawatra University, Pathumthani, Thailand
- 7College of Education, University of the Philippines, Diliman, Philippines
Introduction: This study conducts a bibliometric analysis on neurofeedback research to assess its current state and potential future developments.
Methods: It examined 3,626 journal articles from the Web of Science (WoS) using co-citation and co-word methods.
Results: The co-citation analysis identified three major clusters: “Real-Time fMRI Neurofeedback and Self-Regulation of Brain Activity,” “EEG Neurofeedback and Cognitive Performance Enhancement,” and “Treatment of ADHD Using Neurofeedback.” The co-word analysis highlighted four key clusters: “Neurofeedback in Mental Health Research,” “Brain-Computer Interfaces for Stroke Rehabilitation,” “Neurofeedback for ADHD in Youth,” and “Neural Mechanisms of Emotion and Self-Regulation with Advanced Neuroimaging.
Discussion: This in-depth bibliometric study significantly enhances our understanding of the dynamic field of neurofeedback, indicating its potential in treating ADHD and improving performance. It offers non-invasive, ethical alternatives to conventional psychopharmacology and aligns with the trend toward personalized medicine, suggesting specialized solutions for mental health and rehabilitation as a growing focus in medical practice.
Introduction
Neurofeedback is also known as EEG biofeedback and brainwave biofeedback (Hellrung et al., 2022). The primary objective of neurofeedback is to modify brain electrical activity, which is the basis for emotional and behavioral processes in the body (Mirifar et al., 2022). It combines electroencephalogram (EEG) capabilities with advances in computer technology and operant conditioning (Swingle and Psych, 2010). Neurofeedback enables the brain to self-identify and adjust or self-regulate its electrical activity through the use of specific treatment procedures that either reward (strengthen) or inhibit (weaken) specific brainwave patterns (Ninaus et al., 2015). Participants can learn to interrupt dysfunctional neurological patterns and create more stable brainwave patterns. A remarkable embodiment of neurofeedback principles can be seen in brain-computer interfaces (BCIs) for motor rehabilitation, particularly after stroke (Sebastián-Romagosa et al., 2020). Remsik et al. (2021) describe the use of brain-computer interfaces (BCIs) for stroke rehabilitation through neurofeedback based on operant conditioning. This approach allows stroke survivors to purposefully control their brain’s sensorimotor rhythms by providing real-time feedback when they generate the desired brain activity. This method facilitates neurological recovery and can significantly improve motor function by reinforcing beneficial neural patterns, helping patients re-learn motor skills damaged by stroke. These advances highlight neurofeedback’s uniqueness and potency as a rehabilitation method, diverging fundamentally from conventional self-regulation and cognitive-behavioral interventions by offering specificity, direct targeting of brain function, and immediate, personalized feedback.
Neurofeedback distinguishes itself from conventional self-regulation and cognitive-behavioral techniques by directly focusing on and altering brain activity. Unlike traditional techniques that primarily aim to adjust thoughts, emotions, or behaviors through subjective means (Zabihiyeganeh et al., 2019; Stran et al., 2020), neurofeedback utilizes a range of imaging modalities including real-time EEG, fMRI, MEG, and NIRS to provide objective, individualized insights into brain function, offering a more precise and data-driven approach to understanding and modifying neural activity (Emmert et al., 2016; Marzbani et al., 2016; Kvamme et al., 2022; Wu et al., 2022; Yagi et al., 2022; Flanagan and Saikia, 2023; Lieberman et al., 2023). This level of specificity enables the focused training of specific brain areas and frequencies that are associated with certain functions or illnesses. This sets it apart from the more general effectiveness of conventional methods (Hammond, 2007). Furthermore, neurofeedback’s immediate feedback loop permits real-time self-modulation of brain activity (Marzbani et al., 2016), contrasting with the delayed feedback or the required conscious efforts associated with conventional therapies. Neurofeedback’s training paradigm is uniquely thorough compared to traditional procedures since it requires several sessions to induce enduring changes in brain function, rather than focusing on short-term effects. Hence, neurofeedback provides a specific, direct technique for improving brain activity and attaining therapeutic aims, substantially distinct from the broader, more generic tactics applied by traditional self-regulation and cognitive-behavioral therapies.
The effects of neurofeedback on cognitive function, with a focus on memory, are based on the principle of operant conditioning and involve informing the subject in real time about the workings of their organism to motivate them to change their behavior (Pérez-Elvira et al., 2021). Neurofeedback is founded on two fundamental principles. First, the EEG accurately reflects observable mental states; the second reason is that these states can be educated (Thompson and Thompson, 2003). The neurofeedback method aims to accomplish two primary goals. The first involves altering a specific brainwave frequency in a region of the participant’s brain that has been linked to their current emotional or behavioral issue (Marzbani et al., 2016). The second objective is to improve the stability and communication of neural networks across the brain and between or within its hemispheres (Sitaram et al., 2017). Neurofeedback restores the brain’s rhythm, timing, frequency, and synchronization, allowing the brain to better coordinate perception, movement, and conscious experience (Farmer, 2002).
EEG neurofeedback systems utilize both operant conditioning and classical (associative) learning principles in the context of motor rehabilitation. Operant conditioning is employed to reinforce desired brain activity patterns associated with motor function. For example, when a patient generates specific brainwave patterns indicative of motor planning or execution, they may receive positive feedback such as auditory or visual cues, encouraging them to continue producing those patterns. Classical (associative) learning is utilized to establish connections between movement-related cues or mental imagery and positive outcomes. For instance, patients might be trained to associate imagining the movement of their limbs with successful motor execution or reduced pain, facilitating motor relearning and rehabilitation. By combining these learning principles, EEG neurofeedback systems can effectively engage both voluntary behavior modification and reflexive response associations, enhancing motor rehabilitation outcomes for patients.
Vernon et al. (2003) asserted that prior research suggests neurofeedback may be effective in treating a variety of early childhood disorders. Including attention-deficit/hyperactivity disorder (ADHD), Asperger’s disorder, learning disability, obsessive-compulsive disorder (OCD), and autism spectrum disorder (ASD) (McVoy et al., 2019; Naeimian et al., 2020; Direito et al., 2021; Riesco-Matías et al., 2021; Zafarmand et al., 2022). Several randomized clinical studies on the use of neurofeedback techniques for ADHD have demonstrated the efficacy of neurofeedback (Gevensleben et al., 2009; Sonuga-Barke et al., 2013; Micoulaud-Franchi et al., 2014; Cortese et al., 2016; Young et al., 2017). Because autistic children frequently exhibit symptoms of attention deficit and hyperactivity, these findings have prompted research into neurofeedback as an alternative treatment for autism (Klöbl et al., 2023). Neurofeedback therapy has also been shown in studies to be effective and beneficial in the treatment of a variety of mental disorders, including anxiety, depression (Wang et al., 2022), sleep disorders (Kolken et al., 2023), headaches (Arina et al., 2022), migraines (Hashemipour and Isfahani Asl, 2022), and other emotional issues (Zotev et al., 2011). It has also been shown to be effective in treating people with organic brain disorders such as cerebral palsy, and seizures (Nigro, 2019). Other studies have shown that neurofeedback has the potential to improve optimal performance in high-level musical performers (Egner and Gruzelier, 2003), dance performance (Raymond et al., 2005), and sports performance (Xiang et al., 2018; de Brito et al., 2022).
Literature review
Bibliometric analyses have been useful in identifying key research trends and mapping the intellectual structure of neurofeedback-related research. For instance, Rong et al. (2022) and Yao et al. (2022) conducted bibliometric analyses on ASD and quantitative EEG research in neuropsychiatric disorders, revealing the most influential authors, institutions, and countries in the field as well as the most frequently studied brain regions and EEG features. These analyses shed light on the global research status and trends in autism spectrum disorder (ASD) and electroencephalogram (EEG), as well as how neurofeedback can be used as a treatment option, providing valuable insights for researchers and practitioners. In addition, bibliometric evaluations of the publication history and influence of neurofeedback research have been conducted. Onganlar et al. (2021) conducted a comprehensive analysis of neurofeedback articles published between 1975 and 2020, providing a historical overview of publication trends, citation patterns, and research topics. Using bibliometrics and content analysis based on natural language processing, Wang et al. (2022) investigated changes in depression and radiology-related publications, revealing the evolution of research focus in these fields. These analyses provide historical context and emphasize the dynamic nature of neurofeedback research.
Meta-analyses have also been conducted to systematically evaluate the effects of neurofeedback on particular outcomes, in addition to bibliometric analyses. A meta-analysis conducted by Yeh et al. (2022) examined the effects of neurofeedback training on working memory and episodic memory in healthy populations, providing evidence for the cognitive benefits of neurofeedback. In addition, meta-analyses have been conducted to evaluate the efficacy of neurofeedback in treating ADHD, with studies by Arns et al. (2020), Chiu et al. (2022), and Cortese et al. (2016) revealing promising results for improving inattention, impulsivity, and hyperactivity in individuals with ADHD. These meta-analyses provide valuable evidence regarding the potential therapeutic benefits of neurofeedback in specific populations. In addition, empirical research has investigated the efficacy of neurofeedback in treating various neuropsychiatric conditions. For example, Arns et al. (2009) conducted a meta-analysis on the efficacy of neurofeedback for ADHD and found significant improvements in core ADHD symptoms. Russo et al. (2022) conducted a meta-analysis on neurofeedback for anxiety spectrum disorders, revealing promising results for anxiety symptom reduction. These empirical studies shed light on the clinical applications of neurofeedback and support its potential as a treatment for neuropsychiatric disorders.
Additionally, the meta-analyses conducted by Cervera et al. (2018), Nojima et al. (2022), and Vavoulis et al. (2023) jointly emphasize the effectiveness of Brain-Computer Interface (BCI) systems in improving motor recovery after a stroke. BCIs have shown notable enhancements in motor performance by enabling the regulation of sensorimotor rhythms through neurofeedback. These benefits are measured using assessments like the Fugl-Meyer Assessment. The use of BCIs in rehabilitation not only provides a platform for neuroplasticity but also suggests the possibility of functional and structural brain healing. Despite encouraging findings, these studies highlight the demand for more research to enhance BCI technology, optimize training methods, and test the clinical efficacy through bigger, more varied study populations, hoping to secure BCI’s place in the future of neurorehabilitation.
Present study
The purpose of this investigation is to provide a thorough understanding of the neurofeedback research literature. To the best of the authors’ knowledge, no prior bibliometric study in this area has been conducted. Our study aims to supplement Onganlar et al. (2021) overview of bibliometric analysis because their study only focuses on publication trends, citation patterns, and research topics over time. This study, on the other hand, focuses on examining neurofeedback literature using a co-citation and co-word approach. By utilizing these two bibliometric analyses, this study fills a void by providing insights into past, present, and future research directions. As a result of the specific bibliometric analyses, the following research objectives emerge:
1. To assess significant historical research on neurofeedback using co-citation analysis.
2. To assess emerging trends in neurofeedback using co-word analysis.
Methods
Bibliometric approach
Bibliometric techniques are useful for examining the connections between scientific papers and identifying trends and patterns in the evolution of research disciplines (Wider et al., 2023a). Co-citation analysis is the process of identifying two or more documents that were cited in the reference section of a third paper (Bronk et al., 2023). This analysis of co-citation connections across publications enables researchers to identify clusters of frequently cited works related to specific research topics or subdomains (Li et al., 2023). These classifications provide insights into a research field’s intellectual foundation, the evolution of research themes, and the long-term impact of significant works (Donthu et al., 2021; Wider et al., 2023b). Furthermore, co-citation analysis can aid in the identification of prominent authors, institutions, and journals that have contributed to the advancement of a research field (Gao et al., 2022).
Co-word analysis, on the other hand, entails detecting terms or phrases that appear together in the titles, abstracts, or keywords of academic papers (Dhiman et al., 2023). Researchers can uncover clusters of interconnected research subjects, themes, or ideas by studying the co-occurrence patterns of these terms (Lim et al., 2022; Zakaria et al., 2023). These clusters provide useful information about a research domain’s academic interests and intellectual organization. Furthermore, co-word analysis can help identify emerging research topics and trends, as well as track the evolution of research themes over time (Liu et al., 2021; Wider et al., 2023c).
Researchers can investigate the historical, current, and potential future trends in neurofeedback by using bibliometric techniques such as co-citation and co-word analysis. Neurofeedback research has shown potential benefits in improving cognitive performance, treating neurological disorders, and addressing mental health issues (Loriette et al., 2021). Bibliometric analysis can help identify the most important or highly cited works related to these applications. Researchers can identify the most influential works in neurofeedback research and track their evolution over time by examining co-citation patterns and co-occurring terms. Furthermore, co-word analysis can help identify emerging subjects or trends in neurofeedback research, such as its potential as a powerful therapeutic tool. In conclusion, bibliometric techniques assist researchers in gaining a thorough understanding of the potential benefits of neurofeedback, its progression over time, and its possible future trajectory.
Search string
The search string used in this bibliometric investigation is detailed in Table 1. The topic search (TS) feature of the Web of Science (WOS) database was used to limit terms to titles, abstracts, and keywords. The search term “neurofeedback” covered articles from 1989 to 2023. The search took place on April 6, 2023. The WOS database is well-known for its high quality and comprehensiveness, making it an excellent choice for bibliometric research. It is the world’s oldest, most widely used, and most trustworthy research publication and citation database, providing selective, balanced, and comprehensive coverage of the world’s leading research from over 34,000 journals (Birkle et al., 2020). Eugene Garfield founded Web of Science in 1964 as the Science Citation Index, and it has since expanded its scope to cover a wide range of disciplines.
Table 1. Search string, inclusion, and exclusion criteria.
The search was performed in the WOS Database, a large academic database that indexes conference proceedings, scientific journals, and books. The “Search Field” section outlines the parameters that confined the search to the subject area, encompassing the title, abstract, and keywords of a publication. The search period was extended until April 6th, 2023 in order to include all available publications in the results. To ensure data integrity, all publications were checked for inconsistencies and duplicates prior to conducting the bibliometric analysis (Linnenluecke et al., 2020). Because the citation topics were set to “ALL,” the search results included all publications’ topics, regardless of their specific research focus. Articles, reviews, editorials, and conference proceedings were all included in the “ALL” document type. The search was restricted to publications written in English, which is a widely used language in scientific communication. This restriction ensured that the findings were accessible to a wide range of readers and researchers. Table 1 shows the inclusion and exclusion criteria for this review. Based on these criteria, the screening process retained 3,626 articles (Figure 1). The article selection process was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) methodology (Page et al., 2021).
Figure 1. Flowchart illustrating the search results following the modified PRISMA standard.
Results and discussion
Publication trends and descriptive analysis
The Web of Science (WOS) database revealed 63,195 citations linked to the selected studies (N = 3,626), with a reduction to 33,1,234 when self-citations were excluded. These articles had an H-index of 111 and an average citation count of 17.43 per paper. The body of 3,626 articles reflects a growing interest in neurofeedback research. Although the inaugural paper on neurofeedback appeared in 1989, it wasn’t until 1994 that significant scholarly contributions were noted. Post-1994, publication frequency has surged exponentially. Growth was modest before the 21st century, but from 2000 to 2021, there was a marked escalation in the number of publications, soaring from 10 in 2000 to 392 in 2021, representing a substantial increase over two decades. In 2022, however, there was a slight dip in publications, decreasing to 326. It is anticipated that scholarly focus on neurofeedback will continue to ascend in the forthcoming years. Figure 2 illustrates the trajectory of published articles, and their citation counts from 1989 to 2023.
Figure 2. Number of articles and citations from 1989 to April 6, 2023.
Co-citation analysis
In our co-citation analysis, we set a citation threshold of 86, meaning that only references cited together 86 times or more were included. This methodology led to the identification of 60 references that met or exceeded this co-citation frequency threshold, ensuring that our analysis concentrated on the most significant and relevant themes within the scientific literature. This threshold was determined through a series of tests aimed at ensuring the clusters identified were stable and accurately represented relevant themes. The optimal threshold was established after experimenting with various levels, specifically 54, 55, 57, 58, 59, 61, and 63. Table 2 displays the top 10 co-cited references with the highest total link strength. The study by Arns et al. (2009) received 284 citations, followed by DeCharms et al. (2005) with 228 citations, and Zoefel et al. (2011) with 200 citations. Figure 3 presents a network analysis of neurofeedback research, based on the cited references.
Table 2. Top 10 documents with the highest co-citation and total link strength.
Figure 3. Co-citation analysis.
Through the examination of co-citations, it becomes evident that there are three distinct clusters, each centered around a specific theme. These clusters represent groups of related items that share a common theme. Related articles are organized into clusters, indicated by nodes of matching colors (Dong et al., 2023). Below is the description of each cluster and its corresponding label.
• Cluster 1 (red) is comprised of 22 publications titled “Real-Time fMRI neurofeedback and self-regulation of brain activity.” Neurofeedback based on real-time functional magnetic resonance imaging (fMRI) has emerged as a powerful tool for understanding and modulating brain activity, with significant implications for mental health and cognitive enhancement (Martz et al., 2020; Direito et al., 2021). This collection of research articles looks into the methodologies, applications, and challenges of real-time fMRI neurofeedback, with a particular emphasis on brain activity self-regulation. Birbaumer et al. (2013) and Sitaram et al. (2017) provide comprehensive reviews of neurofeedback science, highlighting the potential of closed-loop brain training in treating a variety of neurological and psychiatric disorders. These studies highlight the significance of learning how to regulate brain metabolism as well as the potential of neurofeedback as a non-invasive intervention. Caria et al. (2007, 2010) investigate the regulation of anterior insular cortex activity and show that volitional control over this area modifies responses to aversive stimuli. These findings could help us understand and treat anxiety and other emotional disorders. Similarly, DeCharms et al. (2004, 2005) demonstrate that learned regulation of spatially localized brain activation can lead to improved pain perception control. Shibata et al. (2011) present a novel approach to perceptual learning based on decoded fMRI neurofeedback, demonstrating that learning can be induced without the need for stimulus presentation. This study demonstrates the potential of real-time fMRI neurofeedback for improving cognitive performance across multiple domains. Young et al. (2014, 2017) investigate the use of real-time fMRI neurofeedback in the treatment of major depressive disorder, demonstrating that training amygdala activity can result in significant improvements in symptoms and autobiographical memory recall. These findings highlight neurofeedback’s therapeutic potential for mental health conditions. Sulzer et al. (2013), Weiskopf (2012) and Weiskopf et al. (2003, 2004) investigate the methodologies and exemplary data associated with real-time fMRI neurofeedback, emphasizing the potential for physiological self-regulation of regional brain activity. This research focuses on the technical aspects and challenges of this rapidly evolving field. Finally, Zotev et al. (2011) investigate amygdala activation self-regulation, bolstering the potential of real-time fMRI neurofeedback in treating emotional disorders and improving emotional control. In summary, this cluster demonstrates the efficacy and potential of real-time fMRI neurofeedback in understanding and modulating brain activity, with important implications for mental health, cognitive enhancement, and the future of neuroscience.
• Cluster 2 (green) contains 21 publications titled “EEG-Neurofeedback and Cognitive Performance Enhancement.” The studies in this cluster are concerned with the effects of EEG-neurofeedback on cognitive performance as well as the methodologies involved. EEG-neurofeedback, a type of biofeedback, entails measuring and providing real-time feedback on EEG activity to help people learn self-regulation of brain activity and improve cognitive performance (Marzbani et al., 2016; Ramalingam et al., 2023). This has been explored in healthy participants (Gruzelier, 2014a) and those with neurological disorders such as epilepsy (Sterman and Egner, 2006). Gruzelier (2014a,b) provides comprehensive reviews on performance optimization using EEG-neurofeedback, with an emphasis on methodological and theoretical considerations. Gruzelier (2014a) emphasizes the beneficial effects on cognition and affect in healthy participants, whereas Gruzelier (2014b) discusses the importance of effective protocols as well as the role of individual differences. Several studies have been conducted to examine the effect of neurofeedback training on specific EEG frequency bands. Both Zoefel et al. (2011) and Hanslmayr et al. (2005) show that increasing upper alpha power via neurofeedback improves cognitive performance. Klimesch (1999) also discovered that EEG alpha and theta oscillations reflect cognitive and memory performance. Egner and Gruzelier (2001, 2004), on the other hand, concentrate on the low beta band components, reporting frequency-specific effects on attention and event-related brain potentials. Vernon et al. (2003) investigate the effect of different neurofeedback protocols on cognitive performance, whereas Delorme and Makeig (2004) present EEGLAB, an open-source toolbox for analyzing single-trial EEG dynamics, including independent component analysis. These tools are critical for researchers to analyze and comprehend the underlying neural processes associated with neurofeedback. Egner and Gruzelier (2003) demonstrate that slow-wave EEG modulation improves musical performance, addressing the ecological validity of neurofeedback. This study emphasizes the practicality of neurofeedback training. Finally, Vernon (2005) assesses the evidence for neurofeedback training’s ability to improve performance and emphasizes the need for additional research in order to draw firm conclusions. In summary, the studies in this cluster investigate the ability of EEG-neurofeedback to improve cognitive performance across multiple domains. They emphasize the relevance of specific frequency bands and the ecological validity of neurofeedback training, as well as methodological considerations, effective protocols, and individual differences.
• Cluster 3 (blue) contains 17 publications with the title “Treatment of attention-deficit/hyperactivity disorder (ADHD) using neurofeedback.” This article collection looks into the efficacy, outcomes, and potential of neurofeedback as an alternative or complementary approach to managing ADHD symptoms in children and adolescents. The comparison of neurofeedback to traditional pharmacological treatments, such as methylphenidate, is a recurring theme in these articles (Fuchs et al., 2003; Sonuga-Barke et al., 2013). This cluster includes multiple meta-analysis that synthesize findings from various studies to provide a comprehensive understanding of neurofeedback’s effectiveness (Arns et al., 2009; Cortese et al., 2016; Van Doren et al., 2019). These meta-analysis show that neurofeedback training has a positive effect on ADHD symptoms and that the effects last. Several articles investigate specific neurofeedback techniques, such as slow cortical potential training (Heinrich et al., 2004; Strehl et al., 2006), and investigate the underlying neurophysiological effects of these treatments (Gevensleben et al., 2009). These studies contribute to a better understanding of how neurofeedback alters brain function in ADHD patients to improve attention, impulsivity, and hyperactivity. Furthermore, some articles provide critical assessments of neurofeedback research and discuss the difficulties in determining its efficacy (Arns et al., 2014). They emphasize the importance of methodologically rigorous studies and long-term follow-ups in order to establish neurofeedback’s clinical utility as a viable ADHD treatment option. This cluster exemplifies the growing interest in neurofeedback as a non-pharmacological treatment for ADHD, highlighting both its potential benefits and limitations. This cluster contributes to a more comprehensive understanding of neurofeedback’s role in managing ADHD symptoms, as well as the importance of ongoing research in this area.
Table 3 presents a summary of co-citation analysis on neurofeedback with the clusters’ number, color, labels, number of publications and representative publications.
Table 3. Co-citation clusters on neurofeedback.
Co-occurrence of keyword
In our co-word analysis, we identified a total of 63 keywords, with a minimum occurrence threshold set at 61. This threshold was crucial in ensuring that our analysis focused on the most frequently occurring and relevant keywords within our dataset, thereby highlighting key trends and areas of focus in the scientific literature. To determine the most effective threshold for our analysis, we conducted a series of tests using various levels, specifically 62, 64, 65, 66, and 67. This rigorous testing process helped us to identify a threshold that accurately captures the core themes and facilitates a stable and meaningful analysis of the relationships between keywords in our study. The co-word analysis revealed that the most frequently used keyword was “neurofeedback” (1,684 occurrences), followed by “EEG” (617 occurrences) and “ADHD” (378 occurrences). Table 4 displays the top 15 co-word analysis keywords.
Table 4. The 15 most frequent keywords in the keyword co-occurrence analysis.
Following that, Figure 4 depicts the network structure of keyword co-occurrence. The diagram depicts four distinct clusters that appear to be related. Each cluster was examined and expanded upon as follows:
• Cluster 1 (Red): This cluster comprises a total of 19 keywords and is titled “neurofeedback and mental health research.” This cluster demonstrates the growing importance of neurofeedback techniques, such as EEG-neurofeedback and biofeedback, in the assessment and treatment of mental health disorders such as anxiety, depression, and attention-related issues (Young et al., 2017; Hey, 2020; Taschereau-Dumouchel et al., 2022). Keywords such as “alpha,” “oscillations,” and “power” highlight the emphasis on specific brainwave patterns and their potential role in the manifestation and treatment of these disorders (Klimesch, 1999; Egner and Gruzelier, 2003; Hanslmayr et al., 2005; Zoefel et al., 2011; Perera et al., 2022). Furthermore, the cluster emphasizes the importance of working memory and cognitive performance, indicating the growing interest in using neurofeedback training to improve overall brain function. Researchers are increasingly interested in using neurofeedback to improve cognitive performance, memory, and attention in healthy individuals, in addition to addressing mental health issues (Egner and Gruzelier, 2001; Gruzelier, 2014a; Marlats et al., 2020; Da Silva and De Souza, 2021; Moradi et al., 2022). Based on this cluster, future trends in neurofeedback research are expected to explore the connections between brain oscillations, mental health, and cognitive performance. Researchers may develop more targeted neurofeedback protocols to address specific disorders or enhance specific cognitive abilities as our understanding of the brain’s intricate processes grows. Furthermore, advances in EEG and biofeedback technology may result in more accessible and personalized neurofeedback training methods, allowing a broader range of people to benefit from these interventions. Finally, the cluster formed around these keywords reflects neurofeedback’s growing importance in the research and treatment of mental health disorders and cognitive enhancement. Future trends in this field are likely to focus on improving neurofeedback training methods and making these interventions more accessible to a larger population.
• Cluster 2 (green): There are 17 keywords in this cluster. Based on the keywords, a cluster reveals a significant research focus on the “development and application of brain-computer interfaces (BCIs) for stroke patient rehabilitation.” This cluster is concerned with the use of BCIs and their underlying mechanisms, such as electroencephalography (EEG) and transcranial magnetic stimulation (TMS), for rehabilitation purposes. BCIs allow direct communication between the brain and external devices, allowing neural activity to be translated into actionable commands (Shih et al., 2012; Kosal and Putney, 2022). One critical application of this technology is in the field of motor recovery and rehabilitation, particularly for people who have had a stroke (Cervera et al., 2018; Fu et al., 2023). In this context, the study looks into the use of motor imagery techniques, which involve mental rehearsal of motor actions without physical execution, in conjunction with BCIs (Vavoulis et al., 2023). EEG detects neural activity associated with motor imagery, and by modulating this activity, stroke patients can regain control of their motor functions (Liao et al., 2023). TMS is also used as a non-invasive brain stimulation method to facilitate cortical reorganization and improve the efficacy of rehabilitation (Naro and Calabrò, 2022). Furthermore, the cluster emphasizes the significance of feedback and classification systems in the development of effective BCI-based rehabilitation programs (Gao et al., 2022). These systems enable the accurate interpretation and real-time adjustment of the user’s neural activity, allowing for a more personalized and adaptive approach to rehabilitation. Future trends in this cluster are likely to focus on refining and expanding BCI technologies for stroke rehabilitation, with an emphasis on increasing the accuracy and reliability of classification and communication systems (Al-Qazzaz et al., 2023). Furthermore, the incorporation of machine learning and artificial intelligence techniques may aid in the development of more sophisticated and adaptive BCIs (Barnova et al., 2023). Ultimately, these advances could lead to more effective and personalized rehabilitation interventions, significantly improving the quality of life and recovery outcomes for stroke patients.
• Cluster 3 (Blue): There are 13 keywords in this cluster. Based on the keywords, one possible cluster is “neurofeedback for ADHD in children and adolescents.” This cluster demonstrates a strong emphasis on understanding and treating ADHD symptoms through the use of EEG biofeedback and slow cortical potentials as therapeutic modalities. The keywords “ADHD,” “adolescents,” “attention-deficit/hyperactivity disorder,” “children,” “deficit hyperactivity disorder,” and “deficit/hyperactivity disorder” highlight the population and condition under investigation. Keywords such as “EEG biofeedback,” “slow cortical potentials,” “therapy,” and “symptoms,” on the other hand, indicate the research’s methodological and therapeutic aspects. The terms “efficacy,” “meta-analysis,” and “hyperactivity” indicate a growing interest in assessing the efficacy of these therapeutic approaches in managing ADHD symptoms, particularly hyperactivity. The presence of “meta-analysis” within this cluster indicates that researchers are synthesizing the findings from multiple studies to obtain a more comprehensive understanding of the efficacy of these interventions (Micoulaud-Franchi et al., 2014; Cortese et al., 2016; Van Doren et al., 2019; Riesco-Matías et al., 2021; Louthrenoo et al., 2022; Kuznetsova et al., 2023). Based on this cluster, future trends in ADHD research and treatment may include a greater focus on neurofeedback techniques such as EEG biofeedback and slow cortical potentials to improve the efficacy of ADHD interventions for children and adolescents (Choudhury et al., 2023). Researchers could concentrate on developing personalized neurofeedback protocols that are tailored to individual needs in order to improve treatment outcomes (Ma et al., 2023; Zhang et al., 2023). Furthermore, there may be an increased interest in researching the long-term effects of these therapies, as well as their potential to reduce or even eliminate the need for pharmacological interventions in some cases (Sibley et al., 2023). Moreover, the integration of new technologies and methods, such as machine learning and real-time brain imaging, could help improve the accuracy and effectiveness of neurofeedback interventions (Haugg et al., 2020; Singh et al., 2022; Taschereau-Dumouchel et al., 2022). This would allow for more targeted targeting of brain regions and neural networks linked to ADHD symptoms. Overall, this cluster points to a future trend in ADHD research that focuses on the development and optimization of novel, non-invasive, and personalized neurofeedback therapies for children and adolescents.
• Cluster 4 (Yellow): There are 12 keywords in this cluster. One possible cluster based on the keywords is “neural mechanisms of emotion and self-regulation using advanced neuroimaging.” The cluster of keywords reflects a strong focus on brain function and connectivity research, particularly concerning emotional regulation and self-regulation processes. This cluster indicates a growing interest in studying the neural underpinnings of emotion regulation and self-regulation using advanced neuroimaging techniques such as functional Magnetic Resonance Imaging (fMRI) and real-time fMRI (Zhu et al., 2019; Mathiak and Keller, 2021; Taschereau-Dumouchel et al., 2022; Zotev et al., 2023). This cluster’s connections show an interaction between brain regions, particularly the amygdala and the prefrontal cortex, in modulating emotional responses and self-regulation processes (Lowe et al., 2020; Drigas and Mitsea, 2021; Janet et al., 2023). The amygdala is well-known for its role in emotion processing, particularly fear and anxiety (Šimić et al., 2021), whereas the prefrontal cortex is associated with higher-order cognitive functions and executive control (Friedman and Robbins, 2022). This cluster’s functional connectivity research emphasizes the importance of interactions between these regions in emotion management and self-regulation. More in-depth studies of the dynamic interactions between various brain regions associated with emotion regulation and self-regulation are likely in the future (Yang et al., 2020). This could include creating more advanced real-time fMRI techniques and analysis methods to better understand the temporal and spatial patterns of brain activation and connectivity during these processes (Warbrick, 2022). Furthermore, researchers may investigate the potential of neurofeedback and other neuromodulation techniques to improve emotion regulation and self-regulation by targeting specific brain regions and networks (Barreiros et al., 2019; Melnikov, 2021; James and Duarte, 2023). This could result in the development of novel therapeutic interventions for people suffering from emotional dysregulation, anxiety, depression, or other mental health issues. Furthermore, interdisciplinary research that integrates insights from psychology, psychiatry, and neuroscience may benefit the field by generating a more comprehensive understanding of the neural mechanisms underlying emotion regulation and self-regulation.
Figure 4. Co-word analysis of neurofeedback research.
The co-word analysis of neurofeedback research is summarized in Table 5, providing information on cluster number, color, labels, number of keywords, and representative keywords.
Table 5. Co-word analysis on neurofeedback research.
Implications
This bibliometric study has multiple key clinical implications. Attention deficit hyperactivity disorder is a growing secondary pandemic in the developed world and has been partially exacerbated by the increasing amount of gadget use and consequent Internet and smartphone addiction issues that have emerged. There is hence higher recourse to “urge surfing” using mobile devices, which presents a double whammy for ADHD sufferers. Neurofeedback training has previously been regarded to be in its infancy, but this bibliometric study suggests through the network of keywords and authors that there is much literature of reasonable quality that can be referred to inform the creation of research-grounded, structured protocols as a promising new frontier of treatment for ADHD.
It is essential to acknowledge the significant contributions of neurofeedback to research, highlighting its role as a valuable tool for monitoring brain activity in real-time. Compared to other brain imaging modalities such as fMRI and PET, neurofeedback—often based on EEG—is particularly advantageous due to its non-invasiveness, affordability, and high temporal resolution. These characteristics make it well-suited for providing real-time feedback during neurofeedback interventions, allowing for immediate adjustment and optimization of treatment protocols. This gives it an edge and acts as an essential tool for monitoring real-time brain activity during neurofeedback interventions. Consequently, it enhances our understanding of the mechanisms involved in ADHD treatments which allows researchers and clinicians to customize interventions and evaluate the effectiveness of treatments with accuracy by analyzing variations in brainwave patterns.
Furthermore, the incorporation of transcranial magnetic stimulation (TMS) as a metric of results enhances our comprehension of neurofeedback interventions. TMS acts as a biomarker for enhanced motor function and offers valuable neurophysiological information about corticomuscular excitability. This information deepens our comprehension of the neural processes involved in neurofeedback interventions and can be used to complement behavioral outcomes. The utilization of both neuroimaging and neuromodulatory techniques in neurofeedback research demonstrates its multidisciplinary nature and its ability to improve treatment outcomes for ADHD and potentially other neurological disorders.
In addition to treating ADHD, neurofeedback and biofeedback show great promise in the emerging clinical fields of performance enhancement, especially in sports and occupational psychiatry. The use of neurofeedback will increase clinicians’ repertoire as they can then provide care options that are not invasive, that do not involve the ethical dilemmas of using psychopharmacology and consequent maleficence via unacceptable side effect profiles, while potentially inducing lasting changes in brainwave structure rather than merely symptomatic relief.
Limitations and conclusion
In conclusion, this bibliometric study demonstrates that there is high potential to grow for neurofeedback and biofeedback as a branch of medical practice. There is already much evidence extant for the role of neurofeedback in stroke and rehabilitation medicine. It now appears to show promise too in the emerging fields of ADHD and performance enhancement, as well as being suitable as a non-invasive treatment modality for general mental health wellness. This bodes well as we move into an age of personalized and precision medicine, where we do not offer one-size-fits-all solutions that offer a broad-based but non-specific treatment for primary and tertiary prevention of mental health disorders.
Data availability statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Author contributions
WW: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft. JM: Conceptualization, Resources, Validation, Visualization, Writing – review & editing. BC: Conceptualization, Resources, Visualization, Writing – review & editing. NP: Writing – review & editing. MF: Methodology, Validation, Visualization, Writing – review & editing. LU: Funding acquisition, Writing – review & editing. LJ: Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This research is supported by the Postgraduate Research Grant (UMSGreat; No: GUG0207-1/2018), Universiti Malaysia Sabah.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Al-Qazzaz, N. K., Aldoori, A. A., Ali, S. H. B. M., Ahmad, S. A., Mohammed, A. K., and Mohyee, M. I. (2023). EEG signal complexity measurements to enhance BCI-based stroke patients’ rehabilitation. Sensors 23:3889. doi: 10.3390/s23083889
Arina, G. A., Dobrushina, O. R., Shvetsova, E. T., Osina, E. D., Meshkov, G. A., Aziatskaya, G. A., et al. (2022). Infra-low frequency neurofeedback in tension-type headache: a cross-over sham-controlled study. Front. Hum. Neurosci. 16:891323. doi: 10.3389/fnhum.2022.891323
Arns, M., Clark, C. R., Trullinger, M., DeBeus, R., Mack, M., and Aniftos, M. (2020). Neurofeedback and attention-deficit/hyperactivity-disorder (ADHD) in children: rating the evidence and proposed guidelines. Appl. Psychophysiol. Biofeedback 45, 39–48. doi: 10.1007/s10484-020-09455-2
Arns, M., De Ridder, S., Strehl, U., Breteler, M., and Coenen, A. (2009). Efficacy of neurofeedback treatment in ADHD: the effects on inattention, impulsivity and hyperactivity: a meta-analysis. Clin. EEG Neurosci. 40, 180–189. doi: 10.1177/155005940904000311
Arns, M., Heinrich, H., and Strehl, U. (2014). Evaluation of neurofeedback in ADHD: the long and winding road. Biol. Psychol. 95, 108–115. doi: 10.1016/j.biopsycho.2013.11.013
Association, A. P (2013). Diagnostic and statistical manual of mental disorders: DSM-5™. 5th Edn. US: American Psychiatric Publishing, Inc.
Barnova, K., Mikolasova, M., Kahankova, R. V., Jaros, R., Kawala-Sterniuk, A., Snasel, V., et al. (2023). Implementation of artificial intelligence and machine learning-based methods in brain-computer interaction. Comput. Biol. Med. 163:107135. doi: 10.1016/j.compbiomed.2023.107135
Barreiros, A. R., Almeida, I., Baía, B. C., and Castelo-Branco, M. (2019). Amygdala modulation during emotion regulation training with fmri-based neurofeedback. Front. Hum. Neurosci. 13:89. doi: 10.3389/fnhum.2019.00089
Birbaumer, N., Ruiz, S., and Sitaram, R. (2013). Learned regulation of brain metabolism. Trends Cogn. Sci. 17, 295–302. doi: 10.1016/j.tics.2013.04.009
Birkle, C., Pendlebury, D. A., Schnell, J., and Adams, J. (2020). Web of science as a data source for research on scientific and scholarly activity. Quantitative Sci. Stud. 1, 363–376. doi: 10.1162/qss_a_00018
Bronk, K. C., Reichard, R. J., and Qi Li, J. (2023). A co-citation analysis of purpose: trends and (potential) troubles in the foundation of purpose scholarship. J. Posit. Psychol. 18, 1012–1026. doi: 10.1080/17439760.2023.2254738
Caria, A., Sitaram, R., Veit, R., Begliomini, C., and Birbaumer, N. (2010). Volitional control of anterior insula activity modulates the response to aversive stimuli. A real-time functional magnetic resonance imaging study. Biol. Psychiatry 68, 425–432. doi: 10.1016/j.biopsych.2010.04.020
Caria, A., Veit, R., Sitaram, R., Lotze, M., Weiskopf, N., Grodd, W., et al. (2007). Regulation of anterior insular cortex activity using real-time fMRI. NeuroImage 35, 1238–1246. doi: 10.1016/j.neuroimage.2007.01.018
Cervera, M. A., Soekadar, S. R., Ushiba, J., Millán, J. D. R., Liu, M., Birbaumer, N., et al. (2018). Brain-computer interfaces for post-stroke motor rehabilitation: a meta-analysis. Annals of clinical and translational neurol. 5, 651–663. doi: 10.1002/acn3.544
Chiu, H. J., Sun, C. K., Fan, H. Y., Tzang, R. F., Wang, M. Y., Cheng, Y. C., et al. (2022). Surface electroencephalographic neurofeedback improves sustained attention in ADHD: a meta-analysis of randomized controlled trials. Child Adolesc. Psychiatry Ment. Health 16, 1–13. doi: 10.1186/s13034-022-00543-1
Choudhury, A., Clare, C., Srivastava, S., Tullman, S., Westendarp, L., Younus, S., et al. (2023). “Biofeedback and its uses in mind body problems in children and adolescents” In J. M. Maldonado-Duran, A. Jimenez-Gomez, and K. Saxena (Eds.), Handbook of mind/body integration in child and adolescent development (Cham: Springer International Publishing), 501–514.
Cortese, S., Ferrin, M., Brandeis, D., Holtmann, M., Aggensteiner, P., Daley, D., et al. (2016). Neurofeedback for attention-deficit/hyperactivity disorder: Meta-analysis of clinical and neuropsychological outcomes from randomized controlled trials. J. Am. Acad. Child Adolesc. Psychiatry 55, 444–455. doi: 10.1016/j.jaac.2016.03.007
Da Silva, J. C., and De Souza, M. L. (2021). Neurofeedback training for cognitive performance improvement in healthy subjects: a systematic review. Psychol. Neurosci. 14, 262–279. doi: 10.1037/pne0000261
de Brito, M. A., Fernandes, J. R., Esteves, N. S. A., Müller, V. T., Alexandria, D. B., Pérez, D. I. V., et al. (2022). The effect of neurofeedback on the reaction time and cognitive performance of athletes: a systematic review and meta-analysis. Front. Hum. Neurosci. 16, 868450. doi: 10.3389/fnhum.2022.868450
DeCharms, R. C., Christoff, K., Glover, G. H., Pauly, J. M., Whitfield, S., and Gabrieli, J. D. (2004). Learned regulation of spatially localized brain activation using real-time fMRI. NeuroImage 21, 436–443. doi: 10.1016/j.neuroimage.2003.08.041
DeCharms, R. C., Maeda, F., Glover, G. H., Ludlow, D., Pauly, J. M., Soneji, D., et al. (2005). Control over brain activation and pain learned by using real-time functional MRI. Proc. Natl. Acad. Sci. 102, 18626–18631. doi: 10.1073/pnas.0505210102
Delorme, A., and Makeig, S. (2004). EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009
Dhiman, P., Kaur, A., Iwendi, C., and Mohan, S. K. (2023). A scientometric analysis of deep learning approaches for detecting fake news. Electronics 12:948. doi: 10.3390/electronics12040948
Direito, B., Mouga, S., Sayal, A., Simões, M., Quental, H., Bernardino, I., et al. (2021). Training the social brain: clinical and neural effects of an 8-week real-time functional magnetic resonance imaging neurofeedback phase IIa clinical trial in autism. Autism 25, 1746–1760. doi: 10.1177/13623613211002052
Dong, S., Mei, F., Li, J. J., and Xing, D. (2023). Global cluster analysis and network visualization in prosthetic joint infection: A scientometric mapping. Orthop. Surg. 15, 1165–1178. doi: 10.1111/os.13681
Donthu, N., Kumar, S., Mukherjee, D., Pandey, N., and Lim, W. M. (2021). How to conduct a bibliometric analysis: An overview and guidelines. Journal of business research, 133, 285–296.
Drigas, A., and Mitsea, E. (2021). Metacognition, stress-relaxation balance & related hormones. Int. J. Recent Contributions Eng. Sci. IT 9, 4–16. doi: 10.3991/ijes.v9i1.19623
Egner, T., and Gruzelier, J. H. (2001). Learned self-regulation of EEG frequency components affects attention and event-related brain potentials in humans. Neuroreport 12, 4155–4159. doi: 10.1097/00001756-200112210-00058
Egner, T., and Gruzelier, J. H. (2003). Ecological validity of neurofeedback: modulation of slow wave EEG enhances musical performance. Neuroreport 14, 1221–1224. doi: 10.1097/00001756-200307010-00006
Egner, T., and Gruzelier, J. H. (2004). EEG biofeedback of low beta band components: frequency-specific effects on variables of attention and event-related brain potentials. Clin. Neurophysiol. 115, 131–139. doi: 10.1016/S1388-2457(03)00353-5
Emmert, K., Kopel, R., Sulzer, J., Brühl, A. B., Berman, B. D., Linden, D. E., et al. (2016). Meta-analysis of real-time fMRI neurofeedback studies using individual participant data: how is brain regulation mediated? NeuroImage 124, 806–812. doi: 10.1016/j.neuroimage.2015.09.042
Flanagan, K., and Saikia, M. J. (2023). Consumer-grade electroencephalogram and functional near-infrared spectroscopy neurofeedback Technologies for Mental Health and Wellbeing. Sensors 23:8482. doi: 10.3390/s23208482
Friedman, N. P., and Robbins, T. W. (2022). The role of prefrontal cortex in cognitive control and executive function. Neuropsychopharmacology 47, 72–89. doi: 10.1038/s41386-021-01132-0
Fu, J., Chen, S., and Jia, J. (2023). Sensorimotor rhythm-based brain–computer interfaces for motor tasks used in hand upper extremity rehabilitation after stroke: a systematic review. Brain Sci. 13:56. doi: 10.3390/brainsci13010056
Fuchs, T., Birbaumer, N., Lutzenberger, W., Gruzelier, J. H., and Kaiser, J. (2003). Neurofeedback treatment for attention-deficit/hyperactivity disorder in children: a comparison with methylphenidate. Appl. Psychophysiol. Biofeedback 28, 1–12. doi: 10.1023/A:1022353731579
Gao, W., Cui, Z., Yu, Y., Mao, J., Xu, J., Ji, L., et al. (2022). Application of a brain–computer interface system with visual and motor feedback in limb and brain functional rehabilitation after stroke: case report. Brain Sci. 12:1083. doi: 10.3390/brainsci12081083
Gao, J., Faheem, M., and Yu, X. (2022). Global research on contaminated soil remediation: a bibliometric network analysis. Landscape 11:1581. doi: 10.3390/land11091581
Gevensleben, H., Holl, B., Albrecht, B., Schlamp, D., Kratz, O., Studer, P., et al. (2009). Distinct EEG effects related to neurofeedback training in children with ADHD: a randomized controlled trial. Int. J. Psychophysiol. 74, 149–157. doi: 10.1016/j.ijpsycho.2009.08.005
Gruzelier, J. H. (2014a). EEG-neurofeedback for optimising performance. I: a review of cognitive and affective outcome in healthy participants. Neurosci. Biobehav. Rev. 44, 124–141. doi: 10.1016/j.neubiorev.2013.09.015
Gruzelier, J. H. (2014b). EEG-neurofeedback for optimising performance. III: a review of methodological and theoretical considerations. Neurosci. Biobehav. Rev. 44, 159–182. doi: 10.1016/j.neubiorev.2014.03.015
Hanslmayr, S., Sauseng, P., Doppelmayr, M., Schabus, M., and Klimesch, W. (2005). Increasing individual upper alpha power by neurofeedback improves cognitive performance in human subjects. Applied Psychophysiol. Biofeedback 30, 1–10. doi: 10.1007/s10484-005-2169-8
Hashemipour, M., and Isfahani Asl, M. (2022). Effectiveness of neurofeedback on sleep quality and pain control of people with migraine headaches who refer to specialized neurosurgery clinics in Ahvaz. Psycholog. Achievements 29, 91–104. doi: 10.22055/psy.2022.40353.2818
Haugg, A., Renz, F. M., Nicholson, A. A., Lor, C., Götzendorfer, S. J., Sladky, R., et al. (2020). Determinants of real-time fMRI neurofeedback performance and improvement–a machine learning mega-analysis. bioRxiv, doi: 10.1101/2020.10.21.349118
Heinrich, H., Gevensleben, H., Freisleder, F. J., Moll, G. H., and Rothenberger, A. (2004). Training of slow cortical potentials in attention-deficit/hyperactivity disorder: evidence for positive behavioral and neurophysiological effects. Biol. Psychiatry 55, 772–775. doi: 10.1016/j.biopsych.2003.11.013
Heinrich, H., Gevensleben, H., and Strehl, U. (2007). Annotation: neurofeedback–train your brain to train behaviour. J. Child Psychol. Psychiatry 48, 3–16. doi: 10.1111/j.1469-7610.2006.01665.x
Hellrung, L., Kirschner, M., Sulzer, J., Sladky, R., Scharnowski, F., Herdener, M., et al. (2022). Analysis of individual differences in neurofeedback training illuminates successful self-regulation of the dopaminergic midbrain. Commun. Biol. 5:845. doi: 10.1038/s42003-022-03756-4
Hey, C. (2020). Neurofeedback and counseling as integrative treatment. Asia Pacific J. Neurotherapy 2, 6–11,
James, T. A., and Duarte, A. (2023). Depressive symptoms are associated with reduced positivity preferences in episodic memory in aging. Neurobiol. Aging 121, 38–51. doi: 10.1016/j.neurobiolaging.2022.10.006
Janet, R., Costes, N., Mérida, I., Derrington, E., and Dreher, J. C. (2023). Relationships between serotonin availability and frontolimbic response to fearful and threatening faces. Sci. Rep. 13:1558. doi: 10.1038/s41598-023-28667-0
Klimesch, W. (1999). EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res. Rev. 29, 169–195. doi: 10.1016/S0165-0173(98)00056-3
Klöbl, M., Prillinger, K., Diehm, R., Doganay, K., Lanzenberger, R., Poustka, L., et al. (2023). Individual brain regulation as learned via neurofeedback is related to affective changes in adolescents with autism spectrum disorder. Child Adolesc. Psychiatry Ment. Health 17, 1–14. doi: 10.1186/s13034-022-00549-9
Kolken, Y., Bouny, P., and Arns, M. (2023). Effects of SMR neurofeedback on cognitive functions in an adult population with sleep problems: a tele-neurofeedback study. Appl. Psychophysiol. Biofeedback 48, 27–33. doi: 10.1007/s10484-022-09560-4
Kosal, M., and Putney, J. (2022). Neurotechnology and international security: predicting commercial and military adoption of brain-computer interfaces (BCIs) in the United States and China. Politics Life Sci. 42, 81–103. doi: 10.1017/pls.2022.2
Kuznetsova, E., Veilahti, A. V. P., Akhundzadeh, R., Radev, S., Konicar, L., and Cowley, B. U. (2023). Evaluation of neurofeedback learning in patients with ADHD: a systematic review. Appl. Psychophysiol. Biofeedback 48, 11–25. doi: 10.1007/s10484-022-09562-2
Kvamme, T. L., Ros, T., and Overgaard, M. (2022). Can neurofeedback provide evidence of direct brain-behavior causality? NeuroImage 258:119400. doi: 10.1016/j.neuroimage.2022.119400
Li, J., Ochiai, Y., Wider, W., and Fauzi, M. A. A. (2023). Bibliometric analysis of immersive Technology in Museum Exhibitions: exploring user experience. Front. Virtual Reality 4:1240562. doi: 10.3389/frvir.2023.1240562
Liao, W., Li, J., Zhang, X., and Li, C. (2023). Motor imagery brain–computer interface rehabilitation system enhances upper limb performance and improves brain activity in stroke patients: a clinical study. Front. Hum. Neurosci. 17:1117670. doi: 10.3389/fnhum.2023.1117670
Lieberman, J. M., Rabellino, D., Densmore, M., Frewen, P. A., Steyrl, D., Scharnowski, F., et al. (2023). A tale of two targets: examining the differential effects of posterior cingulate cortex-and amygdala-targeted fMRI-neurofeedback in a PTSD pilot study. Front. Neurosci. 17:1229729. doi: 10.3389/fnins.2023.1229729
Lim, W. M., Kumar, S., Verma, S., and Chaturvedi, R. (2022). Alexa, what do we know about conversational commerce? Insights from a systematic literature review. Psychol. Mark. 39, 1129–1155. doi: 10.1002/mar.21654
Linnenluecke, M. K., Marrone, M., and Singh, A. K. (2020). Conducting systematic literature reviews and bibliometric analyses. Aust. J. Manag. 45, 175–194. doi: 10.1177/0312896219877678
Liu, C., Zou, D., Chen, X., Xie, H., and Chan, W. H. (2021). A bibliometric review on latent topics and trends of the empirical MOOC literature (2008–2019). Asia Pac. Educ. Rev. 22, 515–534. doi: 10.1007/s12564-021-09692-y
Loriette, C., Ziane, C., and Hamed, S. B. (2021). Neurofeedback for cognitive enhancement and intervention and brain plasticity. Rev. Neurol. 177, 1133–1144. doi: 10.1016/j.neurol.2021.08.004
Louthrenoo, O., Boonchooduang, N., Likhitweerawong, N., Charoenkwan, K., and Srisurapanont, M. (2022). The effects of neurofeedback on executive functioning in children with ADHD: a meta-analysis. J. Atten. Disord. 26, 976–984. doi: 10.1177/10870547211045738
Lowe, C. J., Morton, J. B., and Reichelt, A. C. (2020). Adolescent obesity and dietary decision making—a brain-health perspective. Lancet Child & Adolescent Heal. 4, 388–396. doi: 10.1016/S2352-4642(19)30404-3
Lubar, J. F., Swartwood, M. O., Swartwood, J. N., and O'Donnell, P. H. (1995). Evaluation of the effectiveness of EEG neurofeedback training for ADHD in a clinical setting as measured by changes in TOVA scores, behavioral ratings, and WISC-R performance. Biofeedback Self Regul. 20, 83–99. doi: 10.1007/BF01712768
Ma, Y., Gong, A., Nan, W., Ding, P., Wang, F., and Fu, Y. (2023). Personalized brain–computer interface and its applications. J. Personalized Med. 13:46. doi: 10.3390/jpm13010046
Marlats, F., Bao, G., Chevallier, S., Boubaya, M., Djabelkhir-Jemmi, L., Wu, Y. H., et al. (2020). SMR/theta neurofeedback training improves cognitive performance and EEG activity in elderly with mild cognitive impairment: a pilot study. Front. Aging Neurosci. 12:147. doi: 10.3389/fnagi.2020.00147
Martz, M. E., Hart, T., Heitzeg, M. M., and Peltier, S. J. (2020). Neuromodulation of brain activation associated with addiction: a review of real-time fMRI neurofeedback studies. NeuroImage: Clinical 27:102350. doi: 10.1016/j.nicl.2020.102350
Marzbani, H., Marateb, H. R., and Mansourian, M. (2016). Neurofeedback: a comprehensive review on system design, methodology and clinical applications. Basic and clinical neurosci. 7, 143–158. doi: 10.15412/J.BCN.03070208
Mathiak, K., and Keller, M. (2021). Clinical Application of Real-Time fMRI-Based Neurofeedback for Depression. In Y.-K. Kim (Ed.), Major Depressive Disord., Rethinking and understanding recent discoveries. (Springer Nature Singapore Pte Ltd), 275–293.
McVoy, M., Lytle, S., Fulchiero, E., Aebi, M. E., Adeleye, O., and Sajatovic, M. (2019). A systematic review of quantitative EEG as a possible biomarker in child psychiatric disorders. Psychiatry Res. 279, 331–344. doi: 10.1016/j.psychres.2019.07.004
Melnikov, M. Y. (2021). The current evidence levels for biofeedback and neurofeedback interventions in treating depression: a narrative review. Neural Plast. 2021, 1–31. doi: 10.1155/2021/8878857
Micoulaud-Franchi, J. A., Geoffroy, P. A., Fond, G., Lopez, R., Bioulac, S., and Philip, P. (2014). EEG neurofeedback treatments in children with ADHD: an updated meta-analysis of randomized controlled trials. Front. Hum. Neurosci. 8:906. doi: 10.3389/fnhum.2014.00906
Mirifar, A., Keil, A., and Ehrlenspiel, F. (2022). Neurofeedback and neural self-regulation: a new perspective based on allostasis. Rev. Neurosci. 33, 607–629. doi: 10.1515/revneuro-2021-0133
Moradi, N., Rajabi, S., and Mansouri Nejad, A. (2022). The effect of neurofeedback training combined with computer cognitive games on the time perception, attention, and working memory in children with ADHD. Appl. Neuropsychol. Child. 13, 24–36. doi: 10.1080/21622965.2022.2112679
Naeimian, N., Zarqam Hajabi, M., and Nokani, M. (2020). The effectiveness of a combination of cognitive (computer) and neurofeedback rehabilitation on specific learning disabilities (math, reading and writing) in primary school children in Tehran's district 5. J. Educ. Psychol. Stud. 17, 54–75. doi: 10.22111/jeps.2020.5837
Naro, A., and Calabrò, R. S. (2022). Improving upper limb and gait rehabilitation outcomes in post-stroke patients: a scoping review on the additional effects of non-invasive brain stimulation when combined with robot-aided rehabilitation. Brain Sci. 12:1511. doi: 10.3390/brainsci12111511
Nigro, S. E. (2019). The efficacy of neurofeedback for pediatric epilepsy. Appl. Psychophysiol. Biofeedback 44, 285–290. doi: 10.1007/s10484-019-09446-y
Ninaus, M., Kober, S. E., Witte, M., Koschutnig, K., Neuper, C., and Wood, G. (2015). Brain volumetry and self-regulation of brain activity relevant for neurofeedback. Biol. Psychol. 110, 126–133. doi: 10.1016/j.biopsycho.2015.07.009
Nojima, I., Sugata, H., Takeuchi, H., and Mima, T. (2022). Brain–computer interface training based on brain activity can induce motor recovery in patients with stroke: a meta-analysis. Neurorehabil. Neural Repair 36, 83–96. doi: 10.1177/15459683211062895
Onganlar, Y. H., Eryilmaz, F., and Åžahin, M. (2021). A holistic evaluation of articles on neurofeedback published between 1975 and 2020: a bibliometric analysis. Revista Argentina de Clínica Psicológica 30:376. doi: 10.24205/03276716.2020.2035
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Int. J. Surg. 88:105906. doi: 10.1016/j.ijsu.2021.105906
Perera, M. P. N., Mallawaarachchi, S., Bailey, N. W., Murphy, O. W., and Fitzgerald, P. B. (2022). Obsessive-compulsive disorder (OCD) is associated with increased electroencephalographic (EEG) delta and theta oscillatory power but reduced delta connectivity. bioRxiv 2022:10. doi: 10.1016/j.jpsychires.2023.05.026
Pérez-Elvira, R., Oltra-Cucarella, J., Carrobles, J. A., Moltó, J., Flórez, M., Parra, S., et al. (2021). Enhancing the effects of neurofeedback training: the motivational value of the reinforcers. Brain Sci. 11:457. doi: 10.3390/brainsci11040457
Ramalingam, V., Cheong, S. K., and Lee, P. F. (2023). Study of EEG alpha wave response on the effects of video-guided deep breathing on pain rehabilitation. Technol. Health Care 31, 37–46. doi: 10.3233/THC-213531
Raymond, J., Sajid, I., Parkinson, L. A., and Gruzelier, J. H. (2005). Biofeedback and dance performance: A preliminary investigation. Applied psychophysiology and biofeedback, 30, 65–73.
Remsik, A. B., Gjini, K., Williams, L. Jr., van Kan, P. L., Gloe, S., Bjorklund, E., et al. (2021). Ipsilesional mu rhythm desynchronization correlates with improvements in affected hand grip strength and functional connectivity in sensorimotor cortices following BCI-FES intervention for upper extremity in stroke survivors. Front. Hum. Neurosci. 15:725645. doi: 10.3389/fnhum.2021.725645
Riesco-Matías, P., Yela-Bernabé, J. R., Crego, A., and Sánchez-Zaballos, E. (2021). What do meta-analyses have to say about the efficacy of neurofeedback applied to children with ADHD? Review of previous meta-analyses and a new meta-analysis. J. Atten. Disord. 25, 473–485. doi: 10.1177/1087054718821731
Rong, P., Fu, Q., Zhang, X., Liu, H., Zhao, S., Song, X., et al. (2022). A bibliometrics analysis and visualization of autism spectrum disorder. Front. Psychol. 13:884600. doi: 10.3389/fpsyt.2022.884600
Russo, G. M., Balkin, R. S., and Lenz, A. S. (2022). A meta-analysis of neurofeedback for treating anxiety-spectrum disorders. J. Couns. Dev. 100, 236–251. doi: 10.1002/jcad.12424
Sebastián-Romagosa, M., Cho, W., Ortner, R., Murovec, N., Von Oertzen, T., Kamada, K., et al. (2020). Brain computer interface treatment for motor rehabilitation of upper extremity of stroke patients—a feasibility study. Front. Neurosci. 14:591435. doi: 10.3389/fnins.2020.591435
Shibata, K., Watanabe, T., Sasaki, Y., and Kawato, M. (2011). Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation. Science 334, 1413–1415. doi: 10.1126/science.1212003
Shih, J. J., Krusienski, D. J., and Wolpaw, J. R. (2012). Brain-computer interfaces in medicine. Mayo Clin. Proc. 87, 268–279. doi: 10.1016/j.mayocp.2011.12.008
Sibley, M. H., Bruton, A. M., Zhao, X., Johnstone, J. M., Mitchell, J., Hatsu, I., et al. (2023). Non-pharmacological interventions for attention-deficit hyperactivity disorder in children and adolescents. Lancet Child & Adolescent Heal. 7, 415–428. doi: 10.1016/S2352-4642(22)00381-9
Šimić, G., Tkalčić, M., Vukić, V., Mulc, D., Španić, E., Šagud, M., et al. (2021). Understanding emotions: origins and roles of the amygdala. Biomol. Ther. 11:823. doi: 10.3390/biom11060823
Singh, N. M., Harrod, J. B., Subramanian, S., Robinson, M., Chang, K., Cetin-Karayumak, S., et al. (2022). How machine learning is powering neuroimaging to improve brain health. Neuroinformatics 20, 943–964. doi: 10.1007/s12021-022-09572-9
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., et al. (2017). Closed-loop brain training: the science of neurofeedback. Nat. Rev. Neurosci. 18, 86–100. doi: 10.1038/nrn.2016.164
Sonuga-Barke, E. J., Brandeis, D., Cortese, S., Daley, D., Ferrin, M., Holtmann, M., et al. (2013). Nonpharmacological interventions for ADHD: systematic review and meta-analyses of randomized controlled trials of dietary and psychological treatments. Am. J. Psychiatry 170, 275–289. doi: 10.1176/appi.ajp.2012.12070991
Sterman, M. B., and Egner, T. (2006). Foundation and practice of neurofeedback for the treatment of epilepsy. Appl. Psychophysiol. Biofeedback 31, 21–35. doi: 10.1007/s10484-006-9002-x
Stran, B. M., Chapin, B., Joy, E. E., Stover, B., and Maffei, A. D. (2020). Integrating a self-regulation focused cognitive-behavioral intervention in the classroom. J. Appl. Sch. Psychol. 36, 261–274. doi: 10.1080/15377903.2020.1727600
Strehl, U., Leins, U., Goth, G., Klinger, C., Hinterberger, T., and Birbaumer, N. (2006). Self-regulation of slow cortical potentials: a new treatment for children with attention-deficit/hyperactivity disorder. Pediatrics 118, e1530–e1540. doi: 10.1542/peds.2005-2478
Sulzer, J., Haller, S., Scharnowski, F., Weiskopf, N., Birbaumer, N., Blefari, M. L., et al. (2013). Real-time fMRI neurofeedback: Progress and challenges. NeuroImage 76, 386–399. doi: 10.1016/j.neuroimage.2013.03.033
Swingle, P. G., and Psych, R. (2010). Potentiating neurotherapy: Techniques for stimulating the EEG. Psychophysiology Today, 7, 13–19.
Taschereau-Dumouchel, V., Cushing, C. A., and Lau, H. (2022). Real-time functional MRI in the treatment of mental health disorders. Annu. Rev. Clin. Psychol. 18, 125–154. doi: 10.1146/annurev-clinpsy-072220-014550
Thompson, M., and Thompson, L. (2003). The neurofeedback book: An introduction to basic concepts in applied psychophysiology. Wheat Ridge, CO: Association for Applied Psychophysiology and Biofeedback.
Van Doren, J., Arns, M., Heinrich, H., Vollebregt, M. A., Strehl, U., Loo, K., et al. (2019). Sustained effects of neurofeedback in ADHD: a systematic review and meta-analysis. Eur. Child Adolesc. Psychiatry 28, 293–305. doi: 10.1007/s00787-018-1121-4
Vavoulis, A., Figueiredo, P., and Vourvopoulos, A. (2023). A review of online classification performance in motor imagery-based brain–computer interfaces for stroke neurorehabilitation. Signals 4, 73–86. doi: 10.3390/signals4010004
Vernon, D. J. (2005). Can neurofeedback training enhance performance? An evaluation of the evidence with implications for future research. Appl. Psychophysiol. Biofeedback 30, 347–364. doi: 10.1007/s10484-005-8421-4
Vernon, D., Egner, T., Cooper, N., Compton, T., Neilands, C., Sheri, A., et al. (2003). The effect of training distinct neurofeedback protocols on aspects of cognitive performance. Int. J. Psychophysiol. 47, 75–85. doi: 10.1016/S0167-8760(02)00091-0
Wang, K., Tan, F., Zhu, Z., and Kong, L. (2022). Exploring changes in depression and radiology-related publications research focus: a bibliometrics and content analysis based on natural language processing. Front. Psychol. 13:978763. doi: 10.3389/fpsyt.2022.978763
Warbrick, T. (2022). Simultaneous EEG-fMRI: what have we learned and what does the future hold? Sensors 22:226. doi: 10.3390/s22062262
Weiskopf, N. (2012). Real-time fMRI and its application to neurofeedback. NeuroImage 62, 682–692. doi: 10.1016/j.neuroimage.2011.10.009
Weiskopf, N., Scharnowski, F., Veit, R., Goebel, R., Birbaumer, N., and Mathiak, K. (2004). Self-regulation of local brain activity using real-time functional magnetic resonance imaging (fMRI). J. Physiol.-Paris 98, 357–373. doi: 10.1016/j.jphysparis.2005.09.019
Weiskopf, N., Veit, R., Erb, M., Mathiak, K., Grodd, W., Goebel, R., et al. (2003). Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data. NeuroImage 19, 577–586. doi: 10.1016/S1053-8119(03)00145-9
Wider, W., Fauzi, M. A., Gan, S. W., Yap, C. C., Khadri, M. W. A. B. A., and Maidin, S. S. (2023a). A bibliometric analysis of emerging adulthood in the context of higher education institutions: a psychological perspectives. Heliyon 9:e16988. doi: 10.1016/j.heliyon.2023.e16988
Wider, W., Gao, Y., Chan, C. K., Lin, J., Li, J., Tanucan, J. C. M., et al. (2023b). Unveiling trends in digital tourism research: a bibliometric analysis of co-citation and co-word analysis. Environ. Sustain. Indicators 20:100308. doi: 10.1016/j.indic.2023.100308
Wider, W., Jiang, L., Lin, J., Fauzi, M. A., Li, J., and Chan, C. K. (2023c). Metaverse chronicles: a bibliometric analysis of its evolving landscape. Int. J. Human–Computer Interaction, 1–14. doi: 10.1080/10447318.2023.2227825
Wu, W. J., Cui, L. B., Cai, M., Peng, Z. W., Zhang, W. C., Lv, S., et al. (2022). A parallel-group study of near-infrared spectroscopy-neurofeedback in children with attention deficit hyperactivity disorder. Psychiatry Res. 309:114364. doi: 10.1016/j.psychres.2021.114364
Xiang, M. Q., Hou, X. H., Liao, B. G., Liao, J. W., and Hu, M. (2018). The effect of neurofeedback training for sport performance in athletes: a meta-analysis. Psychol. Sport Exerc. 36, 114–122. doi: 10.1016/j.psychsport.2018.02.004
Yagi, K., Shibahara, Y., Tate, L., and Tamura, H. (2022). A study on analysis method for a real-time neurofeedback system using non-invasive magnetoencephalography. Electronics 11:2473. doi: 10.3390/electronics11152473
Yang, Y., Zhang, X., Peng, Y., Bai, J., and Lei, X. (2020). A dynamic causal model on self-regulation of aversive emotion. Brain informatics 7, 1–13. doi: 10.1186/s40708-020-00122-0
Yao, S., Zhu, J., Li, S., Zhang, R., Zhao, J., Yang, X., et al. (2022). Bibliometric analysis of quantitative electroencephalogram research in neuropsychiatric disorders from 2000 to 2021. Front. Psychiatry 13:830819. doi: 10.3389/fpsyt.2022.830819
Yeh, W. H., Ju, Y. J., Liu, Y. T., and Wang, T. Y. (2022). Systematic review and meta-analysis on the effects of neurofeedback training of theta activity on working memory and episodic memory in healthy population. Int. J. Environ. Res. Public Health 19:11037. doi: 10.3390/ijerph191711037
Young, K. D., Siegle, G. J., Zotev, V., Phillips, R., Misaki, M., Yuan, H., et al. (2017). Randomized clinical trial of real-time fMRI amygdala neurofeedback for major depressive disorder: effects on symptoms and autobiographical memory recall. Am. J. Psychiatry 174, 748–755. doi: 10.1176/appi.ajp.2017.16060637
Young, K. D., Zotev, V., Phillips, R., Misaki, M., Yuan, H., Drevets, W. C., et al. (2014). Real-time FMRI neurofeedback training of amygdala activity in patients with major depressive disorder. PLoS One 9:e88785. doi: 10.1371/journal.pone.0088785
Zabihiyeganeh, M., Afshar, S. V., Kadijani, A. A., Jafari, D., Bagherifard, A., Janbozorgi, M., et al. (2019). The effect of cognitive behavioral therapy on the circulating proinflammatory cytokines of fibromyalgia patients: a pilot controlled clinical trial. Gen. Hosp. Psychiatry 57, 23–28. doi: 10.1016/j.genhosppsych.2019.01.003
Zafarmand, M., Farahmand, Z., and Otared, N. (2022). A systematic literature review and meta-analysis on effectiveness of neurofeedback for obsessive-compulsive disorder. Neurocase, 28, 29–36.
Zakaria, H., Kamarudin, D., Fauzi, M. A., and Wider, W. (2023). Mapping the helix model of innovation influence on education: a bibliometric review. Front. Educ. 8:1142502. doi: 10.3389/feduc.2023.1142502
Zhang, J., Raya, J., Morfini, F., Urban, Z., Pagliaccio, D., Yendiki, A., et al. (2023). Reducing default mode network connectivity with mindfulness-based fMRI neurofeedback: a pilot study among adolescents with affective disorder history. Mol. Psychiatry 28, 2540–2548. doi: 10.1038/s41380-023-02032-z
Zhu, Y., Gao, H., Tong, L., Li, Z., Wang, L., Zhang, C., et al. (2019). Emotion regulation of hippocampus using real-time fMRI neurofeedback in healthy human. Front. Hum. Neurosci. 13:242. doi: 10.3389/fnhum.2019.00242
Zoefel, B., Huster, R. J., and Herrmann, C. S. (2011). Neurofeedback training of the upper alpha frequency band in EEG improves cognitive performance. NeuroImage 54, 1427–1431. doi: 10.1016/j.neuroimage.2010.08.078
Zotev, V., Krueger, F., Phillips, R., Alvarez, R. P., Simmons, W. K., Bellgowan, P., et al. (2011). Self-regulation of amygdala activation using real-time fMRI neurofeedback. PLoS One 6:e24522. doi: 10.1371/journal.pone.0024522
Keywords: neurofeedback, bibliometrics analysis, web of science, human health, co-word analysis, co-citation analysis
Citation: Wider W, Mutang JA, Chua BS, Pang NTP, Jiang L, Fauzi MA and Udang LN (2024) Mapping the evolution of neurofeedback research: a bibliometric analysis of trends and future directions. Front. Hum. Neurosci. 18:1339444. doi: 10.3389/fnhum.2024.1339444
Edited by:
Elias Ebrahimzadeh, University of Tehran, IranReviewed by:
Giuliana Lucci, Università degli Studi Guglielmo Marconi, ItalyAhad Behboodi, University of Nebraska Omaha, United States
Copyright © 2024 Wider, Mutang, Chua, Pang, Jiang, Fauzi and Udang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Jasmine Adela Mutang, amFzbWluZUB1bXMuZWR1Lm15; Lester Naces Udang, bGVzdGVyLm5Ac2l1LmFjLnRo