- 1Institute for Cognitive Neuroscience, HSE University, Moscow, Russia
- 2Pedagogy Department, International University of Central Asia, Tokmok, Kyrgyzstan
- 3V. Zelman Center for Neurobiology and Brain Rehabilitation, Skolkovo Institute of Science and Technology, Moscow, Russia
- 4Developmental Psychology and Family Pedagogic Department, The Herzen State Pedagogical University, Saint Petersburg, Russia
- 5MSU Institute for Artificial Intelligence, Lomonosov Moscow State University, Moscow, Russia
- 6Sechenov Institute of Evolutionary Physiology and Biochemistry of the Russian Academy of Sciences, Saint Petersburg, Russia
- 7Faculty of Mechanics and Mathematics, Lomonosov Moscow State University, Moscow, Russia
This perspective considers the novel concept of olfactory neurofeedback (O-NFB) within the framework of brain-computer interfaces (BCIs), where olfactory stimuli are integrated in various BCI control loops. In particular, electroencephalography (EEG)-based O-NFB systems are capable of incorporating different components of complex olfactory processing – from simple discrimination tasks to using olfactory stimuli for rehabilitation of neurological disorders. In our own work, EEG theta and alpha rhythms were probed as control variables for O-NFB. Additionaly, we developed an olfactory-based instructed-delay task. We suggest that the unique functions of olfaction offer numerous medical and consumer applications where O-NFB is combined with sensory inputs of other modalities within a BCI framework to engage brain plasticity. We discuss the ways O-NFB could be implemented, including the integration of different types of olfactory displays in the experiment set-up and EEG features to be utilized. We emphasize the importance of synchronizing O-NFB with respiratory rhythms, which are known to influence EEG patterns and cognitive processing. Overall, we expect that O-NFB systems will contribute to both practical applications in the clinical world and the basic neuroscience of olfaction.
1 Introduction
BCIs are a multidisciplinary field that holds the promise to revolutionize medicine, technology, and science through the development of systems that bidirectionally connect the nervous system to external devices (Lebedev and Nicolelis, 2017). Neurofeedback (NFB) systems are a subtype of BCIs that convert neural signals into stimuli delivered to human senses to enable self-regulation (Marzbani et al., 2016; Hammond, 2011; Sitaram et al., 2017). Historically, NFB systems have relied mostly on visual and auditory modalities. Here we discuss the idea of using olfaction for NFB.
We suggest that the effects of O-NFB could be unique compared to other NFB types because of the distinct features of odor processing in the brain. The olfactory inputs to the brain originate in the olfactory epithelium of the nose where olfactory neurons respond to odors and send their outputs to the olfactory bulbs (Morrison and Costanzo, 1990). The olfactory bulbs, unlike the other sensory systems, do not connect to the thalamus but project directly to the olfactory cortex (Shepherd et al., 2004). The olfactory bulbs also connect to the hypothalamus, amygdala, entorhinal cortex, and ventral striatum (Wilson and Mainen, 2006) which could be considered as limbic regions (Gottfried, 2006) where emotions are processed (Sullivan et al., 2015; Soudry et al., 2011) including the emotions in the context of social interactions (Sullivan et al., 2015; Malaspina et al., 2006). The projection areas of the olfactory bulb connect to the mediodorsal thalamus, orbitofrontal cortex, and hippocampus (Courtiol and Wilson, 2015). This distributed connectivity of the olfactory signals enables an important role of olfaction in cognition (Richardson and Zucco, 1989; Stevenson, 2013). Thus, olfactory memories have a profound emotional impact, surpassing those elicited by other sensory stimuli (Delaunay-El Allam et al., 2010; Carskadon and Herz, 2004). Disorders of olfaction contribute to such neuropsychiatric conditions as anxiety (Burón and Bulbena, 2013), depression (Kohli et al., 2016), schizophrenia (Marin et al., 2023) and bipolar disorder (Kazour et al., 2017). Additionally, olfactory dysfunctions occur in neurodegenerative diseases such as Parkinson's disease (Doty, 2012) and Alzheimer's disease (Murphy, 2019). Olfactory dysfunctions are also present in autism spectrum disorders (ASD) (Marin et al., 2023; Tonacci et al., 2017). Children with ASD have been reported to have reduced odor identification and discrimination abilities, where the severity of ASD symptoms is correlated with the ability to identify odors (Sweigert et al., 2020; Rozenkrantz et al., 2015), but some authors have disputed these findings (Dudova and Hrdlicka, 2013; Larsson et al., 2017). The COVID-19 endemic has introduced new challenges to the treatment of olfactory dysfunctions (Hannum et al., 2020).
Notwithstanding the previous research on the neural mechanism of olfaction and neural disorders affecting olfaction, the human sense of smell is still much less studied compared to the other sensory modalities, particularly vision (Hutmacher, 2019). There is still no consensus on the classification scheme that should be used for odors. Yet, humans possess an excellent olfactory ability, and the notion that their sense of smell is weak compared to other animals is clearly a isconception (McGann, 2017) even though, many people find it challenging to describe a smell in words (Yeshurun and Sobel, 2010; Distel and Hudson, 2001) or they rank the sense of smell as the least important (Enoch et al., 2019). The olfactory modality is currently underappreciated in neural technologies, even though supporting technologies have been developing such as the electronic nose (Wilson and Baietto, 2011).
2 The challenges of olfactory neurofeedback
In this perspective, we build on our results to propose that the O-NFB approach should be expanded in the future to give rise to the next generation of medical and consumer applications that integrate neural recordings with olfactory displays. Olfactory neurofeedback has several potential applications and multiple challenges. Olfactory dysfunctions (Croy et al., 2014) are the primary area of application for O-NFB. Olfactory training, also known as smell training or scent training, has already proven effective in restoring or improving the sense of smell in individuals with olfactory impairments (Hummel et al., 2009; Sorokowska et al., 2017). Although using olfaction as NFB appears as a reasonable idea, implementations are not as straightforward as with visual and auditory NFB. The complexity of olfactory stimulation (Lorig, 2000) and the methodological challenges of obtaining a reliable neural marker of olfaction (Masaoka et al., 2014) have kept this sensory system outside of the mainstream research on NFB.
Given the abundance of EEG-based approchaes to both BCI (Abiri et al., 2019) and NFB (Omejc et al., 2019), EEG recordings could be the easiest way to implement an O-NFB. EEG research has been ongoing of olfactory processing with such approaches as evoked potentials (Lorig, 2000; Livermore et al., 1992; Arpaia et al., 2022) and EEG rhythms (Schriever et al., 2017; Aydemir, 2017; Cherninskii et al., 2009). EEG modulations have been linked to such characteristics as odor pleasantness (Abbasi et al., 2019; Kroupi et al., 2014; Kim and Watanuki, 2003) and relationship to food (Martin, 1998). Notably, olfactory stimulation induces an increase in EEG power in the theta-rhythm range in frontal-temporal areas (Morozova et al., 2023; Schriever et al., 2017; Hucke et al., 2021). Theta and alpha rythmes modulations have been also linked to emotional responses during olfactory perception (Martin, 1998; Brauchli et al., 1995; Cherninskii et al., 2009), and alpha-rhythm modulations have been reported in a study that combined functional magnetic resonance imaging with magnetoencephalography (Tarfa et al., 2023). Attention to olfactory stimuli modulates EEG in the inferior frontal cortex, insula, and inferior temporal gyrus (Singh et al., 2019). Additionally, when mice explore odors and objects, correlation between EEG in the delta and theta range and their respiration decreases (Dasgupta et al., 2024). Machine learning algorithms have been applied to discern EEG patterns elicited by different odors (Ninenko et al., 2021; Aydemir, 2017; Saha et al., 2014).
In parallel to the studies of EEG responses to odors and the decoding of odor identity from EEG, there has been work toward solving the significant technical hurdles in eliciting and delivering olfactory stimuli that would be needed for an effective O-NFB system. The appropriate odor-delivery system should be capable of both precise delivery of scents and their removal. Such properties of olfactory responses as persistence, multiplicity, and masking complicate the transition between different scents and potentially lead to interference (Yanagida, 2008). Odors are complex mixtures of volatile molecules that can vary widely in their composition and concentration. This variability makes it challenging to precisely control odor stimuli across experiments. Odor perception is variable across individuals (Hudson and Distel, 2002; Trimmer et al., 2019; Wright and Mitchell, 2005) which makes it challenging to establish a standardized set of odor stimuli suitable for all participants. Addressing these challenges is essential, especially when rapid scent changes are required without causing an overlap or confusion of different olfactory inputs. Several odor-delivery methods have been developed (Yanagida, 2012; Wen et al., 2018; Garcia-Ruiz et al., 2021). One method involves scented waxes or oils that release odors upon air exposure. The other method uses compressed scent in bottles, sprayed into the air with an electronically controlled device. The third method consists of encasing scents in cartridges and dispersing them via inkjet technology for precise scent delivery (Sugimoto et al., 2010). In the fourth method, a scented mist is produced using ultrasonic transducers. This mist is added to the stream of air.
Regarding the methods for odor delivery to the olfactory epithelium, odor containing air could be delivered to participants either be spraying them in front of the nose or through the use of airtight masks, which are commonly employed for controlled olfactory stimulation. These masks create a sealed environment that isolates specific odorants and mitigates contamination be the odors from external sources. Odor accumulation within a mask is a limitation of this method. As participants inhale and exhale, odors accumulate and residual odors could interact with the olfactory stimuli, causing variability in the perception of odor intensity and quality. Given this limitation, spraying odors in a well-ventilated room could be a better solution than wearing a mask. In this room, precautions should be taken to minimize the effects of olfactory cross-contamination when multiple odors are utilized. Surfaces that could come into contact with odorants should be cleaned with an alcohol solution between participants. It is important to note that odor delivery devices could retain residual scents even after a single experimental session; therefore, regular cleaning of the surfaces in contact with odorants is essential to ensure the fidelity of the experimental conditions.
3 Specific experiments with O-NFB and their implications
Notwithstanding the improvements in our understanding of how olfactory processing is manifested in EEG, technological developments in the olfactory displays have already laid a foundation for olfactory-based BCIs and O-NFB systems. Yet, very little progress has been made in such neural technologies. Besides our own writings on these topics (Morozova et al., 2023; Ninenko et al., 2021; Medvedeva et al., 2024), there is just one human study of an olfactory-based biofeedback (Miyaura et al., 2011), where participants' level of concentration was controlled. A custom-built olfactory display was mounted under the nose to provide feedback of the concentration level measured based on the electrocardiogram analysis. The odors presented this way improved the performance, but constant odor delivery was effective, as well. In animal research, an olfactory-based BCI has been mentioned (Dong et al., 2014) but no real-time system has been developed.
Based on our work, we have recently proposed a research program aimed at the development of olfactory-based BCIs (Morozova et al., 2023). Toward this goal, we have conducted several studies where EEG was recorded in settings suitable for an O-NFB (Experiment 1 in Figures 1A, B, Table 1). Ninenko et al. (2021) developed an instructed-delay paradigm to investigate EEG modulations during olfactory discrimination. An automated odor delivery system was utilized to ensure a precise and controlled presentation of olfactory stimuli and respiration data. The olfactory delivery system was mounted on the ceiling of a custom-designed room. A constant airstream descended from above, into which odors were seamlessly integrated. The instructed-delay task required associating specific odors with visual targets and reporting perceived odors by pointing to those targets with a joystick. The participants held their breath before the odorant delivery, which ensured a consistent breath cycle during the task execution. The odor-perception delay was 10 s, which corresponded to 2-3 breath cycles. The participants had a median success rate of 93.8% for odor discrimination and the participants' ability to differentiate scents did not change over a one-hour session. With this approach, we obtained insights into the spatial and spectral properties of cortical activity associated with olfactory processing. In particular, a ~12 Hz rhythmic activity was observed over the EEG recording site C4, which was sensitive to olfactory processing. This ~12 Hz rhythmic activity falls into the high-alpha or low-beta frequency range (Egner and Gruzelier, 2004). The latter has been linked to attentive processing and sensorimotor functions (Gola et al., 2013; Kilavik et al., 2013). Given the involvement of respiratory modulation in olfactory tasks, it is plausible that this activity was related to the sensorimotor processes essential for odor discrimination. Additionally, the visually evoked response P200 was modulated depending on the perceived odor. We suggest these EEG modulations, combined with data from studies on olfactory event-related potentials (Invitto and Mazzatenta, 2019; Rombaux et al., 2007), should be further explored for possible use in O-NFB systems.
Figure 1. EEG recordings during olfactory stimulation and O-NFB. Evoked responses (A) and respiratory data (B) for coffee and water smells for one participant during Experiment 1 where a version of then olfactory instructed-delay task was implemented was implemented (Ninenko et al., 2021). The analyses are also depicted of the changes in theta power (C, D, G) and the across-averaged for each participant average theta power in perception (E) and discrimination (F) tasks from Experiment 2 where participants perceived and memorized odors or discriminated pairs of odors (Ninenko et al., 2021). Additionally, floating-mean progression of z-cored alpha power the change is shown for day 1 (H) and day 2 (I) of O-NFB training. The floating mean is shown for the Z-score of the alpha-range PSD envelope. Day 1 (H) and day 2 (I) data are shown from experiment 3 where an O-NFB was implemented based on the EEG alpha rhythm.
Morozova et al. (2023) (Experiment 2 in Figures 1C–G, Table 1)utilized a somewhat different experimental arrangement to explore the EEG manifestation of odor perception and discrimination. The Aroma Shooter diffuser (developed by Aromajoin Corporation, Japan) was used for odor delivery. This device generated 0.5 s long olfactory stimuli which the participants perceived and memorized or discriminated. In the discrimination task, a sequence of two odors was presented, and the participants reported by pressing a keyboard key whether they were the same or different. With this methodology, we found modulations in the frontal EEG theta (4-7 Hz) evoked by the olfactory stimuli. Additionally, an increase in the parietal alpha power (8-12 Hz) was observed during odor memorization.
Medvedeva et al. (2024) (Experiment 3 in Figures 1H, I, Table 1) proceeded with the development of an olfactory-based NFB system for controlling the EEG alpha rhythm (8-12Hz). In this study, odors were delivered using a robotic device that positioned Sniffin' Sticks markers in front of the participant's nose. The participants were divided into three groups by the type of feedback they received: O-NFB, auditory NFB, and mock-olfactory NFB. During each 20-minute session, subjects kept their eyes closed and received NFB of their alpha rhythm every 10 s. The O-NFB and auditory NFB participants received the corresponding reinforcement if their alpha rhythm power exceeded a predefined threshold. Two daily sessions were conducted per participant. The study showed comparable increases in alpha power in the O-NFB and auditory NFB groups but not in the mock NFB group. Overall, this study is a proof of concept demonstration of the feasibility of an EEG-based olfactory NFB system.
4 Discussion
While our work on O-NFB is currently at a proof-of-concept stage, we foresee a bright future for O-NFB systems and suggest that they have significant potential for multiple medical and consumer applications, including neural technologies that improve olfactory training (Ojha and Dixit, 2022; Hummel et al., 2009; Sorokowska et al., 2017) rehabilitate emotions (Taalman et al., 2017), enrich memory (Wilson and Stevenson, 2003), and augment cognition (Chen et al., 2022).
Based on our experience in the experiments involving olfactory stimuli, we offer several recommendations for the researchers entering this field. Firstly, when analyzing evoked brain activity in response to olfactory stimuli, one should consider not only the timing of stimulus presentation but also the respiratory cycle. This consideration is particularly important for the settings where the stimulus onset does not align with the onset of inhalation. To mitigate this, the respiratory cycle should be monitored using appropriate sensors. Additionally, external cues (e.g. visual or auditory stimuli) could be added to guide inhalation and exhalation. Secondly, we recommend using a control where respiratory cycles occur without odorant inhalation. Since respiratory cycles itself change brain activity (Heck et al., 2017), data from the odorless respiratory cycles would help to elucidate the specific contribution of olfactory stimuli to neural modulations when stimuli are presented. Thirdly, in analyzing both evoked and induced brain activity, eye position and state (open or closed) should be monitored and ocular artifacts should be removed from the electrophysiological data. Participants often close their eyes during aroma inhalation and exhibit eye movements when engaged in cognitive tasks. These eye movements could be confused with the evoked potential. Additionally, eye closure could elevate alpha power, potentially leading to erroneous interpretations. Depending on the specific experimental protocol, it could be advisable to instruct participants to keep their eyes closed throughout the session to reduce ocular artifacts. Fourthly, researchers should systematically collect additional behavioral data regarding participants' subjective experiences caused by the presented aromas. It is important to gather information on the perceived intensity of the olfactory stimuli and their specific features. Olfactory performance could be evaluated prior to the experiment using tests, such as the Sniffin' Sticks test (Hummel et al., 1997).
Given that O-NFB systems currently do not exist, a reasonable course of their emergence and development would be by mimicking and supplementing the capacity of the existing visual and auditory NFB systems, which are abundant because of the ease of their implementation. Since O-NFB is technically more challenging, the realization of its potential hinges upon addressing several critical factors inherent to olfactory feedback delivery. Foremost among these is the precise presentation of olfactory stimuli independently of the concurrent sensory modalities. To achieve this, odor delivery protocols should be used that maintain consistent airflow, facilitate the swift removal of odors post-delivery, and prevent residual scents from affecting subsequent stimuli. The development of olfactory displays has been impressive in recent years (Garcia-Ruiz et al., 2021) including the ones integrated with virtual reality (Liu et al., 2023; Micaroni et al., 2019), which ensures that the needs of the specific O-NFB systems can be met.
One advantage of the current visual and auditory NFB systems is their capacity for feedback delivery with a short delay. For instance, NFB of the parietal alpha rhythm works better when delivered promptly (Belinskaia et al., 2020) and the shorter the BCI delay the greater is the sense of agency (Evans et al., 2015). Electrophysiological responses to odors can occur as early as 200 ms after the stimulus, as demonstrated in the studies of olfactory event-related potentials (Invitto and Mazzatenta, 2019; Rombaux et al., 2007). However, perceptual decisions are typically slower, taking approximately 1 s (Olofsson, 2014). Additionally, olfactory perception occurs only during inhalation, making it discontinuous. Therefore, O-NFB systems should account for the respiratory cycle and synchronize olfactory displays to the readings of respiration. It should be also considered that such synchronization could lead participants to modify their breathing patterns to optimize O-NFB outcomes – the effect that could be desirable or undesirable depending on the application.
The other consideration for the O-NFB systems is that their performance could improve if recordings are conducted from the primary olfactory structures such as the olfactory bulb and olfactory cortex. Even though this is a difficult task for EEG recordings, electrode placement on the forehead allows picking up the signal from the olfactory bulb (Iravani et al., 2020, 2021; Cakmak et al., 2020). O-NFB could be made more efficient when integrated with invasive recording methods such as stereoelectroencephalography (sEEG), which enables direct recordings from the olfactory cortex (Yang et al., 2022).
The potential applications are numerous where O-NFB could target specific olfactory functions or dysfunctions. To mention a few, O-NFB could be instrumental in olfactory rehabilitation following conditions like COVID-19 (Hannum et al., 2020) stress management recovery after cessation of smoking (Ajmani et al., 2017), and brain health for the elderly (Chen et al., 2022). O-NFB is potentially applicable to the treatment of autism spectrum disorders (ASD), where the peculiarities of the sense of smell could contribute to the eating disorders in ASD. O-NFB could become a tool for olfactory training in professions that rely heavily on a well-developed sense of smell, such as sommelier (Filiz et al., 2022). Additionally, exploiting olfaction's unique characteristics, such as its influence on perception of the other sensory modalities, could augment the current NFB approaches like visual and auditory NFB. Unlike visual or auditory NFB, which typically require awareness and attention, O-NFB could work without these requirements but still influence cognitive and emotional states. Such covert delivery of O-NFB would enable a seamless integration of olfaction with the other sensory modalities to exert slow modulations of the faster NFB mechanisms.
O-NFB systems present a number of ethical challenges. In medical applications, privacy and informed consent are paramount, as brain activity data could be highly sensitive. It is crucial to ensure that participants understand how their neural data will be used. In consumer settings, the potential misuse of NFB systems, whether for manipulation cognitive states or tracking data without consent, should be controlled for. Overall, the responsible development and regulation of O-NFB systems will be essential for ensuring ethical application of this technology.
Exploring the feasibility of administering olfactory stimuli during sleep stages presents another avenue for future research (Badia et al., 1990; Barnes and Wilson, 2014). Olfactory stimuli could be delivered during sleep without disturbing the person (and stimuli of the other modalities would be more disturbing) and this delivery could be aligned with particular EEG phases and the stages of sleep. An O-NFB could modulate sleep patterns this way, which could work as a treatment for sleep disorders.
Personalization is an important consideration for optimizing O-NFB protocols. Accounting for features like individual EEG characteristics, electrode positions, individual responses to odors, and task difficulty could improve NFB effectiveness. For example, allowing participants to choose a specific set of odors could improve the intervention's efficacy. While olfaction is inherently subjective and influenced by prior experiences, our previous work (Ninenko et al., 2021) has demonstrated low variability in discrimination performance regardless of prior experience. In these experiments, individual variability was observed in the ability to correctly name odors. However, the sample was relatively small and we could not relate this variability to the subjects' cultural background. Moving forward, researchers should choose between further standardization of the olfactory settings vs. individualization depending on the experimental objectives.
O-NFB, which is the system where a smell is generated based on the analysis of neural activity, is not the only possible olfactory BCI system. The other class of olfactory-based BCIs could utilize odor stimuli as the initial inputs that drive the BCI operations. For instance, olfactory training could consist of odor delivery followed by the selection of a matching visual image using a P300 BCI (Morozova et al., 2023). Such a BCI could be useful for the rehabilitation of olfactory dysfunctions and for the rehabilitation of dementia, as well.
Finally, the sense of smell could be evoked by the electrical stimulation of olfactory structures (Holbrook et al., 2019; Karunanayaka et al., 2023) and the orbitofrontal cortex (Bérard et al., 2021), and such stimulation could be considered a bidirectional BCI or a form of O-NFB, with a range of medical applications. These findings highlight the potential for using neuromodulation techniques to artificially induce olfactory sensations, which could be applied to BCIs and O-NFBs for sensory restoration or enhancement. In particular, electrical stimulation of the olfactory bulb has been shown to evoke smell perception in individuals with olfactory dysfunction, building expectation of rehabilitation in conditions such as anosmia (Holbrook et al., 2019). Furthermore, stimulation of cortical areas like the orbitofrontal cortex can elicit pleasant olfactory experiences, suggesting that such interventions could not only improve olfactory function but also modulate emotions and reward-related processing (Bérard et al., 2021).
However, there are notable limitations to this approach. First, the precise control of electrical stimulation is challenging due to the complexity of olfactory processing, which involves multiple brain regions interconnected in complex non-linear ways. Unlike other senses, olfactory information bypasses the thalamus and directly connects to areas responsible for emotions and memory, such as the amygdala and hippocampus (Wilson and Mainen, 2006). This unique pathway complicates the task of delivering targeted stimulation without unintended effects on mood and cognition. Additionally, individual variability in olfactory perception (Hudson and Distel, 2002) means that the same stimulation could produce different results across subjects, further complicating the development of standardized protocols for inducing smell.
The other limitation lies in the technical aspects of delivering non-invasive electrical stimulation. Recent advances have made progress in addressing this issue. Cakmak et al. (2020) optimized electrode placements for non-invasive electrical stimulation of both the olfactory bulb and olfactory mucosa, demonstrating a more precise approach to targeting these structures without invasive procedures. This development is significant because it could help mitigate some of the risks associated with invasive techniques, such as transethmoidal stimulation of the olfactory bulb (Holbrook et al., 2019). Nevertheless, the persistence of olfactory stimulation and the complexity of odor mixtures make it difficult to control and modulate induced smells in real-time, limiting the applicability of such techniques in dynamic environments like virtual reality or everyday life (Yanagida, 2012).
In conclusion, we are at the beginning of the development of olfactory-based BCIs and O-NFB systems, and the potential for such devices appears to be considerable.
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by the Skolkovo Institute of Science and Technology. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
IN: Conceptualization, Formal analysis, Funding acquisition, Investigation, Writing – original draft. AM: Conceptualization, Formal analysis, Funding acquisition, Investigation, Writing – original draft. VE: Conceptualization, Writing – review & editing. DK: Data curation, Formal analysis, Writing – review & editing. MM: Conceptualization, Formal analysis, Funding acquisition, Writing – review & editing. ML: Conceptualization, Methodology, Project administration, Supervision, Writing – review & editing.
Funding
The author(s) declare that no financial support was received for the research, authorship, and/or publication of this article.
Acknowledgments
We acknowledge the use of AI to improve the English language in several sentences within this manuscript. However, all ideas, analyses, and scientific content are entirely original and were developed and verified by the authors. The AI (ChatGPT) was used solely for language enhancement and not for content generation.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
References
Abbasi, N. I., Bose, R., Bezerianos, A., Thakor, N. V., and Dragomir, A. (2019). “EEG-based classification of olfactory response to pleasant stimuli,” in 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (Berlin: IEEE).
Abiri, R., Borhani, S., Sellers, E. W., Jiang, Y., and Zhao, X. (2019). A comprehensive review of EEG-based brain–computer interface paradigms. J. Neural. Eng. 16:011001. doi: 10.1088/1741-2552/aaf12e
Ajmani, G. S., Suh, H. H., Wroblewski, K. E., and Pinto, J. M. (2017). Smoking and olfactory dysfunction: a systematic literature review and meta-analysis. Laryngoscope 127, 1753–1761. doi: 10.1002/lary.26558
Arpaia, P., Cataldo, A., Criscuolo, S., De Benedetto, E., Masciullo, A., and Schiavoni, R. (2022). Assessment and scientific progresses in the analysis of olfactory evoked potentials. Bioengineering 9:252. doi: 10.3390/bioengineering9060252
Aydemir, O. (2017). Olfactory recognition based on EEG gamma-band activity. Neural Comput. 29, 1667–1680. doi: 10.1162/NECO_a_00966
Badia, P., Wesensten, N., Lammers, W., Culpepper, J., and Harsh, J. (1990). Responsiveness to olfactory stimuli presented in sleep. Physiol. Behav. 48, 87–90. doi: 10.1016/0031-9384(90)90266-7
Barnes, D. C., and Wilson, D. A. (2014). Sleep and olfactory cortical plasticity. Front. Behav. Neurosci. 8:134. doi: 10.3389/fnbeh.2014.00134
Belinskaia, A., Smetanin, N., Lebedev, M., and Ossadtchi, A. (2020). Short-delay neurofeedback facilitates training of the parietal alpha rhythm. J. Neural. Eng. 17:6. doi: 10.1088/1741-2552/abc8d7
Bérard, N., Landis, B. N., Legrand, L., Tyrand, R., Grouiller, F., Vulliémoz, S., et al. (2021). Electrical stimulation of the medial orbitofrontal cortex in humans elicits pleasant olfactory perceptions. Epilepsy Behav. 114:107559. doi: 10.1016/j.yebeh.2020.107559
Brauchli, P., Rüegg, P. B., Etzweiler, F., and Zeier, H. (1995). Electrocortical and autonomic alteration by administration of a pleasant and an unpleasant odor. Chem Senses 20, 505–515. doi: 10.1093/chemse/20.5.505
Burón, E., and Bulbena, A. (2013). Olfaction in affective and anxiety disorders: a review of the literature. Psychopathology. 46, 63–74. doi: 10.1159/000338717
Cakmak, Y. O., Nazim, K., Thomas, C., and Datta, A. (2020). Optimized electrode placements for non-invasive electrical stimulation of the olfactory bulb and olfactory mucosa. Front. Neurosci. 14:581503. doi: 10.3389/fnins.2020.581503
Carskadon, M. A., and Herz, R. S. (2004). Minimal olfactory perception during sleep: why odor alarms will not work for humans. Sleep 27, 405-407. doi: 10.1093/sleep/27.3.402
Chen, B., Espin, M., Haussmann, R., Matthes, C., Donix, M., Hummel, T., et al. (2022). The effect of olfactory training on olfaction, cognition, and brain function in patients with mild cognitive impairment. J. Alzheimers Dis. 85, 745–754. doi: 10.3233/JAD-215257
Cherninskii, A. A., Zima, I. G., Makarchouk, N. Y., Piskorskaya, N. G., and Kryzhanovskii, S. A. (2009). Modifications of EEG related to directed perception and analysis of olfactory information in humans. Neurophysiology 41, 63–70. doi: 10.1007/s11062-009-9078-z
Courtiol, E., and Wilson, D. A. (2015). The olfactory thalamus: Unanswered questions about the role of the mediodorsal thalamic nucleus in olfaction. Front. Neural. Circuits 9:49. doi: 10.3389/fncir.2015.00049
Croy, I., Nordin, S., and Hummel, T. (2014). Olfactory disorders and quality of life—an updated review. Chem. Senses. 39, 185–194. doi: 10.1093/chemse/bjt072
Dasgupta, D., Schneider-Luftman, D., Schaefer, A. T., and Harris, J. J. (2024). Wireless monitoring of respiration with EEG reveals relationships between respiration, behavior, and brain activity in freely moving mice. J. Neurophysiol. 132, 290–307. doi: 10.1152/jn.00330.2023
Delaunay-El Allam, M., Soussignan, R., Patris, B., Marlier, L., and Schaal, B. (2010). Long-lasting memory for an odor acquired at the mother's breast. Dev. Sci. 13:941. doi: 10.1111/j.1467-7687.2009.00941.x
Distel, H., and Hudson, R. (2001). Judgement of odor intensity is influenced by subjects' knowledge of the odor source. Chem Senses 26:247. doi: 10.1093/chemse/26.3.247
Dong, Q., Hu, L., Zhuang, L., Li, R., Liu, Q., and Wang, P. (2014). Odor discrimination by mammalian olfaction based on brain-machine interface and olfactory decoding. Sensor Letters. 20:883. doi: 10.1166/sl.2014.3180
Doty, R. L. (2012). Olfactory dysfunction in Parkinson disease. Nat. Rev. Neurol. 8(6):329–339. doi: 10.1038/nrneurol.2012.80
Dudova, I., and Hrdlicka, M. (2013). Olfactory functions are not associated with autism severity in autism spectrum disorders. Neuropsychiatr. Dis. Treat. 9:1847–1851. doi: 10.2147/NDT.S54893
Egner, T., and Gruzelier, J. H. (2004). EEG biofeedback of low beta band components: frequency-specific effects on variables of attention and event-related brain potentials. Clini. neurophysiol. 115, 131–139. doi: 10.1016/S1388-2457(03)00353-5
Enoch, J., McDonald, L., Jones, L., Jones, P. R., and Crabb, D. P. (2019). Evaluating Whether Sight Is the Most Valued Sense. JAMA Ophthalmol. 137, 1317–1320. doi: 10.1001/jamaophthalmol.2019.3537
Evans, N., Gale, S., Schurger, A., and Blanke, O. (2015). Visual feedback dominates the sense of agency for brain-machine actions. PLoS ONE. 10:e0130019. doi: 10.1371/journal.pone.0130019
Filiz, G., Poupon, D., Banks, S., Fernandez, P., and Frasnelli, J. (2022). Olfactory bulb volume and cortical thickness evolve during sommelier training. Human Brain Mapping. 43, 2621–2633. doi: 10.1002/hbm.25809
Garcia-Ruiz, M. A., Kapralos, B., and Rebolledo-Mendez, G. (2021). An overview of olfactory displays in education and training. Multimodal Technol. Interact. 5:mti5100064. doi: 10.3390/mti5100064
Gola, M., Magnuski, M., Szumska, I., and Wróbel, A. (2013). EEG beta band activity is related to attention and attentional deficits in the visual performance of elderly subjects. Int. J. Psychophysiol. 89, 334–341. doi: 10.1016/j.ijpsycho.2013.05.007
Gottfried, J. A. (2006). Smell: central nervous processing. Adv Otorhinolaryngol 63, 44–69. doi: 10.1159/000093750
Hammond, D. C. (2011). What is neurofeedback? J. Neurothera. 15, 305–336. doi: 10.1080/10874208.2011.623090
Hannum, M. E., Ramirez, V. A., Lipson, S. J., Herriman, R. D., Toskala, A. K., Lin, C., et al. (2020). Objective sensory testing methods reveal a higher prevalence of olfactory loss in COVID-19-positive patients compared to subjective methods: a systematic review and meta-analysis. Chem. Senses. 45, 865–874. doi: 10.1093/chemse/bjaa064
Heck, D. H., McAfee, S. S., Liu, Y., Babajani-Feremi, A., Rezaie, R., Freeman, W. J., et al. (2017). Breathing as a fundamental rhythm of brain function. Front. Neural Circuits 10:115. doi: 10.3389/fncir.2016.00115
Holbrook, E. H., Puram, S. V., See, R. B., Tripp, A. G., and Nair, D. G. (2019). Induction of smell through transethmoidal electrical stimulation of the olfactory bulb. Int. Forum Allergy Rhinol. 9, 158–164. doi: 10.1002/alr.22237
Hucke, C. I., Heinen, R. M., Pacharra, M., Wascher, E., and van Thriel, C. (2021). Spatiotemporal processing of bimodal odor lateralization in the brain using electroencephalography microstates and source localization. Front. Neurosci. 14:620723. doi: 10.3389/fnins.2020.620723
Hudson, R., and Distel, H. (2002). “The Individuality of Odor Perception,” in Olfaction, Taste, and Cognition.
Hummel, T., Rissom, K., Reden, J., Hähner, A., Weidenbecher, M., and Hüttenbrink, K. B. (2009). Effects of olfactory training in patients with olfactory loss. Laryngoscope. 119, 496–499. doi: 10.1002/lary.20101
Hummel, T., Sekinger, B., Wolf, S. R., Pauli, E., and Kobal, G. (1997). ‘Sniffin'sticks': olfactory performance assessed by the combined testing of odor identification, odor discrimination and olfactory threshold. Chem. Senses 22, 39–52. doi: 10.1093/chemse/22.1.39
Hutmacher, F. (2019). Why is there so much more research on vision than on any other sensory modality? Front. Psychol. 10:2246. doi: 10.3389/fpsyg.2019.02246
Invitto, S., and Mazzatenta, A. (2019). Olfactory event-related potentials and exhaled organic volatile compounds: the slow link between olfactory perception and breath metabolic response. A pilot study on phenylethyl alcohol and vaseline oil. Brain Sci. 9:84. doi: 10.3390/brainsci9040084
Iravani, B., Arshamian, A., Ohla, K., Wilson, D. A., and Lundström, J. N. (2020). Non-invasive recording from the human olfactory bulb. Nat. Commun. 11:648. doi: 10.1038/s41467-020-14520-9
Iravani, B., Schaefer, M., Wilson, D. A., Arshamian, A., and Lundström, J. N. (2021). The human olfactory bulb processes odor valence representation and cues motor avoidance behavior. Proc. Natl. Acad. Sci. U S A. 118:e2101209118. doi: 10.1073/pnas.2101209118
Karunanayaka, K., Cheok, A. D., and Vedadi, S. (2023). Digital smell: towards electrically reproducing artificial smell sensations. IEEE Access. 11, 50659–50670. doi: 10.1109/ACCESS.2023.3278093
Kazour, F., Richa, S., Desmidt, T., Lemaire, M., Atanasova, B., and El Hage, W. (2017). Olfactory and gustatory functions in bipolar disorders: a systematic review. Neurosci. Biobehav. Rev. 80, 69–79. doi: 10.1016/j.neubiorev.2017.05.009
Kilavik, B. E., Zaepffel, M., Brovelli, A., MacKay, W. A., and Riehle, A. (2013). The ups and downs of beta oscillations in sensorimotor cortex. Exp. Neurol. 245, 15–26. doi: 10.1016/j.expneurol.2012.09.014
Kim, Y. K., and Watanuki, S. (2003). Characteristics of electroencephalographic responses induced by a pleasant and an unpleasant odor. J. Physiol. Anthropol. Appl. Human Sci. 22, 285–291. doi: 10.2114/jpa.22.285
Kohli, P., Soler, Z. M., Nguyen, S. A., Muus, J. S., and Schlosser, R. J. (2016). The association between olfaction and depression: a systematic review. Chem Sens. 41, 479–486. doi: 10.1093/chemse/bjw061
Kroupi, E., Yazdani, A., Vesin, J. M., and Ebrahimi, T. (2014). “EEG correlates of pleasant and unpleasant odor perception,” in ACM Transactions on Multimedia Computing, Communications, and Applications TOMM (New York, NY: Association for Computing Machinery).
Larsson, M., Carlos, T., and Wiens, S. (2017). A meta-analysis of odor thresholds and odor identification in autism spectrum disorders. Front. Psychol. 8:679. doi: 10.3389/fpsyg.2017.00679
Lebedev, M. A., and Nicolelis, M. A. (2017). Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation. Physiol. Rev. 97, 767–837. doi: 10.1152/physrev.00027.2016
Liu, Y., Yiu, C. K., Zhao, Z., Park, W., Shi, R., Huang, X., et al. (2023). Soft, miniaturized, wireless olfactory interface for virtual reality. Nat Commun. 14:2297. doi: 10.1038/s41467-023-37678-4
Livermore, A., Hummel, T., and Kobal, G. (1992). Chemosensory event-related potentials in the investigation of interactions between the olfactory and the somatosensory (trigeminal) systems. Electroencephalogr Clin Neurophysiol. 83, 201–210. doi: 10.1016/0013-4694(92)90145-8
Lorig, T. S. (2000). The application of electroencephalographic techniques to the study of human olfaction: a review and tutorial. Int. J. Psychophysiol. 36, −91-104. doi: 10.1016/S0167-8760(99)00104-X
Malaspina, D., Corcoran, C., and Goudsmit, N. (2006). “The impact of olfaction on human social functioning,” in Olfaction and the Brain.
Marin, C., Alobid, I., Fuentes, M., et al. (2023). Olfactory dysfunction in mental illness. Curr. Allergy Asthma Rep. 23, 153–164. doi: 10.1007/s11882-023-01068-z
Martin, G. N. (1998). Human electroencephalographic EEG response to olfactory stimulation: Two experiments using the aroma of food. Int. J. Psychophysiol. 30, 287–302. doi: 10.1016/S0167-8760(98)00025-7
Marzbani, H., Marateb, H. R., and Mansourian, M. (2016). Neurofeedback: a comprehensive review on system design, methodology and clinical applications. Basic Clin. Neurosci. 7, 143–158. doi: 10.15412/J.BCN.03070208
Masaoka, Y., Harding, I. H., Koiwa, N., Yoshida, M., Harrison, B. J., Lorenzetti, V., et al. (2014). The neural cascade of olfactory processing: A combined fMRI–EEG study. Respir. Physiol. Neurobiol. 204, 71–77. doi: 10.1016/j.resp.2014.06.008
McGann, J. P. (2017). Poor human olfaction is a 19th-century myth. Science. 356:eaam7263. doi: 10.1126/science.aam7263
Medvedeva, A., Ninenko, I., Kleeva, D. F., Fedoseev, A., Bazhenov, A., Cabrera, M. A., et al. (2024). The development and testing of olfactory-based neurofeedback for the EEG alpha rhythm. Neurosci. Behav. Physiol. 54, 177–186. doi: 10.1007/s11055-024-01580-3
Micaroni, L., Carulli, M., Ferrise, F., Gallace, A., and Bordegoni, M. (2019). An olfactory display to study the integration of vision and olfaction in a virtual reality environment. J. Comput. Inf. Sci. Eng. 4, 1212–1221. doi: 10.1115/1.4043068
Miyaura, M., Narumi, T., Nishimura, K., Tanikawa, T., and Hirose, M. (2011). Olfactory feedback system to improve the concentration level based on biological information. Proceedings - IEEE Virtual Real. 139–142. doi: 10.1109/VR.2011.5759452
Morozova, M., Bikbavova, A., Bulanov, V., and Lebedev, M. A. (2023). An olfactory-based Brain-Computer Interface: electroencephalography changes during odor perception and discrimination. Front. Behav. Neurosci. 17:1122849. doi: 10.3389/fnbeh.2023.1122849
Morrison, E. E., and Costanzo, R. M. (1990). Morphology of the Human Olfactory Epithelium. J. Comp. Neurol. 297, 1–13. doi: 10.1002/cne.902970102
Murphy, C. (2019). Olfactory and other sensory impairments in Alzheimer disease. Nat. Rev. Neurol. 15, 11–24. doi: 10.1038/s41582-018-0097-5
Ninenko, I., Gritsenko, G., Bukreev, N., Ossadtchi, A., and Lebedev, M. (2021). “Brain-computer interface for olfaction: machine learning decoding odors from EEG,” in Proceedings - 3rd International Conference “Neurotechnologies and Neurointerfaces” (Kaliningrad: CNN 2021, Institute of Electrical and Electronics Engineers Inc).
Ojha, P., and Dixit, A. (2022). Olfactory training for olfactory dysfunction in COVID-19: A promising mitigation amidst looming neurocognitive sequelae of the pandemic. Clin Exp Pharmacol. Physiol. 49:13626. doi: 10.1111/1440-1681.13626
Olofsson, J. K. (2014). Time to smell: a cascade model of human olfactory perception based on response-time (RT) measurement. Front. Psychol. 5:33. doi: 10.3389/fpsyg.2014.00033
Omejc, N., Rojc, B., Battaglini, P. P., and Marusic, U. (2019). Review of the therapeutic neurofeedback method using electroencephalography: EEG Neurofeedback. Bosn J. Basic Med. Sci. 19, 213–220. doi: 10.17305/bjbms.2018.3785
Richardson, J. T., and Zucco, G. M. (1989). Cognition and olfaction: a review. Psychol. Bull. 105, 352–160. doi: 10.1037/0033-2909.105.3.352
Rombaux, P., Bertrand, B., Keller, T., and Mouraux, A. (2007). Clinical significance of olfactory event-related potentials related to orthonasal and retronasal olfactory testing. Laryngoscope 117, 1096–1101. doi: 10.1097/MLG.0b013e31804d1d0d
Rozenkrantz, L., Zachor, D., Heller, I., Plotkin, A., Weissbrod, A., Snitz, K., et al. (2015). A mechanistic link between olfaction and autism spectrum disorder. Curr. Biol. 25, 1904–1910. doi: 10.1016/j.cub.2015.05.048
Saha, A., Konar, A., Chatterjee, A., and Ralescu Nagar, A. K. (2014). EEG analysis for olfactory perceptual-ability measurement using a recurrent neural classifier. IEEE Trans. Hum. Mach. Syst. doi: 10.1109/THMS.2014.2344003
Schriever, V. A., Han, P., Weise, S., Hösel, F., Pellegrino, R., and Hummel, T. (2017). Time frequency analysis of olfactory induced EEG-power change. PLoS ONE. 12:e0185596. doi: 10.1371/journal.pone.0185596
Shepherd, G. M., Chen, W. R., and Greer, C. A. (2004). “Olfactory bulb,” in The Synaptic Organization of the Brain. Oxford: Oxford University Press.
Singh, A. K., Touhara, K., and Okamoto, M. (2019). Electrophysiological correlates of top-down attentional modulation in olfaction. Sci. Rep. 9:4953. doi: 10.1038/s4159F8-019-41319-6
Sitaram, R., Ros, T., Stoeckel, L., Haller, S., Scharnowski, F., Lewis-Peacock, J., et al. (2017). Closed-loop brain training: the science of neurofeedback. Nat. Rev. Neurosci. 18, 86–100. doi: 10.1038/nrn.2016.164
Sorokowska, A., Drechsler, E., Karwowski, M., and Hummel, T. (2017). Effects of olfactory training: a meta-analysis. Rhinology 55, 17–26. doi: 10.4193/Rhino16.195
Soudry, Y., Lemogne, C., Malinvaud, D., Consoli, S. M., and Bonfils, P. (2011). Olfactory system and emotion: common substrates. Eur. Ann Otorhinolaryngol Head Neck Dis. 128, 18–23. doi: 10.1016/j.anorl.2010.09.007
Stevenson, R. J. (2013). Olfactory perception, cognition, and dysfunction in humans. Wiley Interdisc. Rev.: Cognit. Sci. 4, 273–284. doi: 10.1002/wcs.1224
Sugimoto, S., Noguchi, D., Bannnai, Y., and Okada, K. (2010). “Ink jet olfactory display enabling instantaneous switches of scents,” in Proceedings of the 18th ACM International Conference on Multimedia (MM '10) (Association for Computing Machinery). doi: 10.1145/1873951.1873994
Sullivan, R. M., Wilson, D. A., Ravel, N., and Mouly, A. M. (2015). Olfactory memory networks: From emotional learning to social behaviors. Front. Behav. Neurosci. 9:36. doi: 10.3389/fnbeh.2015.00036
Sweigert, J. R., St. John, T., Begay, K. K., Davis, G. E., Munson, J., Shankland, E., et al. (2020). Characterizing olfactory function in children with autism spectrum disorder and children with sensory processing dysfunction. Brain Sci. 10:362. doi: 10.3390/brainsci10060362
Taalman, H., Wallace, C., and Milev, R. (2017). Olfactory functioning and depression: a systematic review. Front. Psychiatry. 8:190. doi: 10.3389/fpsyt.2017.00190
Tarfa, R., Yu, S. E., Ahmed, O. H., Moore, J. A., Bruña, R., Velasquez, N., et al. (2023). Neuromapping olfactory stimulation using magnetoencephalography - visualizing smell, a proof-of-concept study. Front. Allergy. 3:1019265. doi: 10.3389/falgy.2022.1019265
Tonacci, A., Billeci, L., Tartarisco, G., Ruta, L., Muratori, F., Pioggia, G., et al. (2017). Olfaction in autism spectrum disorders: a systematic review. Child Neuropsychol. 23, 1–25. doi: 10.1080/09297049.2015.1081678
Trimmer, C., Keller, A., Murphy, N. R., Snyder, L. L., Willer, J. R., Nagai, M. H., et al. (2019). Genetic variation across the human olfactory receptor repertoire alters odor perception. Proc. Natl. Acad. Sci. U S A. 116, 9475–9480. doi: 10.1073/pnas.1804106115
Wen, T., Luo, D., He, J., and Mei, K. (2018). The odor characterizations and reproductions in machine olfactions: a review. Sensors. 18:2329. doi: 10.3390/s18072329
Wilson, A. D., and Baietto, M. (2011). Advances in electronic-nose technologies developed for biomedical applications. Sensors 11, 1105–1176. doi: 10.3390/s110101105
Wilson, D. A., and Stevenson, R. J. (2003). The fundamental role of memory in olfactory perception. Trends Neurosci. 26, 243–237. doi: 10.1016/S0166-2236(03)00076-6
Wilson, R. I., and Mainen, Z. F. (2006). Early events in olfactory processing. Annu. Rev. Neurosci., 29, 163–201 doi: 10.1146/annurev.neuro.29.051605.112950
Wright, G., and Mitchell, T. (2005). Odor perception and the variability in natural odor scenes. Recent Adv. Phytochem. 39:191. doi: 10.1016/S0079-9920(05)80009-7
Yanagida, Y. (2008). “Olfactory interfaces,” in HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces, 267–290.
Yanagida, Y. (2012). “A survey of olfactory displays: Making and delivering scents,” in Proceedings of IEEE Sensors (Taipei: IEEE).
Yang, Q., Zhou, G., Noto, T., Templer, J. W., Schuele, S. U., Rosenow, J. M., et al. (2022). Smell-induced gamma oscillations in human olfactory cortex are required for accurate perception of odor identity. PLoS Biol. 20:e3001509. doi: 10.1371/journal.pbio.3001509
Keywords: olfaction, EEG, BCI, NFB, olfactory processing
Citation: Ninenko I, Medvedeva A, Efimova VL, Kleeva DF, Morozova M and Lebedev MA (2024) Olfactory neurofeedback: current state and possibilities for further development. Front. Hum. Neurosci. 18:1419552. doi: 10.3389/fnhum.2024.1419552
Received: 18 April 2024; Accepted: 24 October 2024;
Published: 29 November 2024.
Edited by:
Selina C. Wriessnegger, Graz University of Technology, AustriaReviewed by:
Antonio Pereira, Federal University of Pará, BrazilArjun Ramakrishnan, Indian Institute of Technology Kanpur, India
Bettina Habelt, Technical University Dresden, Germany
Copyright © 2024 Ninenko, Medvedeva, Efimova, Kleeva, Morozova and Lebedev. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ivan Ninenko, aXZhbi5uaW5lbmtvJiN4MDAwNDA7Z21haWwuY29t