- 1Engineering Division, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
- 2Department of Biomedical Engineering, Ulsan National Institute of Science and Technology, Ulsan, South Korea
Vibrotactile feedback technology has become widely used in human–computer interaction due to its low cost, wearability, and expressiveness. Although neuroimaging studies have investigated neural processes associated with different types of vibrotactile feedback, encoding vibration intensity in the brain remains largely unknown. The aim of this study is to investigate neural processes associated with vibration intensity using electroencephalography. Twenty-nine healthy participants (aged 18–40 years, nine females) experienced vibrotactile feedback at the distal phalanx of the left index finger with three vibration intensity conditions: no vibration, low-intensity vibration (1.56 g), and high-intensity vibration (2.26 g). The alpha and beta band event-related desynchronization (ERD) as well as P2 and P3 event-related potential components for each of the three vibration intensity conditions are obtained. Results demonstrate that the ERD in the alpha band in the contralateral somatosensory and motor cortex areas is significantly associated with the vibration intensity. The average power spectral density (PSD) of the peak period of the ERD (400–600 ms) is significantly stronger for the high- and low-vibration intensity conditions compared to the no vibration condition. Furthermore, the average PSD of the ERD rebound (700–2,000 ms) is significantly maintained for the high-vibration intensity compared to low-intensity and no vibration conditions. Beta ERD signals the presence of vibration. These findings inform the development of quantitative measurements for vibration intensities based on neural signals.
1. Introduction
Humans are surrounded by vibrations that are extremely important to how the ambient environment is perceived. In human–computer interaction applications, vibration feedback technologies seem to gain more popularity, compared to force feedback counterparts, due to their low-cost, wearability, and expressiveness (Chouvardas et al., 2008). With the widespread use of wearable devices with vibration capabilities, understanding how humans perceive vibrations is essential for the design of vibrotactile interfaces. For instance, understanding how the physical properties of vibration such as intensity, duration, and frequency influence vibration perception is crucial for the design of effective vibration-mediated interfaces.
Human perception of vibrotactile signals has been the subject of several psychophysical studies that are based on self-reporting and behavioral assessment (Verrillo et al., 1969). Many aspects of vibration perception have been studied in great detail, including detection threshold (Reynolds et al., 1977; Moshourab et al., 2016), perception of vibration intensity and equal sensation curve (Giacomin et al., 2004; Mansfield and Maeda, 2005), frequency discrimination (Tommerdahl et al., 2005; Mahns et al., 2006), emotional responses (Reynolds et al., 1977; Réhman, 2010), among others. Most previous studies used self-reporting and/or behavior analysis in order to evaluate the user experience. An emerging approach to measure the mental experience of vibration is to utilize brain imaging technologies such as electroencephalography (EEG) or functional magnetic resonance imaging (fMRI) in order to provide quantitative, real-time, and non-intrusive evaluation of vibration experience (Coghill et al., 1994; Harrington and Downs III, 2001; Simons et al., 2005; Kim et al., 2016). Since neuronal information processing for vibration occurs at a millisecond timescale (Mackevicius et al., 2012), EEG plays an important role in assessing vibration information processing due to its high temporal resolution (Burle et al., 2015).
Several EEG analytical methods are utilized for the quantitative exploration of vibration, including time domain analysis such as event-related potentials (ERP) (Ryun et al., 2017), frequency domain analysis such as power spectral density (Khasnobish et al., 2018) or steady-state evoked potential (SSEP) (Timora and Budd, 2013; Moungou et al., 2016), time-frequency analysis such as event-related desynchronization/synchronization (ERD/ERS) (Choi et al., 2017), and functional connectivity such as phase locking value (PLV) (Hari, 1980; Langdon et al., 2011). Previous EEG studies examined how the human brain represents various vibrotactile properties, most notably the frequency and intensity of vibration. Early studies demonstrated that vibrotactile frequency information are encoded in the P50 and P100 components of the ERP waveform in the postcentral gyrus of the primary somatosensory cortex and the parietal operculum of the secondary somatosensory cortex (Hämäläinen et al., 1990). A recent study examined the neural correlates of vibration intensity by considering three vibration intensities (0.25, 0.38, and 1.3 g) (Choi et al., 2020). Results demonstrated that the maximum and minimum peak, and peak to peak values of somatosensory evoked potential (SEP) patterns in the C3 somatosensory area increased as the stimulus intensity increased.
ERD, a localized power attenuation in the EEG rhythm, is associated with increased activation of the somatosensory and motor cortices during sensorimotor processing (Neuper et al., 2006). In particular, alpha (8–12 Hz) and beta (18–30 Hz) ERD oscillations are strongly associated with tactile sensation (Buchholz et al., 2014). On the other hand, localized power attenuation ERP is known to play a significant role in coding tactile perception (Tang et al., 2020). Two components of the ERP waveform will be considered: P200 and P300. P200 or P2 component, a positive deflection peaking around 100–250 ms after the stimulus, may reflect the sensation-seeking behavior of an individual (e.g., detection of vibration; Sur and Sinha, 2009). On the other hand, P3 component is associated with cognitive functions such as the identification of the vibration intensity (Sur and Sinha, 2009). Therefore, the P2 and P3 components of the ERP waveform as well as the alpha and beta band oscillations will be considered in this study.
The aim of this study is to systematically examine brain correlates associated with the intensity of vibration when applied at the distal phalanx of the left index finger. We hypothesize that the vibration intensity modulates P2 and P3 components as well as alpha and beta band oscillations. Three levels of vibration intensities are applied: no vibration, low-intensity vibration (1.56 g), and high-intensity vibration (2.26 g). This study contributes to developing quantitative measure of vibration intensity perception, and informs both the cognitive mechanisms associated with vibration intensity perception and the development of future vibration-enabled interfaces.
2. Materials and Methods
2.1. Participants
Twenty-nine healthy volunteers (nine females) participated in the experiment. The inclusion criteria were an age range of 18–55 years, right-handedness, and normal or corrected-to-normal vision/hearing. The exclusion criteria were a person with orthopedic hand conditions or with a history of neurological or psychiatric disease. All participants were students from Ulsan National Institute of Science and Technology recruited by an online call for participation. Thirteen participants are aged between 18 and 25 years old, 14 participants are aged between 25 and 30 years old, and two participants are aged between 30 and 40 years old. Eleven participants had previous experience using a haptic device. All participants were informed about the purpose of the experiment, and written informed consent was obtained prior to participation. The study was carried out with an approved protocol by Institutional Review Boards of New York University Abu Dhabi and Ulsan National Institute of Science and Technology (HRPP–2020–80). The experiment was conducted under the guidelines for prevention of novel coronavirus infection, Ulsan National Institute of Science and Technology, Republic of Korea.
2.2. Experimental Setup
A Pico Vibe 310–177 (Precision Microdrives) vibrotactile actuator was used to provide different levels of vibration intensity to the participants. The actuator has a 10 mm diameter and a 3.4 mm thickness. Figure 1 shows how the vibrotactile actuator was attached to the participant's left index finger. The participant's finger was wiped with an alcohol swab before the experiment. The vibrotactile actuator was attached to the participant's left index finger using a double-sided tape (3 M, model 5925), cut in a size of 10 × 10 [mm] (0.64 mm thickness). The left hand was supported with a towel to minimize hand movement during the experiment (as shown in Figure 1). The vibration motor was properly attached to the finger with no contact with the towel so the vibration stimulation is not attenuated.
Three levels of vibration intensity were used for the experiment; no vibration, low-intensity vibration, and high-intensity vibration. The stimulation intensities were controlled by adjusting the duty cycle of the pulse width modulation (PWM) signal of the Arduino microcontroller that controls the vibrotactile actuator. Increasing the duty cycle of the PWM signal increases the effective voltage applied to the actuator and thus the vibration intensity. The high and low intensity of vibration were measured using the optoNCDT 1750 vibrometer to be 2.26 and 1.56 g, respectively. These vibration intensity levels are perceptually distinguishable as confirmed through a pilot study. The frequency of the high and low vibration was in the range of 200–240 Hz, which is extremely difficult to distinguish for humans (Merchel and Altinsoy, 2020).
The stimulation software was developed using Presentation (a software by Neurobehavioral Systems, Albany, CA, USA). This software controls visual and auditory cues and synchronizes these cues with the vibrotactile stimulation through an Arduino microcontroller, as well as records event triggers in the EEG system. Neurological activities during the experiment were recorded with 1,000 Hz sampling rate using a 32-channel EEG device and amplified in the EEG recording system (BrainAmp by Brain Products, Munich, Germany). TP9 and TP10 electrodes were used for ground and reference channel, respectively. The experiment data are publicly available at: https://osf.io/j9s2q/.
2.3. Procedure and Evaluation Metrics
Before starting the experiment, participants completed a training session to get acquainted with the experimental setup and protocol. Participants were then asked to sit comfortably in order to minimize movements during the experiment.
Figure 2 shows the experimental protocol. One trial consisted of rest, task, and rating periods. The rest period was randomly set to 1, 1.5, 2, or 2.5 s to prevent participants from predicting task cues. A visual fixation was displayed during the rest period to draw the user's attention to the assigned task. A square-shaped visual cue and a 1,000 Hz beep auditory cue announced the start of the task. Participants were instructed not to move their finger and just feel the vibration at the tip of their left index finger. The three levels of vibration intensities were displayed in this task period with random sequence to avoid any short-term memory or learning effects. A beep sound of 500 Hz indicated the end of the task. Immediately after the square-shaped visual cue disappeared, participants were asked to rate their experience using a 5-ratings scale (1, “I didn't feel any vibration”; 2, “I felt a very weak vibration”; 3, “I felt a weak vibration”; 4, “I felt a strong vibration”; and 5, “I felt a very strong vibration”). The user provided the rating input with the right hand via a numeric keypad (one to five number key). It is worth noting that the study involves multimodal stimulation, however visual and auditory stimuli were the same in all three vibration intensity conditions.
During the experiment, one trial took 3–6 s depending on the rest time and the self-reporting response time. One run consisted of 30 trials (10 trials for each vibration intensity level), for a total of about 2.5 min for one run. All participants completed ten runs separated by short breaks to reduce fatigue. A total of 100 trial data were recorded for each vibration intensity level per participant. For behavioral analysis, we investigated how participants rated each stimulus. This was to check if participants were able to clearly distinguish the three levels of vibration intensity.
For the preprocessing of the EEG data, the EEGLAB toolbox was utilized (Delorme and Makeig, 2004). EEG analysis was divided into time course power spectral density (PSD) and ERP analysis. For the time course PSD analysis, two EEG data streams corresponding to the outside locations (FT9 and FT10) were removed. Band pass filters with different frequency ranges were used. A zero-phase finite impulse response filter with a Hamming window was used for band pass filtering (0.1–55 Hz). The artifact subspace reconstruction method was applied to remove eye movement and muscle artifacts. Then, EEG signals were re-referenced using the common average reference (Binnie et al., 2003). The filtered EEG signal was divided into epochs (−1,000 to 2,000 ms) corresponding to the three vibration intensity levels and 1,000 ms before the onset was used as the baseline. After preprocessing, power spectral density of alpha (8–12 Hz) and beta (13–30 Hz) bands at each channel were computed via short-time Fourier transform with a 500 ms Hamming window, sliding by 50 ms.
The differences associated with the three vibration intensity levels (no vibration, low-intensity vibration, and high-intensity vibration) were analyzed through the topography of alpha and beta frequency bands in order to find areas of the brain that are associated with the vibration intensity. The contralateral and ipsilateral motor and somatosensory areas were the regions of interest. Time course alpha/beta PSDs during the task period in the bilateral somatosensory and motor cortices were investigated. The average PSD values for each vibration intensity level for all participants within the selected regions were compared. Box plots were used to show data distribution. On each box, the central mark indicates the median. The bottom and top edges of the box indicate the 25th (Q1) and 75th (Q3) percentiles, respectively. The whiskers extend to the most extreme data points not considered outliers. The outliers are defined as being any point of data that lies over Q3 + 1.5 × (Q3–Q1) or below Q1–1.5 × (Q3–Q1) and outliers are plotted individually using the “+” symbol. All data points including outliers were used for statistical analysis. One-way analysis of variance (ANOVA) or Kruskal–Wallis tests were used depending on whether the data followed a normal distribution by Jarque–Bera test. Then, the Holm–Bonferroni correction was used as a post-hoc to counteract the problem of multiple comparisons.
For the ERP analysis, a zero-phase finite impulse response filter with a Hamming window was used for band pass filtering (1–30 Hz). The artifact subspace reconstruction method was applied to remove eye movement and muscle artifacts (Mullen et al., 2013). Then, EEG signals were re-referenced using mastoids, T7 and T8. The filtered EEG signal was divided into epochs (−100 to 500 ms) corresponding to the three vibration intensity levels. The average of the EEG signals for the three vibration intensity conditions for each participant for 100 ms before the stimulation onset was used as the baseline. The time window for the ERP waveform is examined in the range of 150–275 ms for P2 (Correll et al., 2006) and 250–500 ms for P3 (Polich, 2007). The Jarque–Bera test was used to verify if the data followed normal distribution and box plots were used to show data distribution. All data points including outliers were used for statistical analysis. One-way ANOVA or Kruskal–Wallis tests were used depending on whether the data followed a normal distribution, and the Holm–Bonferroni correction was used as a post hoc to counteract the problem of multiple comparisons. Three areas of the brain were considered for the ERP analysis, namely the middle frontal (Fz), middle central (Cz), and middle parietal (Pz) channels.
3. Results
3.1. Behavioral Analysis
Participants' ratings for the three vibration intensity levels were examined (shown in Figure 3). For the no vibration condition, 99.03±3.26 percentage of the responses confirmed that no vibration was felt. For the low-intensity vibration, 76.86±16.34 percentage of respondents perceived the stimulus as very weak vibration while 21±15.64 percentage perceived it as weak vibration. In total, 98.31 percentage of the participants reported very weak or weak vibration for the weak vibration level. This confirmed that the no vibration and low-intensity vibration conditions were clearly perceived as expected. However, the perception of the high-intensity vibration was less consistent; 10.21±11.36 percentage of the responses were weak vibration, 47.10±16.54 percentage were strong vibration, and 42.06±23.42 percentage were very strong vibration. Unexpectedly, more than 10 percentage of the participants rated high-intensity vibration as weak. In addition, the standard deviation among the participants in case of the strong vibration stimulus was very large, 23.42. Unlike no vibration and low-intensity vibration, high-intensity vibration was rated differently (weak, strong, or very strong) depending on personal standards. It is assumed that the participants' personal experience and standards for the vibrotactile stimulus being strong or very strong were different. Since the individual standards for vibration intensity are different, it is expected that it would be meaningful to investigate the differences in EEG according to the perceived intensity, however it was difficult to compare due to the limited sample size.
Figure 3. The percentages of the rating by three different stimuli after the task period. Mean ± standard deviation among the participants.
3.2. Power Spectral Density Analysis
We investigated how the alpha and beta frequency bands varied according to the three vibration intensity conditions over the two-second task. Figure 4 shows the power topographies of the alpha frequency band during the task period. In the first 200 ms of the task, alpha power increased for all the vibration intensity conditions. After that, in the case of low- and high-vibration intensity conditions, event-related desynchronization in the contralateral somatosensory and motor cortices was observed up to 400 ms. After 400 ms, the alpha ERD appeared bilaterally in the low- and high-intensity vibration conditions, which rebounded again after 800 ms in the case of low-intensity vibration. However, in the case of high-intensity vibration, alpha ERD was sustained until the end of the task period.
In order to observe the changes in the alpha band in the contralateral somatosensory and motor cortices (C4, Cp2, and Cp6) in more detail, a time course graph was constructed as shown in Figure 5A. The highlighted areas represent time periods where statistically significant differences between the vibration intensity conditions were observed. The differences among the three vibration intensity conditions are determined based on the average of the alpha frequency band for each highlighted region. The average PSD of the peak period of the alpha ERD (400–600 ms) is significantly stronger for the high- and low-vibration intensity conditions compared to the no vibration condition [one-way ANOVA, F(2, 86) = 5.76, Holm–Bonferroni correction, p_adj<0.05] as shown in Figure 5B. Note that 2 and 86 in F(2, 86) represent 2 degrees of freedom between groups (conditions) and 86 total degrees of freedom, respectively. Furthermore, the average PSD of the ERD rebound (700–2,000 ms) is significantly stronger for the high-vibration intensity compared to low intensity and no vibration conditions [Kruskal–Wallis test, H(2, 86) = 19.02, Holm–Bonferroni correction, p_adj<0.05], as shown in Figure 5C. Therefore, it is concluded that the ERD in the alpha band in the contralateral somatosensory and motor cortex areas encodes the vibration intensity.
Figure 5. (A) Time course alpha power spectral density during the task period in the contralateral somatosensory and motor cortex (C4, Cp2, and Cp6). Two highlighted periods indicate significant differences among three stimuli. (B) Box plots to show average alpha power spectral density of the first highlighted region, the peak period of the event-related desynchronization (ERD). One-way analysis of variance (ANOVA), F(2, 86) = 5.76, Holm–Bonferroni correction. (C) Box plots to show average alpha power spectral density of the second highlighted regions, rebound period of the ERD. Kruskal–Wallis test, H(2) = 19.02, Holm–Bonferroni correction.
The change of the beta PSD shows a slightly different pattern from the change of the alpha PSD. Figure 6 shows that ERD did not appear stronger than that of the alpha band, and rebound was not significant. In the low- and high-vibration intensity conditions, ERDs appeared in the contralateral somatosensory and motor cortices from 200 to 400 ms, and bilaterally from 400 to 600 ms. However, unlike alpha PSD, bilateral ERD did not appear after 600 ms. In addition, Figure 6 shows that ERD was sustained longer in the ipsilateral somatosensory and motor cortices in the beta band, unlike the alpha band, where ERD was sustained longer in the contralateral somatosensory and motor cortices. Therefore, in the beta band, ipsilateral somatosensory and motor cortices (C3, Cp1, and Cp5) were further investigated. The two highlighted sections in the time course beta PSD in Figure 7A were selected by statistical difference among the vibration intensity conditions and are referred to as the peak and rebound periods. In the peak period (300–650 ms), ERD appeared significantly stronger for low- and high-intensity vibration conditions as compared to no vibration condition [one-way ANOVA, F(2, 86) = 6.5, Holm–Bonferroni correction, p_adj<0.01], as shown in Figure 7B. In the rebound period (1,450–1,650 ms), significant differences remained only between the no vibration and the high-intensity vibration conditions [one-way ANOVA, F(2, 86) = 4.46, Holm–Bonferroni correction, p_adj<0.05], as shown in Figure 7C. Therefore, beta ERD seems to play a role in encoding the presence of vibration stimulation. The two highlighted sections in Figures 5A, 7A were determined as time windows showing significant differences for the three stimuli.
Figure 7. (A) Time course beta power spectral density during the task period in the ipsilateral somatosensory and motor cortex (C3, Cp1, and Cp5). Two highlighted periods indicate significant differences among three stimuli. (B) Box plots to show average beta power spectral density of the first highlighted regions. One-way analysis of variance (ANOVA), F(2, 86) = 6.5, Holm–Bonferroni correction. (C) Box plots to show average beta power spectral density of the second highlighted regions. One-way ANOVA, F(2, 86) = 4.46, Holm–Bonferroni correction.
3.3. Event-Related Potential Analysis
Significant differences between the three vibration intensity conditions were observed in the P2 and P3 components of the ERP signal. Figure 8A shows the average amplitude of the three difference vibration intensity conditions in the middle frontal area, Fz, where clear differences between the three conditions are observed. The highlighted periods (200–260 and 370–470 [ms]) indicate time window of P2 and P3, respectively. The P2 component was significantly higher for high-intensity vibration compared to no vibration and low-intensity vibration [Figure 8B, Kruskal–Wallis test, H(2) = 14.41, Holm–Bonferroni correction, p_adj<0.01]. Furthermore, the P3 component did not appear significantly in the no vibration condition and appeared only in the low-intensity vibration condition [one-sample t-test, t(28) = 3.38, p=0.0021] and high-intensity vibration condition [one-sample t-test, t(28) = 6.05, p=0.0000]. Furthermore, the P3 component for the low- and high-intensity vibration conditions were significantly higher than the no vibration condition [one-way ANOVA, F(2, 86) = 13.4, Holm–Bonferroni correction, p_adj<0.05], as shown in Figure 8C. The differences of ERP with respect to vibration intensities in each Pz and Cz area were not significant. These results confirm sensory (P2 component) and cognitive (P3 component) processes associated with vibration but do not seem to encode the vibration intensity. In addition to the middle frontal area (Fz), the P2 component was also examined in the middle central (Cz) and middle parietal (Pz) areas. As shown in Figure 9, the peak of the P2 component appeared at 170, 220, and 230 [ms] after the stimulation onset in Pz, Cz, and Fz, respectively. It was found that P2 occurred first in the middle parietal area and subsequently occurred in the middle central area and eventually in the middle frontal area.
Figure 8. (A) Event-related potential, P2, and P3 components in the middle frontal area (Fz). (B) Box plots to show significant differences in P2 component among three stimuli. Kruskal–Wallis test, H(2) = 14.41, Holm–Bonferroni correction. (C) Box plots to show significant differences in P3 component among three stimuli. One-way analysis of variance (ANOVA), F(2, 86) = 13.4, Holm–Bonferroni correction.
Figure 9. Event-related potential for the high-intensity vibration in the middle parietal (Pz), central (Cz), and frontal (Fz) areas.
4. Discussion
4.1. Alpha and Beta PSDs
Alpha and beta PSD changes have been reported in many studies related to proprioception or cutaneous sensation (Pfurtscheller et al., 1997; Yao et al., 2017; Angelini et al., 2018; Alsuradi et al., 2020). In this study, changes in alpha and beta PSDs were observed differently. Alpha PSD immediately increased at the onset of the stimulation. Although the participants did not experience any vibration in the no vibration condition, the alpha power increased within 200 ms, especially in the middle central and frontal areas. Therefore, it is reasonable to assume that the increase in alpha power is associated with attention rather than vibration stimulation. Previous research showed that alpha ERD encodes attention (Kerr et al., 2013). The randomize rest time is used to avoid expectation, however it is thought that the participants expected to receive the stimulus soon. Also, due to the rating task for intensity after stimulation period, it is expected that they may concentrate on the short stimulation for two seconds. However, this is not the main concern of this study as it appears the same in all three intensity vibrations.
Alpha ERD activation is driven by stimulation and appeared differently depending on the vibration intensity. Alpha ERD appeared in the no vibration condition, though the participants did not get any vibration stimulation. A previous study showed that alpha/beta ERD appears differently depending on the task (Klostermann et al., 2007), but it is an interesting finding in this study that ERD appeared even with no vibration. Perhaps the participants anticipated that there was vibration stimulation by the task cue, or it might be due to slight finger movements. It would be interesting to use finger tracking techniques (muscle activities using EMG or computer vision) to confirm if ERD activation is indeed due to finger movements. Therefore, additional research is needed to verify these hypotheses. On the other hand, beta ERD was significant for low- and high-intensity vibration but not in the case of no vibration. Even in the case of low- and high-intensity vibration, beta ERD was smaller than alpha, and its rebound was not significant. In addition to this, in Figure 7A, beta rebound did not appear. In general, beta rebound appears after the motor task (Jurkiewicz et al., 2006), however in this experiment, it is thought that it is because the vibration stimuli were given to the fingertips without motor movement, and this is a different result from the alpha PSD.
4.2. Strong and Longer ERD Activation in the Time Course Alpha PSD
When participants experienced strong vibration, there are two potential reasons for having a strong and elongated ERD activation. First, strong vibration produces a strong ERD and maintains it for a longer period due to top-down processing. We infer that a stronger ERD occurred due to the human instinct to be more attentive in order to protect oneself against a strong stimulus, and that rebound may be slow because of the prolonged attention. Existing literature also shows that alpha and beta power can be associated with somatosensory attention and top-down cognitive function (Jones et al., 2009; Park et al., 2014).
Another interpretation is that strong vibration may stimulate the mechanoreceptors of the skin more strongly. Thus, the firing of the nervous system may be stronger and last longer. In a study that observed the response of a single neuron by various frequency and amplitude of the vibration stimulation, it was found that for low-intensity stimulation, the frequency of firing of the nerve is small and occurs in a short time, but the frequency of firing is higher and lasts longer as the intensity of stimulation increases (Strzalkowski et al., 2017). The beta rebound after motor movement is reported in many studies (Pfurtscheller et al., 2005; Jurkiewicz et al., 2006), but the alpha rebound is not a common feature. Just few studies show alpha rebound after motor task (Lindig-León et al., 2015). The novelty of this study is to show that the ERD peak and rebound of alpha PSD can be important features in classifying vibration intensity.
4.3. Sensation-Related Perception
The P2 component of the ERP was significantly higher in the case of high-intensity vibration compared to the no vibration and low-intensity vibration conditions. This may be attributed to the perceptual processes associated with making a decision about the intensity of the vibration (no vibration and low-intensity vibration conditions were much easier to identify). Through behavioral data, there was a dominant response in the case of no vibration and low-intensity vibration conditions, but the responses for high-intensity vibration were divided comparably between strong and very strong vibration ratings. Furthermore, more than 10% of response for the high vibration intensity was rated as weak vibration. It is concluded that the high-intensity vibration was not as clear for participants to classify as a strong vibration. Choi et al. (2020) shows the difference of SEP for various frequencies and intensities. It shows that SEP peak is increased for strong stimulation, which is similar to the high P2 peak of high-intensity vibration in the ERP result of this study. However, a similar result is also reported by auditory intensity studies (Linka et al., 2005; Paiva et al., 2016).
The P3 component of the ERP also showed differences among the three vibration intensity levels, which is thought to be related to the cognitive efforts for rating the intensity of vibration after completing the task. It is inferred that the cognitive processes involved in rating the high-intensity vibration caused a larger P3. The average 42.06% of the responses for high-intensity vibration were very strong, with a standard deviation of 23.42. On the other hand, the no vibration condition was clearly identified and thus it is assumed that there was no P3 component (average response for no vibration was 99.03%, with a standard deviation of 3.26).
Figure 9 shows that the P2 component for high-intensity vibration shows different latency and amplitude in the middle parietal, central, and frontal areas. Although this result does not show the results according to the three vibration intensities, it helps to understand the tactile sensation that is not yet fully understood. First, it can be seen that the P2 peak occurs in a temporal sequence from parietal to central to frontal areas. It seems that vibration sensation is similar to the dorsal stream transmitted to the frontal area through neural processing with other modalities in the parietal area after basic information is analyzed in the somatosensory cortex. It is well-known that visual information for movement control follows the dorsal stream process, but it has been reported through fMRI studies that tactile and kinesthetic information also follow a similar process (Fiehler et al., 2008). In terms of amplitude, the peak of P2 component in the middle central area was the highest. In the brain–computer interface spellers, P3 of the middle central area (Cz) is shown to distinguish target and non-target stimuli (van der Waal et al., 2012). Middle central area is known to be an important area affecting not only P3 but also P2 for tactile sensation.
This study was intended to investigate the neural representation of vibration intensity, but visual and auditory stimuli were provided in addition to the tactile stimuli for a proper experimental design. A limitation of this study is that, although visual and auditory stimuli were equally provided for no, low, and high vibration intensity conditions, it is an experiment under multimodal stimulation and not only tactile stimulation.
5. Conclusion
In this study, we investigated how the vibration intensity is represented in the brain. The time course alpha and beta PSD analysis showed significant differences in ERD associated with the three levels of vibration intensity. Low- and high-intensity vibrations are associated with stronger alpha and beta ERD than no vibration condition. In alpha PSD, rebound of no vibration and low vibration conditions occurred after 700 ms, but in the high-intensity vibration condition, PSD was sustained longer. In addition, the P2 and P3 components of the ERP signal were examined. High-intensity vibration elicited significantly larger amplitude of the ERP, P2 component compared to no vibration and low-intensity vibration. Findings of the present study can be used to provide a quantitative measurement for the perceived vibration intensity based on brain activation.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by New York University Abu Dhabi and Ulsan National Institute of Science and Technology. The participants provided their written informed consent to participate in this study.
Author Contributions
ME proposed the study. WP designed the experimental protocol and performed statistical analysis of recorded EEG data. S-PK and ME supervised the study. All authors have contributed intellectually in writing and revising the manuscript.
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher's Note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Acknowledgments
This research was supported by New York University Abu Dhabi.
References
Alsuradi, H., Park, W., and Eid, M. (2020). EEG-based neurohaptics research: a literature review. IEEE Access 8, 49313–49328. doi: 10.1109/ACCESS.2020.2979855
Angelini, M., Fabbri-Destro, M., Lopomo, N. F., Gobbo, M., Rizzolatti, G., and Avanzini, P. (2018). Perspective-dependent reactivity of sensorimotor mu rhythm in alpha and beta ranges during action observation: an EEG study. Sci. Rep. 8, 1–11. doi: 10.1038/s41598-018-30912-w
Binnie, C., Cooper, R., Mauguiere, F., Osselton, J., Prior, P., and Tedman, B. (2003). EEG, Paediatric Neurophysiology, Special Techniques and Applications. Clinical neurophysiology.
Buchholz, V. N., Jensen, O., and Medendorp, W. P. (2014). Different roles of alpha and beta band oscillations in anticipatory sensorimotor gating. Front. Hum. Neurosci. 8:446. doi: 10.3389/fnhum.2014.00446
Burle, B., Spieser, L., Roger, C., Casini, L., Hasbroucq, T., and Vidal, F. (2015). Spatial and temporal resolutions of EEG: is it really black and white? A scalp current density view. Int. J. Psychophysiol. 97, 210–220. doi: 10.1016/j.ijpsycho.2015.05.004
Choi, M.-H., Jung, J.-J., Lee, J.-H., Kim, H.-S., Kim, H.-J., and Chung, S.-C. (2020). A study on somatosensory evoked potential patterns according to various vibrotactile stimulation: frequencies and intensities. J. Mech. Med. Biol. 20:2040015. doi: 10.1142/S0219519420400151
Choi, M.-H., Kim, B., Kim, H.-S., Gim, S.-Y., Kim, W.-R., and Chung, S.-C. (2017). Perceptual threshold level for the tactile stimulation and response features of erd/ers-based specific indices upon changes in high-frequency vibrations. Front. Hum. Neurosci. 11:207. doi: 10.3389/fnhum.2017.00207
Chouvardas, V. G., Miliou, A. N., and Hatalis, M. K. (2008). Tactile displays: overview and recent advances. Displays 29, 185–194. doi: 10.1016/j.displa.2007.07.003
Coghill, R. C., Talbot, J. D., Evans, A. C., Meyer, E., Gjedde, A., Bushnell, M. C., et al. (1994). Distributed processing of pain and vibration by the human brain. J. Neurosci. 14, 4095–4108. doi: 10.1523/JNEUROSCI.14-07-04095.1994
Correll, J., Urland, G. R., and Ito, T. A. (2006). Event-related potentials and the decision to shoot: the role of threat perception and cognitive control. J. Exp. Soc. Psychol. 42, 120–128. doi: 10.1016/j.jesp.2005.02.006
Delorme, A., and Makeig, S. (2004). EEGlab: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21. doi: 10.1016/j.jneumeth.2003.10.009
Fiehler, K., Burke, M., Engel, A., Bien, S., and Rösler, F. (2008). Kinesthetic working memory and action control within the dorsal stream. Cereb. Cortex 18, 243–253. doi: 10.1093/cercor/bhm071
Giacomin, J., Shayaa, M., Dormegnie, E., and Richard, L. (2004). Frequency weighting for the evaluation of steering wheel rotational vibration. Int. J. Indus. Ergon. 33, 527–541. doi: 10.1016/j.ergon.2003.12.005
Hämäläinen, H., Kekoni, J., Sams, M., Reinikainen, K., and Näätänen, R. (1990). Human somatosensory evoked potentials to mechanical pulses and vibration: contributions of SI and SII somatosensory cortices to p50 and p100 components. Electroencephalogr. Clin. Neurophysiol. 75, 13–21. doi: 10.1016/0013-4694(90)90148-D
Hari, R. (1980). Evoked potentials elicited by long vibrotactile stimuli in the human EEG. Pflügers Archiv. 384, 167–170. doi: 10.1007/BF00584434
Harrington, G. S., and Downs, J. H. III (2001). FMRI mapping of the somatosensory cortex with vibratory stimuli: Is there a dependency on stimulus frequency? Brain Res. 897, 188–192. doi: 10.1016/S0006-8993(01)02139-4
Jones, S. R., Pritchett, D. L., Sikora, M. A., Stufflebeam, S. M., Hämäläinen, M., and Moore, C. I. (2009). Quantitative analysis and biophysically realistic neural modeling of the MEG MU rhythm: rhythmogenesis and modulation of sensory-evoked responses. J. Neurophysiol. 102, 3554–3572. doi: 10.1152/jn.00535.2009
Jurkiewicz, M. T., Gaetz, W. C., Bostan, A. C., and Cheyne, D. (2006). Post-movement beta rebound is generated in motor cortex: evidence from neuromagnetic recordings. Neuroimage 32, 1281–1289. doi: 10.1016/j.neuroimage.2006.06.005
Kerr, C. E., Sacchet, M. D., Lazar, S. W., Moore, C. I., and Jones, S. R. (2013). Mindfulness starts with the body: somatosensory attention and top-down modulation of cortical alpha rhythms in mindfulness meditation. Front. Hum. Neurosci. 7:12. doi: 10.3389/fnhum.2013.00012
Khasnobish, A., Sardar, D., Pal, M., and Nagar, A. K. (2018). “Analysing vibrotactually stimulated EEG signals to comprehend object shapes,” in 2018 IEEE Symposium Series on Computational Intelligence (SSCI) (Bengaluru), 484–490. doi: 10.1109/SSCI.2018.8628759
Kim, J., Chung, Y. G., Chung, S.-C., Bülthoff, H. H., and Kim, S.-P. (2016). Neural categorization of vibrotactile frequency in flutter and vibration stimulations: an fMRI study. IEEE Trans. Hapt. 9, 455–464. doi: 10.1109/TOH.2016.2593727
Klostermann, F., Nikulin, V. V., Kühn, A. A., Marzinzik, F., Wahl, M., Pogosyan, A., et al. (2007). Task-related differential dynamics of EEG alpha-and beta-band synchronization in cortico-basal motor structures. Eur. J. Neurosci. 25, 1604–1615. doi: 10.1111/j.1460-9568.2007.05417.x
Langdon, A. J., Boonstra, T. W., and Breakspear, M. (2011). Multi-frequency phase locking in human somatosensory cortex. Prog. Biophys. Mol. Biol. 105, 58–66. doi: 10.1016/j.pbiomolbio.2010.09.015
Lindig-León, C., Bougrain, L., and Rimbert, S. (2015). “Alpha rebound improves on-line detection of the end of motor imageries,” in 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER) (Montpellier), 655–658. doi: 10.1109/NER.2015.7146708
Linka, T., Müller, B., Bender, S., Sartory, G., and Gastpar, M. (2005). The intensity dependence of auditory evoked ERP components predicts responsiveness to reboxetine treatment in major depression. Pharmacopsychiatry 38, 139–143. doi: 10.1055/s-2005-864126
Mackevicius, E. L., Best, M. D., Saal, H. P., and Bensmaia, S. J. (2012). Millisecond precision spike timing shapes tactile perception. J. Neurosci. 32, 15309–15317. doi: 10.1523/JNEUROSCI.2161-12.2012
Mahns, D. A., Perkins, N., Sahai, V., Robinson, L., and Rowe, M. (2006). Vibrotactile frequency discrimination in human hairy skin. J. Neurophysiol. 95, 1442–1450. doi: 10.1152/jn.00483.2005
Mansfield, N. J., and Maeda, S. (2005). Equal sensation curves for whole-body vibration expressed as a function of driving force. J. Acoust. Soc. Am. 117, 3853–3859. doi: 10.1121/1.1898703
Merchel, S., and Altinsoy, M. E. (2020). Psychophysical comparison of the auditory and tactile perception: a survey. J. Multimodal User Interfaces 14, 271–283. doi: 10.1007/s12193-020-00333-z
Moshourab, R., Frenzel, H., Lechner, S., Haseleu, J., Bégay, V., Omerbašić, D., and Lewin, G. R. (2016). Measurement of vibration detection threshold and tactile spatial acuity in human subjects. J. Vis. Exp. 115:e52966. doi: 10.3791/52966
Moungou, A., Thonnard, J.-L., and Mouraux, A. (2016). EEG frequency tagging to explore the cortical activity related to the tactile exploration of natural textures. Sci. Rep. 6, 1–9. doi: 10.1038/srep20738
Mullen, T., Kothe, C., Chi, Y. M., Ojeda, A., Kerth, T., Makeig, S., et al. (2013). “Real-time modeling and 3d visualization of source dynamics and connectivity using wearable EEG,” in 2013 35th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC) (Osaka), 2184–2187. doi: 10.1109/EMBC.2013.6609968
Neuper, C., Wörtz, M., and Pfurtscheller, G. (2006). ERD/ERS patterns reflecting sensorimotor activation and deactivation. Prog. Brain Res. 159, 211–222. doi: 10.1016/S0079-6123(06)59014-4
Paiva, T. O., Almeida, P. R., Ferreira-Santos, F., Vieira, J. B., Silveira, C., Chaves, P. L., et al. (2016). Similar sound intensity dependence of the n1 and p2 components of the auditory ERP: averaged and single trial evidence. Clin. Neurophysiol. 127, 499–508. doi: 10.1016/j.clinph.2015.06.016
Park, W., Kwon, G. H., Kim, D.-H., Kim, Y.-H., Kim, S.-P., and Kim, L. (2014). Assessment of cognitive engagement in stroke patients from single-trial EEG during motor rehabilitation. IEEE Trans. Neural Syst. Rehabil. Eng. 23, 351–362. doi: 10.1109/TNSRE.2014.2356472
Pfurtscheller, G., Neuper, C., Brunner, C., and Da Silva, F. L. (2005). Beta rebound after different types of motor imagery in man. Neurosci. Lett. 378, 156–159. doi: 10.1016/j.neulet.2004.12.034
Pfurtscheller, G., Neuper, C., Flotzinger, D., and Pregenzer, M. (1997). EEG-based discrimination between imagination of right and left hand movement. Electroencephalogr. Clin. Neurophysiol. 103, 642–651. doi: 10.1016/S0013-4694(97)00080-1
Polich, J. (2007). Updating p300: an integrative theory of p3a and p3b. Clin. Neurophysiol. 118, 2128–2148. doi: 10.1016/j.clinph.2007.04.019
Réhman, U. (2010). Expressing emotions through vibration for perception and control (Ph.D. thesis). Umeå University, Umeå, Sweden.
Reynolds, D., Standlee, K., and Angevine, E. (1977). Hand-arm vibration, part iii: subjective response characteristics of individuals to hand-induced vibration. J. Sound Vibrat. 51, 267–282. doi: 10.1016/S0022-460X(77)80036-9
Ryun, S., Kim, J. S., Lee, H., and Chung, C. K. (2017). Tactile frequency-specific high-gamma activities in human primary and secondary somatosensory cortices. Sci. Rep. 7, 1–10. doi: 10.1038/s41598-017-15767-x
Simons, S. B., Tannan, V., Chiu, J., Favorov, O. V., Whitsel, B. L., and Tommerdahl, M. (2005). Amplitude-dependency of response of si cortex to flutter stimulation. BMC Neurosci. 6:43. doi: 10.1186/1471-2202-6-43
Strzalkowski, N. D., Ali, R. A., and Bent, L. R. (2017). The firing characteristics of foot sole cutaneous mechanoreceptor afferents in response to vibration stimuli. J. Neurophysiol. 118, 1931–1942. doi: 10.1152/jn.00647.2016
Sur, S., and Sinha, V. K. (2009). Event-related potential: an overview. Indus. Psychiatry J. 18:70. doi: 10.4103/0972-6748.57865
Tang, W., Liu, R., Shi, Y., Hu, C., Bai, S., and Zhu, H. (2020). From finger friction to brain activation: tactile perception of the roughness of gratings. J. Adv. Res. 21, 129–139. doi: 10.1016/j.jare.2019.11.001
Timora, J. R., and Budd, T. W. (2013). Dissociation of psychophysical and EEG steady-state response measures of cross-modal temporal correspondence for amplitude modulated acoustic and vibrotactile stimulation. Int. J. Psychophysiol. 89, 433–443. doi: 10.1016/j.ijpsycho.2013.06.006
Tommerdahl, M., Hester, K., Felix, E., Hollins, M., Favorov, O., Quibrera, P., et al. (2005). Human vibrotactile frequency discriminative capacity after adaptation to 25 hz or 200 hz stimulation. Brain Res. 1057, 1–9. doi: 10.1016/j.brainres.2005.04.031
van der Waal, M., Severens, M., Geuze, J., and Desain, P. (2012). Introducing the tactile speller: an ERP-based brain-computer interface for communication. J. Neural Eng. 9:045002. doi: 10.1088/1741-2560/9/4/045002
Verrillo, R. T., Fraioli, A. J., and Smith, R. L. (1969). Sensation magnitude of vibrotactile stimuli. Percept. Psychophys. 6, 366–372. doi: 10.3758/BF03212793
Keywords: haptics, neural signal processing, vibration, sensation, alpha ERD
Citation: Park W, Kim S-P and Eid M (2021) Neural Coding of Vibration Intensity. Front. Neurosci. 15:682113. doi: 10.3389/fnins.2021.682113
Received: 17 March 2021; Accepted: 04 October 2021;
Published: 11 November 2021.
Edited by:
Rufin VanRullen, Centre National de la Recherche Scientifique (CNRS), FranceReviewed by:
Frederic Von Wegner, University of New South Wales, AustraliaRichard Martin Vickery, University of New South Wales, Australia
Copyright © 2021 Park, Kim and Eid. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mohamad Eid, mohamad.eid@nyu.edu