Zemeng Chen
Xiang Ji1
Ting Li
Chenyang Gao
Shuyu Liu- 1Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin, China
- 2Applied Physiology and Kinesiology, College of Health and Human Performance, University of Florida, Gainesville, FL, United States
- 3Academy of Opto-Electronics, China Electronics Technology Group Corporation, Tianjin, China
Introduction: Conflict monitoring and processing is an important part of the human cognitive system, it plays a key role in many studies of cognitive disorders.
Methods: Based on a Chinese word-color match Stroop task, which included incongruent and neutral stimuli, the Electroencephalogram (EEG) and functional Near-infrared Spectroscopy (fNIRS) signals were recorded simultaneously. The Pearson correlation coefficient matrix was calculated to analyze brain connectivity based on EEG signals. Granger Causality (GC) method was employed to analyze the effective connectivity of bilateral frontal lobes. Wavelet Transform Coherence (WTC) was used to analyze the functional connectivity of the bilateral hemisphere and ipsilateral hemisphere.
Results: Results indicated that brain connectivity analysis on EEG signals did not show any significant lateralization, while fNIRS analysis results showed the frontal lobes especially the left frontal lobe play the leading role in dealing with conflict tasks. The human brain shows leftward lateralization while processing the more complicated incongruent stimuli. This is demonstrated by the higher functional connectivity in the left frontal lobe and the information flow from the left frontal lobe to the right frontal lobe.
Discussion: Our findings in brain connectivity during cognitive conflict processing demonstrated that the dual modality method combining EEG and fNIRS is a valuable tool to excavate more information through cognitive and physiological studies.
1. Introduction
Conflict monitoring and processing has always been a key characteristic of the human cognitive system. It is closely related to the study of neurological disorders, stroke, and congenital cognitive dysfunction in children (1, 2). The Stroop task is one of the most widely used methods for studying how the human brain detects and resolves conflicts (3, 4). In 1935, John Ridley Stroop first discovered that when the meaning of a printed word was different from the color of the word, there would be a cognitive delay, which is the Stroop effect (5). The Stroop effect makes behavioral responses to incongruent stimuli (when the word’s meaning and the word’s ink color are not consistent, e.g., the word “blue” shown in red ink) less accurate and slower than responses to neutral stimuli (6) (when the word’s meaning and the word’s ink color are consistent).
In recent years, there have been several functional neuroimaging methods applied to detect brain activity during the Stroop task, such as Electroencephalogram (EEG) and functional Near-infrared Spectroscopy (fNIRS) (7, 8). As to EEG, it records neutral activities with a high temporal resolution, which is within the millisecond range, but has a lack of spatial resolution resulting from volume conduction, thus leading to barriers in source localization (9, 10). The past few decades have seen a rapid increase in the use of fNIRS for monitoring metabolic change in the cerebral cortex, which has excellent spatial but low temporal resolution resulting from the inherent hemodynamic delay (11, 12). Moreover, fNIRS is more robust than EEG when confronted with motion-based muscle activity and electrical noise artifacts (13). The dual-modal imaging technology that combines the high spatial resolution of fNIRS with the high temporal resolution of EEG has gained attention (14–17). EEG-fNIRS correlation analysis helped to further reveal the complex relationship between electrophysiological and hemodynamic changes in neuroscience (18).
As for EEG, Event-related potentials (ERP) analysis was employed to trace the time course of different executive processes and sub-processes involved in experimental tasks involving a cognitive conflict with precision (19). In previous studies, the ERP frontal-central N200 component reflects conflict monitoring procedures (20, 21). The Pearson correlation coefficient (PCC) is an indicator of brain functional connectivity, which is widely accepted during the measurement of the statistical relationships between random variables and the relationships between signals (22). As to fNIRS, a previous study has used Dynamic Causal Modeling (DCM) to analyze effective connectivity, and the used general linear model (GLM) to identify brain regions that are significantly activated during the Stroop task (23). Another study employed Granger Causality (GC) to evaluate the effective connectivity between hemispheres, and Wavelet Transform Coherence (WTC) to assess intrahemispheric functional connectivity (15). This study proved that GC and WTC analysis can be reliable methods for fNIRS data processing. One previous study initially recorded the EEG signals and fNIRS data simultaneously, they used ANOVA analysis on N450 ERP and hemodynamic activation data. And the result indicated that N450 reflects conflict detection and resolution, the left frontal lobe may be involved in conflict detection, and the bilateral frontal lobe is engaged in conflict resolution (15).
In this study, we aimed to find out which brain region plays the leading role, in local information processing, and how information flow transfers inside the human brain in processing Stroop tasks. A Chinese color-word match Stroop task was employed since it primarily activates the bilateral frontal lobes (24–26). The behavioral data, EEG signals from the whole brain, and fNIRS signals from the frontal lobe and the parietal lobe were recorded simultaneously. The GC method was employed to analyze the effective connectivity of bilateral frontal lobes. The WTC method was used to analyze the functional connectivity of the bilateral hemisphere and ipsilateral hemisphere. According to the results, we found out that the left frontal lobe plays the leading role during processing the more complex incongruent tasks. Meanwhile, the human brain showed leftward lateralization, which means the ability of local information processing in the left frontal region increased, and the information flow from the left frontal lobe to the right frontal lobe also increased. This study made us gain a deeper understanding of brain activity during cognition processing.
2. Materials and methods
2.1. Participants
A total of 21 healthy volunteers (9 females/12 males, aged 23.0 ± 2.3 years ranging from 20 to 30 years) were recruited from the Institution of Biomedical Engineering, Peking Union Medical College. All participants’ color vision is normal. and they have no history of mental illness or other related diseases that may interfere with the conclusion of the study. All participants are Chinese native speakers, and the whole experiment paradigm was performed in a Chinese environment. Experimental procedures involving human subjects described in this paper were approved by the Clinical Research Ethics Committee of the First Affiliated Hospital, College of Medicine, Zhejiang University (IIT20210036C-R1). All participants signed informed consent before the experiments and were compensated for their effort by being given a certain amount of test fee.
2.2. Procedures
The classical verbal Stroop color-word task with a block design was employed in this study, which was adapted from a previous study (19). Each stimulus contained two Chinese characters and participants were asked to judge whether the color of the upper one matched the meaning of the lower one, as shown in Figure 1A. If the two Chinese characters in the stimulus were corresponding, participants pressed the left mouse button and held it until a trial ended. On the contrary, participants pressed the right button. There were two different kinds of stimulus conditions: neutral and incongruent. In neutral stimuli, the upper Chinese character was a noncolor word which consists of “贯,” “奖,” “放,” “社,” meaning “pass through,” “prize,” “lay,” and “society,” presented in red, yellow, blue, or green; the lower Chinese character was a color word which consists of “红,” “黄,” “蓝,” “绿,” meaning “red,” “yellow,” “blue,” and “green,” presented in white. In incongruent stimuli, the upper Chinese character was a color word presented in a different color. For each stimulus, the numbers of “corresponding” trails and “not corresponding” trails were equal, and those two trails were randomly mixed within each block.
Figure 1. Experimental process and position arrangement of the fNIRS and EEG probe channel of the system. (A) “R” is short for rest, “N” is short for the neutral stimulus block, “B” is short for break, and “I” is short for the incongruent stimulus block. (B) Left and right fNIRS channel number and brain region distribution. (C) fNIRS probe site with the 10–20 system.
Four blocks were included in this study, they were displayed in order: neutral stimulus block, neutral stimulus block, incongruent stimulus block, and incongruent stimulus block. Each block consisted of 16 trials. During each trial, a stimulus was presented for 2 s, and there are 5 s intervals between two successive trials. There were 30 s rest periods before the first block and after the fourth block. During the break and interval, a white cross was shown in the center of the screen with a black background. A beep sound appeared 0.5 s before each block to remind participants. There was a practice session before the formal experiment to let participants are familiar with the task. The experimental environment was kept dark and quiet to minimize disturbance to the participants.
2.3. Data recording
As for behavioral data, the judgment results and the reaction time of all participants for each stimulus are collected and recorded by the stimulus program.
Figure 1C shows the 10–20 system of the international federation, which was used for EEG recording as the scalp site, with the left mastoid using a Neuroscan 64-channel device (Synamps) to record, while the right mastoid was as a reference. The Electrooculograms (EOGs) were recorded using four additional bipolar electrodes. Two electrodes were placed in the superior and inferior areas of the left orbit to record vertical EOG, and two electrodes were placed lateral to the left and right orbits to record horizontal EOG. A 0.05–100 Hz band-pass filter was designed for the EEG and EOG data, then a 50 Hz notch filter is used. The sampling rate of the continuous records is 100 Hz. Electrode impedances were kept under 5 kΩ.
This study used a continuous-wave, modulated light source fNIRS system developed by our laboratory to record the fNIRS data (27). It consists of continuous wave laser diodes (L785P100, Thorlabs, USA and ADL85501TL, Roithner Lasertechnik, Austria), direct digital synthesis chip (ML2035, Micro Linear, USA), micro control unit (AT89C2051, Atmel, United States), custom-made dual fiber collimators (Space Star Aerospace Technology Applications Co., Ltd., China), and avalanche photodiode (C5460-01, Hamamatsu Photonics, Japan). Based on the modified Beer–Lambert Law, two wavelengths (785 nm and 850 nm) were used to determine the concentration changes of HbO2 (Δ[HbO2]) and Hb (Δ[Hb]). The fNIRS probe was placed in the EEG electrode cap and held four sources (represented by the red circle in Figure 1B) and 18 detectors (represented by the green square in Figure 1B), providing 20 detector channels covering the frontal and parietal lobes. For example, S1-D1 is short for light source 1 and detector 1 is a channel. In Figure 1B, the white curve divided the frontal and parietal lobes into two parts, the blue squares “a” and “b” represented the left and right frontal lobe respectively, and the blue squares “c: and “d” represented the left and right parietal lobe, respectively. There were 10 detector channels in both the left and right regions with a 3 cm interval. The sampling rate of our fNIRS system is 100 Hz.
During the experiment, the brightness of the lower right corner of the screen was changed with the change of the type of stimuli, which made a photoelectric marking module generate different signals for the fNIRS system and EEG system through a capture card. This made optical and electrical signals can be detected simultaneously, and it was also useful in data processing for data alignment.
2.4. Data analysis
2.4.1. Behavioral data analysis
MATLAB™ R2022b (MathWorks, Natick, MA, United States) was used to process the raw behavioral data, and statistical tests were analyzed using IBM Statistics SPSS 24. Accuracy, reaction time, and accuracy divided by reaction time (accuracy/reaction time) were calculated for both incongruent stimulus and neutral stimulus. The paired t-test was conducted for paired accuracy, reaction time, and accuracy/reaction time.
2.4.2. EEG data analysis
This study used the EEG data processing toolbox developed by André Mouraux (Institute of Neuroscience, Université catholique de Louvain, Belgium) et al.1 The EEG data were Butterworth band-pass filtered with a frequency range from 0.05 to 30 Hz. If the electrode with excessive impedance was recorded according to the experiment, the bad electrode was removed and interpolated. Independent component analysis (ICA) matrix was computed, and after that, the movement artifacts and eye-blink artifacts were identified and removed by applying ICA spatial filter. The EEG data were then segmented into 1,000-ms epochs, including a 200-ms pre-stimulus baseline. The segmented EEG data were re-referenced to channel CZ data. After the baseline correction, epochs were averaged separately for incongruent stimulus and neutral stimulus.
2.4.2.1. ERP analysis
Based on our results and previous studies, analyses focused on N200 and P300. Both N200 and P300 ERP components in EEG signals, can be detected during cognitive tasks to executive cognitive control functions (28), and response to word presentation (29). Each peak N200 amplitude and peak P300 amplitude was extracted for both the incongruent and neutral stimuli. The N200 amplitudes for P7 and P8 channels and P300 amplitudes for CP3 and CP4 channels for each stimulus were extracted. Then paired t-tests were used for paired data.
2.4.2.2. Brain connectivity analysis of EEG signals
The PCC values of EEG channels within left and right hemispheres (EEG channels in left hemisphere: P3, P7, CP3, TP7, C3, T7, FC3, FT7, F3, F7, FP1. EEG channels in right hemisphere: P8, P4, TP8, CP4, T8, C4, FT8, FC4, F8, F4, FP2) for both stimuli were calculated to analyze the brain connectivity to provide more information about the lateralization differences using EEG signals. A MATLAB function was applied to calculate the PCC values between every 11 channels with half hemisphere. Then average PCC values were calculated and the mean intra-hemispheric connectivity matrix was plotted, separately based on EEG signals between subjects in the incongruent and neutral stimulus. Each matrix element was the average PCC value for an EEG channel pair represented by its row coordinate and column coordinate.
2.4.3. fNIRS data analysis
In this study, HbO2 was employed to estimate the changes in cerebral blood oxygenation because HbO2 has a better signal-to-noise ratio (SNR) than Hb (30).
According to the marker generated by the photoelectric marking module, raw fNIRS data of the incongruent stimulus and neutral stimulus were divided into two parts. A 3 Hz lower-pass filter was used first to the data to remove instrument noise, then downsampled to 10 Hz. After converting to a change in optical density, a ranged from 0.015 to 0.2 Hz band-pass filter was used to reduce gradual drifts and oscillations of the arterial pulse. Later on, the differential pathlength factor (DPF) method was applied to convert the optical intensity data into HbO2 and Hb signals, while the DPF values were 5.2 at 850 nm and 6.0 at 785 nm (30). The wavelet minimum description length detrending algorithm was used to suppress unknown global trends. At last, the HbO2 and Hb signals were stimuli averaged.
2.4.3.1. Brain activation analysis
The mean value of HbO2 and Hb signals during the task period (0–40 s after the task began) were calculated for the task hemodynamic response for each channel. Then paired t-tests were conducted for paired HbO2 and Hb data for each channel.
2.4.3.2. Effective connectivity analysis of bilateral frontal lobes
One of the brain connection analyses is the effective connection method. The causal relationship between the interactions of different brain regions is reflected by their analysis of effective connectivity. The analysis results describe how information flow transmit between different brain regions. The GC mathematical model was used to analyze effective connectivity between hemispheres (31, 32). Signal A can be referred to as the “Granger cause” of signal B if the past values of signal A can be utilized as a priori knowledge to forecast signal B. An autoregressive model was employed to calculate GC.
To explore the hemispheric lateralization properties of the brain processing different kinds of stimuli. GC values were calculated for HbO2 signals of corresponding channels between the frontal lobes of the left and right hemispheres (e.g., S1-D1 and S3-D9 are corresponding channels). The Difference of Influence (DOI) between brain regions was defined as the GC value for each channel pair with the left pointing to the right minus the GC value for the right pointing to the left. Therefore, a positive DOI value indicates that information flowed from the left-sided to the right-sided. To display the Granger causality properties between left and right brain regions, DOI values were obtained for four channel pairs in frontal regions. DOI values were calculated for incongruent and neutral stimuli.
This study used a Granger causal connectivity analysis MATLAB toolbox (Granger causal connectivity analysis, GCCA) developed by Seth (33). The Granger output results were affected by the lag period selection of the GC model. In this study, it was automatically selected according to the Bayesian information criteria (34), when, at their minimal values, these criteria indicate the best trade-offs between accuracy and parameter count. Therefore, the results are robust to variations in the model order. Then paired t-test was conducted to the mean DOI values of parameters with an automatically selected lag in the frontal lobes of the left and right hemispheres in the incongruent and neutral stimulus.
2.4.3.3. Functional connectivity analysis of bilateral hemisphere
Functional connectivity undirected showed the statistical correlation of activity in different regions of the brain from the viewpoint of functional integration, using the WTC method in this study (31, 35). The WTC method indicated the time-frequency cross-correlation of two data series (36). It can also detect local phase information which might be difficult to find out by traditional time series analysis methods (37). In this study, a MATLAB wavelet transforms coherence toolbox developed by Grinsted et al. (38)2 was used to analyze the functional connectivity of bilateral and ipsilateral hemispheres.
The correlation analysis of the time series of HbO2 signals between corresponding channel pairs in the left and right hemispheres (e.g., S1-D1 and S3-D9 are corresponding channel pairs) was calculated using the WTC. The mean values of coherence value in the 0.071–0.5 Hz band (corresponding to period 14 and 2 s, respectively) were computed to indicate functional connectivity for each corresponding channel pair (37). The Fisher-z transform was used on the coherence values, then paired t-tests were performed on each channel pair in the incongruent and neutral stimulus.
2.4.3.4. Functional connectivity analysis of ipsilateral hemisphere
The WTC analysis was used for correlation analysis of the time series of HbO2 signals between any two channels in the left and right hemispheres (L1-L10, R1-R10. L1 to L5 correspond to S1-D1 to S1-D5, L6 correspond to S2-D1, L7-L10 correspond to S2-D5 to S2-D8. R1 to R5 correspond to S3-D9 to S3-D13, R6 correspond to S4-D9, R7-R10 correspond to S4-D13 to S4-D16.). The mean values of coherence value in the 0.071–0.55 Hz band were computed to present the functional connectivity strength within the ipsilateral hemisphere, and this also came out with the left and right intra-hemispheric functional connectivity matrices. Then we plotted the mean intra-hemispheric functional connectivity matrix, separately based on HbO2 signals between subjects in the incongruent and neutral stimulus. Each matrix element was the coherence value for a fNIRS channel pair represented by its row coordinate and column coordinate. After the Fisher-z transform was used on the coherence values, paired t-tests were used for paired samples (39).
3. Results
The test results in the figure or table as followed abided the standards: *indicates p < 0.05, **indicates p < 0.01, ***indicates p < 0.001.
3.1. Behavioral results
Table 1 and Figure 2 displays the average accuracy, reaction time, and accuracy/reaction time for two stimulus conditions. As to accuracy, there was a significant difference between both stimulus conditions, and it was lower for the incongruent condition than the neutral condition. These behavioral results also suggested longer reaction times for incongruent conditions, while the difference was significant. Moreover, the accuracy/reaction time for the incongruent condition is significantly lower. All behavioral results showed significant Stroop effects.
Table 1. Statistical results of accuracy, reaction time, and accuracy/reaction time for each stimulus.
Figure 2. Accuracy, reaction time, and accuracy/reaction time for each stimulus.
3.2. EEG results
3.2.1. ERP results
As shown in Table 2 and Figure 3, the two feature-based components, N200 in P7 and P8 channel, and P300 in CP3 and CP4 channel, presented significant differences for the incongruent and neutral stimulus. For incongruent stimulus, the occurrence time of both N200 and P300 in each channel was significantly longer than in neutral stimulus, while the peak of both N200 and P300 in each channel was significantly higher than in neutral stimulus.
Table 2. Statistical results of occurrence time and amplitude of P7 N200, P8 N200, CP3 P330, and CP4 N200 for each stimulus.
Figure 3. Waveform of P7 N200, P8 N200, CP3 P300, and CP4 P300 for each stimulus of a representative participant, the straight dashed line perpendicular to the x-axis marks the peak of each wave.
3.2.2. EEG brain connectivity analysis results
Every matrix element of the EEG brain connectivity matrices represented the averaged PCC value between channel pairs (horizontal coordinates and vertical coordinates) as shown in Figure 4. According to the matrices, the PCC value of the left and right hemispheres had no big differences in both incongruent and neutral stimulus. What’s more, there were no significant differences between left and right hemispheres both in incongruent and neutral stimulus.
Figure 4. Brain connectivity matrix based on EEG signals.
3.3. fNIRS results
3.3.1. Brain activation analysis results
Figure 5 shows the grand average HbO2 and Hb signals for the incongruent task and the neutral task at two typical frontal lobe channels. The two straight lines perpendicular to the x-axis mark the beginning and the end of the stimuli. In both S1-D2 and S3-D10, the activation responses for the incongruent task were significantly greater than the neutral task. The statistical results of HbO2 in S1-D2 (t = 2.499, p = 0.029), S3-D10 (t = 2.246, p = 0.024) showed significant differences. The statistical results of Hb on S1-D2 (t = 2.148, p = 0.033), S3-D10 (t = 3.118, p = 0.017) also showed significant differences.
Figure 5. The grand average HbO2 and Hb signal for each stimulus.
3.3.2. Results of effective connectivity analysis of bilateral frontal lobes
The automatically selected lag period for incongruent and neutral stimuli is 4 s. Meanwhile, the DOI value in the left and right frontal lobes of the incongruent stimulus was positive, and the DOI value in the left and right frontal lobes of the neutral stimulus was negative, as shown in Figure 6. Statistical tests showed significant differences in DOI values between incongruent and neutral stimulus at the lag period of 4 (t = 3.947, p = 0.001). The results showed that the information flow from the left to the right frontal lobes was major in accompanying conflict processing.
Figure 6. Mean DOI values in lag 4 s calculated based on HbO2 signals.
3.3.3. Results of functional connectivity analysis of bilateral hemisphere
As shown in Figure 7A and Table 3, statistical tests show that in channel pairs L6 and R6, the strength of brain functional connectivity of incongruent stimulus was significantly stronger than the strength of brain functional connectivity of neutral stimulus (t = 2.617, p = 0.017). They were highlighted with red boxes in Figures 7B,C, and they were located in the frontal lobe.
Figure 7. Bilateral hemisphere functional connectivity analysis results. (A) Average coherence values between left and right frontal paired channels based on HbO2 signals. (B) Channels with significant differences located in left and right fNIRS channel number and brain region distribution figure. (C) Channels with significant differences located in fNIRS probe site with the 10–20 system figure.
Table 3. Statistical results of functional connectivity analysis of bilateral hemisphere.
3.3.4. Results of functional connectivity analysis of ipsilateral hemisphere
Every matrix element of the functional connectivity matrices represented the correlation value between channel pairs (horizontal coordinates and vertical coordinates) as shown in Figure 8. According to the matrices, the frontal lobes had stronger functional connectivity than other areas of the brain, and the functional connectivity of the left frontal lobes is stronger than the functional connectivity of the right frontal lobes both in the incongruent and neutral stimulus. Therefore, statistical tests were employed for frontal lobes (L1–L5 and R1–R5) in both stimuli, and the functional connectivity within the left frontal lobes was significantly stronger than the functional connectivity within the right frontal lobes (neutral, t = 3.385, p = 0.001, incongruent, t = 2.326, p = 0.029). What’s more, the functional connectivity within the left frontal lobes of the incongruent stimulus was significantly stronger than that of the neutral stimulus, and the functional connectivity within the right frontal lobes of the incongruent stimulus was also significantly stronger than that of the neutral stimulus (left, t = 6.162, p = 0.001, right, t = 3.768, p = 0.020).
Figure 8. Ipsilateral hemisphere functional connectivity analysis results. (A) Ipsilateral hemisphere functional connectivity matrix based on HbO2 signals. (B) Average functional connectivity within left frontal lobes based on HbO2 signals.
4. Discussion
In this study, we recorded behavioral data, EEG signals, and fNIRS signals simultaneously during the Chinese color-word matching Stroop task. The behavioral data performance, the EEG results, and the fNIRS activation results represented significant Stroop effects, indicating that our experimental design was correct, and making it reliable to find out about the internal information flow of the human brain when processing cognitive tasks.
Accuracy and accuracy/reaction time were significantly lower for the incongruent conditions than the neutral conditions, while the reaction time is the opposite, which showed significant Stroop effects. The two feature-based EEG components N200 and P300 also displayed significant Stroop effects. As for the N200, it can be detected when the human brain deals with cognitive tasks such as flanker tasks (40) and go/no-go tasks (41). The N200 is considered to be associated with cognitive control (28), making it explainable that, when the human brain processes the more complex incongruent stimulus, both the occurrence time and the peak of the N200 were larger than the neutral stimulus. The P300 is another event-related potential associated with cognitive processing. Our results showed that the occurrence time and the peak of the P300 for the incongruent conditions were significantly bigger than the neutral conditions, which were consistent with previous studies (42). The Chinese color-word matching Stroop task was employed to activate the bilateral frontal lobes (24, 43, 44). The fNIRS activation results showed that the amplitude of HbO2 signals in the frontal lobe for incongruent stimulus was significantly higher than for neutral stimulus, which indicated significant Stroop effects in both the left and right frontal lobes. These results are consistent with previous studies (24), representing that the recording of fNIRS data with high quality was correct.
The effective connectivity analysis of bilateral frontal lobes results in the 4 s lag DOI values in the left and right frontal lobes of the incongruent stimulus was positive and showed significant differences in DOI values between incongruent and neutral stimulus. As for the DOIs’ definition is the causality in the left-to-right direction minus that in the right-to-left direction (33), which corresponded to the net causality of the left to the right direction (45), indicated that for the incongruent stimulus versus the neutral stimulus, the information flow from the left frontal lobe to the right frontal lobe increased, demonstrating increased interhemispheric functional integration along with the attentional processing. According to one previous cognition research on healthy people, the flow of information from the left to the right prefrontal cortexes increased accompanying conflict processing (15).
The functional connectivity analysis of the bilateral hemisphere showed that the average coherence value between L6-R6 channel pair in congruent stimulus is significantly higher than in neutral stimulus, indicated that when the human brain processes more complex cognitive tasks like incongruent stimuli, the strength of brain functional connectivity between bilateral frontal lobes became stronger. Previous studies pointed out that interhemispheric functional integration was involved during attentional processing (46), and interhemispheric functional integration led to superior performance (47). According to the functional connectivity analysis of the ipsilateral hemisphere, the functional connectivity within the left frontal lobe in both incongruent and neutral stimuli is significantly stronger than the right frontal lobe, and the functional connectivity within the left frontal lobe of the incongruent stimulus is significantly higher than the neutral stimulus.
This study indicated that the combination of EEG and fNIRS is meaningful for the exploration of cognitive functions. One previous study integrated EEG and fNIRS to record brain activity during Stroop tasks (15), which initiated our study. The previous study focused on the relationship between brain hemodynamic and electrophysiological signals in the time dimension but lacked analysis of brain effective connectivity and functional connectivity. And the previous study only put 16 detectors which covered the left and right prefrontal cortex. Our system employed more channels, covered larger brain regions, and can obtain more information on brain activity. In future studies, the bimodal research approach can be applied to more cognitive functional paradigms, such as n-back tasks (48), go/no-go tasks (49), flanker tasks (50), and so on. Bimodal techniques can also be used for joint analysis of EEG and fNIRS brain networks, or to develop multimodal data processing algorithms.
In this study, we explored the human brain region that plays the role of an initiator, local information processing, and how information flow transfers between brain regions during processing the Chinese color-word match Stroop task. The frontal lobes especially the left frontal lobe play the leading role in dealing with conflict tasks. When processing the more complex incongruent stimulus, the human brain shows leftward lateralization, presented as the left frontal lobe showing stronger functional connectivity, and the information flow is from the left frontal lobe to the right frontal lobe. Therefore, our study promotes the understanding of brain activity during cognitive conflict processing.
5. Conclusion
In this study, we employed a Chinese color-word match Stroop task, significant Stroop effects emerged according to a decrease in accuracy, increase in reaction time, and decrease in accuracy/reaction time in the incongruent stimulus, which was more complex. The ERP component N200 and P300 also showed significant Stroop effects manifested as a delay in the time of occurrence and an increase in peak in the incongruent stimulus. We found that the frontal lobes especially the left frontal lobes played the leading role when the human brain processes cognitive tasks. Compared with processing the neutral stimulus, the human brain showed leftward lateralization when dealing with the more complex incongruent stimulus, the ability of local information processing in the left frontal region enhanced, and the information flow manifested as an increase in global flow from the left frontal lobe to the right frontal lobe. The above fNIRS results indicated that when the human brain deals with conflict events, information processing seems to be mainly carried out in the left hemisphere, especially the left frontal lobe. However, in EEG results there were no such finding, and there were no lateralization differences. In EEG data and fNIRS data there were lateralization differences in functional activity during Stroop tasks, EEG showed no lateralization while fNIRS showed left lateralization. Therefore, it is necessary to combine EEG signals and fNIRS signals to analyze brain activity during cognitive detect and processing more comprehensively. It is valuable to apply the dual modality method combining EEG and fNIRS to excavate more information through cognitive and physiological studies.
Data availability statement
The original contributions presented in the study are included in the article/supplementary material, further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by the Clinical Research Ethics Committee of the First Affiliated Hospital, College of Medicine, Zhejiang University (IIT20210036C-R1). The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this study.
Author contributions
ZC completed most of the data collection and processing, and independently wrote the initial manuscript. XJ made suggestions for data processing and made revisions to the entire manuscript. CG provided advice on manuscript revision. GL helped with EEG brain connectivity analysis. SL helped with part of the data collection. TL and YZ contributed to the conceptualization of the study and participated in the revision, editing, and final approval of the manuscript. All authors read and approved the final manuscript.
Funding
This research was funded by the National Natural Science Foundation of China (grant no. 81971660), the Medical and Health Innovation Project (grant nos. 2021-I2M-1-042, 2021-I2M-1-058, and 2022-I2M-C&T-A-005), the Sichuan Science and Technology Program (grant no. 2021YFH0004), the Tianjin Outstanding Youth Fund Project (grant no. 20JCJQIC00230), and the Program of Chinese Institute for Brain Research in Beijing (grant no. 2020-NKX-XM-14).
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Footnotes
References
1. Holmes, AJ, and Pizzagalli, DA. Response conflict and frontocingulate dysfunction in unmedicated participants with major depression. Neuropsychologia. (2008) 46:2904–13. doi: 10.1016/j.neuropsychologia.2008.05.028
2. Sun, J, Zhai, J, Song, R, Zou, L, and Gong, H. Reduced prefrontal cortex activation in the color-word Stroop task for Chinese dyslexic children: a near-infrared spectroscopy study. J Phys Conf Ser. (2011) 277:277. doi: 10.1088/1742-6596/277/1/012034
3. Scarpina, F, and Tagini, S. The Stroop color and word test. Front Psychol. (2017) 8:557. doi: 10.3389/fpsyg.2017.00557
4. MacLeod, CM. The Stroop task in cognitive research In: A Wenzel and DC Rubin, editors. Cognitive methods and their application to clinical research : American Psychological Association (2005). 17–40. doi: 10.1037/10870-002
5. Stroop, JR. Studies of interference in serial verbal reactions. J Exp Psychol Anim Learn Cogn. (1935) 18:643–62. doi: 10.1037/h0054651
6. Logan, GD, Zbrodoff, NJ, and Williamson, J. Strategies in the color-word Stroop task. Bull Psychon Soc. (1984) 22:135–8. doi: 10.3758/BF03333784
7. Schroeter, ML, Zysset, S, Wahl, M, and von Cramon, DY. Prefrontal activation due to Stroop interference increases during development—an event-related fNIRS study. Neuroimage. (2004) 23:1317–25. doi: 10.1016/j.neuroimage.2004.08.001
8. Taniguchi, K, Sumitani, S, Watanabe, Y, Akiyama, M, and Ohmori, T. Multi-channel near-infrared spectroscopy reveals reduced prefrontal activation in schizophrenia patients during performance of the kana Stroop task. J Med Investig. (2012) 59:45–52. doi: 10.2152/jmi.59.45
9. Binnie, CD, and Prior, PF. Electroencephalography. J Neurol Neurosurg Psychiatry. (1994) 57:1308–19. doi: 10.1136/jnnp.57.11.1308
10. Michel, CM, and Murray, MM. Towards the utilization of EEG as a brain imaging tool. Neuroimage. (2012) 61:371–85. doi: 10.1016/j.neuroimage.2011.12.039
11. Pinti, P, Tachtsidis, I, Hamilton, A, Hirsch, J, Aichelburg, C, Gilbert, S, et al. The present and future use of functional near-infrared spectroscopy (fNIRS) for cognitive neuroscience. Ann N Y Acad Sci. (2020) 1464:5–29. doi: 10.1111/nyas.13948
12. Ehlis, AC, Schneider, S, Dresler, T, and Fallgatter, AJ. Application of functional near-infrared spectroscopy in psychiatry. Neuroimage. (2014) 85:478–88. doi: 10.1016/j.neuroimage.2013.03.067
13. Robertson, FC, Douglas, TS, and Meintjes, EM. Motion artifact removal for functional near infrared spectroscopy: a comparison of methods. IEEE Trans Biomed Eng. (2010) 57:1377–87. doi: 10.1109/TBME.2009.2038667
14. Li, R, Yang, D, Fang, F, Hong, KS, Reiss, AL, and Zhang, Y. Concurrent fNIRS and EEG for brain function investigation: a systematic, methodology-focused review. Sensors. (2022) 22:5865. doi: 10.3390/s22155865
15. Sun, J, Sun, B, Zhang, L, Luo, Q, and Gong, H. Correlation between hemodynamic and electrophysiological signals dissociates neural correlates of conflict detection and resolution in a Stroop task: a simultaneous near-infrared spectroscopy and event-related potential study. J Biomed Opt. (2013) 18:096014. doi: 10.1117/1.JBO.18.9.096014
16. Goenarjo, R, Bosquet, L, Berryman, N, Metier, V, Perrochon, A, Fraser, SA, et al. Cerebral oxygenation reserve: the relationship between physical activity level and the cognitive load during a Stroop task in healthy young males. Int J Environ Res Public Health. (2020) 17:1406. doi: 10.3390/ijerph17041406
17. Szűcs, D, Killikelly, C, and Cutini, S. Event-related near-infrared spectroscopy detects conflict in the motor cortex in a Stroop task. Brain Res. (2012) 1477:27–36. doi: 10.1016/j.brainres.2012.08.023
18. Näsi, T, Kotilahti, K, Noponen, T, Nissilä, I, Lipiäinen, L, and Meriläinen, P. Correlation of visual-evoked hemodynamic responses and potentials in human brain. Exp Brain Res. (2010) 202:561–70. doi: 10.1007/s00221-010-2159-9
19. Heidlmayr, K, Kihlstedt, M, and Isel, F. A review on the electroencephalography markers of Stroop executive control processes. Brain Cogn. (2020) 146:105637. doi: 10.1016/j.bandc.2020.105637
20. Liotti, M, Woldorff, MG, Perez, R III, and Mayberg, HS. An ERP study of the temporal course of the Stroop color-word interference effect. Neuropsychologia. (2000) 38:701–11. doi: 10.1016/S0028-3932(99)00106-2
21. Tillman, CM, and Wiens, S. Behavioral and ERP indices of response conflict in Stroop and flanker tasks. Psychophysiology. (2011) 48:1405–11. doi: 10.1111/j.1469-8986.2011.01203.x
22. Šverko, Z, Vrankić, M, Vlahinić, S, and Rogelj, P. Complex Pearson correlation coefficient for EEG connectivity analysis. Sensors. (2022) 22:1477. doi: 10.3390/s22041477
23. Masjoodi, S, Fooladi, M, Jalalvandi, M, Vosoughi, R, and Khabiri, H. Identification of the cognitive interference effect related to Stroop stimulation: using dynamic causal modeling of effective connectivity in functional near-infrared spectroscopy (fNIRS). J Biomed Phys Eng. (2020) 10:467. doi: 10.31661/jbpe.v0i0.1174
24. Zysset, S, Müller, K, Lohmann, G, and von Cramon, DY. Color-word matching Stroop task: separating interference and response conflict. Neuroimage. (2001) 13:29–36. doi: 10.1006/nimg.2000.0665
25. Poser, BA, and Norris, DG. Application of whole-brain CBV-weighted fMRI to a cognitive stimulation paradigm: robust activation detection in a Stroop task experiment using 3D GRASE VASO. Hum Brain Mapp. (2010) 32:974–81. doi: 10.1002/hbm.21083
26. Yang, D, Huang, R, Yoo, SH, Shin, MJ, Yoon, JA, Shin, YI, et al. Detection of mild cognitive impairment using convolutional neural network: temporal-feature maps of functional near-infrared spectroscopy. Front Aging Neurosci. (2020) 12:141. doi: 10.3389/fnagi.2020.00141
27. Zhang, Z, Sun, B, Gong, H, Zhang, L, Sun, J, Wang, B, et al. A fast neuronal signal-sensitive continuous-wave near-infrared imaging system. Rev Sci Instrum. (2012) 83:094301. doi: 10.1063/1.4752021
28. Folstein, JR, and Van Petten, C. Influence of cognitive control and mismatch on the N2 component of the ERP: a review. Psychophysiology. (2008) 45:152–70. doi: 10.1111/j.1469-8986.2007.00602.x
29. Azizian, A, and Polich, J. Evidence for attentional gradient in the serial position memory curve from event-related potentials. J Cogn Neurosci. (2007) 19:2071–81. doi: 10.1162/jocn.2007.19.12.2071
30. Duncan, A, Meek, JH, Clemence, M, Elwell, CE, Fallon, P, Tyszczuk, L, et al. Measurement of cranial optical path length as a function of age using phase resolved near infrared spectroscopy. Pediatr Res. (1996) 39:889–94. doi: 10.1203/00006450-199605000-00025
31. Friston, KJ. Functional and effective connectivity: a review. Brain Connect. (2011) 1:13–36. doi: 10.1089/brain.2011.0008
32. Holper, L, Scholkmann, F, and Wolf, M. Between-brain connectivity during imitation measured by fNIRS. Neuroimage. (2012) 63:212–22. doi: 10.1016/j.neuroimage.2012.06.028
33. Seth, AK. A MATLAB toolbox for granger causal connectivity analysis. J Neurosci Methods. (2010) 186:262–73. doi: 10.1016/j.jneumeth.2009.11.020
34. Schwarz, G. Estimating the dimension of a model. Ann Stat. (1978) 6:461–4. doi: 10.1214/aos/1176344136
35. Yang, D, and Hong, KS. Quantitative assessment of resting-state for mild cognitive impairment detection: a functional near-infrared spectroscopy and deep learning approach. J Alzheimers Dis. (2021) 80:647–63. doi: 10.3233/JAD-201163
36. Torrence, C, and Compo, GP. A practical guide to wavelet analysis. Bull Am Meteorol Soc. (1998) 79:61–78. doi: 10.1175/1520-0477(1998)079<0061:APGTWA>2.0.CO;2
37. Cui, X, Bryant, DM, and Reiss, AL. NIRS-based hyperscanning reveals increased interpersonal coherence in superior frontal cortex during cooperation. Neuroimage. (2012) 59:2430–7. doi: 10.1016/j.neuroimage.2011.09.003
38. Grinsted, A, Moore, JC, and Jevrejeva, S. Application of the cross wavelet transform and wavelet coherence to geophysical time series. Nonlinear Process Geophys. (2004) 11:561–6. doi: 10.5194/npg-11-561-2004
39. Yoo, SH, Woo, SW, Shin, MJ, Yoon, JA, Shin, YI, and Hong, KS. Diagnosis of mild cognitive impairment using cognitive tasks: a functional near-infrared spectroscopy study. Curr Alzheimer Res. (2020) 17:1145–60. doi: 10.2174/1567205018666210212154941
40. Sahni, P, and Kumar, J. Effect of nature experience on fronto-parietal correlates of neurocognitive processes involved in directed attention: an ERP study. Ann Neurosci. (2020) 27:136–47. doi: 10.1177/0972753121990143
41. Pfefferbaum, A, Ford, JM, Weller, BJ, and Kopell, BS. ERPs to response production and inhibition. Electroencephalogr Clin Neurophysiol. (1985) 60:423–34. doi: 10.1016/0013-4694(85)91017-X
42. Ila, AB, and Polich, J. P300 and response time from a manual Stroop task. Clin Neurophysiol. (1999) 110:367–73. doi: 10.1016/S0168-5597(98)00053-7
43. Norris, DG, Zysset, S, Mildner, T, and Wiggins, CJ. An investigation of the value of spin-echo-based fMRI using a Stroop color–word matching task and EPI at 3 T. Neuroimage. (2002) 15:719–26. doi: 10.1006/nimg.2001.1005
44. Schroeter, ML, Zysset, S, Kupka, T, Kruggel, F, and Von Cramon, DY. Near-infrared spectroscopy can detect brain activity during a color–word matching Stroop task in an event-related design. Hum Brain Mapp. (2002) 17:61–71. doi: 10.1002/hbm.10052
45. Gao, C, Shu, L, and Li, T. Studying hemispheric lateralization of 4-month-old infants from different language groups through near-infrared spectroscopy-based connectivity. Front Psych. (2022) 13:1049719. doi: 10.3389/fpsyt.2022.1049719
46. Banich, MT. The missing link: the role of interhemispheric interaction in attentional processing. Brain Cogn. (1998) 36:128–57. doi: 10.1006/brcg.1997.0950
47. Banich, MT. Integration of information between the cerebral hemispheres. Curr Dir Psychol Sci. (1998) 7:32–7. doi: 10.1111/1467-8721.ep11521844
48. Jaeggi, SM, Buschkuehl, M, Perrig, WJ, and Meier, B. The concurrent validity of the N-back task as a working memory measure. Memory. (2010) 18:394–412. doi: 10.1080/09658211003702171
49. Nosek, BA, and Banaji, MR. The go/no-go association task. Soc. Cognition. (2001) 19:625–66. doi: 10.1521/soco.19.6.625.20886
Keywords: lateralization difference, functional near-infrared spectroscopy, electroencephalogram, brain connectivity analysis, event-related potential, Stroop task
Citation: Chen Z, Ji X, Li T, Gao C, Li G, Liu S and Zhang Y (2023) Lateralization difference in functional activity during Stroop tasks: a functional near-infrared spectroscopy and EEG simultaneous study. Front. Psychiatry. 14:1221381. doi: 10.3389/fpsyt.2023.1221381
Edited by:
Dalin Yang, Washington University in St. Louis, United StatesReviewed by:
Zengyong Li, National Research Center for Rehabilitation Technical Aids, ChinaJinyan Sun, The Third Affiliated Hospital of Foshan University, China
Keum-Shik Hong, Pusan National University, Republic of Korea
Copyright © 2023 Chen, Ji, Li, Gao, Li, Liu and Zhang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Ting Li, liting@bme.cams.cn