A commentary has been posted on this article:
Commentary: Functional Connectivity in the Left Dorsal Stream Facilitates Simultaneous Language Translation: An EEG Study
Stefan Elmer*
Jürg Kühnis- Auditory Research Group Zurich (ARGZ), Division Neuropsychology, Institute of Psychology, University of Zurich, Zurich, Switzerland
Cortical speech processing is dependent on the mutual interdependence of two distinctive processing streams supporting sound-to-meaning (i.e., ventral stream) and sound-to-articulation (i.e., dorsal stream) mapping. Here, we compared the strengths of intracranial functional connectivity between two main hubs of the dorsal stream, namely the left auditory-related cortex (ARC) and Broca’s region, in a sample of simultaneous interpreters (SIs) and multilingual control subjects while the participants performed a mixed and unmixed auditory semantic decision task. Under normal listening conditions such kind of tasks are known to initiate a spread of activation along the ventral stream. However, due to extensive and specific training, here we predicted that SIs will more strongly recruit the dorsal pathway in order to pre-activate the speech codes of the corresponding translation. In line with this reasoning, EEG results demonstrate increased left-hemispheric theta phase synchronization in SLI compared to multilingual control participants during early task-related processing stages. In addition, within the SI group functional connectivity strength in the left dorsal pathway was positively related to the cumulative number of training hours across lifespan, and inversely correlated with the age of training commencement. Hence, we propose that the alignment of neuronal oscillations between brain regions involved in “hearing” and “speaking” results from an intertwining of training, sensitive period, and predisposition.
Introduction
Different experimental approaches have demonstrated that the speech perception and production systems are tightly coupled (Liberman and Mattingly, 1985). Such an interrelationship can, for example, be observed in congenitally deaf individuals who often achieve only rudimentary speech competence (Smith, 1975). On the other side, altered auditory feedback has a disruptive effect on speech production (Yates, 1963; Houde and Jordan, 1998), and subjects suffering from dysarthria or Broca aphasia are often accompanied by language comprehension deficits (Hustad and Beukelman, 2002; Davis et al., 2008).
The arcuate fasciculus (AF) is part of the dorsal processing stream (Makris et al., 2005; Hickok and Poeppel, 2007) and connects the posterior bank of the supratemporal plane with the ventral prefrontal cortex (i.e., Broca’s area; Makris et al., 2005; Rilling et al., 2008). The AF is strongly lateralized to the left hemisphere (Catani and Mesulam, 2008; Glasser and Rilling, 2008) and integrates auditory information with the frontal articulatory system. Otherwise, the inferior longitudinal fasciculus (ILF) is part of the ventral stream (Hickok and Poeppel, 2007), stretches from occipitotemporal regions toward the temporal pole (Dick et al., 2014), and constitutes the anatomical correlate underlying sound-to-meaning mapping (Almairac et al., 2014).
The medial-dorsal bank of the supratemporal plane is part of the auditory-related cortex (ARC; Geschwin and Levitsky, 1968; Galaburda et al., 1978; Steinmetz et al., 1991; Jäncke and Steinmetz, 2004) and behaves as a computational hub by segregating spectrotemporal information (Griffiths and Warren, 2002). This brain region is essentially involved in phonetic processes (Jäncke et al., 2002; Osnes et al., 2011; Elmer et al., 2012), language comprehension functions (Tzourio et al., 1998a,b) and can serve as a marker for left hemispheric language specialization (Tzourio et al., 1998a,b; Josse et al., 2003; Josse and Tzourio-Mazoyer, 2004). In addition, due to its anatomical location, the ARC acts as an interface between sound-to-meaning and sound-to-articulation mapping mechanisms. Broca’s region is engaged in a variety of different cognitive- (Fedorenko et al., 2012; Makuuchi and Friederici, 2013), linguistic- (Grodzinsky and Friederici, 2006; Grodzinsky and Santi, 2008), and speech-related functions (Eickhoff et al., 2009; Moser et al., 2009). There is even evidence indicating that this brain region, in association with other circuits, is implicated in the orchestration of the articulatory system and of paramount importance for the planning and execution of articulatory processes (Eickhoff et al., 2009).
SIs are specifically trained in translating a source- into a target language quasi simultaneously (Elmer, 2012). During such a task, auditory speech cues have to reliably be associated with lexical/semantic representations along the ventral stream as well as to be coupled with the dorsal articulatory system with minimal time delay. Since the ARC has previously been proposed to behave as an interface between sound-to-meaning and sound-to-articulation mapping mechanisms (Hickok and Poeppel, 2007), and Broca’s region constitutes a main hub within the articulatory system, here we evaluated functional connectivity between these two brain regions in professional SIs and multilingual control subjects while the participants performed a mixed and unmixed semantic decision task.
Materials and Methods
Participants
We measured a sample of professional SIs [principally interpreting from English (L2) to German (L1), totally 12, 10 women, mean age = 37.9 years, SD = 6.9 years] and multilingual controls participants (totally 12, 9 women, mean age = 39 years, SD = 4.7 years). All participants were consistently right-handed, as revealed by the Annett Handedness Inventory (Annett, 1970), and were native German speakers with a good English listening comprehension (DIALANG1). The two groups were matched for age, gender, L2 proficiency, age of L2 acquisition, and education (i.e., University degree). None of the participants reported a history of neurological, psychiatric or audiological disorders (Home Audiometer Software2) and all participants denied consumption of illegal drugs or regular medication. The participants were paid for participation, the local ethics committee approved the study, and written informed consent was obtained. Table 1 provides an overview of the biographical and behavioral data.
TABLE 1
Table 1. Autobiographical and behavioral data of the participants.
Semantic Decision Task
In the context of a block design (i.e., each language direction was presented in a different block), the participants performed four runs of a mixed [German-English (GE) and English-German (EG)] and unmixed [German-German (GG) and English-English (EE)] semantic decision task, consisting in judging whether two consecutive presented disyllabic nouns are semantically congruent (67 word pairs in each language direction; e.g., EE: journey-travel; GG: Fahrstuhl-Aufzug; GE: Flasche-bottle; EG: damage-Schaden) or incongruent (67 word pairs in each language direction; e.g., EE: traffic-poison; GG: Ampel-Rücken; GE: König-surprise; EG: flower-Hafen) by pressing the corresponding response keys (Elmer et al., 2010).
Stimulus Material and Procedure
The linguistic stimuli were used in a previous work of our group (Elmer et al., 2010), spoken by a bilingual German-Canadian female speaker, registered as 16 bit stereo files, and matched for intensity by using the Adobe Audition software (Adobe Audition 1.5). The stimuli were presented binaurally with a sound pressure level of about 50 dB (SPL, Digital Sound Level Meter 329, Voltcraft) by using HIFI-headphones (Sennheiser, HD 25–1, 70 Ω, Ireland), matched for syllables length (disyllabic nouns), word frequency3, and double checked by a professional linguist for plausibility. The auditory stimuli had a mean duration of 800 ms, the inter-stimulus interval between noun-pairs was of 1600 ms, and the inter-trial interval corresponded to 1200 ms after response selection (Elmer et al., 2010). Stimulus presentation and recording of responses were controlled by the Presentation software.4
EEG Data Acquisition and Pre-Processing
Participants seated in a dimmed and acoustically shielded room at about 110 cm distance from a monitor and were instructed to fixate a cross presented at the center of the screen in order to minimize eye movements during EEG recording. Continuous EEG (57 electrodes + 2 eye channels, provided by Easy Cap) was recorded with a sampling rate of 500 Hz and a high pass filter of 0.1 Hz by using an EEG-amplifier (Brainproducts, Munich, Germany). The electrodes (sintered silver/silver-chloride) were located at frontal, temporal, parietal and occipital scalp sites according to the international 10–10 system (Fp1, Fp2, AF3, AF4, F7, F5, F3, F1, Fz, F2, F4, F6, F8, FT7, FC5, FC3, FC1, FCz, FC2, FC4, FC6, FT8, T7, C5, C3, C1, Cz, C2, C4, C6, T8, TP7, CP5, CP3, CP1, CPz, CP2, CP4, CP6, TP8, P7, P5, P3, P1, Pz, P2, P4, P6, P8, PO7, PO3, POz, PO4, PO8, O1, Oz, O2). The online reference electrode was placed over the left mastoid (TP9), and electrode impedance was reduced to <10 kΩ by using electrogel conductant. For all pre-processing steps, we used the Brain Vision Analyser Software Package (Version 2.01, Brainproducts, Munich, Germany). Data were re-referenced offline to an average reference, filtered from 0.1 to 30 Hz, and artifacts were corrected by using an independent component analysis (ICA; Jung et al., 2000) in association with a semi-automatic raw data inspection. After data pre-processing and baseline correction relative to the −100 to 0 ms prestimulus time period, the brain responses to the first word, as well as the ISI period (central period between the two single nouns), were segmented into single sweeps of 800 ms, and data were subjected to intracranial functional connectivity analyses by using the eLORETA toolbox. Functional connectivity in response to the second word was not evaluated because more likely reflecting semantic matching processes than sensory-to-articulation coupling mechanisms.
Intracranial Functional Connectivity Analyses
Functional connectivity was evaluated in the same way as in a previous work of our group (Elmer et al., 2015) by estimating intracranial lagged phase-synchronization and by using the eLORETA Software Package.5 Lagged phase synchronization is a measure for the similarity (a corrected phase synchrony value) between signals in the frequency domain based on normalized (unit module) Fourier transforms; thus it is related to nonlinear functional connectivity. This lagged connectivity measure is accurately corrected as it represents the connectivity between two signals after the instantaneous zero-lag contribution has been excluded (Nolte et al., 2004; Stam and van Straaten, 2012). Such a correction is preferable when using scalp EEG signals or estimated intracranial signals (EEG tomography), because zero-lag connectivity in a given frequency band is often due to non-physiological effects or intrinsic physics artifacts. In particular, volume conduction and low spatial resolution that usually affect other connectivity indices. Thus, this measure is thought to contain only true physiological connectivity information.
In the current implementation of eLORETA, computations were made within a realistic head model (Fuchs et al., 2002), using the MNI 152 template (Mazziotta et al., 2001), with the three-dimensional solution space restricted to cortical gray matter, as determined by the probabilistic Talairach atlas (Lancaster et al., 2000). The intracranial volume is partitioned in 6239 voxels at 5 mm spatial resolution. eLORETA images represent the electric activity at each voxel in neuroanatomic Montreal Neurological Institute (MNI) space as the exact magnitude of the estimated current density. Anatomical labels as Brodmann areas (BA) are reported using MNI space, with correction to Talairach space (Brett et al., 2002).
For intracranial functional connectivity analyses, we selected two a-priori defined regions of interest (ROIs) in the left hemisphere (Figure 1). These two ROIs consisted of BA 41/42 (ROI 1, left ARC) and left BA 44/45 (ROI 2, Broca’s region). Intracranial connectivity between the two left-sided ROIs was evaluated based on a specific a-priori hypothesis. In addition, the same two ROIs in the right hemisphere were used as control regions. For functional connectivity analyses between the two ROIs, a method using a single voxel at the centroid of the BAs was chosen (Elmer et al., 2015). Details on eLORETA connectivity algorithms can be found in previous reports by Pascual-Marqui et al. (2011). For each group, eLORETA functional connectivity was only computed in the theta frequency band (θ; ~4–7 Hz). In fact, previous work has repeatedly shown that theta oscillations constitute salient markers of information integration (Ward, 2003) and neuronal communication between distinct brain regions over long-range circuits (Ward, 2003; Polanía et al., 2012; Elmer et al., 2015).
FIGURE 1
Figure 1. Regions of interest (ROIs) position within the 3D MNI space. Left: transversal view; middle: sagittal view; right: coronal view.
Statistical Analyses
Prior to statistical analyses, all data (autobiographical-, behavioral-, and EEG data) were tested for normal distribution by using the Kolmogorov-Smirnov procedure (p > 0.25). Normal The data were analyzed by using analyses of variance (ANOVA) as well as parametric correlations (according to Pearson’s r). Since the cumulative number of training hours as well as functional connectivity is dependent on age (Satterthwaite et al., 2013), the relationship between these two variables was assessed by using partial correlations (i.e., corrected for the influence of age). English listening comprehension was evaluated by means of a Mann-Whitney-U test.
Results
Autobiographical and Behavioral Data
The two groups did not differ in age (t(22) = −0.452, p = 0.656, two-tailed), in age of L2 acquisition (t(22) = −0.971, p = 0.342, two-tailed), nor in L2 listening comprehension (i.e., proficiency level from a1 to c2 was coded numerically from 1 to 6; Mann-Whitney-U = 62, p = 0.488, two-tailed).
Error scores during the semantic decision task were evaluated by a 2 × 4 ANOVA (2 groups; 4 language directions). This procedure revealed significant effects of “language direction” (F(1,22) = 28.142, p = 0.000025) and “group” (F(1,22) = 7.935, p = 0.010) as well as a significant “language direction” × “group” interaction effect (F(1,22) = 8.439, p = 0.008). Post hoc t-tests for independent samples only reached significance in the language direction English-English (EE: t(22) = −3.723, p = 0.001; EG: t(22) = −0.921, p = 0.367; GE: t(22) = −0.875, p = 0.391; GG: t(22) = 0.054, p = 0.12; two–tailed). Taken together, the most errors were committed in the EE condition, whereas the main effect of “group” as well as the “group” × “language direction” interaction effect originated from a better performance of SIs during the EE condition (Figure 2).
FIGURE 2
Figure 2. Behavioral results of the semantic decision task. SLI, simultaneous language interpreters; C, multilingual control participants; GG, German-German; GE, German-English; EG, English-German; EE, English-English. Error bars depict standard error. ***p < 0.001.
Intracranial Functional Connectivity
Functional connectivity data were subjected to an omnibus 2 × 2 × 2 × 4 ANOVA [2 groups, 2 hemispheres, 2 processing stages (i.e., first word and ISI), and 4 language directions]. Results revealed a main effect of “processing stage” (F(1,22) = 26.266, p = 0.001) as well as a significant “group” × “hemisphere” × “processing stage” interaction (F(1,22) = 5.511, p = 0.028). Additional separate 2 × 2 × 4 analyses for each hemispheres (2 groups, 2 processing stages, and 4 language directions] revealed a main effect of “group” (F(1,22) = 4.908, p = 0.037), of “processing stage” (F(1,22) = 15.907, p = 0.001), as well as a significant significant “group” × “processing stage” interaction effect (F(1,22) = 6.959, p = 0.015) in the left hemisphere. Figure 3 indicates that the main effect of “group” as well as the significant “group” × “processing stage” interaction effect originate from an increased left-sided functional connectivity in the SIs group while processing the first word (i.e., processing stage 1), irrespective of language direction (i.e., mixed or unmixed conditions). The main effect of “processing stage” was related to an increased θ phase alignment in the left dorsal pathway in response to the first word, irrespective of group affiliation. By contrast, right-hemispheric analysis revealed a significant main effect of “processing stage” that originated from increased connectivity during processing stage 1 (F(1,22) = 14.254, p = 0.001), irrespective of group.
FIGURE 3
Figure 3. Functional connectivity values between the left ARC and Broca’s region are depicted separately for the 2 groups, the 2 processing stages (i.e., 1. PS and 2. PS), and the 4 language directions. GG, German-German; GE, German-English; EG, English-German; EE, English-English. Error bars indicate standard error. *p < 0.05.
Relationships Between Intracranial Connectivity and Biographical Data
Based on the results, we additionally investigated putative relationships between mean functional connectivity during the first processing stage (mean connectivity values across all language directions) and age of commencement of interpreting training. Furthermore, in order to address training-related changes in functional connectivity, we performed partial correlations (corrected for the influence of age) between left-hemispheric connectivity and the cumulative number of training hours across lifespan. Results demonstrate a negative relationship between age of commencement and mean functional connectivity (Person’s r, r = −0.536, p = 0.036, one-tailed). In addition, we revealed a significant positive correlation between mean connectivity and the cumulative number of training hours across lifespan (partial correlation, r = 0.576, p = 0.032). These results indicate that the increased functional connectivity we observed in professional SIs results from an intertwining of sensitive period and training intensity (Figure 4). However, since from Figure 4 it becomes visible that one SI started quite late with interpreting, we re-performed all correlative analyses by excluding this specific individual. Results still revealed a significant relationship between the cumulative number of training hours and mean left-sided connectivity (r = 0.643, p = 0.023), whereas the correlation between age of commencement and mean connectivity failed to reach significance (r = −0.242, p = 0.237).
FIGURE 4
Figure 4. This figure shows the negative correlation between mean functional connectivity and age of training commencement (A), and the positive relationship between cumulative number of training hours and mean connectivity (partial correlation) (B). The partial correlation is depicted by plotting residual values of training (age) against connectivity (age).
Discussion
The main assumption of the present work was that the strong demands placed on sensory-to-articulation mapping mechanisms in SIs will have a distinctive influence on the temporal alignment of neural oscillations between the left ARC and Broca’s region. Therefore, here we evaluated θ phase synchronization between these two main hubs of the dorsal stream in both hemispheres while participants performed a mixed and unmixed auditory semantic decision task. Usually, in similar linguistic conditions brain activity spreads along the ventral processing stream by initiating a cascade of neuronal processes mirroring lexical-semantic representations (Visser and Lambon Ralph, 2011; Marconi et al., 2013). However, due to extensive and specific practice of SIs, here we predicted that this specific subgroup of participants will more strongly pre-activate the dorsal stream that is necessarily involved when it comes to anticipate the articulatory code of the corresponding translation (Price et al., 1999; Quaresima et al., 2001). Exactly this perspective is supported by our results. In fact, EEG data revealed a significant “group” × “hemisphere” × “processing stage” interaction effect (Figure 3), suggesting an earlier and more pronounced recruitment of the left dorsal stream in SIs. Most notably, functional connectivity strengths significantly correlated with the age of training commencement and the cumulative number of training hours, indicating training-related changes as well as the influence of sensitive periods. Finally, the same analysis also yielded a main effect of “processing stages” irrespective of group affiliation, a result that reinforces the general mutual interdependence of the speech perception and production systems (Liberman and Mattingly, 1985).
Certainly, simultaneous translation constitutes a linguistic task that places demands on the ventral pathway in order to access lexical-semantic knowledge in the target language. However, this is even true for multilingual participants, especially when they do not differ in age of L2 acquisition and are characterized by a comparable L2 proficiency level (Perani and Abutalebi, 2005; Elmer et al., 2010). By contrast, the continuous conveyance of an input into a target language with a minimal time delay (while at the same time adapting the linguistic structure of the output sentence) can hardly be achieved by multilingual speaker who are not specifically trained in such a complex linguistic task. Consequently, it appears natural to assume that simultaneous translation places more distinctive functional demands on the dorsal processing stream, a circuit that is not only involved in sound-to-articulation mapping (Price et al., 1999; Rinne et al., 2000; Hickok and Poeppel, 2007) but also in the coordination of syntactical aspects of speech in a time-dependent manner (Bornkessel-Schlesewsky and Schlesewsky, 2013). Since results demonstrate an overall increased functional connectivity in SIs, irrespective of language direction, here we propose that the functional coupling between the left ARC and Broca’s region more likely reflects a domain-general process that originates from the time constraints placed on sound-to-articulation synchronization mechanisms rather than linguistic functions per se. In particular, we propose that professional interpreting training leads to an automatic co-activation of these two brain regions which are involved in a variety of linguistic, articulatory, and cognitive processes.
It results obvious that the extreme processing demands placed on simultaneous language translation cannot simply be considered as a magnification of the processing requirements engaged in multilingual speech processing. Otherwise, this perspective enables to set important premises for better understanding the neuronal circuits underlying speech processing in association with expertise. In this context, important steps forward have been made regarding the cortical representation of multiple languages (for an overview consider Sebastian et al., 2011) as well as the associated cognitive control mechanisms that are necessarily engaged for avoiding interferences between the different languages (Rodriguez-Fornells et al., 2006; Abutalebi and Green, 2007; Bialystok and Poarch, 2014; Costa and Sebastián-Gallés, 2014).
Most relevant for the the present work are especially studies providing evidence for a selective influence of multilingual speech processing and language expertise on the functional-anatomical architecture of the dorsal part of the ARC and Broca’s region. This perspective is driven by the reasoning that the ramification of multilingual speech processing on the functional-anatomical malleability of these two specific brain regions constitutes the bearing skeleton beyond the increased phase alignment we observed in SIs. In this context, there are at least some studies in earnest showing such an influence. For example, Simmonds et al. (2011) performed fMRI measurements while bilingual participants articulated concatenated sentences in L1 and L2. Results revealed an increased blood-oxygen-level dependent (BOLD) response in the ARC while articulating in L2 compared to L1, possibly reflecting increased demands placed on the integration of predictive feedforward and post-articulatory feedback processes (Simmonds et al., 2011). In addition, by evaluating brain structures in phoneticians and non-phoneticians, Golestani et al. (2011) observed a relationship between expertise and the morphology of the ARC. In the same work, the researchers also reported a positive correlation between the volume of left Broca pars opercularis and the number of years of phonetic transcription training. Finally, at least other two studies (Golestani et al., 2007; Wong et al., 2008) reported a positive correlation between the ability to perceive foreign speech sounds and ARC volume, and a further one found evidence for plasticity effects in the ARC of bilingual participants (Ressel et al., 2012). Certainly, the results of these previous studies cannot be directly compared to interpreting training. However, they provide at least evidence for brain changes in the two main hubs of the dorsal pathway in association with expertise in different domains.
There is evidence showing that language translation is strongly dependent on the recruitment of the left dorsal pathway, in both SIs (Rinne et al., 2000; for a comprehensive review on SIs consider Elmer, 2012) and multilingual participants (Price et al., 1999; Hervais-Adelman et al., 2015). Previous work (Elmer et al., 2014) more specifically focusing on plasticity effects in SIs (compared to multilingual control participants) reported (among other areas) an altered gray matter architecture in Broca’s region and in the left supramarginal gyrus, the latter being part of ARC (Caspers et al., 2006; for comparable results in bilinguals consider Golestani and Pallier, 2007). Most interestingly, the volume of Broca’s area correlated with the cumulative number of training hours across lifespan, indicating training-related changes. In a further DTI study performed with the same population (Elmer et al., 2011), the same authors found white matter differences between SIs and multilingual control participants in the left supramarginal gyrus (for comparable results in bilinguals consider Mechelli et al., 2004) as well as in the extreme capsule, a fiber tract that connects Broca’s area with the left anterior insula, a brain structure that has been proposed to support (among other functions) articulation of speech and phonation (Eickhoff et al., 2009; Ackermann and Riecker, 2010). Finally, a recent EEG study (Elmer et al., 2014) brought to light differential event-related brain responses to morphed speech stimuli in SIs, compared to control participants, during early stages of auditory processing. An alternative plausible interpretation of the results is that due to intensive training SIs require fewer demands to perform the task and that the automatic recruitment of the dorsal stream reflects higher dexterity. This perspective is partially supported by the behavioral data showing that SIs committed fewer errors during the task, especially in the EE condition. Furthermore, we cannot exclude that the increased functional connectivity we observed in SIs may reflect a top-down control of audition (Geranmayeh et al., 2014) or even higher prediction processes.
In summary, based on our results, we propose that in SIs “hearing” and “speaking” are tightly coupled in time, in such a manner that this distinctive and training-related electrophysiological signature can saliently be detected by evaluating functional connectivity in the left dorsal pathway. This is an important step toward a holistic and integrative understanding of the speech perception and production systems in the context of multilingual speech processing. Certainly, the reciprocal influence of the ventral and dorsal pathway on the two main hubs described, as well as the contribution of working memory functions, have to be described in more detail. The same is true for the influence of auto-biographical and genetic features and its relationships to functional and structural plasticity.
Author Contributions
SE collected the data, performed the statistical analyses, and wrote the manuscript. JK was involved in the connectivity analyses.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
This research was supported by the Swiss National Science Foundation (SNF, Grant No. 320030-120661 and Grant No. 4-62341-05 to Prof. Lutz Jäncke). We would like to thank Prof. Lutz Jäncke for providing us the necessary infrastructure, the EEG equipment, as well as for the financial support.
Footnotes
- ^ www.lancaster.ac.uk/researchenterprise/dialang/dialang_technical
- ^ www.esseraudio.com/de/home-audiometer-hoertest.html
- ^ www.corpora.uni-leipzig.de/
- ^ www.neurobs.com
- ^ www.uzh.ch/keyinst/loreta.htm
References
Abutalebi, J., and Green, D. (2007). Bilingual language production: the neurocognition of language representation and control. J. Neurolinguistics. 20, 242–275. doi: 10.1016/j.jneuroling.2006.10.003
Ackermann, H., and Riecker, A. (2010). The contribution(s) of the insula to speech production: a review of the clinical and functional imaging literature. Brain Struct. Funct. 214, 419–433. doi: 10.1007/s00429-010-0257-x
Almairac, F., Herbet, G., Moritz-Gasser, S., de Champfleur, N. M., and Duffau, H. (2014). The left inferior fronto-occipital fasciculus subserves language semantics: a multilevel lesion study. Brain Struct. Funct. 220, 1983–1995. doi: 10.1007/s00429-014-0773-1
Annett, M. (1970). A classification of hand preference by association analysis. Br. J. Psychol. 61, 303–321. doi: 10.1111/j.2044-8295.1970.tb01248.x
Bialystok, E., and Poarch, G. J. (2014). Language experience changes language and cognitive ability. Z. Erziehwiss. 17, 433–446. doi: 10.1007/s11618-014-0491-8
Bornkessel-Schlesewsky, I., and Schlesewsky, M. (2013). Reconciling time, space and function: a new dorsal-ventral stream model of sentence comprehension. Brain Lang. 125, 60–76. doi: 10.1016/j.bandl.2013.01.010
Brett, M., Johnsrude, I. S., and Owen, A. M. (2002). The problem of functional localization in the human brain. Nat. Rev. Neurosci. 3, 243–249. doi: 10.1038/nrn756
Caspers, S., Geyer, S., Schleicher, A., Mohlberg, H., Amunts, K., and Zilles, K. (2006). The human inferior parietal cortex: cytoarchitectonic parcellation and interindividual variability. Neuroimage 33, 430–448. doi: 10.1016/j.neuroimage.2006.06.054
Catani, M., and Mesulam, M. (2008). The arcuate fasciculus and the disconnection theme in language and aphasia: history and current state. Cortex 44, 953–961. doi: 10.1016/j.cortex.2008.04.002
Costa, A., and Sebastián-Gallés, N. (2014). How does the bilingual experience sculpt the brain? Nat. Rev. Neurosci. 15, 336–345. doi: 10.1038/nrn3709
Davis, C., Kleinman, J. T., Newhart, M., Gingis, L., Pawlak, M., and Hillis, A. E. (2008). Speech and language functions that require a functioning Broca’s area. Brain Lang. 105, 50–58. doi: 10.1016/j.bandl.2008.01.012
Dick, A. S., Bernal, B., and Tremblay, P. (2014). The language connectome: new pathways, new concepts. Neuroscientist 20, 453–467. doi: 10.1177/1073858413513502
Eickhoff, S. B., Heim, S., Zilles, K., and Amunts, K. (2009). A systems perspective on the effective connectivity of overt speech production. Philos. Trans. A Math. Phys. Eng. Sci. 367, 2399–2421. doi: 10.1098/rsta.2008.0287
Elmer, S. (2012). The investigation of simultaneous interpreters as an alternative approach to address the signature of multilingual speech processing. Z. Neuropsychol. 23, 105–116.doi: 10.1024/1016-264x/a000068
Elmer, S., Hänggi, J., and Jäncke, L. (2014). Processing demands upon cognitive, linguistic and articulatory functions promote grey matter plasticity in the adult multilingual brain: insights from simultaneous interpreters. Cortex 54, 179–189. doi: 10.1016/j.cortex.2014.02.014
Elmer, S., Hänggi, J., Meyer, M., and Jäncke, L. (2011). Differential language expertise related to white matter architecture in regions subserving sensory-motor coupling, articulation and interhemispheric transfer. Hum. Brain Mapp. 32, 2064–2074. doi: 10.1002/hbm.21169
Elmer, S., Klein, C., Kühnis, J., Liem, F., Meyer, M., and Jäncke, L. (2014). Music and language expertise influence the categorization of speech and musical sounds: behavioral and electrophysiological measurements. J. Cogn. Neurosci. 26, 2356–2369. doi: 10.1162/jocn_a_00632
Elmer, S., Rogenmoser, L., Kühnis, J., and Jäncke, L. (2015). Bridging the gap between perceptual and cognitive perspectives on absolute pitch. J. Neurosci. 35, 366–371. doi: 10.1523/JNEUROSCI.3009-14.2015
Elmer, S., Meyer, M., and Jäncke, L. (2010). Simultaneous interpreters as a model for neuronal adaptation in the domain of language processing. Brain Res. 1317, 147–156. doi: 10.1016/j.brainres.2009.12.052
Elmer, S., Meyer, M., and Jäncke, L. (2012). Neurofunctional and behavioral correlates of phonetic and temporal categorization in musically trained and untrained subjects. Cereb. Cortex 22, 650–658. doi: 10.1093/cercor/bhr142
Fedorenko, E., Duncan, J., and Kanwisher, N. (2012). Language-selective and domain-general regions lie side by side within Broca’s area. Curr. Biol. 22, 2059–2062. doi: 10.1016/j.cub.2012.09.011
Fuchs, M., Kastner, J., Wagner, M., Hawes, S., and Ebersole, J. S. (2002). A standardized boundary element method volume conductor model. Clin. Neurophysiol. 113, 702–712. doi: 10.1016/s1388-2457(02)00030-5
Galaburda, A. M., Sanides, F., and Geschwind, N. (1978). Human-brain—cytoarchitectonic left-right asymmetries in temporal speech region. Arch. Neurol. 35, 812–817. doi: 10.1001/archneur.1978.00500360036007
Geranmayeh, F., Wise, R. J., Metha, A., and leech, R. (2014). Overlapping networks engaged during spoken language production and its cognitive control. J. Neurosci. 34, 8728–8740. doi: 10.1523/JNEUROSCI.0428-14.2014
Geschwin, N., and Levitsky, W. (1968). Human brain – left-right asymmetries in temporal speech region. Science 161, 186–187. doi: 10.1126/science.161.3837.186
Glasser, M. F., and Rilling, J. K. (2008). DTI tractography of the human brain’s language pathways. Cereb. Cortex 18, 2471–2482. doi: 10.1093/cercor/bhn011
Golestani, N., Molko, N., Dehaene, S., LeBihan, D., and Pallier, C. (2007). Brain structure predicts the learning of foreign speech sounds. Cereb. Cortex 17, 575–582. doi: 10.1093/cercor/bhk001
Golestani, N., and Pallier, C. (2007). Anatomical correlates of foreign speech sound production. Cereb. Cortex 17, 929–934. doi: 10.1093/cercor/bhl003
Golestani, N., Price, C. J., and Scott, S. K. (2011). Born with an ear for dialects? structural plasticity in the expert phonetician brain. J. Neurosci. 31, 4213–4220. doi: 10.1523/JNEUROSCI.3891-10.2011
Griffiths, T. D., and Warren, J. D. (2002). The planum temporale as a computational hub. Trends Neurosci. 25, 348–353. doi: 10.1016/s0166-2236(02)02191-4
Grodzinsky, Y., and Friederici, A. D. (2006). Neuroimaging of syntax and syntactic processing. Curr. Opin. Neurobiol. 16, 240–246. doi: 10.1016/j.conb.2006.03.007
Grodzinsky, Y., and Santi, A. (2008). The battle for Broca’s region. Trends Cogn. Sci. 12, 474–480. doi: 10.1016/j.tics.2008.09.001
Hervais-Adelman, A., Moser-Mercer, B., Michel, C. M., and Golestani, N. (2015). fMRI of simultaneous interpretation reveals the neural basis of extreme language control. Cereb. Cortex 25, 4727–4739. doi: 10.1093/cercor/bhu158
Hickok, G., and Poeppel, D. (2007). Opinion - the cortical organization of speech processing. Nat. Rev. Neurosci. 8, 393–402. doi: 10.1038/nrn2113
Houde, J. F., and Jordan, M. I. (1998). Sensorimotor adaptation in speech production. Science 279, 1213–1216. doi: 10.1126/science.279.5354.1213
Hustad, K. C., and Beukelman, D. R. (2002). Listener comprehension of severely dysarthric speech: effects of linguistic cues and stimulus cohesion. J. Speech Lang. Hear. Res. 45, 545–558. doi: 10.1044/1092-4388(2002/043)
Jäncke, L., and Steinmetz, H. (2004). “Anatomical brain asymmetries and their relevance for functional asymmetries,” in Brain Asymmetry, eds K. Hughdahl and R. J. Davidson (Cambridge, MA: MIT Press), 187–229).
Jäncke, L., Wüstenberg, T., Scheich, H., and Heinze, H. J. (2002). Phonetic perception and the temporal cortex. Neuroimage 15, 733–746. doi: 10.1006/nimg.2001.1027
Josse, G., Mazoyer, B., Crivello, F., and Tzourio-Mazoyer, N. (2003). Left planum temporale: an anatomical marker of left hemispheric specialization for language comprehension. Brain Res. Cogn. Brain Res. 18, 1–14. doi: 10.1016/j.cogbrainres.2003.08.007
Josse, G., and Tzourio-Mazoyer, N. (2004). Hemispheric specialization for language. Brain Res. Brain Res. Rev. 44, 1–12. doi: 10.1016/j.brainresrev.2003.10.001
Jung, T. P., Makeig, S., Humphries, C., Lee, T. W., McKeown, M. J., Iragui, V., et al. (2000). Removing electroencephalographic artifacts by blind source separation. Psychophysiology 37, 163–178. doi: 10.1111/1469-8986.3720163
Lancaster, J. L., Woldorff, M. G., Parsons, L. M., Liotti, M., Freitas, E. S., Rainey, L., et al. (2000). Automated talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 10, 120–131. doi: 10.1002/1097-0193(200007)10:3<120::aid-hbm30>3.0.co;2-8
Liberman, A. M., and Mattingly, I. G. (1985). The motor theory of speech-perception revised. Cognition 21, 1–36. doi: 10.1016/0010-0277(85)90021-6
Makris, N., Kennedy, D. N., McInerney, S., Sorensen, A. G., Wang, R., Caviness, V. S., et al. (2005). Segmentation of subcomponents within the superior longitudinal fascicle in humans: a quantitative, in vivo, DT-MRI study. Cereb. Cortex 15, 854–869. doi: 10.1093/cercor/bhh186
Makuuchi, M., and Friederici, A. D. (2013). Hierarchical functional connectivity between the core language system and the working memory system. Cortex 49, 2416–2423. doi: 10.1016/j.cortex.2013.01.007
Marconi, D., Manenti, R., Catricalà, E., Della Rosa, P. A., Siri, S., and Cappa, S. F. (2013). The neural substrates of inferential and referential semantic processing. Cortex 49, 2055–2066. doi: 10.1016/j.cortex.2012.08.001
Mazziotta, J., Toga, A., Evans, A., Fox, P., Lancaster, J., Zilles, K., et al. (2001). A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philos. Trans. R. Soc. Lond. B Biol. Sci. 356, 1293–1322. doi: 10.1098/rstb.2001.0915
Mechelli, A., Crinion, J. T., Noppeney, U., O’Doherty, J., Ashburner, J., Frackowiak, R. S., et al. (2004). Structural plasticity in the bilingual brain - Proficiency in a second language and age at acquisition affect grey-matter density. Nature 431:757. doi: 10.1038/431757a
Moser, D., Fridriksson, J., Bonilha, L., Healy, E. W., Baylis, G., Baker, J. M., et al. (2009). Neural recruitment for the production of native and novel speech sounds. Neuroimage 46, 549–557. doi: 10.1016/j.neuroimage.2009.01.015
Nolte, G., Bai, O., Wheaton, L., Mari, Z., Vorbach, S., and Hallett, M. (2004). Identifying true brain interaction from EEG data using the imaginary part of coherency. Clin. Neurophysiol. 115, 2292–2307. doi: 10.1016/j.clinph.2004.04.029
Osnes, B., Hugdahl, K., Hjelmervik, H., and Specht, K. (2011). Increased activation in superior temporal gyri as a function of increment in phonetic features. Brain Lang. 116, 97–101. doi: 10.1016/j.bandl.2010.10.001
Pascual-Marqui, R. D., Lehmann, D., Koukkou, M., Kochi, K., Anderer, P., Saletu, B., et al. (2011). Assessing interactions in the brain with exact low-resolution electromagnetic tomography. Philos. Trans. A Math. Phys. Eng. Sci. 369, 3768–3784. doi: 10.1098/rsta.2011.0081
Perani, D., and Abutalebi, J. (2005). The neural basis of first and second language processing. Curr. Opin. Neurobiol. 15, 202–206. doi: 10.1016/j.conb.2005.03.007
Polanía, R., Nitsche, M. A., Korman, C., Batsikadze, G., and Paulus, W. (2012). The importance of timing in segregated theta phase-coupling for cognitive performance. Curr. Biol. 22, 1314–1318. doi: 10.1016/j.cub.2012.05.021
Price, C. J., Green, D. W., and von Studnitz, R. (1999). A functional imaging study of translation and language switching. Brain 122, 2221–2235. doi: 10.1093/brain/122.12.2221
Quaresima, V., Colier, W. N. J. M., Van der Sluijs, M., Menssen, J., and Ferrari, M. (2001). A functional near-infrared imaging study of translation and language switching. Neuroimage 13:S590. doi: 10.1016/s1053-8119(01)91933-0
Ressel, V., Pallier, C., Ventura-Campos, N., Diaz, B., Roessler, A., Ávila, C., et al. (2012). An effect of bilingualism on the auditory cortex. J. Neurosci. 32, 16597–16601. doi: 10.1523/JNEUROSCI.1996-12.2012
Rilling, J. K., Glasser, M. F., Preuss, T. M., Ma, X. Y., Zhao, T. J., Hu, X. P., et al. (2008). The evolution of the arcuate fasciculus revealed with comparative DTI. Nat. Neurosci. 11, 426–428. doi: 10.1038/nn2072
Rinne, J. O., Tommola, J., Laine, M., Krause, B. J., Schmidt, D., Kaasinen, V., et al. (2000). The translating brain: cerebral activation patterns during simultaneous interpreting. Neurosci. Lett. 294, 85–88. doi: 10.1016/s0304-3940(00)01540-8
Rodriguez-Fornells, A., Balaguer, R. D., and Munte, T. F. (2006). Executive control in bilingual language processing. Lang. Learn. 56, 133–190. doi: 10.1111/j.1467-9922.2006.00359.x
Satterthwaite, T. D., Wolf, D. H., Ruparel, K., Erus, G., Elliott, M. A., Eickhoff, S. B., et al. (2013). Heterogeneous impact of motion on fundamental patterns of developmental changes in functional connectivity during youth. Neuroimage 83, 45–57. doi: 10.1016/j.neuroimage.2013.06.045
Sebastian, R., Laird, A. R., and Kiran, S. (2011). Meta-analysis of the neural representation of first language and second language. Appl. Psycholinguist. 32, 799–819. doi: 10.1017/s0142716411000075
Simmonds, A. J., Wise, R. J. S., Dhanjal, N. S., and Leech, R. (2011). A comparison of sensory-motor activity during speech in first and second languages. J. Neurophysiol. 106, 470–478. doi: 10.1152/jn.00343.2011
Smith, C. R. (1975). Residual hearing and speech production in deaf children. J. Speech Hear. Res. 18, 795–811. doi: 10.1044/jshr.1804.795
Stam, C. J., and van Straaten, E. C. W. (2012). Go with the flow: use of a directed phase lag index (dPLI) to characterize patterns of phase relations in a large-scale model of brain dynamics. Neuroimage 62, 1415–1428. doi: 10.1016/j.neuroimage.2012.05.050
Steinmetz, H., Volkmann, J., Jäncke, L., and Freund, H. J. (1991). Anatomical left-right asymmetry of language-related temporal cortex is different in left-handers and right-handers. Ann. Neurol. 29, 315–319. doi: 10.1002/ana.410290314
Tzourio, N., Crivello, F., Mellet, E., Nkanga-Ngila, B., and Mazoyer, B. (1998a). Functional anatomy of dominance for speech comprehension in left handers vs right handers. Neuroimage 8, 1–16. doi: 10.1006/nimg.1998.0343
Tzourio, N., Nkanga-Ngila, B., and Mazoyer, B. (1998b). Left planum temporale surface correlates with functional dominance during story listening. Neuroreport 9, 829–833. doi: 10.1097/00001756-199803300-00012
Visser, M., and Lambon Ralph, M. A. (2011). Differential contributions of bilateral ventral anterior temporal lobe and left anterior superior temporal gyrus to semantic processes. J. Cogn. Neurosci. 23, 3121–3131. doi: 10.1162/jocn_a_00007
Ward, L. M. (2003). Synchronous neural oscillations and cognitive processes. Trends Cogn. Sci. 7, 553–559. doi: 10.1016/j.tics.2003.10.012
Wong, P. C. M., Warrier, C. M., Penhune, V. B., Roy, A. K., Sadehh, A., Parrish, T. B., et al. (2008). Volume of left heschl’s gyrus and linguistic pitch learning. Cereb. Cortex 18, 828–836. doi: 10.1093/cercor/bhm115
Keywords: simultaneous interpreters, EEG, functional connectivity, dorsal stream, lexical decision task
Citation: Elmer S and Kühnis J (2016) Functional Connectivity in the Left Dorsal Stream Facilitates Simultaneous Language Translation: An EEG Study. Front. Hum. Neurosci. 10:60. doi: 10.3389/fnhum.2016.00060
Received: 13 November 2015; Accepted: 08 February 2016;
Published: 19 February 2016.
Edited by:
Nathalie Tzourio-Mazoyer, Université de Bordeaux, FranceReviewed by:
Claude Alain, Rotman Research Institute, CanadaMonica Baciu, Université Pierre Mendès-France, France
Copyright © 2016 Elmer and Kühnis. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution and reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Stefan Elmer, s.elmer@psychologie.uzh.ch