Mauro DiNuzzo1*
Daniele Mascali1,2
Marta Moraschi1,2
Giorgia Bussu3
Laura Maugeri1
Fabio Mangini1
Michela Fratini1,4
Federico Giove1,2- 1Fondazione Santa Lucia (IRCCS), Rome, Italy
- 2Centro Fermi – Museo Storico della Fisica e Centro Studi e Ricerche Enrico Fermi, Rome, Italy
- 3Donders Institute for Brain, Cognition and Behavior, Radboud University, Nijmegen, Netherlands
- 4CNR Nanotec, Rome, Italy
Phasic changes in eye’s pupil diameter have been repeatedly observed during cognitive, emotional and behavioral activity in mammals. Although pupil diameter is known to be associated with noradrenergic firing in the pontine Locus Coeruleus (LC), thus far the causal chain coupling spontaneous pupil dynamics to specific cortical brain networks remains unknown. In the present study, we acquired steady-state blood oxygenation level-dependent (BOLD) functional magnetic resonance imaging (fMRI) data combined with eye-tracking pupillometry from fifteen healthy subjects that were trained to maintain a constant attentional load. Regression analysis revealed widespread visual and sensorimotor BOLD-fMRI deactivations correlated with pupil diameter. Furthermore, we found BOLD-fMRI activations correlated with pupil diameter change rate within a set of brain regions known to be implicated in selective attention, salience, error-detection and decision-making. These regions included LC, thalamus, posterior cingulate cortex (PCC), dorsal anterior cingulate and paracingulate cortex (dACC/PaCC), orbitofrontal cortex (OFC), and right anterior insular cortex (rAIC). Granger-causality analysis performed on these regions yielded a complex pattern of interdependence, wherein LC and pupil dynamics were far apart in the network and separated by several cortical stages. Functional connectivity (FC) analysis revealed the ubiquitous presence of the superior frontal gyrus (SFG) in the networks identified by the brain regions correlated to the pupil diameter change rate. No significant correlations were observed between pupil dynamics, regional activation and behavioral performance. Based on the involved brain regions, we speculate that pupil dynamics reflects brain processing implicated in changes between self- and environment-directed awareness.
Introduction
Consensual changes in eye’s pupil size are strongly associated with neuromodulatory tone. Specifically, pupil size is controlled by sympathetic and parasympathetic systems (McDougal and Gamlin, 2015) and it is recognized as a peripheral index of arousal (Bradley et al., 2008; Gilzenrat et al., 2010; Jepma and Nieuwenhuis, 2011; Nassar et al., 2012; Wierda et al., 2012; Naber et al., 2013; Urai et al., 2017; Wang et al., 2018; Aminihajibashi et al., 2019; van Kempen et al., 2019), in addition to the well-known regulation by ambient illumination (reviewed by Mathot and Van der Stigchel, 2015). In monkeys and rodents, light-independent pupil dilations have been found to be correlated with neuronal firing in the pontine locus coeruleus (LC), the major source of noradrenergic input to the cerebral cortex (Rajkowski et al., 1993; Joshi et al., 2016). Accordingly, pupil dilations are associated with desynchronized cortical electroencephalographic and electrophysiological signals and enhancement of sensory responses, i.e., attentive state (Reimer et al., 2014).
Although the results found in animal models might not directly translate to the human brain, the relationship between pupil dynamics and LC has been indirectly confirmed in humans using pupillometry and functional magnetic resonance imaging (fMRI) (Alnaes et al., 2014; Murphy et al., 2014; Yellin et al., 2015; Schneider et al., 2016; Elman et al., 2017). An important difference between animal and human studies is that the fMRI signal only indirectly reflects neuronal firing through the action of neurovascular coupling (Logothetis and Pfeuffer, 2004). However, recent experimental evidence in mice demonstrated that resting-state hemodynamics can be predicted from spontaneous neuronal activity using a convolution-based approach, indicating that hemodynamic fluctuations are indeed a low-pass filtered version of the underlying neuronal activity (Ma et al., 2016). Moreover, either electrode recordings within LC or aggregate neuronal calcium signaling in cortical axonal projections from LC (the latter having an intrinsically slow dynamics, e.g., several hundreds of ms), have been reported to be closely correlated to pupil size fluctuations (Joshi et al., 2016; Reimer et al., 2016). Accordingly, pupil dilations after activation of LC occur on a relatively slow time-scale (500–1000 ms) (Larsen and Waters, 2018). These findings strongly support the possibility to track pupil-related brain activity using neurovascular coupling through the fMRI blood oxygenation level-dependent (BOLD) signals, as evidenced by several experiments. In particular, LC activation was initially observed using the temporal derivatives of the canonical hemodynamic response function (HRF) (Murphy et al., 2014 and references therein). Subsequently, it was found that it is not pupil size per se but the change rate of pupil diameter to be correlated with the BOLD signals in LC and other subcortical and cortical areas during resting state (Schneider et al., 2016). This notion is consistent with electrophysiological measurements in mice showing that, during both quiet waking and locomotion, pupil size is correlated with the cholinergic system, while its time derivative is correlated with the noradrenergic LC (Reimer et al., 2016). It should be noted, however, that LC does not directly control pupil size, and the functional relevance of anatomical pathways between LC and oculomotor neurons such as preganglionic cells of the Edinger-Westphal midbrain nucleus is not definitely established (McDougal and Gamlin, 2015). Thus, it is important to remark that fMRI is not able to resolve these dependencies, especially the correlations between regional brain activity and the high-frequency components of pupil dynamics.
Remarkably, during stimulus-related protocols in humans, such as reward-anticipation (Schneider et al., 2018) or fear-learning (Leuchs et al., 2017), but also during mind-wandering resting-state (Schneider et al., 2016), pupil-related activations consistently implicated cortical areas of the salience-network, including anterior cingulate cortex (ACC) and anterior insular cortex (AIC) (Menon and Uddin, 2010). Furthermore, a large degree of overlap has been reported in pupil-related BOLD activation maps during either continuous rest-fixation or block-design visual-imagery experiments (Yellin et al., 2015). These observations raise the possibility that at least in part low-frequency pupil dynamics reflects task-independent fluctuations in cortical activity.
In the present study, we sought to characterize the pupil-related brain networks during a steady-state experimental protocol designed to achieve a continuous degree of attentional load. To this end, we recorded pupillometry and fMRI data along with response times from healthy human subjects exposed to a whole-field visual stimulation and either left or right hemifield-directed attention. We were particularly interested in the brain network comprising LC and thalamus (TH), two critical components of the ascending reticular activating system (ARAS). The ARAS is responsible for arousal and it is thought to subserve both self and environmental awareness (Yeo et al., 2013). The aims of this work were (i) to interrogate the pupil-related brain networks during a continuous attentive state, and (ii) to identify the underlying functional hierarchy between the involved brain areas by means of causality and connectivity analysis.
Materials and Methods
Participants
Fifteen healthy volunteers (age: 26 ± 5 years, mean ± SD; age range: 18–44 years; 5 females) participated in the study. The protocol of the study was approved by the Ethics Committee of Santa Lucia Foundation. All subjects gave written informed consent in accordance with the Declaration of Helsinki and with the European Union regulations.
MR Acquisitions
MR data were acquired on a 3T scanner (Siemens, Magnetom Allegra, Erlangen, Germany) equipped with a standard birdcage coil. Functional images were collected with a multi-echo (Speck and Hennig, 1998) planar imaging sequence (TR = 3100 ms, TE1/TE2/TE3 = 16/39/63 ms, Flip Angle = 85°, voxel size = 3× 3 × 3.75 mm3, FOV = 192 × 192 mm2) lasting 12 min and 43 s for a total of 246 volumes (including 4 dummy scans). Two functional runs were acquired for each subject. Parallel imaging and partial k-space sampling were avoided by leveraging the high scanner gradient performances (rise time 100 μs to reach a maximum amplitude of 40 mT/m). Clinical scans were also acquired to comply with institutional guidelines and to exclude pathological conditions.
Steady-State Attentional Task
During the acquisition of functional images, subjects performed a continuous motion detection task with covert attention. The constant-luminance (21 cd/m2) visual stimulation (Figure 1A) consisted of two circle-shaped (3° of radius) white-black rotating (2 cycles/s) checkerboards located in the left and right hemifield at 4° horizontal decentering and vertically centered. The two checkerboards inverted the direction of rotation independently of one another, with a random inversion period ranging uniformly from 1 to 3 s. A leftward or rightward white arrow located at the center of the screen identified the fixation point. Subjects were asked to keep the gaze on the central arrow while maintaining the attention to checkerboard pointed by the arrow, and to push an MRI compatible button whenever the target checkerboard inverted the direction of rotation. Two functional runs were acquired for each subject, with either leftward or rightward attention. The run ordering was randomized across subjects. The visual stimulation was generated with Cogent 2000 (Laboratory of Neurobiology, Wellcome Trust, London, United Kingdom) running on Matlab 7.1 (The Mathworks Inc., Natick, MA, United States). A single chip Digital Light Processing (DLP) projector model NP216G (NEC Display Solutions, Itasca, IL, United States), located outside the magnet room, projected the stimulation on a screen mounted on the magnet bore behind the subject, who viewed it via a mirror mounted on the head coil. The fixation distance between subjects’ eyes and the screen was approximately 65 cm.
Figure 1. Experimental design, pupillometry and relation to subject’s performance. (A) Schematization of the visual stimulation with leftward attention presented during the functional scans. While maintaining the gaze on the central arrow, subjects had to pay attention to the change in the direction of rotation of the target checkerboard while ignoring the distracting checkerboard on the opposite hemifield. One run with leftward and one with rightward attention were acquired for each subject. (B) Pupil and pupil-derived time courses from one representative subject. (C) Eye-position heat map overlaid over the visual stimulation for one representative subject during the leftward attention run. The distribution is centered on the fixation point, demonstrating subject’s compliance. (D) and (E) panels show the autocorrelation function and power spectral density of the corrected and resampled pupil data, respectively. The black lines represent the across-subject averages, which are displayed over single-subject data (blue lines). (F) Correlations between response delay times and pupillometry over time, displayed separately for each subject (left panel) and for the entire group (right panel). The white rectangles on the left panel indicate missing data. The error bars on the right panel represent the standard deviation, while the p-values are the results of one-sample t-tests on the distribution of correlations.
Preprocessing of Functional Images
Preprocessing of functional images was performed with AFNI (Cox, 1996). After discarding four dummy scans, correction for head motion was estimated from the second-echo series, using the first volume as reference (3dvolreg). Each echo series was slice-timing corrected (3dTshift) and then motion corrected by applying the previously estimated transformations (3dAllineate). Non-brain regions were removed by intersecting the realigned volumes with a mask obtained via 3dAutomask applied to a provisional optimal combined time series. Then, the three-echo series were fed to “tedana.py” to perform multi-echo ICA denoising (ME-ICA) (Kundu et al., 2012; Kundu et al., 2013). ME-ICA removes nuisance sources of variance by performing ICA decomposition followed by component classification based on their TE dependency, with TE-independent components marked as non-BOLD components and hence removed from the data. Tedana yielded a single cleaned “optimal combined” series, obtained via a T2∗-weighted average of the three echoes (Posse et al., 1999). The cleaned series was normalized to Montreal Neurological Institute (MNI) space (3 × 3 × 3 mm3) using as source image the mean of the motion-corrected second-echo series. The transformation to MNI space was obtained combining an affine transformation (@auto_tlrc) with a non-linear warp (3dQwarp), and it was applied in a single interpolation step using 3dNwarpApply. Slow frequencies (<0.008 Hz), linear and quadratic trends, as well as motion-derived parameters were regressed out using 3dTproject. Finally, the resulting series was smoothed within the brain mask with an isotropic 4 mm FWHM Gaussian kernel (3dBlurInMask).
Pupillometry and Pupil Data Preprocessing
Eye-tracking data were acquired during complete darkness (ambient luminance measured inside the bore during the stimulation < 1 lux) in order to counter-balance the influence of the visual stimulation (at constant light intensity, see above) on pupil constriction, as addition of light facilitates the detection of spontaneous (i.e., light-independent) changes in pupil diameter (Behrends et al., 2019). Adaptation to the light conditions (ambient darkness plus visual stimulation) lasted ∼15 min while the acquisition of anatomical reference images and clinical scans took place. We did not test different light conditions, as eye-tracking measurements (e.g., number and duration of blink/eye closure) and fMRI-related variables (e.g., motion parameters and regional pupil-BOLD correlations) have been previously shown not to differ significantly in either light or dark conditions (Yellin et al., 2015; Schneider et al., 2016), although luminance might affect pupillary responses under cognitive load (Peysakhovich et al., 2017). During acquisitions, subject’s gaze was recorded (60 Hz) through an eye-tracking system (Applied Science Laboratories, model 504) equipped with remote pan/tilt optic infrared module and a video camera that was custom-adapted for use in the scanner. After a 16-points calibration procedure, eye-position traces, linearly interpolated and smoothed (after an up-sampling to 1 kHz) by a boxcar filter (width ± 25 ms), were used to verify subject’s compliance. Pupil diameter was directly computed by the eye-tracking software through automatic elliptical fitting and major axis determination (preferred over area to avoid partial pupil coverage by the eyelid). Peak-envelope of pupil diameter time course was determined based on its frequency-spectrum and downsampled to 1/TR to be used for regression analysis. Data underwent outliers-removal using Hampel Filter and detrending (only for linear trends), thus obtaining artifact-free pupil diameter time courses (Figure 1B). It is noted that the convolution approach used for pupil-BOLD regression carries the Nyquist frequency of 0.16 Hz, which means that our analysis of pupillary oscillations is correspondingly limited to low frequencies.
Identification of Brain Regions Correlated to Pupil Dynamics
We performed a regression analysis by convolving the canonical HRF with the pupil diameter time-course as well as its first-order (pupil diameter change rate) and second-order time derivatives. The analysis was performed with SPM121 running on Matlab 2018a (The Mathworks Inc., Natick, MA, United States). Statistical t-maps were thresholded at p < 0.001; Family-wise error (FWE) correction for multiple comparisons was performed at cluster level (pFWE < 0.05). Each cluster identified a specific region of interest (ROI) used for further analysis (see below), with the following exceptions. Left and right orbitofrontal cortices, as well as anterior paracingulate cortex and cingulate cortex, were grouped together due to high homology and substantial temporal correlation between the corresponding time-series, thus reducing the eight clusters to six ROIs.
Granger Causality Analysis
Pairwise conditional GC was computed using the state-of-the-art Multivariate Granger Causality (MVGC) Matlab Toolbox (Barnett and Seth, 2014). In particular, the algorithm performs numerical computation and statistical inference of multivariate GC given an ensemble of fMRI data time series (variables are the ROIs defined above, observations are time points, and trials are subjects/sessions). Since we found no difference in activation maps for left and right hemifield-directed attention, we lumped together all sessions. Vector autoregressive model parameter estimation was performed using the Levinson-Durbin-Whittle-Wiggins-Robinson (LWR) method and model selection was done using the Bayesian information criterion (BIC). Significance level was set to p < 0.05 with Bonferroni correction for multiple comparisons. The binarized version of the matrix of suprathreshold elements was interpreted as adjacency matrix for directed graph determination and calculation of node centrality.
Seed-to-Voxel Functional Connectivity
With the aim of exploring the steady-state networks associated with the above-mentioned ROIs, we computed the seed-to-voxel functional connectivity (FC) maps (Biswal et al., 1995) as the Pearson’s correlation coefficient between the ROI-averaged time course and every other voxel time course. Group-level maps were generated with SPM12 using one-sample t-tests on the z-Fisher-transformed maps. FWE correction for multiple comparisons was performed both at voxel (pFWE < 0.05) and cluster (pFWE < 0.001) level.
Data Availability
All data sets (fMRI-BOLD and pupil size time series) are available upon reasonable request to the corresponding author.
Results
Pupillometry and steady-state fMRI data were successfully acquired from all subjects (two sessions from two different subjects were discarded due to low-quality of eye-tracking recordings and one session of a separate subject was discarded due to excessive in-scanner head motion). Overall task performance was high, with an average fraction of correct responses of 89 ± 10% (mean ± SD) and an average response delay time of 433 ± 42 ms (mean ± SD). All subjects kept their gaze consistently on the fixation point at the center of the screen (Figure 1C). As previously reported (Yellin et al., 2015), autocorrelation and frequency analysis revealed no periodic frequencies in the pupil data (Figures 1D,E). No significant correlation was found between mean performance and the average of either pupil diameter or its 1st- and 2nd-order time derivatives. A very small (r = −0.06) but significant (p < 0.05, one-sample, two-tailed t-test) negative correlation was observed using the response delay and the pupil diameter across time (Figure 1F).
To determine pupil-related cortical areas, we performed regression analysis using general linear model by employing HRF-convolved pupil diameter and its time derivatives. Widespread deactivation maps correlated to pupil diameter were observed in visual and sensory-motor cortices (Figure 2A and Table 1). Activation maps correlated to pupil diameter change rate were observed in several subcortical and cortical areas (Figure 2B and Table 2), including LC, TH, posterior cingulate cortex (PCC), dorsal anterior cingulate and paracingulate cortex (dACC/PaCC), orbitofrontal cortex (OFC) as well as right anterior insular cortex (rAIC). Notably, separate regression analysis for left and right hemifield-directed attention revealed no suprathreshold cluster for either left > right or right > left statistical tests (p > 0.9 uncorrected, data not shown).
Figure 2. Brain regions correlated to pupil dynamics. Regression analysis yielded clusters of brain regions significantly (cluster-level pFWE < 0.05) related to pupil diameter (A) and to pupil diameter change rate (B), while no significant cluster was found testing the effect of pupil second-order time derivative. (A) Deactivations (i.e., negative correlations) were found by testing the effect of pupil diameter (see Table 1 for details). (B) Activations (i.e., positive correlations) were found by testing the effect of pupil diameter change rate (see Table 2 for details). Images are presented in neurological convention.
Table 1. Brain regions negatively correlated to pupil diameter.
Table 2. Brain regions positively correlated to pupil diameter change rate.
In order to elucidate the ability of each ROI (see section “Materials and Methods” for ROI definition) in predicting the behavior of the others within the pupil-related network, we performed Granger causality (GC) analysis. We found a complex pattern of interdependence between the cortical areas correlated with pupil diameter change (Figure 3). Specifically, PCC and dACC/PaCC exhibited the largest pairwise conditional GC for outwardly and inwardly directed causal influences, respectively. Node centrality analysis accordingly revealed that dACC/PaCC is the main authority and PCC is the main hub of the cortical network (Table 3). No significant correlation was found between mean within ROI t-value and either pupil dynamics or average task performance (qFDR > 0.2, data not shown).
Table 3. Node centrality of ROIs within the pupil-related brain network.
Figure 3. Granger-causality analysis for the pupil-related network. (A) Estimated pairwise conditional GC between BOLD time courses within each ROI. (B) Corresponding p-values. (C) Statistically significant (p < 0.05, Granger’s F-test, Bonferroni corrected) causal influences against the null hypothesis of no causality. (D) Directed graph of causal influences obtained using the result shown on panel C as adjacency matrix.
To further characterize pupil-related networks, we determined seed-to-voxel FC maps with each ROI taken as seed (Figure 4A and Table 4). As expected, the PCC-seed FC yielded default mode network (DMN) areas including superior frontal gyrus (SFG). Subregions of the SFG were common members in all FC networks. The correlation between the different FC maps was globally very high, with PCC-seed versus rAIC-seed exhibiting the lowest correlation.
Figure 4. Seed-to-voxel functional connectivity analysis. (A) Unthresholded t-maps showing the second-level effect of seed-to-voxel connectivity (see Table 4 for the corrected statistics). The seed-ROI is indicated below each map. (B) Correlation matrix between each pair of ROI-seed FC maps.
Table 4. Brain regions functionally connected to the ROIs of the pupil-related network.
Discussion
In this study, we investigated the brain networks related to temporal variations of the eye’s pupil. We were mainly interested in examining the connection between pupil dynamics and LC in the pons, which together with TH and other subcortical structures (e.g., catecholaminergic nuclei) are linked to the arousal/ARAS system (Yeo et al., 2013). The regression analysis between steady-state fMRI signals and pupil diameter showed deactivations in a widespread cortical territory comprising visual and sensorimotor areas (Figure 2A and Table 1), in excellent agreement with previous studies (Murphy et al., 2014; Yellin et al., 2015; Schneider et al., 2016). Since the cholinergic system is thought to be correlated to pupil diameter (Reimer et al., 2016), the negative activations that we report here might be explained by a decreased cholinergic input to visual and sensorimotor areas. However, in humans the cholinergic nucleus basalis of Meynert innervates predominantly the limbic system (Mesulam, 2004) while the patterns of cholinergic innervation in the visual cortex varies considerably across mammalian species (Gu, 2003). Previous reports interpreted these deactivations as reflecting the suppression of interoceptive processes (including mental imagery) during alertness-induced pupil dilations, possibly mediated by the cholinergic branch of the ARAS (Yellin et al., 2015; Schneider et al., 2016). Further research is required to elucidate the significance of these results.
Positive activations were found using pupil diameter change rate (i.e., first-order time derivative of the pupil size) as regressor, which identified a set of subcortical and cortical regions including LC and TH as well as PCC, ACC, OFC and AIC (Figure 2B and Table 2). These areas largely overlap with previously published results (see Table 5). It should be noted that differences between findings unrelated to specific experimental design (e.g., rest-fixation resting-state, block-design or steady-state task, and so on) might result from a variety of sources, including but not limited to preprocessing of pupillometry and fMRI data, physiological noise (e.g., respiratory and cardiac rhythms) correction and statistical significance thresholds (e.g., voxel- and cluster-level correction for multiple comparisons).
Table 5. Summary of findings obtained in previous pupillometry-fMRI experiments.
The network of brain areas related to pupil diameter change rate was found to have PCC as its main cortical hub, as evidenced by GC analysis (Figure 3) and node centrality (Table 3). PCC appears to be the principal cortical region in initiating the communication with both LC and pupil. In turn, the edges connecting LC to pupil diameter change rate always involve dACC/PaCC and rAIC, the latter mediating the sole mutual connection with pupil. These findings are consistent with the hypothesis that LC is “informed” by the cortex (here directly by OFC and PCC and indirectly by ACC), which largely support the Aston-Jones and Cohen (2005) model. It is noted that the edges between the nodes of the network do not necessarily entail the presence of a direct connection or the absence of an indirect connection, as in our GC analysis not all brain regions are incorporated and even those that are incorporated as ROIs might be subregions of the actual labeled area. As an illustration, the TH cluster resulting from our analysis only comprises parts of specific thalamic nuclei (i.e., medial dorsal nucleus, ventral anterior nucleus, central lateral nucleus, and lateral posterior nucleus) and the absence of outward edges from TH cannot be interpreted as lack of thalamocortical connections.
In order to somewhat reduce such limitation, we performed seed-to-voxel FC. Interestingly, all cortical regions that were correlated with the pupil diameter change rate had the SFG (orbital, medial, dorsolateral or posterior subregion) within the corresponding FC network (Table 4), consistently with the proposed parcellation and connectivity patterns of this area (Li et al., 2013). It is noted that the hub of the network related to the pupil diameter change rate, namely PCC, coincides with the main hub of the DMN. The DMN is the seat of internally generated and self-directed brain activity (Stawarczyk et al., 2011). SFG is part of the DMN (Buckner et al., 2008) and it has been linked to self-awareness (Goldberg et al., 2006).
Consistent with our expectation that pupil dynamics reflects spontaneous, task-independent fluctuations in cortical activity, we did not find any significant correlation between pupil diameter (or its time derivatives), pupil-related brain regions and task performance. This is particularly interesting considering that the task required a constant and relatively high degree of attention, which is known to implicate the ARAS and related cortical areas. While it is possible that the correlation between pupil and performance depend on specific kind of attentive processes (e.g., top-down attention versus decision-making, see van Kempen et al., 2019), our results are consistent with electroencephalography-pupillometry data showing no correlation between pupil and reaction time (Hong et al., 2014). Generally, understanding of the conditions where a correlation between pupil and performance exists is not straightforward (van den Brink et al., 2016; Trani and Verhaeghen, 2018). Notably, LC activity and pupil does not necessarily correlate with behavioral performance (Varazzani et al., 2015). We only report a very small correlation between instantaneous response delay time and pupil diameter time course, which might be explained by the known relation between pupil dilation and increase in attentional load (Lisi et al., 2015).
Virtually all regions of the pupil-related network are known to be implicated in arousal, selective attention, salience, error-detection, decision-making and perception (Schneider et al., 2016), i.e., more generally, in consciousness. Pupil dynamics has been proposed to reflect both conscious (Kang and Wheatley, 2015) and preconscious (Laeng et al., 2012) brain activity. In particular, pupillometry might be an index of spontaneous fluctuations in the arousal state that are characterized by a switch between internally directed (e.g., mind wandering) and environmentally directed (e.g., on-task) attentional resources (Unsworth and Robison, 2018). Pupil size has also been linked to the subjective passage of time (Suzuki et al., 2016). Notably, time-perception tasks implicate the AIC (see Gili et al., 2018). Timing has been related to the metastability of cortical networks, something that is hypothesized to be dynamically “adjusted” by the PCC (Leech and Sharp, 2014). We found that the rAIC-seed FC network and the PCC-seed FC network exhibited the lowest between-map correlation (Figure 4B), although both rAIC and PCC were strongly correlated with the pupil diameter change rate (Figure 2 and Table 2). Notably, the within-ROI BOLD time course of rAIC and PCC were anticorrelated (p = 0.0029, one-sample, two-tailed t-test). These regions may subserve complementary functions, as evidenced by the finding that activation of rAIC can cause deactivation of the PCC in response to unexpected salient events (Sridharan et al., 2008). It has been proposed that the anterior insula signals the need to direct attention externally, thereby leading the PCC to reduce whole-brain metastability in order to facilitate the activation of cortical areas/networks that are appropriate for the current behavioral state (Leech and Sharp, 2014). Based on our results, we speculate that the eye’s pupil reflects continuous switches between self- (PCC) and environment- (OFC and rAIC) directed awareness (Sridharan et al., 2008; Scheibner et al., 2017).
It should be realized that cortical regions participate in the maintenance of conscious state through consciousness-entangled contributions that are region-specific. For example, OFC is implicated in metacognitive processes related to self-awareness (Lak et al., 2014; Xie et al., 2018), in synergy with the LC noradrenergic system (Sadacca et al., 2017). The right anterior insula is involved in interoceptive body representation (i.e., integration of autonomic, visceral and sensory information) and together with anterior cingulate and prefrontal cortex constitutes a task-independent network known to be linked to goal-directed behavior (Eckert et al., 2009 and references therein). Even the rAIC is related to the awareness of visceral and sensory information (Kotani et al., 2009). The PCC is part of a functional noradrenergic arousal circuitry (together with LC and TH, among others) and has been proposed as a cortical hub for consciousness (see section “Discussion” in Song et al., 2017).
Conclusion
In conclusion, we used steady-state fMRI to study the relation between pupil dynamics and brain networks. Our results advance a potential important link between changes in pupil and cortical state (Schwalm and Rosales Jubal, 2017). It would be interesting to study how the pupil-related network evolves during altered states of consciousness. For example, resting-state fMRI during pharmacological modulation of arousal established the brainstem (putatively LC) and TH as two main subcortical structures involved in consciousness (Gili et al., 2013; Song et al., 2017). In our analysis, LC and TH had the SFG as a functionally connected cortical region, in common with all pupil-related cortical areas. This result advances the possibility that FC with SFG might be used as an index of the pupillometry-fMRI relation. Finally, disruption of pupillary responses has been linked to neurodegeneration such as Parkinson’s disease (Wang et al., 2016) and Alzheimer’s disease (Granholm et al., 2017). For example, the identification of pupil-related network and the study of its integrity might be useful as an early marker of cognitive decline, e.g., in MCI patients (Elman et al., 2017). Although the interpretation of the data is made difficult by the complexity of the interplay between pupil size regulation and brain state, our results provide useful information that might help designing new experiments aiming at further investigating the pupil-BOLD relation in the human brain.
Data Availability
The datasets generated for this study are available on request to the corresponding author.
Ethics Statement
The protocol of the study was approved by the Ethics Committee of Santa Lucia Foundation. All subjects gave written informed consent in accordance with the Declaration of Helsinki and with the European Union regulations.
Author Contributions
MD conceived the idea. FG designed and supervised the experiments. GB, DM, MM, and FG performed the experiments. MD and DM analyzed the data and prepared the figures. MD wrote the manuscript. All authors contributed to the interpretation of the results, critically reviewed the manuscript, and approved the content of the manuscript.
Funding
This work was partially funded by the Italian Ministry of Health Young Researcher Grant 2013 (GR-2013-02358177).
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors thank Maxim Zaitsev at the University Medical Center Freiburg for the implementation of Multi Echo EPI on Siemens platform.
Footnotes
References
Alnaes, D., Sneve, M. H., Espeseth, T., Endestad, T., Van De Pavert, S. H., and Laeng, B. (2014). Pupil size signals mental effort deployed during multiple object tracking and predicts brain activity in the dorsal attention network and the locus coeruleus. J. Vis. 14:1. doi: 10.1167/14.4.1
Aminihajibashi, S., Hagen, T., Foldal, M. D., Laeng, B., and Espeseth, T. (2019). Individual differences in resting-state pupil size: evidence for association between working memory capacity and pupil size variability. Int. J. Psychophysiol. 140, 1–7. doi: 10.1016/j.ijpsycho.2019.03.007
Aston-Jones, G., and Cohen, J. D. (2005). Adaptive gain and the role of the locus coeruleus-norepinephrine system in optimal performance. J. Comp. Neurol. 493, 99–110. doi: 10.1002/cne.20723
Barnett, L., and Seth, A. K. (2014). The MVGC multivariate Granger causality toolbox: a new approach to Granger-causal inference. J. Neurosci. Methods 223, 50–68. doi: 10.1016/j.jneumeth.2013.10.018
Behrends, M., Larson, M. D., Neice, A. E., and Bokoch, M. P. (2019). Suppression of pupillary unrest by general anesthesia and propofol sedation. J. Clin. Monit. Comput. 33, 317–323. doi: 10.1007/s10877-018-0147-y
Biswal, B., Yetkin, F. Z., Haughton, V. M., and Hyde, J. S. (1995). Functional connectivity in the motor cortex of resting human brain using echo-planar MRI. Magn. Reson. Med. 34, 537–541. doi: 10.1002/mrm.1910340409
Bradley, M. M., Miccoli, L., Escrig, M. A., and Lang, P. J. (2008). The pupil as a measure of emotional arousal and autonomic activation. Psychophysiology 45, 602–607. doi: 10.1111/j.1469-8986.2008.00654.x
Buckner, R. L., Andrews-Hanna, J. R., and Schacter, D. L. (2008). The brain’s default network: anatomy, function, and relevance to disease. Ann. N. Y. Acad. Sci. 1124, 1–38. doi: 10.1196/annals.1440.011
Cox, R. W. (1996). AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 29, 162–173. doi: 10.1006/cbmr.1996.0014
Eckert, M. A., Menon, V., Walczak, A., Ahlstrom, J., Denslow, S., Horwitz, A., et al. (2009). At the heart of the ventral attention system: the right anterior insula. Hum. Brain Mapp. 30, 2530–2541. doi: 10.1002/hbm.20688
Elman, J. A., Panizzon, M. S., Hagler, D. J., Eyler, L. T., Granholm, E. L., Fennema-Notestine, C., et al. (2017). Task-evoked pupil dilation and BOLD variance as indicators of locus coeruleus dysfunction. Cortex 97, 60–69. doi: 10.1016/j.cortex.2017.09.025
Gili, T., Ciullo, V., and Spalletta, G. (2018). Metastable states of multiscale brain networks are keys to crack the timing problem. Front. Comput. Neurosci. 12:75. doi: 10.3389/fncom.2018.00075
Gili, T., Saxena, N., Diukova, A., Murphy, K., Hall, J. E., and Wise, R. G. (2013). The thalamus and brainstem act as key hubs in alterations of human brain network connectivity induced by mild propofol sedation. J. Neurosci. 33, 4024–4031. doi: 10.1523/JNEUROSCI.3480-12.2013
Gilzenrat, M. S., Nieuwenhuis, S., Jepma, M., and Cohen, J. D. (2010). Pupil diameter tracks changes in control state predicted by the adaptive gain theory of locus coeruleus function. Cogn. Affect. Behav. Neurosci. 10, 252–269. doi: 10.3758/CABN.10.2.252
Goldberg, I. I., Harel, M., and Malach, R. (2006). When the brain loses its self: prefrontal inactivation during sensorimotor processing. Neuron 50, 329–339. doi: 10.1016/j.neuron.2006.03.015
Granholm, E. L., Panizzon, M. S., Elman, J. A., Jak, A. J., Hauger, R. L., Bondi, M. W., et al. (2017). Pupillary responses as a biomarker of early risk for alzheimer’s disease. J. Alzheimers Dis. 56, 1419–1428. doi: 10.3233/JAD-161078
Gu, Q. (2003). Contribution of acetylcholine to visual cortex plasticity. Neurobiol. Learn. Mem. 80, 291–301. doi: 10.1016/s1074-7427(03)00073-x
Hong, L., Walz, J. M., and Sajda, P. (2014). Your eyes give you away: prestimulus changes in pupil diameter correlate with poststimulus task-related EEG dynamics. PLoS One 9:e91321. doi: 10.1371/journal.pone.0091321
Jepma, M., and Nieuwenhuis, S. (2011). Pupil diameter predicts changes in the exploration-exploitation trade-off: evidence for the adaptive gain theory. J. Cogn. Neurosci. 23, 1587–1596. doi: 10.1162/jocn.2010.21548
Joshi, S., Li, Y., Kalwani, R. M., and Gold, J. I. (2016). Relationships between pupil diameter and neuronal activity in the locus coeruleus, colliculi, and cingulate cortex. Neuron 89, 221–234. doi: 10.1016/j.neuron.2015.11.028
Kang, O., and Wheatley, T. (2015). Pupil dilation patterns reflect the contents of consciousness. Conscious. Cogn. 35, 128–135. doi: 10.1016/j.concog.2015.05.001
Kotani, Y., Ohgami, Y., Kuramoto, Y., Tsukamoto, T., Inoue, Y., and Aihara, Y. (2009). The role of the right anterior insular cortex in the right hemisphere preponderance of stimulus-preceding negativity (SPN): an fMRI study. Neurosci. Lett. 450, 75–79. doi: 10.1016/j.neulet.2008.11.032
Kundu, P., Brenowitz, N. D., Voon, V., Worbe, Y., Vertes, P. E., Inati, S. J., et al. (2013). Integrated strategy for improving functional connectivity mapping using multiecho fMRI. Proc. Natl. Acad. Sci. U.S.A. 110, 16187–16192. doi: 10.1073/pnas.1301725110
Kundu, P., Inati, S. J., Evans, J. W., Luh, W. M., and Bandettini, P. A. (2012). Differentiating BOLD and non-BOLD signals in fMRI time series using multi-echo EPI. Neuroimage 60, 1759–1770. doi: 10.1016/j.neuroimage.2011.12.028
Laeng, B., Sirois, S., and Gredeback, G. (2012). Pupillometry: a window to the preconscious? Perspect. Psychol. Sci. 7, 18–27. doi: 10.1177/1745691611427305
Lak, A., Costa, G. M., Romberg, E., Koulakov, A. A., Mainen, Z. F., and Kepecs, A. (2014). Orbitofrontal cortex is required for optimal waiting based on decision confidence. Neuron 84, 190–201. doi: 10.1016/j.neuron.2014.08.039
Larsen, R. S., and Waters, J. (2018). Neuromodulatory correlates of pupil dilation. Front. Neural. Circuits 12:21. doi: 10.3389/fncir.2018.00021
Leech, R., and Sharp, D. J. (2014). The role of the posterior cingulate cortex in cognition and disease. Brain 137, 12–32. doi: 10.1093/brain/awt162
Leuchs, L., Schneider, M., Czisch, M., and Spoormaker, V. I. (2017). Neural correlates of pupil dilation during human fear learning. Neuroimage 147, 186–197. doi: 10.1016/j.neuroimage.2016.11.072
Li, W., Qin, W., Liu, H., Fan, L., Wang, J., Jiang, T., et al. (2013). Subregions of the human superior frontal gyrus and their connections. Neuroimage 78, 46–58. doi: 10.1016/j.neuroimage.2013.04.011
Lisi, M., Bonato, M., and Zorzi, M. (2015). Pupil dilation reveals top-down attentional load during spatial monitoring. Biol. Psychol. 112, 39–45. doi: 10.1016/j.biopsycho.2015.10.002
Logothetis, N. K., and Pfeuffer, J. (2004). On the nature of the BOLD fMRI contrast mechanism. Magn. Reson. Imaging 22, 1517–1531. doi: 10.1016/j.mri.2004.10.018
Ma, Y., Shaik, M. A., Kozberg, M. G., Kim, S. H., Portes, J. P., Timerman, D., et al. (2016). Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons. Proc. Natl. Acad. Sci. U.S.A. 113, E8463–E8471. doi: 10.1073/pnas.1525369113
Mathot, S., and Van der Stigchel, S. (2015). New light on the mind’s eye: the pupillary light response as active vision. Curr. Dir. Psychol. Sci. 24, 374–378. doi: 10.1177/0963721415593725
McDougal, D. H., and Gamlin, P. D. (2015). Autonomic control of the eye. Compr. Physiol. 5, 439–473. doi: 10.1002/cphy.c140014
Menon, V., and Uddin, L. Q. (2010). Saliency, switching, attention and control: a network model of insula function. Brain Struct. Funct. 214, 655–667. doi: 10.1007/s00429-010-0262-0
Mesulam, M. M. (2004). The cholinergic innervation of the human cerebral cortex. Prog. Brain Res. 145, 67–78. doi: 10.1016/s0079-6123(03)45004-8
Murphy, P. R., O’connell, R. G., O’sullivan, M., Robertson, I. H., and Balsters, J. H. (2014). Pupil diameter covaries with BOLD activity in human locus coeruleus. Hum. Brain Mapp. 35, 4140–4154. doi: 10.1002/hbm.22466
Naber, M., Alvarez, G. A., and Nakayama, K. (2013). Tracking the allocation of attention using human pupillary oscillations. Front. Psychol. 4:919. doi: 10.3389/fpsyg.2013.00919
Nassar, M. R., Rumsey, K. M., Wilson, R. C., Parikh, K., Heasly, B., and Gold, J. I. (2012). Rational regulation of learning dynamics by pupil-linked arousal systems. Nat. Neurosci. 15, 1040–1046. doi: 10.1038/nn.3130
Peysakhovich, V., Vachon, F., and Dehais, F. (2017). The impact of luminance on tonic and phasic pupillary responses to sustained cognitive load. Int. J. Psychophysiol. 112, 40–45. doi: 10.1016/j.ijpsycho.2016.12.003
Posse, S., Wiese, S., Gembris, D., Mathiak, K., Kessler, C., Grosse-Ruyken, M. L., et al. (1999). Enhancement of BOLD-contrast sensitivity by single-shot multi-echo functional MR imaging. Magn. Reson. Med. 42, 87–97. doi: 10.1002/(sici)1522-2594(199907)42:1<87::aid-mrm13>3.0.co;2-o
Rajkowski, J., Kubiak, P., and Aston-Jones, G. (1993). Correlations between locus coeruleus (LC) neural activity, pupil diameter and behavior in monkey support a role of LC in attention. Soc. Neurosci. 19:974.
Reimer, J., Froudarakis, E., Cadwell, C. R., Yatsenko, D., Denfield, G. H., and Tolias, A. S. (2014). Pupil fluctuations track fast switching of cortical states during quiet wakefulness. Neuron 84, 355–362. doi: 10.1016/j.neuron.2014.09.033
Reimer, J., Mcginley, M. J., Liu, Y., Rodenkirch, C., Wang, Q., Mccormick, D. A., et al. (2016). Pupil fluctuations track rapid changes in adrenergic and cholinergic activity in cortex. Nat. Commun. 7:13289. doi: 10.1038/ncomms13289
Sadacca, B. F., Wikenheiser, A. M., and Schoenbaum, G. (2017). Toward a theoretical role for tonic norepinephrine in the orbitofrontal cortex in facilitating flexible learning. Neuroscience 345, 124–129. doi: 10.1016/j.neuroscience.2016.04.017
Scheibner, H. J., Bogler, C., Gleich, T., Haynes, J. D., and Bermpohl, F. (2017). Internal and external attention and the default mode network. Neuroimage 148, 381–389. doi: 10.1016/j.neuroimage.2017.01.044
Schneider, M., Hathway, P., Leuchs, L., Samann, P. G., Czisch, M., and Spoormaker, V. I. (2016). Spontaneous pupil dilations during the resting state are associated with activation of the salience network. Neuroimage 139, 189–201. doi: 10.1016/j.neuroimage.2016.06.011
Schneider, M., Leuchs, L., Czisch, M., Samann, P. G., and Spoormaker, V. I. (2018). Disentangling reward anticipation with simultaneous pupillometry/fMRI. Neuroimage 178, 11–22. doi: 10.1016/j.neuroimage.2018.04.078
Schwalm, M., and Rosales Jubal, E. (2017). Back to pupillometry: how cortical network state fluctuations tracked by pupil dynamics could explain neural signal variability in human cognitive neuroscience. eNeuro 4:ENEURO.293-16.2017. doi: 10.1523/ENEURO.0293-16.2017
Song, A. H., Kucyi, A., Napadow, V., Brown, E. N., Loggia, M. L., and Akeju, O. (2017). Pharmacological modulation of noradrenergic arousal circuitry disrupts functional connectivity of the locus ceruleus in humans. J. Neurosci. 37, 6938–6945. doi: 10.1523/JNEUROSCI.0446-17.2017
Speck, O., and Hennig, J. (1998). Functional imaging by I0- and T2∗-parameter mapping using multi-image EPI. Magn. Reson. Med. 40, 243–248. doi: 10.1002/mrm.1910400210
Sridharan, D., Levitin, D. J., and Menon, V. (2008). A critical role for the right fronto-insular cortex in switching between central-executive and default-mode networks. Proc. Natl. Acad. Sci. U.S.A. 105, 12569–12574. doi: 10.1073/pnas.0800005105
Stawarczyk, D., Majerus, S., Maquet, P., and D’argembeau, A. (2011). Neural correlates of ongoing conscious experience: both task-unrelatedness and stimulus-independence are related to default network activity. PLoS One 6:e16997. doi: 10.1371/journal.pone.0016997
Suzuki, T. W., Kunimatsu, J., and Tanaka, M. (2016). Correlation between pupil size and subjective passage of time in non-human primates. J. Neurosci. 36, 11331–11337. doi: 10.1523/jneurosci.2533-16.2016
Trani, A., and Verhaeghen, P. (2018). Foggy windows: pupillary responses during task preparation. Q. J. Exp. Psychol. 71, 2235–2248. doi: 10.1177/1747021817740856
Unsworth, N., and Robison, M. K. (2018). Tracking arousal state and mind wandering with pupillometry. Cogn. Affect. Behav. Neurosci. 18, 638–664. doi: 10.3758/s13415-018-0594-4
Urai, A. E., Braun, A., and Donner, T. H. (2017). Pupil-linked arousal is driven by decision uncertainty and alters serial choice bias. Nat. Commun. 8:14637. doi: 10.1038/ncomms14637
van den Brink, R. L., Murphy, P. R., and Nieuwenhuis, S. (2016). Pupil diameter tracks lapses of attention. PLoS One 11:e0165274. doi: 10.1371/journal.pone.0165274
van Kempen, J., Loughnane, G. M., Newman, D. P., Kelly, S. P., Thiele, A., O’connell, R. G., et al. (2019). Behavioural and neural signatures of perceptual decision-making are modulated by pupil-linked arousal. eLife 8:e42541. doi: 10.7554/eLife.42541
Varazzani, C., San-Galli, A., Gilardeau, S., and Bouret, S. (2015). Noradrenaline and dopamine neurons in the reward/effort trade-off: a direct electrophysiological comparison in behaving monkeys. J. Neurosci. 35, 7866–7877. doi: 10.1523/JNEUROSCI.0454-15.2015
Wang, C. A., Baird, T., Huang, J., Coutinho, J. D., Brien, D. C., and Munoz, D. P. (2018). Arousal effects on pupil size, heart rate, and skin conductance in an emotional face task. Front. Neurol. 9:1029. doi: 10.3389/fneur.2018.01029
Wang, C. A., Mcinnis, H., Brien, D. C., Pari, G., and Munoz, D. P. (2016). Disruption of pupil size modulation correlates with voluntary motor preparation deficits in Parkinson’s disease. Neuropsychologia 80, 176–184. doi: 10.1016/j.neuropsychologia.2015.11.019
Wierda, S. M., Van Rijn, H., Taatgen, N. A., and Martens, S. (2012). Pupil dilation deconvolution reveals the dynamics of attention at high temporal resolution. Proc. Natl. Acad. Sci. U.S.A. 109, 8456–8460. doi: 10.1073/pnas.1201858109
Xie, Y., Nie, C., and Yang, T. (2018). Covert shift of attention modulates the value encoding in the orbitofrontal cortex. eLife 7:e31507. doi: 10.7554/eLife.31507
Yellin, D., Berkovich-Ohana, A., and Malach, R. (2015). Coupling between pupil fluctuations and resting-state fMRI uncovers a slow build-up of antagonistic responses in the human cortex. Neuroimage 106, 414–427. doi: 10.1016/j.neuroimage.2014.11.034
Keywords: steady-state BOLD-fMRI, pupillometry, human brain, locus coeruleus, granger-causality, functional connectivity
Citation: DiNuzzo M, Mascali D, Moraschi M, Bussu G, Maugeri L, Mangini F, Fratini M and Giove F (2019) Brain Networks Underlying Eye’s Pupil Dynamics. Front. Neurosci. 13:965. doi: 10.3389/fnins.2019.00965
Received: 11 April 2019; Accepted: 28 August 2019;
Published: 18 September 2019.
Edited by:
Daniel Baumgarten, UMIT – Private Universität für Gesundheitswissenschaften, Medizinische Informatik und Technik, AustriaReviewed by:
Merlin D. Larson, University of California, San Francisco, United StatesPeter Herman, Yale University, United States
Copyright © 2019 DiNuzzo, Mascali, Moraschi, Bussu, Maugeri, Mangini, Fratini and Giove. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Mauro DiNuzzo, bWF1cm8uZGludXp6b0BuZXVyb2VuZXJnZXRpY3Mub3Jn