- 1Department of Psychology, Centre for Vision Research, York University, Toronto, ON, Canada
- 2Department of Biology, Centre for Vision Research, York University, Toronto, ON, Canada
- 3Neuroscience Graduate Diploma Program, York University, Toronto, ON, Canada
- 4Division of Fundamental Neurobiology, Toronto Western Hospital Research Institute, Toronto, ON, Canada
- 5Krembil Neuroscience Center, Toronto, ON, Canada
- 6Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, ON, Canada
Visual exploration in primates depends on saccadic eye movements (SEMs) that cause alternations of neural suppression and enhancement. This modulation extends beyond retinotopic areas, and is thought to facilitate perception; yet saccades may also influence brain regions critical for forming memories of these exploratory episodes. The hippocampus, for example, shows oscillatory activity that is generally associated with encoding of information. Whether or how hippocampal oscillations are influenced by eye movements is unknown. We recorded the neural activity in the human and macaque hippocampus during visual scene search. Across species, SEMs were associated with a time-limited alignment of a low-frequency (3–8 Hz) rhythm. The phase alignment depended on the task and not only on eye movements per se, and the frequency band was not a direct consequence of saccade rate. Hippocampal theta-frequency oscillations are produced by other mammals during repetitive exploratory behaviors, including whisking, sniffing, echolocation, and locomotion. The present results may reflect a similar yet distinct primate homologue supporting active perception during exploration.
Introduction
For most primates, exploration of the environment is primarily visual, and makes use of the specialized mechanism of saccadic eye movements (SEMs): the rapid and repetitive displacement of a high-acuity region of the retina to sample different locations in the visual environment. During SEMs, neural activity is suppressed (Latour, 1962; Burr et al., 1994; Reppas et al., 2002; Thiele et al., 2002; Uematsu et al., 2013) whereas after SEMs, during fixation, neural activity is enhanced (Ibbotson et al., 2007, 2008; Cloherty et al., 2010). This fluctuation is thought to promote efficient processing of new visual information (Melloni et al., 2009; Schroeder et al., 2010).
Although saccades are known to modulate visual perception, the most notable effects of saccadic activity have been observed in early and intermediate visual areas (Bair and O'keefe, 1998; Leopold and Logothetis, 1998; Martinez-Conde et al., 2000; Reppas et al., 2002; Thiele et al., 2002; Ibbotson et al., 2007, 2008; Maldonado et al., 2008; Rajkai et al., 2008; Bremmer et al., 2009; Crowder et al., 2009; Cloherty et al., 2010; Ibbotson and Krekelberg, 2011; Ito et al., 2011). In the temporal lobe, eye movements made in the dark or following simple visual stimuli elicited spiking and/or local field potential (LFP) modulation in subdomains such as the superior temporal polysensory area, the parahippocampal gyrus, inferotemporal cortex, and hippocampus, though the consequences for perception are unclear (Ringo et al., 1994; Sobotka et al., 1997, 2002; Purpura et al., 2003; Bartlett et al., 2011; Jutras et al., 2013).
The interaction between neural responses to saccades and to visual stimulation illustrates one role of eye movements in active vision. Eye movements that are concomitant with the onset of new visual information, as occurs during naturalistic visual search, lead to temporal lobe neuronal activity which is phase-locked in the theta-alpha range (Bartlett et al., 2011). This coupling effect is stronger than that predicted exclusively by the visually-evoked response when decoupled from fixation, and is generally consistent with reports of phase-locking and phase-dependent codes in early visual areas (Montemurro et al., 2008; Rajkai et al., 2008; Bosman et al., 2009; Ito et al., 2011). Precisely-timed responses through neural synchronization may facilitate the speed and efficacy of perceptual processing (Masquelier et al., 2009; Panzeri et al., 2010; Turesson et al., 2012; Womelsdorf et al., 2012; Lisman and Jensen, 2013), but such mechanisms are not limited to perception. Precise phase-alignment of spiking activity to oscillations in the rodent hippocampus is posited to be relevant for memory encoding, as well (Tort et al., 2009; Shirvalkar et al., 2010; Lisman and Jensen, 2013).
The hippocampus produces low-frequency theta oscillations (5–10 Hz) during whisking, sniffing, and locomotion in rodents (Grastyán et al., 1959; Vanderwolf, 1969), during echolocation in the bat (Ulanovsky and Moss, 2007), and during passive viewing of images in macaques (Jutras et al., 2013, but see Skaggs et al., 2007). These oscillations are, in turn, associated with encoding of experiences for later recall, for review see Buzsáki (2005); Hasselmo (2005). The role of eye movements in modulating hippocampal oscillations during active search is unknown. Here we asked whether saccades influence hippocampal oscillations during a visual foraging task measured in the human and non-human primate.
Materials and Methods
Participants
Six patients (3 males) with medically refractory epilepsy underwent surgical implantation of subdural surface electrodes and depth macroelectrodes to localize epileptogenic regions. Electrode location and type were selected solely on clinical considerations. These experiments occurred between 2 and 10 days post-operatively, with informed consent, and in accordance with protocols approved by the University Health Network Research Ethics Board and the York University Human Participants Review subcommittee. A single adult rhesus macaque (Macaca mulatta, female, 10 kg) also participated in these experiments following implantation of chronically indwelling tetrodes. The experiments occurred 2–5 months post-operatively, under protocols approved by the Animal Care Committee at York University, in accordance with the Canadian Council for Animal Care.
Experimental Design
The basic experimental design is described previously (Chau et al., 2011). Exceptions are noted in the summary below.
Stimuli
Photographic images were taken from a large collection of natural scenes including landscapes, cityscapes, wildlife, and indoor scenes. One object in a given image was modified in Adobe Photoshop to give the impression that it disappeared, referred to here as the “target.” Sizes, locations, and content of targets were varied to reduce the predictability of the target object by prior experience with the task. Images were presented full-screen at 1280 × 1024 pixel resolution.
Behavioral procedure
Each participant sat approximately 51 cm away from a 38-cm by 30-cm computer monitor. Patients sat in a small testing room under fluorescent lighting with 2–3 experimenters in the room with them. Macaques sat in a private darkened booth inside a room where the experimenters monitored the neural and behavioral activity. All participants first underwent a 13-point calibration of the eye tracker system (patients: iView RED sampled at 60 Hz: macaque: iView high-speed primate, sampled at 1250 Hz, both from SensoMotoric Instruments, Teltow, Germany). The eye tracker was connected via ethernet cable to the stimulus presentation computer running Presentation (NeuroBehavioral Systems, Albany, CA, USA). During each trial of the main task, an original scene was shown in alternation with the target-modified scene, each lasting 500 ms, with an intervening 50-ms gray screen separating these image pairs. Participants searched for the single changing object—the target—and, upon detection, could elicit the end of the trial by fixating the target for 1000 ms. Regardless of whether or not the target was found within the time limit (typically 45 s), the trial ended by removing the gray screen gap, revealing the target as the only changing part of the image thereby removing the “change blindness” illusion. In the case of the macaque, if the target was found in the time limit, this target “giveaway” was accompanied by delivery of a preferred smoothie treat. All participants of the main task viewed trials in blocks of 30, with the number of blocks per analysis varying from 4–10 in the patient participants and spanning 37 blocks for the macaque. With equal probability, the scene pairs in a given trial were either novel or repeated once from a previous trial, and targets were unique to the scenes, i.e., uncued. All but one participant completed this main task.
The remaining participant, Patient 6, was run on a control variation of the task in which only one image of the pair was presented, and with a presentation duration of up to 6 s, after which the target location was revealed through alternation, as described above. Two successions of 10 unique targets-in-scenes were presented, and each succession was repeated 3 times, for a total of 80 trials. As with the main task, the trial ended before the time limit if the target location was fixated for 1000 ms. This control task provided a constant image during exploratory saccades, similar to other memory-guided search tasks (Ryan and Cohen, 2004; Smith et al., 2006; Chau et al., 2011; Chukoskie et al., 2013), removing the interposition of image onsets with saccades, as occurs during the main task.
The inter-trial interval procedures differed across patient and task. In the main task, patients saw a series of screens prompting verbal responses for memory of the scenes and target objects. The macaque was not asked for verbal report but was instead given a 20-s inter-trial interval in which the display was set to black. Similarly, in the control task (Patient 6) the end of the trial proceeded directly to a black display screen lasting 5 s, with no verbal report screen.
Neural Recordings
Electrophysiological recordings in patients were obtained from depth macro electrodes with four electrical contacts used to record hippocampal activity. In addition, patients were implanted with strips of 4–6 subdural platinum-iridium electrodes 3-mm diameter and 10-mm inter-electrode distance (PMT, Chanhassen, MN, USA) targeting anterior temporal, ventral-medial temporal, and posterior temporal locations. A 4-contact subgaleal electrode over the parietal midline and facing away from the brain was used for ground and reference. Signals were filtered at 0.1 Hz–1 kHz, sampled at 5 kHz with a NeuroScan SynAmps2 data acquisition system (Compumedics, Charlotte, NC, USA), and recorded to disk. Electrode localization was verified by co-registering a post-operative CT image with a pre-operative MRI structural image.
In the macaque, quartz platinum tungsten tetrodes (Thomas Recordings, Giessen, Germany) were implanted chronically in a modified 18-drive (Neuralynx Inc, Gray Matter Research, Bozeman, Montana, USA). The guide tube was insulated until the tip, which ended ~4 mm above the hippocampus and served as a local reference. Each tetrode was independently adjustable in depth up to 1 cm. Signal was split between spiking and LFP channels digitally and sampled at 32 and 2 kHz, respectively, using a Digital Lynx acquisition system (Neuralynx, Inc.). LFP was filtered between 0.5 Hz and 2 kHz. Electrode location was determined functionally with characteristic hippocampal activity and structurally using post-operative MRI.
For both neural acquisition systems, serial-output pulses from the Presentation stimulus-delivery PC were used to synchronize neural and behavioral events.
Data Analysis
Eye tracking files were preprocessed with iView X iTools IDF Event Detector, using a dispersion based algorithm (I-VT) with a minimum fixation duration of 80 ms and maximum dispersion of 100 pixels (Salvucci and Goldberg, 2000).
Neural and eye movement data files were read into MATLAB (The Mathworks Inc., Natick, MA), and processed with purpose-built code and the FieldTrip toolbox (Oostenveld et al., 2011). LFP signal preprocessing included resampling to 1 kHz, filtering between 1 and 200 Hz, detrending and—for patient data but not macaque data—a notch filter was applied in preprocessing at 30 and 60 Hz to remove line noise and artifacts. Neural data underwent artifact rejection through the FieldTrip toolbox. No interictal spikes were observed to occur in the data presented here. Subsequent to testing in this experiment, some electrodes were identified as recording from epileptogenic regions (see Table 1, Figure 4D).
Exclusion criteria for eye movements were: 1. any eye movement occurring within the first 1 s of the trial, when strong image-evoked activity occurs and to allow pre-and post- fixation windows to reflect similar visual stimulation conditions, i.e., after image onset. 2. For trials in which the target was found before the time limit, we excluded fixations in the target area of interest that led to the “target found” trigger. In this way we are isolating eye movements during search and not as part of target fixation and recognition. Eye movements were also collected in the inter-trial intervals of the macaque experiment, while in the darkened booth, and in the control task with Patient 6, on the black screen in the lit room. For the analysis of long fixations, we took the subset of fixations that lasted >500 ms and that were immediately preceded by a fixation whose duration was also >500 ms, thereby creating an analysis window that was not contaminated by additional eye movements, and that reflected an eye movement rate of <2 Hz, i.e., below the neural frequencies of interest.
In general, statistical significance was determined in two steps. First, a null distribution was created by shuffling the saccade times in each trial, for all trials for that electrode site, calculating the analytical measure of interest for each data point, and repeating this process 1000 times to identify observed values that exceeded the 0.001 threshold of the null distribution for that data point. Second, a Benjamini–Hochberg FDR correction was applied to the time or time-frequency series of interest, to correct for multiple comparisons. Specific details or exceptions are noted below. The within-trial shuffling was selected to allow an identical number of samples per trial, and trials per analysis, and the same across-trial variability as the original data, jittering only the precise timing to the onset of a given fixation.
Fixation-aligned mean evoked responses (Figure 2) were considered significant if the mean observed response exceeded the 0.002 percentile of the mean shuffled-fixation response distribution (a two-sided test of the 1000-element null distribution). Time-frequency plots aligned to fixation onset were calculated with FieldTrip using a Hanning window of 800 ms from −1.2 to 1.2 s (i.e., windows centered from −800 to 800 ms) taken every 10 ms, in 1-Hz increments from 3 to 80 Hz (Figures 3, 4) and from 3 to 20 Hz (Figure 5). The Hann (or Hanning) window was selected rather than multiple tapers to maximize temporal precision with minimal spectral leakage for these time-limited, low-frequency events of interest. Peri-fixational changes in power were tested by comparing an observed time-frequency power value to those of its fixation-time shuffled distribution, and FDR-correcting for the number of time-frequency points tested.
Phase analysis used the same time and frequency windows as the power analysis. Phase alignment was calculated as the pairwise phase consistency, “PPC,” (Vinck et al., 2010). Briefly, the PPC—like other measures such as the phase locking value (PLV)—is a measure of the consistency of phase across observations for a given frequency. Whereas PLV calculates phase for each event (here, fixation), and then determine the central tendency of the distribution, the PPC calculates the circular distance between pairs observations (the cosine of the absolute angular distances), permuted over the population of events, from which central tendency is then measured. The reasoning is that if events are aligned to a common phase, the average absolute angular distance among event pairs (i.e., among relative phases) will be small. We also calculated the PLV measure for comparison and, as previously established analytically, the PPC approximates the square of the PLV.
For the results shown in Figures 4, 5, observed PPC values were compared to a permuted distribution containing the PPC values obtained when fixation onset times shuffled within-trials (over 1000 permutations). Significance masks were set at the 0.001 threshold of this permuted distribution and also had to survive multiple comparison correction using the Benjamini–Hochberg FDR correction of the Rayleigh distribution, set to q < 0.001. To test the frequency specificity of peri-fixational phase alignment, windows centered from −50 to 250 ms from fixation onset were selected for each frequency 3–80 Hz and tested against the fixation-time shuffled distribution at the respective frequency. Frequencies with PPCs exceeding the p < 0.001 threshold and also surviving the FDR correction are indicated in Figure 4C. Temporal selectivity was tested by comparing these peri-fixational PPC values to those obtained from a window centered −800 to −600 ms prior to fixation onset, i.e., “pre,” and measured using a Wilcoxon signed rank test “signrank” (Figure 4D). PPC data from each individual hippocampus was tested for values exceeding p < 0.001 of its fixation-shuffled distribution obtained over the same time window. The individual results are presented in Figure 4E as a normalized index: (PPC_peri - PPC_pre)/(PPC_peri + PPC_pre), allowing an appreciation of the degree of fixation-related phase alignment above that seen prior to the fixation.
Figure 5 shows the PPC in restricted frequency bands across control conditions. As before, each PPC value is compared to its fixation-shuffled distribution and FDR corrected for its respective plot. Only values exceeding both thresholds survive the mask. For 5A, the original and a subset of data are shown; the subset includes only long fixations before and after the fixation event of interest.
Results
Search Behavior
The seven participants in this study contributed between 1000 and 28000 fixation events during visual scene search (Table 1). All participants actively scanned the image in search of the “target” object (Figures 1A,B for examples) with median fixation durations between 180 and 350 ms across participants (Figures 1C–H).
Figure 1. Saccadic eye movements during visual search. (A) Gaze during one example trial from patient 2. The sequence of gaze locations is shown in purple. The target from this trial was a wind chime, which has been outlined with a yellow dashed rectangle for visibility in this figure. The patient spent the full 45 s searching for the target. (B) Gaze during the same trial viewed by a macaque. Conventions are as in (A), and the macaque also did not find the target on this trial. (C–H) Normalized histogram of fixation durations during the search task for each of the six participants in the main task, respectively. Median search times are listed and indicated with a vertical red line.
Recording Locations
We determined patient recording locations from CT co-registration to the pre-operative MR independently from electrophysiological signal analysis. In addition, the macaque recordings included functional characteristics of hippocampal activity such as sharp wave ripples, and complex spikes, as defined in previous studies (Skaggs et al., 2007). Not all surface electrodes in patients sampled the same regions, with the exception of co-localized temporal pole sampling (e.g., Figure 2A, Table 1).
Figure 2. Localization of electrodes and evoked responses. (A) Renderings from patient 1's MR images with co-localized recording sites. On the left are two coronal sections showing the location of hippocampal depth macroelectrodes, with the most eccentric 1–2 contacts localized to the hippocampus, indicated by the blue dashes. On the right is a rendering of the whole brain, with the anterior tip oriented up and to the right, revealing the locations of subdural surface electrodes. This was the most common arrangement for the patients in this study. (B) Average evoked responses from several electrode locations, aligned to fixation onset. Time is on the x-axis, relative to fixation onset and magnitude in microvolts is on the Y axis. Time points of significant deviations are indicated by the lines at the bottom of the plot, color coded for the corresponding site (p < 0.001 cutoff of the fixation-time shuffled distribution). Note that the post-fixation response is qualitatively strongest in the hippocampus, and shows a polarity reversal across RHD sites; other locations such as the anterior temporal lobe show transient, broad-band modulation around the saccade event. For more information of the electrode locations sampled across subjects, see Table 1.
Evoked Responses
Recordings aligned to fixation onset revealed several patterns of modulation. A fast, transient response just prior to fixation was seen at most sites (green lines, Figure 2B, reflect this across-electrode common response). In comparison to the average, the pre-fixation transient was strongest at the temporal pole sites. The hippocampal probes showed a response following fixation not common to other sites, and which could manifest itself across multiple HC contacts, as opposite-polarity signals, depending on hippocampal recordings site (Figure 2B, second plot). Slight fluctuations in frequency and phase of responses across trials can lead to attenuation of the evoked response, so higher frequencies and sustained responses can be difficult to measure. To evaluate the relative strength of oscillations independent of polarity and of evoked oscillations associated with fixations, we calculated the trial-by-trial spectral power.
Spectral Power
When mean spectral power was calculated from segments of data aligned to fixation during search, a high-frequency (25–80 Hz) power modulation was seen that was significant in 5/9 hippocampi tested (Figure 3). No changes in power under 20 Hz was observed at any recording site. If the theta-band activity is not power-modulated by eye movements, this indicates that either theta occurs independently of eye movements, or its phase is altered without a corresponding change in theta amplitude, as has been observed in other cognitive processes.
Figure 3. Time-frequency spectrogram of hippocampal activity aligned to fixation onset during visual search, grand averaged across each patient. Frequency was measured from 3 to 80 Hz at 1 Hz intervals, time was measured in 800 ms Hanning-tapered windows, shifted every 10 ms. For visualization of each frequency band, power is presented in each band relative to the average seen for that frequency band between ±800 ms around fixation onset. None of the hippocampal recording sites showed theta power modulation, though some exhibited modulation in higher frequency bands.
Post-Fixation Phase Alignment
SEMs elicited phase alignment in all hippocampal recording sites from all participants tested (for example see Figure 4A, for group mean, see Figure 4B). PPC results were qualitatively indistinguishable to those obtained using the PLV measure, so only the PPC values are depicted. The alignment was typically seen within the first 200 ms following fixation, and was restricted to a band that peaked within the 3–8 Hz range (Figure 4C; note non-significant harmonics of individual peaks at 10–16 Hz). In addition, 5/9 hippocampal recordings showed a brief PPC closely locked to the saccade event ranging between 15–35 Hz (Figures 4A,B), but presumably due to its transience, it did not survive significance testing in the −50 to 250 ms centered peri-fixation tests (Figure 4C). Furthermore, the beta-band but not theta-band phase alignment was seen in other sites that had evoked responses to saccades at that time, such as those in the temporal pole (Figure 2).
Figure 4. Phase-alignment to fixations during search shows specificity in frequency and time. (A) Single-subject theta-band phase-locking to fixations. Shown is the pairwise phase consistency (PPC) for each time-frequency bin described in Figure 3, with time on the x axis relative to fixation onset and frequency on the y-axis. Significant PPC values are unmasked (p < 0.001 of fixation-time-shuffled distribution and Rayleigh test p < 0.001 FDR corrected). (B) Group-averaged PPC plots for each hippocampus sampled. Conventions are as in (A), but for the mean PPC values, with no masking. (C) Frequency band-limited hippocampal phase alignment to fixations, across subjects. For each frequency indicated on the x axis, the y-axis shows the mean PPC value from time-frequency points centered −50 to 250 ms from fixation onset, expressed as the proportion of the maximal PPC value of that sample from 3 to 80 Hz and −800 to 800 ms. Each thin line reflects the normalized PPC from a single hippocampus, with significant frequency bands indicated with a thickened gray line; all hippocampi produced significant phase concentration within a 3–8 Hz band; none produced significant phase concentration above 12 Hz. The black bold line is the group-averaged mean (N = 9). (D) Peri-fixational phase alignment, group averages pre and peri-fixation. Average PPC values from time bins centered −50 to 250 ms from fixation onset were compared with PPC values −800 to −600 ms prior to each fixation. *p < 0.01, Wilcoxon signed rank test. (E) Bars reflect the PPC values from each hippocampus recorded, indexed as the difference between the pre- and peri-fixational time windows (see Materials and Methods). Participant number and hemisphere are indicated below each bar.
The duration of phase alignment and the frequency band overlapped with the average rate of saccades (2–6 Hz, Figure 1B). To determine whether hippocampal 3–8 Hz phase is passively reflecting the rate of eye movements, we calculated the PPC for the subset of fixations that were protracted in time (>500 ms fixations for both the aligned and the immediately preceding fixation, or <2 Hz). Figure 5A shows that even for this subset of long fixations, the 3–8 Hz phase effects seen from the full distribution persist. Phase alignment does not persist for longer than when shorter fixations are included, nevertheless, we see alignment at the same frequencies rather than decay or drop in frequency corresponding to the new saccade rate.
Figure 5. Three to eight hertz phase alignment depends on visual search but not on matched-rate (3–6 Hz) saccades. Left columns show full data and right columns the control condition. Significant PPC values are unmasked (p < 0.001 of fixation-time-shuffled distribution and Rayleigh test p < 0.001 FDR corrected). (A) PPC from a single hippocampal recording site in a patient. (B) PPC from the same site, excluding all but fixations lasting >500 ms both before and after the fixation onset of interest. (C) Average PPC from Patient 6 during search in the constant-stimulus version task. (D) Average PPC from the same sites, but for fixations made on the dark screen during the inter-trial intervals. (E) Average PPC from the macaque hippocampus aligned to fixations occurring during the main-task trials, and the inter-trial interval on a black screen (F).
The effects of eye movements on hippocampal activity could be due to sampling new parts of the image, or they could be extra-retinal, reflecting some non-visual correlate of the eye movement itself. To address the relevance of the visual scene search to theta phase alignment, we compared the PPC during search to the PPC following fixations made on the darkened monitor, during the inter-trial intervals. Whereas all recording sites showed phase alignment within the 3–8 Hz band during scene search, no site showed this alignment from fixations that occurred during the ITI (Figures 5D,F).
Finally, the image alternation was occurring throughout visual search in the main task. To determine whether 3–8 Hz phase alignment occurred during visual search independent of the changing stimulus, we tested a patient on a constant-image control task. Theta phase alignment persisted during search on the static image, but was lost during the inter-trial interval, suggesting that image-guided visual search elicits the 3–8 Hz phase alignment.
Discussion
Despite numerous differences across species, both human and monkey share a common mode of visual scene exploration. Capitalizing on the similarities in behavior, we conducted the same task in human and macaque and found a similar response in the hippocampus following fixations during visual search. The response, seen in all participants, was a 3–8 Hz frequency phase-alignment to the fixation. The effect was relatively short lived, lasting around or slightly longer than the typical duration of a fixation, amounting to 2 or 3 cycles of the oscillation. The effect was not driven solely by the rate of eye movements, because it persisted when only long-lasting <500 ms sequences of fixations were considered. The short time course even for long fixations suggests that the response is rapidly dampened, even without the interruption of a subsequent eye movement. Furthermore, the effect was not observed for eye movements made in between search trials, on a darkened monitor (Figure 5D), and even with a darkened environment (Figure 5F). Thus, the eye movement per se was not sufficient to elicit the observed phase-aligned activity, suggesting visual input and/or task-related factors contributed to the phase alignment. When a constant, unchanging scene was presented for the duration of search, the phase alignment persisted, suggesting that exogenous changes in visual input do not underlie the 3–8 Hz phase alignment (Figure 5C).
Three to Eight Hertz Phase Alignment Occurs Without Increases in Power
Some of the earliest descriptions of theta phase resetting or aligning to an independent event, noted that it was not associated with increases in theta power (Buño et al., 1978; Givens, 1996). In the paper by Givens, a continuous conditional discrimination (CCD) showed phase-resetting where a sensory discrimination task did not. Theta power, however, was unchanged across tasks. In human ECoG recordings, theta phase-resetting was not associated with increases in power, suggesting a reorganization of oscillations rather than an evoked response (Rizzuto, 2003). During a Sternberg item recognition task, resetting was the predominant effect, and over a larger spatial extent. Another account of phase alignment without power changes was shown to result from sclerosis (Mormann, 2007), which would be relevant to the patient population; however, in the present study, individual hippocampi with no known or visible signs of pathology also showed phase-alignment in the absence of power changes (Figures 4C,D).
Cellular Correlates of Theta Resetting in the Hippocampus that Account for no Change in Power
The lack of power changes is consistent with spiking data (Vinogradova, 1995; Zugaro et al., 2005) in which theta phase reset is associated with no significant increase in spiking. On the contrary, a resetting stimulus first results in complete quiescence within the hippocampus, followed by periodic increases in spiking activity at the theta frequency. The maxima of the peaks, however, are not greater than the spike rates prior to the resetting stimulus. Thus, increases in spike-field coherence rather than overall firing rate are predicted for the post-saccadic activity. This would be consistent with human unit recordings during a visual recognition memory task in which theta phase-locking but not spike-triggered power distinguished later-remembered vs. later-forgotten trials (Rutishauser et al., 2010). Even in rodents known for sustained hippocampal theta, the spiking activity used to decode the spatiotemporal context occurs within one cycle and can, under some circumstances, flip as rapidly as one theta cycle, suggesting that the underlying coding can be accomplished within this time frame (Jezek et al., 2011).
Phase Clustering and Power Increases
A notable difference between our results and other intracranial results looking at hippocampal responses is that we see only phase effects whereas often both power and phase increases are identified. This suggests that the mechanisms are dissociable in the hippocampus and may be operative under different conditions. A detailed analysis was conducted of the hippocampal potentials during a continuous visual word recognition paradigm in which a button press indicated old or new judgments (Mormann et al., 2005). Phase locking occurred for both hits and correct rejections in the theta and alpha bands. Power increases were greater for hits than for correct rejections, thus, the phase locking they describe appears to be different from the evoked responses in this memory task. In the present study, the lack of phase alignment in the ITI, despite saccade generation, suggests that phase alignment is specific to post-saccadic (retinal) processing rather than an automatic result of the post-saccadic (or extra-retinal) state.
Higher-Frequency Phase and Power Effects
For some participants, hippocampal power above 25 Hz was enhanced in a narrow window around the time of the saccade. In addition, phase alignment was seen in some individual sites at 15–35 Hz, also locked to the saccade event, but none survived the statistical testing in the peri-event window used here. These modulations—especially those also observed in the temporal pole—may be attributable to oculomotor artifact, even in intracranial recordings (Yuval-Greenberg et al., 2008; Kovach et al., 2011; Nagasawa et al., 2011); however, visually-modulated neural responses are also known to occur in early visual areas in these frequency bands (Ito et al., 2013), and gamma oscillations are thought to play an important role in hippocampal computation in rats (Colgin et al., 2009) and primates (Jutras et al., 2009), therefore, the higher frequency responses are not necessarily attributable to eye movement artifacts. In contrast to the higher-frequency responses, the protracted hippocampal response was of lower frequency than that described for oculomotor artifacts, did not modulate power, was not limited to the eye movement duration, showed a polarity reversal across two probes spanning the hippocampus mediolaterally, and was additionally task-dependent: there was greater phase alignment when eye movements were made during the search task than during the inter-trial interval, disambiguating it from other responses.
Whether and Which Theta
The 3–8 Hz response in this task was among the most consistent and robust effects, with all participants showing this band in response to fixation. Like other studies with humans, macaques, and bats, clear theta rhythmicity in this study appears to be shorter-lived than what is seen in the rat. For eye movements, this may fall conveniently within the fixation durations, yet we did not observe a “ringing” or sustained theta commensurate with the sustained fixation windows. One possibility is that the nature of sampling strongly constrains the hippocampal oscillations; the greater the periodicity of movement, the more likely the hippocampus will entrain to it. Alternatively, hippocampal theta in primates may simply not have the same resonance properties as that of the rat hippocampus. Another non-exclusive possibility is that the hippocampus here is matching extra-hippocampal oscillations. Both of these possibilities are broadly supported by the short-lived (500 ms) theta coherence associated with successful memory encoding among hippocampal and other neocortical structures (Burke et al., 2013), theta synchronization associated with visual search (Bosman et al., 2010) and the long-range theta coherence in fronto-parietal networks during planning epochs that are initiated by eye fixations (Phillips et al., 2013). Finally, if eye movements trigger a band-limited response to a single event, the typical rates of repetition of eye movements could nevertheless, produce effects at the cellular level that may be indistinguishable from those produced through sustained or intrinsic rhythms. As such, eye movements could still co-opt the functionality associated with these rhythms as they have been observed in rats. In any case, the hippocampus of primates is sensitive to visual exploratory rhythms; how this constrains or facilitates hippocampal function remains to be seen.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The authors would like to thank Eleanor and Emily Murphy for assistance with the training and recordings in macaques and Martin Vinck for assistance with the phase-analytical measures. We would also like to thank the patients for their willingness and perseverance during recordings. This research was supported by: NSERC CREATE VSA (Rodrigo Montefusco-Siegmund, Timothy K. Leonard), NSERC Discovery Grant (Kari L. Hoffman), CIHR (Cristiano Micheli, Taufik A. Valiante) Alfred P. Sloan Foundation (Kari L. Hoffman), the Krembil Foundation (Kari L. Hoffman), CFI (Kari L. Hoffman), an Ontario MRI ERA (Kari L. Hoffman).
References
Bair, W., and O'keefe, L. P. (1998). The influence of fixational eye movements on the response of neurons in area MT of the macaque. Vis. Neurosci. 15, 779–786.
Bartlett, A. M., Ovaysikia, S., Logothetis, N. K., and Hoffman, K. L. (2011). Saccades during object viewing modulate oscillatory phase in the superior temporal sulcus. J. Neurosci. 31, 18423–18432. doi: 10.1523/JNEUROSCI.4102-11.2011
Bosman, C. A., Womelsdorf, T., Desimone, R., and Fries, P. (2009). A microsaccadic rhythm modulates gamma-band synchronization and behavior. J. Neurosci. 29, 9471–9480. doi: 10.1523/JNEUROSCI.1193-09.2009
Bosman, C. A., Zamorano, F., and Aboitiz, F. (2010). Functional differences of low- and high-frequency oscillatory dynamics during illusory border perception. Brain Res. 1319, 92–102. doi: 10.1016/j.brainres.2010.01.004
Bremmer, F., Kubischik, M., Hoffmann, K. P., and Krekelberg, B. (2009). Neural dynamics of saccadic suppression. J. Neurosci. 29, 12374–12383. doi: 10.1523/JNEUROSCI.2908-09.2009
Buño, W., Garcia-Sanchez, J., and Garcia-Austt, E. (1978). Reset of hippocampal rhythmical activities by afferent stimulation. Brain Res. Bull. 3, 21–28.
Burke, J. F., Zaghloul, K. A., Jacobs, J., Williams, R. B., Sperling, M. R., Sharan, A. D., et al. (2013). Synchronous and asynchronous theta and gamma activity during episodic memory formation. J. Neurosci. 33, 292–304. doi: 10.1523/JNEUROSCI.2057-12.2013
Burr, D. C., Morrone, M. C., and Ross, J. (1994). Selective suppression of the magnocellular visual pathway during saccadic eye movements. Nature 371, 511–513.
Buzsáki, G. (2005). Theta rhythm of navigation: link between path integration and landmark navigation, episodic and semantic memory. Hippocampus 15, 827–840. doi: 10.1002/hipo.20113
Chau, V. L., Murphy, E. F., Rosenbaum, R. S., Ryan, J. D., and Hoffman, K. L. (2011). A flicker change detection task reveals object-in-scene memory across species. Front. Behav. Neurosci. 5:58. doi: 10.3389/fnbeh.2011.00058
Chukoskie, L., Snider, J., Mozer, M. C., Krauzlis, R. J., and Sejnowski, T. J. (2013). Learning where to look for a hidden target. Proc. Natl. Acad. Sci. U. S. A. 110(Suppl. 2), 10438–10445. doi: 10.1073/pnas.1301216110
Cloherty, S. L., Mustari, M. J., Rosa, M. G., and Ibbotson, M. R. (2010). Effects of saccades on visual processing in primate MSTd. Vision Res. 50, 2683–2691. doi: 10.1016/j.visres.2010.08.020
Colgin, L. L., Denninger, T., Fyhn, M., Hafting, T., Bonnevie, T., Jensen, O., et al. (2009). Frequency of gamma oscillations routes flow of information in the hippocampus. Nature 462, 353–357. doi: 10.1038/nature08573
Crowder, N. A., Price, N. S. C., Mustari, M. J., and Ibbotson, M. R. (2009). Direction and contrast tuning of macaque MSTd neurons during saccades. J. Neurophysiol. 101, 3100–3107. doi: 10.1152/jn.91254.2008
Givens, B. (1996). Stimulus-evoked resetting of the dentate theta rhythm: relation to working memory. Neuroreport 8, 159–163.
Grastyán, E., Lissák, K., Madarász, I., and Donhoffer, H. (1959). Hippocampal electrical activity during the development of conditioned reflexes. Electroencephalogr. Clin. Neurophysiol. 11, 409–430.
Hasselmo, M. E. (2005). What is the function of hippocampal theta rhythm?–Linking behavioral data to phasic properties of field potential and unit recording data. Hippocampus 15, 936–949. doi: 10.1002/hipo.20116
Ibbotson, M. R., Crowder, N. A., Cloherty, S. L., Price, N. S. C., and Mustari, M. J. (2008). Saccadic modulation of neural responses: possible roles in saccadic suppression, enhancement, and time compression. J. Neurosci. 28, 10952–10960. doi: 10.1523/JNEUROSCI.3950-08.2008
Ibbotson, M., and Krekelberg, B. (2011). Visual perception and saccadic eye movements. Curr. Opin. Neurobiol. 21, 553–558. doi: 10.1016/j.conb.2011.05.01
Ibbotson, M., Price, N., Crowder, N., Ono, S., and Mustari, M. (2007). Enhanced motion sensitivity follows saccadic suppression in the superior temporal sulcus of the macaque cortex. Cereb. Cortex 17, 1129–1138.
Ito, J., Maldonado, P., and Grün, S. (2013). Cross-frequency interaction of the eye-movement related LFP signals in V1 of freely viewing monkeys. Front. Syst. Neurosci. 7:1. doi: 10.3389/fnsys.2013.00001
Ito, J., Maldonado, P., Singer, W., and Grün, S. (2011). Saccade-related modulations of neuronal excitability support synchrony of visually elicited spikes. Cereb. Cortex 21, 2482–2497. doi: 10.1093/cercor/bhr020
Jezek, K., Henriksen, E. J., Treves, A., Moser, E. I., and Moser, M. B. (2011). Theta-paced flickering between place-cell maps in the hippocampus. Nature 478, 246–249. doi: 10.1038/nature10439
Jutras, M. J., Fries, P., and Buffalo, E. A. (2009). Gamma-band synchronization in the macaque hippocampus and memory formation. J. Neurosci. 29, 12521–12531. doi: 10.1523/JNEUROSCI.0640-09.2009
Jutras, M. J., Fries, P., and Buffalo, E. A. (2013). Oscillatory activity in the monkey hippocampus during visual exploration, and memory formation. Proc. Natl. Acad. Sci. U.S.A. 110, 13144–13149. doi: 10.1073/pnas.1302351110
Kovach, C. K., Tsuchiya, N., Kawasaki, H., Oya, H., Howard, M. A., and Adolphs, R. (2011). Manifestation of ocular-muscle EMG contamination in human intracranial recordings. Neuroimage 54, 213–233. doi: 10.1016/j.neuroimage.2010.08.002
Latour, P. L. (1962). Visual threshold during eye movements. Vision Res. 2, 261. doi: 10.1016/0042-698990031-698990037
Leopold, D. A., and Logothetis, N. K. (1998). Microsaccades differentially modulate neural activity in the striate and extrastriate visual cortex. Exp. Brain Res. 123, 341–345.
Lisman, J. E., and Jensen, O. (2013). The theta-gamma neural code. Neuron 77, 1002–1016. doi: 10.1016/j.neuron.2013.03.007
Maldonado, P., Babul, C., Singer, W., Rodriguez, E., Berger, D., and Grun, S. (2008). Synchronization of neuronal responses in primary visual cortex of monkeys viewing natural images. J. Neurophysiol. 100, 1523–1532. doi: 10.1152/jn.00076.2008
Martinez-Conde, S., Macknik, S. L., and Hubel, D. H. (2000). Microsaccadic eye movements and firing of single cells in the striate cortex of macaque monkeys. (1). Nat. Neurosci. 3, 251–258. doi: 10.1038/72961
Masquelier, T., Hugues, E., Deco, G., and Thorpe, S. (2009). Oscillations, phase-of-firing coding, and spike timing-dependent plasticity: an efficient learning scheme. J. Neurosci. 29, 13484–13493. doi: 10.1523/JNEUROSCI.2207-09.2009
Melloni, L., Schwiedrzik, C. M., Rodriguez, E., and Singer, W. (2009). (Micro)Saccades, corollary activity and cortical oscillations. Trends Cogn. Sci. 13, 239–245. doi: 10.1016/j.tics.2009.03.007
Montemurro, M. A., Rasch, M. J., Murayama, Y., Logothetis, N. K., and Panzeri, S. (2008). Phase-of-firing visual stimuli in coding of natural primary visual cortex. Curr. Biol. 18, 375–380. doi: 10.1016/j.cub.2008.02.023
Mormann, F., Fell, J., Axmacher, N., Weber, B., Lehnertz, K., Elger, C. E., et al. (2005). Phase/amplitude reset and theta-gamma interaction in the human medial temporal lobe during a continuous word recognition memory task. Hippocampus 15, 890–900. doi: 10.1002/hipo.20117
Mormann, F. (2007). Declarative memory formation in hippocampal sclerosis: an intracranial event-related potentials study. Neuroreport 18, 317–321. doi: 10.1097/WNR.0b013e3280287ae9
Nagasawa, T., Matsuzaki, N., Juhász, C., Hanazawa, A., Shah, A., Mittal, S., et al. (2011). Occipital gamma-oscillations modulated during eye movement tasks: simultaneous eye tracking and electrocorticography recording in epileptic patients. Neuroimage 58, 1101–1109. doi: 10.1016/j.neuroimage.2011.07.043
Oostenveld, R., Fries, P., Maris, E., and Schoffelen, J. M. (2011). FieldTrip: open source software for advanced analysis of MEG, EEG, and invasive electrophysiological data. Comput. Intell. Neurosci. 2011, 156869. doi: 10.1155/2011/156869
Panzeri, S., Brunel, N., Logothetis, N. K., and Kayser, C. (2010). Sensory neural codes using multiplexed temporal scales. Trends Neurosci. 33, 111–120. doi: 10.1016/j.tins.2009.12.001
Phillips, J. M., Vinck, M., Everling, S., and Womelsdorf, T. (2013). A long-range fronto-parietal 5- to 10-Hz network predicts “Top-Down” controlled guidance in a task-switch paradigm. Cereb. Cortex. doi: 10.1093/cercor/bht050. [Epub ahead of print].
Purpura, K. P., Kalik, S. F., and Schiff, N. D. (2003). Analysis of perisaccadic field potentials in the occipitotemporal pathway during active vision. J. Neurophysiol. 90, 3455–3478. doi: 10.1152/jn.00011.2003
Rajkai, C., Lakatos, P., Chen, C. M., Pincze, Z., Karmos, G., and Schroeder, C. E. (2008). Transient cortical excitation at the onset of visual fixation. Cereb. cortex 18, 200–209. doi: 10.1093/cercor/bhm046
Reppas, J. B., Usrey, W. M., and Reid, R. C. (2002). Saccadic eye movements modulate visual responses in the lateral geniculate nucleus. Neuron 35, 961–974.
Ringo, J. L., Sobotka, S., Diltz, M. D., and Bunce, C. M. (1994). Eye movements modulate activity in hippocampal, parahippocampal, and inferotemporal neurons. J. Neurophysiol. 71, 1285–1288.
Rizzuto, D. S. (2003). Reset of human neocortical oscillations during a working memory task. Proc. Natl. Acad. Sci. U.S.A. 100, 7931–7936. doi: 10.1073/pnas.0732061100
Rutishauser, U., Ross, I. B., Mamelak, A. N., and Schuman, E. M. (2010). Human memory strength is predicted by theta-frequency phase-locking of single neurons. Nature 464, 903–907. doi: 10.1038/nature08860
Ryan, J. D., and Cohen, N. J. (2004). The nature of change detection and online representations of scenes. J. Exp. Psychol. Hum. Percept. Perform. 30, 988–1015. doi: 10.1037/0096-1523.30.5.988
Salvucci, D. D., and Goldberg, J. H. (2000). “Identifying fixations and saccades in eye-tracking protocols,” in Paper Presented at the Proceedings of the 2000 Symposium on Eye Tracking Research and Applications (Palm Beach Gardens, Florida: ACM), 71–78.
Schroeder, C., Wilson, D., Radman, T., Scharfman, H., and Lakatos, P. (2010). Dynamics of active sensing and perceptual selection. Curr. Opin. Neurobiol. 20, 172–176. doi: 10.1016/j.conb.2010.02.010
Shirvalkar, P. R., Rapp, P. R., and Shapiro, M. L. (2010). Bidirectional changes to hippocampal theta-gamma comodulation predict memory for recent spatial episodes. Proc. Natl. Acad. Sci. U.S.A. 107, 7054–7059. doi: 10.1073/pnas.0911184107
Skaggs, W. E., McNaughton, B. L., Permenter, M., Archibeque, M., Vogt, J., Amaral, D. G., et al. (2007). EEG sharp waves and sparse ensemble unit activity in the macaque hippocampus. J. Neurophysiol. 98, 898–910. doi: 10.1152/jn.00401.2007
Smith, C. N., Hopkins, R. O., and Squire, L. R. (2006). Experience-dependent eye movements, awareness, and hippocampus-dependent memory. J. Neurosci. 26, 11304–11312. doi: 10.1523/JNEUROSCI.3071-06.2006
Sobotka, S., Nowicka, A., and Ringo, J. (1997). Activity linked to externally cued saccades in single units recorded from hippocampal, parahippocampal, and inferotemporal areas of macaques. J. Neurophysiol. 78, 2156–2163.
Sobotka, S., Zuo, W., and Ringo, J. L. (2002). Is the functional connectivity within temporal lobe influenced by saccadic eye movements. J. Neurophysiol. 88, 1675–1684.
Thiele, A., Henning, P., Kubischik, M., and Hoffmann, K. P. (2002). Neural mechanisms of saccadic suppression. Science 295, 2460–2462.
Tort, A. B. L., Komorowski, R. W., Manns, J. R., Kopell, N. J., and Eichenbaum, H. (2009). Theta-gamma coupling increases during the learning of item-context associations. Proc. Natl. Acad. Sci. U.S.A. 106, 20942–20947. doi: 10.1073/pnas.0911331106
Turesson, H. K., Logothetis, N. K., and Hoffman, K. L. (2012). Category-selective phase coding in the superior temporal sulcus. Proc. Natl. Acad. Sci. U.S.A. 109, 19438–19443. doi: 10.1073/pnas.1217012109
Uematsu, M., Matsuzaki, N., Brown, E. C., Kojima, K., and Asano, E. (2013). Human occipital cortices differentially exert saccadic suppression: Iintracranial recording in children. Neuroimage 83, 224–236. doi: 10.1016/j.neuroimage.2013.06.046
Ulanovsky, N., and Moss, C. F. (2007). Hippocampal cellular and network activity in freely moving echolocating bats. Nat. Neurosci. 10, 224–233. doi: 10.1038/nn1829
Vanderwolf, C. H. (1969). Hippocampal electrical activity and voluntary movement in the rat. Electroencephalogr. Clin. Neurophysiol. 26, 407–418.
Vinck, M., van Wingerden, M., Womelsdorf, T., Fries, P., and Pennartz, C. M. A. (2010). The pairwise phase consistency: a bias-free measure of rhythmic neuronal synchronization. Neuroimage 51, 112–122. doi: 10.1016/j.neuroimage.2010.01.073
Vinogradova, O. (1995). Expression, control, and probable functional significance of the neuronal theta-rhythm. Prog. Neurobiol. 45, 523–583.
Womelsdorf, T., Lima, B., Vinck, M., Oostenveld, R., Singer, W., Neuenschwander, S., et al. (2012). Orientation selectivity and noise correlation in awake monkey area V1 are modulated by the gamma cycle. Proc. Natl. Acad. Sci. U.S.A. 109, 4302–4307. doi: 10.1073/pnas.1114223109
Yuval-Greenberg, S., Tomer, O., Keren, A. S., Nelken, I., and Deouell, L. Y. (2008). Transient induced gamma-band response in EEG as a manifestation of miniature saccades. (1). Neuron 58, 429–441. doi: 10.1016/j.neuron.2008.03.027
Keywords: theta, electrocorticography, epilepsy, saccades, phase-locking, macaque, human, foraging
Citation: Hoffman KL, Dragan MC, Leonard TK, Micheli C, Montefusco-Siegmund R and Valiante TA (2013) Saccades during visual exploration align hippocampal 3–8 Hz rhythms in human and non-human primates. Front. Syst. Neurosci. 7:43. doi: 10.3389/fnsys.2013.00043
Received: 08 May 2013; Paper pending published: 28 May 2013;
Accepted: 02 August 2013; Published online: 30 August 2013.
Edited by:
Junji Ito, Research Center Juelich, GermanyReviewed by:
Keith P. Purpura, Weill Cornell Medical College, USALucia Melloni, Max Planck Institute for Brain Research, Germany
Conrado A. Bosman, University of Amsterdam, Netherlands
Copyright © 2013 Hoffman, Dragan, Leonard, Micheli, Montefusco-Siegmund and Valiante. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Kari L. Hoffman, Department of Psychology, Centre for Vision Research, York University, 4700 Keele St., Lassonde Bldg., Toronto, ON M3J 1P3, Canada e-mail: khoffman@yorku.ca