- 1Department of Neurosurgery, Tianjin Medical University General Hospital, Tianjin, China
- 2Department of Surgery, First Teaching Hospital of Tianjin University of Traditional Chinese Medicine, Tianjin, China
- 3Graduate School, Kunming Medical University, Kunming, China
- 4Department of Orthopaedic Surgery, Tianjin Medical University General Hospital, Tianjin, China
- 5Department of Otorhinolaryngology Head and Neck Surgery, Tianjin First Central Hospital, Tianjin, China
- 6School of Medical Imaging and Tianjin Key Laboratory of Functional Imaging, Tianjin Medical University, Tianjin, China
- 7Department of Neurosurgery, Tsinghua University Beijing Tsinghua Changgeng Hospital, Beijing, China
The way spatial memory retrieval is represented in the brain remains unclear to date. Previous studies have displayed a hippocampus-centered navigation network using functional magnetic resonance imaging (fMRI) analysis. There have been some studies on the representation of navigation behavior by signal distribution patterns, but only in the hippocampus and adjacent structures. In this study, we aimed to determine (1) the brain regions that represent information in both intensity and distribution patterns during spatial memory retrieval and (2) whether the patterns of neural responses represent spatial memory retrieval behavior performance. Both univariate analysis [general linear model (GLM)] and multivariate pattern analysis (MVPA) were employed to reveal the spatial distributions of brain responses elicited by spatial memory retrieval. Correlation analyses were performed to detect the correspondences between brain responses and behavior performance. We found that spatial memory retrieval occurred in widespread brain regions, including the bilateral hippocampi, bilateral superior frontal gyrus, bilateral superior parietal lobules, bilateral occipital lobes, and cerebellum. The amplitude of activation in the left hippocampus showed a significant negative correlation (r = −0.46, p = 0.039) with the number of task completions. Additionally, within-subject classification accuracies based on the blood oxygenation level-dependent (BOLD) signal patterns of the right middle temporal gyrus (rMTG) rostral areas in the Brainnetome Atlas showed a significant positive correlation (r = 0.78, p < 0.0001) with retrieval accuracy. In summary, our findings have implications for understanding the separation between navigational and non-navigational states and emphasizing the utility of MVPA in the whole brain.
Introduction
Spatial memory is the storage of information about orientation and location. The way spatial memory is represented in the brain has been a motivating question for decades (Eichenbaum et al., 1999; Buzsaki and Llinas, 2017; Bellmund et al., 2018). Tolman first conducted a water maze experiment in mice to probe this exciting issue and concluded that spatial memory was represented in the central nervous system rather than being a simple stimulus response (Tolman, 1948). This finding was further demonstrated by O’Keefe and colleagues’ discovery of place cells in the rodent hippocampus, which allowed neural instantiation of spatial location in the central nervous system (O’Keefe and Dostrovsky, 1971; O’Keefe and Nadel, 1978). Although correlations between small numbers of neurons and spatial location have been delineated in animals, they have not yet been mapped in the complex human nervous system. However, depicting the nervous activity of spatial memory on a macroscopic scale is essential (Hassabis et al., 2009).
Forty years later, a self-paced Roland’s hometown walking task was initially designed and applied to evaluate mental activity changes involving long-term spatial memory retrieval using positron emission tomography–computed tomography (PET–CT) (Roland et al., 1987). Since then, Roland’s hometown walking task has frequently been used in neuroimaging studies to assess patients’ spatial memory function (e.g., anterior temporal lobe resection, temporal lesions) (Avila et al., 2004, 2006; Janszky et al., 2005; Bonelli et al., 2010; Strandberg et al., 2017). Despite congruent findings, such a free-behaving experiment remained a niche due to uncontrollability and unnecessary complexity, resulting in essentially uninterpretable data (Maguire, 2012). Hence, the correspondence between the behavior performance of memory ability and neural responses is a challenging area to investigate (Banta Lavenex et al., 2015; Fernandez-Baizan et al., 2019a, b). To overcome the limitations mentioned above, investigators have proposed numerous paradigms to quantify spatial memory retrieval process by two-dimensional space, such as recognition visual field location (Jeye et al., 2018; Fritch et al., 2020) or scenario pictures (Lacy et al., 2011), and three-dimensional space, such as a virtual round arena (Nilsson et al., 2013), spatial route learning (Rekkas et al., 2005), the virtual Morris water maze (Antonova et al., 2011; Reynolds et al., 2019), and perspective changing in space (Lambrey et al., 2012). Notably, these previous works frequently used univariate statistical models, focusing on the hippocampus and entorhinal cortex (EC) functions in spatial memory and navigation processes. Neuroimaging and neuropsychological studies have indicated that the hippocampus and EC are not the only regions that mediate spatial memories. The pre-existing spatial cognitive map in some patients remains intact after medial temporal lobe (MTL) impairment (Teng and Squire, 1999), consistent with our clinical experience in patients who underwent MTL resection. In addition, the univariate method may have overlooked information beyond the amplitude of the brain signals (e.g., spatial patterns of brain activation). Spatial signal distribution deserves attention due to the complexity of the cognitive spatial map in the brain. The bridge between the MTL and other cortices associated with spatial memory has not yet been fully built (Maviel et al., 2004; Vann and Albasser, 2011; Moscovitch et al., 2016; Sekeres et al., 2018).
To analyze the distribution pattern of brain signals detected by functional magnetic resonance imaging (fMRI) or electroencephalogram (EEG), multivariate pattern analysis (MVPA) has received increasing attention in brain imaging data analysis (Hassabis et al., 2009; Chadwick et al., 2010, 2012; Bonnici et al., 2012; Nielson et al., 2015; Deuker et al., 2016). MVPA can detect effective information in high-dimensional data to a greater extent, discriminating between experimental conditions and searching for slight individual differences to prevent signal-loss issues (Pereira et al., 2009). Cognitive maps formed in the MTL have been identified in a few studies using MVPA based on fMRI signal patterns. Dissociated patterns between responses in the hippocampus and parahippocampal gyrus were observed in Hassabis and colleagues’ research with two virtual squared rooms (Hassabis et al., 2009). Subsequent work with a large-scale quasi-real environment confirmed that spatial and temporal events could reflect the similarity of neural patterns in the hippocampus from different subjects (Deuker et al., 2016). Another study showed various activation patterns in the anterior hippocampus during retrieval of one’s life, representing distinct experience integration in reality (Nielson et al., 2015). Undoubtedly, neural activation within the MTL can provide a scaffold for episodic memory and navigation, whether in a real or a virtual world. Nevertheless, few studies have used MVPA to study spatial memory representations within the navigation network or brain level.
In the present study, a well-designed three-dimensional spatial memory retrieval task with an egocentric view (Hassabis et al., 2009) was used, and blood oxygenation level-dependent (BOLD) signals were collected. Both univariate and multivariate methods were conducted to identify the brain regions encoding the spatial memory retrieval process, and correlation analyses were performed to reveal the correspondence between neural activities and the behavior performance of memory retrieval. We aimed to determine (1) the brain regions representing the information in both intensity and distribution patterns during spatial memory retrieval and (2) whether the patterns of neural responses reflect a person’s spatial memory ability.
Materials and Methods
Subjects
Twenty young healthy volunteers (men, ranging from 20 to 30 years, 26.3 ± 3.6 years) with no history of psychiatric or neurological illness were recruited. All participants were right-handed, as ascertained by the Edinburgh Handedness Inventory. The study was approved by the ethics committee of Tianjin Medical University General Hospital. All the participants provided written informed consent before the study.
MRI Data Acquisition
All MRI data were acquired using a 3.0 T magnetic resonance scanner (Siemens Prisma) with a 64-channel phased-array head coil. Functional data were acquired using a simultaneous multislice, gradient echo, echo-planar imaging sequence (EPI) with the following parameters: echo time (TE) = 30 ms, repetition time (TR) = 750 ms, field of view (FOV) = 222 × 222 mm, matrix = 74 × 74, in-plane resolution = 3 × 3 mm, flip angle (FA) = 54°, slice thickness = 3 mm, no gap between slices, number of slices = 48, and slice orientation = transverse.
Experimental Design
A validated three-dimensional spatial memory task was applied to evaluate the memory retrieval of spatial locations (Hassabis et al., 2009). All experimental tasks were implemented with the Unity game engine1. An MRI-compatible response collection system with four buttons was available for fMRI experiments, which allowed participants to freely move forward or backward and turn right or left through the environment. During the navigation task, subjects were required to follow a given letter to a specific location in two virtual reality rooms. Each room was 8 × 8 m in square and 3 m in height and consisted of a roof, ground, and four walls, which was smaller than what Hassabis made, allowing the subjects to navigate efficiently during the task phase. Four target positions in the corners labeled A, B, C, and D were reachable according to the layouts of decorations on the wall (i.e., clock, panting, door, chair). A birch-colored table was placed in each corner of the room and was immaterial as a cue during navigation. Participants could walk at a realistic speed of 1.9 m/s in the compartments, which is vital in the spatial updating process, as Hassabis et al. (2009) described (Figures 1A,B).
Figure 1. Experimental design. (A) Navigation task is completed in two virtual reality rooms of different colors (i.e., green or blue) with four decorations on the wall (i.e., clock, panting, door, chair). (B) Schematic of the room layouts with the four target corners, labeled A, B, C, and D. A birch-colored table is placed in each corner of the room and is immaterial as a cue during navigation. The target positions are set under the tables, corresponding to the letters, A, B, C, and D. The two rooms are designed to increase the difficulty of the task. (C) The task proceeds in a block-design manner with a 30 s duration of each block. The task stage alternates with the resting stage in the course of 8 min. In the retrieval stage (task state), participants enter the room and face the wall, where a random letter for the navigation target is displayed for 2 s. When they arrive at the targets, the viewpoint transitions downward so that the identical floor texture occupied the entire field of view. Participants will be given a feedback (a check mark or a cross) after navigation in the learning and testing phase, but not in the scanning stage. After a 3 s countdown, a new letter was given that was to be followed. In the non-retrieval stage (rest state), no letter prompts and no movements were made, and random perspectives were displayed. The subjects were requested to press buttons at the same frequency as the task and watch the screen to ensure visual matching. The entire task is only used to distinguish between navigational (task) and non-navigational (rest) states.
Before scanning, participants immersed themselves in virtual compartments to maximize familiarity with the keyboard controls and were introduced to the navigation task without prior knowledge of matching labels to target positions. They had to reach the target points by the given labels at their own pace. When the participants passed through the incorrect locations, they received feedback from a cross showing on the screen. When the subjects arrived at the designated location, they got a check mark and returned to the virtual room center before the next navigation. Prior to the scanning process, the participants had to meet the criterion performance in a behavioral test in which they had to correctly complete 10 navigation tests in a row in each room to ensure that both layouts had been well mastered. Navigation training took at least 30 min to reach the required performance. Prescanning training was necessary to minimize any learning or novelty effects and stabilize neural activity during retrieval. There was an interval of 1 day between the pretraining task and the formal scanning session. In the retrieval stage, participants entered the room and faced the wall, where a random letter for the navigation target was displayed for 2 s. When they arrived at the targets, the viewpoint transitioned downward so that the identical floor texture occupied the entire field of view. After a 3 s countdown, a new letter was given that was to be followed (Figure 1C). Before proceeding in the scanner, the subject needed to complete as many retrieval tasks as possible in 4 min. The number of task completions and the accuracy of retrieval tasks were gathered for further analysis.
Throughout the scanning, the task proceeded in a block-design manner with a 30 s duration of each block. The task stage alternated with the resting stage in the course of 8 min. No letter prompts and no movements were made in the rest phase, and random perspectives were displayed. The subjects were requested to press buttons at the same frequency as the task and continue to watch the screen until the prompt letter appeared in the center of the screen (Figure 1C). The two stages were matched in terms of visual content and hand movements to the maximum extent.
Image Preprocessing
The fMRI data were preprocessed using Statistical Parametric Mapping (SPM12)2 with the following steps: realignment (correction for head motion-induced intervolume displacement), normalization to the Montreal Neurological Institute (MNI) space using the unified normalization–segmentation procedure via the structural images, and spatial smoothing using a Gaussian kernel of 5 mm full-width at half-maximum (FWHM). Default high-pass temporal filtering (1/128 Hz cut-off) in SPM12 was applied to remove low-frequency noise and signal drifts from each voxel’s fMRI time course.
General Linear Model
The rationale behind the localization of brain regions associated with spatial memory is that the amplitude of such responses depends on the specific spatial task. To formally test this hypothesis, we performed a general linear model (GLM) analysis to identify brain areas where neural activity correlates with spatial memory tasks by contrasting the retrieval state (task phase) and non-retrieval state (rest phase). The two states were modeled as separate regressors in GLM. Six head motion parameters (estimated from the realignment step during fMRI data preprocessing) were included as covariates in the GLM. The contrast maps corresponding to the retrieval state (task phase) minus the non-retrieval state (rest phase) in the first-level analysis were further entered into a second-level one-sample T-test to obtain group-level results. The significance level was set at p < 0.001 at the voxel level, corrected to p < 0.05 using family-wise error (FWE) at the cluster level. Averaged beta values within significantly activated clusters were extracted and correlated with the behavior scores (i.e., retrieval completed times and retrieval accuracy).
Multivariate Pattern Analysis
MVPA of fMRI signals has recently gained popularity in the neuroimaging community. MVPA is considered a sensitive method to recognize the variation in brain activation and was employed in our analysis. MVPA is a machine learning technique that uses a pattern classifier (Mur et al., 2009; Pereira et al., 2009) to identify the representational content of the neural responses elicited by spatial memory retrieval. In contrast with univariate analyses that detect regional averaged signals and consider a single voxel or a single region of interest (ROI) at a time, MVPA analyzes the spatial pattern of fMRI signals across all voxels within a predefined area. That is, MVPA detects condition-specific patterns of activity across many voxels at once. Whereas GLM directly compares differences in signal amplitude on a voxel-by-voxel basis, MVPA projects samples composed of multiple voxels from each condition of interest into a high-dimensional space and searches for the boundary between the samples from two or more conditions (Mur et al., 2009). MVPA is usually more sensitive than conventional univariate analysis (i.e., GLM) in revealing differences in brain activity between experimental conditions because it offers a powerful solution to the problem of multiple comparisons. It performs a joint analysis of patterns of activity distributed across multiple voxels. In the current study, we applied both within-subject and between-subject MVPAs to detect spatial memory retrieval neural responses. All analyses were conducted using custom scripts written in MATLAB (MathWorks, Natick, MA, United States) in combination with LibSVM implementation of the linear support vector machine (SVM)3 using a linear kernel. The parameters of the SVM were set to their default values. In both the within-subject and the between-subject MVPA, we only distinguished between navigational and non-navigational states. If there was no specific information, the average classification accuracy was 50%.
Within-Subject MVPA
For within-subject MVPA, the detailed procedures were as follows: for each subject, (1) the averaged BOLD signal of each trial was calculated and labeled as the task stage and the rest stage, (2) the MVPAs were performed in each brain defined by the Brainnetome Atlas4 (Fan et al., 2016) and cerebellum templates in Automated Anatomical Labeling (AAL) atlas (Tzourio-Mazoyer et al., 2002), and for each brain region, the BOLD signals of all rest and task trials were extracted and used as features for classification. Leave-one-out cross-validation (LOOCV) was conducted, and the average classification accuracy for each subject was obtained. (3) Subsequently, the accuracy of all subjects within each brain region was fed into one-sample T-tests separately to generate a T value brain map. The corresponding p-values were corrected by Bonferroni correction (p < 0.05/272).
Between-Subject MVPA
For between-subject MVPA, the detailed procedures were as follows: (1) the beta maps generated by GLM analyses were labeled as the task stage and the rest stage, (2) MVPAs were performed in each brain defined by the Brainnetome Atlas, and for each brain region, the beta values of all rest and task maps across subjects were extracted and used as features for classification. LOOCV was conducted to obtain group-level classification accuracy. The statistical significance of the classification model was determined by a permutation test (n = 1,000) and corrected for multiple comparisons (p < 0.05, corrected for FWE) using an in-house MATLAB (R2017a) script. Briefly, in each permutation step, after randomly shuffling the labels of all beta maps, SVM models were performed to generate corresponding classification accuracies in brain regions defined by the Brainnetome Atlas and cerebellum templates in the AAL Atlas, and the maximal classification accuracy across all regions was selected. This procedure was repeated 1,000 times and resulted in 1,000 maximal classification accuracies used to generate the null distribution for calculating the p-value of each brain region. Note that because the null distribution was generated using the maximal classification accuracies across all brain regions, the resultant p-values were automatically corrected for FWE (Nichols and Hayasaka, 2003).
Results
Behavioral Results
All 20 subjects successfully completed the test. In the behavioral research phase, the average accuracy of retrieval tasks within 4 min was 94.52% (SD = 5.77), and the average number of task completions was 26.65 (SD = 3.13).
GLM Results and Behavioral Relevance
Using a voxelwise GLM analysis model to determine the effect of spatial memory retrieval, we found that the amplitude of fMRI responses was associated with spatial memory retrieval (at p < 0.001, FWE correction corrected for p < 0.05 at the cluster level) in widespread brain areas, including the bilateral hippocampi, bilateral frontal superior gyri, bilateral superior parietal lobule (SPL), bilateral occipital lobe, and cerebellum. The detailed information can be found in Table 1. The spatial distribution of these brain regions can be found in Figure 2. In the current study, significantly activated brain regions were the core parts often elicited by spatial memory retrieval (Nilsson et al., 2013; Reynolds et al., 2019). Subsequently, the correspondences between the amplitude brain responses and the behavior performance were detected by performing Pearson correlation analysis. The average beta values of the abovementioned clusters were extracted and correlated with the behavior performance (i.e., completion times and accuracy). The beta value in the left hippocampus showed a significant negative correlation (r = 0.46, p = 0.039) with the number of task completions quantified by behavior assessment (Figure 3, left).
Figure 2. Activation map obtained from the “navigational vs. non-navigational” state (at p < 0.001, corrected by FWE for p < 0.05 at the cluster level). The hot bar at the bottom labels T value from 0 to 15. Numbers represent X (sagittal view), Y (coronal view), and Z (axial view) coordinates in the MNI space.
Figure 3. The beta value in the left hippocampus shows a significant negative correlation (r = 0.46, p = 0.039) with the number of task completions (left). Within-subject classification accuracies positively correlated with the spatial memory retrieval accuracy (r = 0.775, p = 0.0079) in the rMTG (right).
Within-Subject MVPA
Considering GLM restriction, the lack of scrutinization of distribution patterns and information mining toward small sample data, we performed MVPA to detect the neural responses elicited by spatial memory retrieval. We conducted within-subject MVPA in brain regions defined by the Brainnetome Atlas using the average BOLD signal of each trial. We found that widespread brain regions showed high classification accuracies between the task and rest stages (corrected by Bonferroni correction) (Figure 4). The average classification accuracy of each brain region is presented in Table 2. Brain regions with accuracies higher than 80% included two subregions in the right lateral occipital cortex (LOcC), two subregions in the left SPL, one subregion in the right SPL, and two subregions in the medioventral occipital cortex (MVOcC) according to the Brainnetome Atlas. Detailed information on all corrected subregions is shown in Supplementary Table 1. Moreover, we found that the within-subject classification accuracies positively correlated with the spatial memory retrieval accuracy (r = 0.775, p = 0.0079; Figure 3, right) in the rostral area of the right middle temporal gyrus (rMTG).
Figure 4. Whole-brain regionwise within-subject MVPA result obtained from “navigational vs. non-navigational” state classification. The hot bar at the bottom indicates percentage accuracy values. Numbers represent X (sagittal view), Y (coronal view), and Z (axial view) coordinates in the MNI space.
Between-Subject MVPA
By applying regionwise between-subject MVPA, we found that numerous regions showed high classification accuracy between task- and rest-stage beta maps. These brain regions are mainly located in the paracentral lobule, basal ganglia, superior frontal gyrus, MVOcC, and SPL (Figure 5). The arithmetic average classification accuracy of each brain region is presented in Table 2. Detailed information can be found in Supplementary Table 2. These brain regions mainly overlapped with our previous results.
Figure 5. Whole-brain regionwise between-subject MVPA result obtained from “navigational vs. non-navigational” state classification. The hot bar at the bottom indicates percentage accuracy values. Numbers represent X (sagittal view), Y (coronal view), and Z (axial view) coordinates in the MNI space.
Discussion
The present results indicate that the brain’s vast regions are associated with spatial memory retrieval in univariate and multivariate ways. Spatial memory recognition therefore depends on the whole brain, not just the MTL structures. In the behavioral analysis, the amplitude of average fMRI signals in the left hippocampus showed a significant negative correlation with the number of task completions in a limited time. In addition, task retrieval accuracy positively correlates with the classification accuracy given by the patterns of the rMTG rostral areas in the Brainnetome Atlas. Therefore, MVPA-based spatial memory analysis should be extended from the hippocampus or MTL structures to the whole-brain level to deepen our understanding of spatial memory.
Multivariate-Based Brain Map in Spatial Memory
The increasing application of MVPA brings sensitivity to fluctuations in multivariate information and offers the possibility to attach further details in spatial memory. Chadwick et al. (2012) previously reviewed their four published MVPA studies that specifically focused on the MTL, including spatial information recognition (Hassabis et al., 2009), individual episodic memory discrimination (Chadwick et al., 2010), identifying the overlapping information in episodes (Chadwick et al., 2011), and decoding overlapping scene representations (Bonnici et al., 2012). Their experiments convincingly highlight the potential utility of MVPA in hippocampal analyses. Additionally, recent publications have significantly improved hippocampus-specific analysis of spatial memory (Hassabis et al., 2009; Nielson et al., 2015; Deuker et al., 2016). Hassabis et al. (2009) demonstrated that the hippocampal neuron population represented precise spatial positions, whereas voxels in the parahippocampal gyrus expressed environmental information in two virtual cubical spaces. We also used this paradigm in our research to distinguish the differences between navigational and non-navigational states instead of spatial location or environmental information. Deuker et al. (2016) introduced a novel experimental paradigm that allowed them to investigate spatial and temporal aspects of memory in a large-scale virtual city. Their results provided a new explanation for a common coding mechanism of episodic and spatial memory, in which the spatiotemporal network was reflected in the hippocampus’s neural patterns. In real life, another report showed that both spatial and temporal contexts were encoded within the hippocampus across various scales of magnitude, up to 1 month in time and 30 km in distance (Nielson et al., 2015). MVPAs enable scientists to decode complex, overlapping, and practical information from voxel patterns in the human hippocampus, whether in rigorous laboratory conditions or in the real world.
Remarkably, the MVPA method primarily focuses on detecting diverse patterns of neural signal changes relating to specific stimuli information in the brain in addition to the BOLD intensity from standard fMRI analyses. Region-specific analyses by MVPA within the hippocampus consolidate its place in spatial memory retrieval and navigation. However, there is less focus on the rest of the brain areas. Thus, it is worth exploring whether there is any difference between the multivariate-based brain map and univariate-based activation map in the spatial memory task. This study aims to identify cortices involving spatial memory across the brain by MVPA, referring to Hassabis’s paradigm (Hassabis et al., 2009). We first present a multivariate-based spatial navigation map consisting mainly of the bilateral hippocampi, bilateral superior frontal gyrus, bilateral SPLs, bilateral occipital lobes, and cerebellum. The univariate (Figure 2) and multivariate (Figures 4, 5) images display a fair visual uniformity in spatial distribution. To show consistency with similar experiments, Neurosynth (Yarkoni et al., 2011), an automated meta-analysis platform5, was used to present a navigation-based synthetic activation map (Supplementary Figure 1) from 77 published articles. As in the above three maps (Uncorrected Annotation Univariate map, Figure 2; Multivariate map, Figures 4, 5; Synthetic map, Supplementary Figure 1), brain regions in the “navigation network” beyond the hippocampus mainly overlap with three regions, SPL, MVOcC, and LOcC.
To better illustrate the navigation map, we need to describe the spatial information processing method in detail. Spatial processing is well organized by two hierarchical pathways: the ventral stream (or the “what” pathway) for object vision and the dorsal stream (or the “how” pathway) for spatial vision (Ungerleider and Haxby, 1994; Konen and Kastner, 2008). Kravitz et al. (2011) updated a novel neural framework for visuospatial processing and redefined the dorsal stream’s anatomical origin. Posterior regions of the parietal cortex, including medial portions of the SPL, are critical in the dorsal stream. Much research has provided evidence that some parietal lobe parts encode spatial performance in the human brain (Fein et al., 2009; Gottlieb and Snyder, 2010; Vandenberghe et al., 2012). The SPL plays a central role in spatial functions, such as spatial attention, saccadic eye movements (Gottlieb and Snyder, 2010), and memory tasks (Simons et al., 2010; Vandenberghe et al., 2012). Posterior parietal lesions can also lead to egocentric disorientation (Aguirre and D’Esposito, 1999) and an inability to localize objects in space (Kase et al., 1977). This deficit indicates that the posterior parietal cortex is the source of the egocentric information needed for navigation. In our research, bilateral occipitoparietal cortices were revealed among these three maps (Figures 2, 4, 5) with a high T value in GLM analysis and high accuracy of MVPA classification. These results strengthen the previous conclusion that the posterior parietal cortex is associated with spatial memory in BOLD signal intensity and distribution patterns. However, it is difficult to determine how the three pathways form in the posterior parietal cortex. The distribution pattern within this region may involve the separation of functions, which MVPA might resolve.
The GLM approach, the “gold” standard in fMRI research, is usually referred to as a mass univariate model-based analysis, revealing linear correlations between time course and task design. MVPA is a classification algorithm that captures subtle differences in informative voxel distributions between various conditions based on SVM in general. Both methods were adopted in this research to compare the distribution of multivariate and univariate information. In our maps, although the multivariate and univariate information overlapped for the most part, there were slight differences as well. Classification accuracy within the hippocampus is lower than that calculated from the SPL, MVOcC, and LOcC, especially in within-subject MVPA, in which the classification accuracy fails to pass the correction. The decision whether to navigate is likely embodied in these areas. Further detailed experimental designs are needed to compare the representation of navigation decisions in these brain regions.
Behavioral Analyses in the Hippocampus and rMTG
The MTL structures, particularly the hippocampus, showed enhanced brain activity during navigation (Epstein et al., 2017). We found the same neural signaling alterations in the hippocampus (Figure 2 and Table 1). In the behavior analysis, we noticed that the beta value of the left hippocampus showed a significant negative correlation (r = 0.46, p = 0.039) with the number of task completions in a limited time. Because all subjects underwent multiple exercises before the scanning, we assume that lower neural activity was required for well-trained subjects than for others to achieve the same performance. The reduction in neural activity caused by repeated stimuli is the robust cortical activity associated with experience (Vannini et al., 2013). In studies of episodic memory, repetition suppression has been observed in the hippocampus and adjacent brain regions in the MTL, suggesting that suppression may reflect successful encoding or consolidation (Gonsalves et al., 2005; Rand-Giovannetti et al., 2006; Suzuki et al., 2011). A significant number of studies using two-dimensional images as experimental materials have produced the same conclusion, although a similar effect in a three-dimensional environment has not yet been confirmed.
We first report that classification accuracy based on the patterns of the rMTG rostral areas in the Brainnetome Atlas showed a remarkably significant correlation with task performance by using MVPA. Under the strictest correction, the rostral areas of the rMTG, located in the anterior temporal lobe, showed a high Pearson correlation coefficient (r = 0.7750), which suggested that potential neural function correlated with spatial memory retrieval. A previous study indicated that anterior temporal lobe resection might impair memory function, typically visual memory following right anterior temporal lobe resection (Bonelli et al., 2013). Patients who undergo from right anterior temporal resections demonstrate deficits of memory for locations in both two-dimensional and three-dimensional performances (Diaz-Asper et al., 2006). We suggest that the rostral areas of the rMTG may serve as an essential component of the parieto-medial temporal pathway and have a vital function in visuospatial retrieval.
Limitations
Gender differences were frequently discussed in previous studies (Persson et al., 2013; Spets et al., 2019) that showed that men have better performance in spatial memory tasks and different patterns of cortical activity. To better elucidate how spatial memory is encoded in the brain, we recruited only male subjects to ensure homogeneity. However, sex comparisons should be a significant component of further studies. With regard to data continuity and comparability, we collected only behavioral data from the MRI unit. Further analysis should be performed using behavioral data obtained both inside and outside the MRI unit.
Conclusion
In summary, whole-brain maps of spatial memory retrieval in cubical space were generated using GLM and MVPA in our study. Certain distribution patterns in these regions, the posterior parietal cortex and rMTG, are specific to spatial memory retrieval. These results show global and regional effects in the brain during spatial memory retrieval. MVPA provides assistance in obtaining more information about spatial memory in the brain.
Data Availability Statement
The raw data supporting the conclusions of this article will be made available by the authors, without undue reservation.
Ethics Statement
The studies involving human participants were reviewed and approved by the Medical Ethics Committee of Tianjin Medical University General Hospital. The patients/participants provided their written informed consent to participate in this study. Written informed consent was obtained from the individual(s) for the publication of any potentially identifiable images or data included in this article.
Author Contributions
JG wrote the main manuscript text. JG and RZ performed the data analyses. KZ and JZ designed the experiments. JZ, YLin, and SY conducted the experiments. JZ and YLia was responsible for data collection. KZ, WQ, and XY supervised the experimental framework. KZ and XY supervised the analyses. All authors have read and agreed to the published version of the manuscript.
Funding
The research was funded by the National Key Research and Development Program of China (No. 2018YFC0115603) and the Tianjin Medical University Clinical Medicine Research Project (No. 2018kylc001).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
We sincerely thank fellows from the Department of Radiology, Tianjin Medical University General Hospital for their assistance in MRI scanning and data processing.
Supplementary Material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fncir.2021.624352/full#supplementary-material
Footnotes
- ^ https://unity3d.com/
- ^ https://www.fil.ion.ucl.ac.uk/spm/
- ^ www.csie.ntu.edu.tw/∼cjlin/libsvm
- ^ http://atlas.brainnetome.org
- ^ www.neurosynth.org
References
Aguirre, G. K., and D’Esposito, M. (1999). Topographical disorientation: a synthesis and taxonomy. Brain 122(Pt 9), 1613–1628. doi: 10.1093/brain/122.9.1613
Antonova, E., Parslow, D., Brammer, M., Simmons, A., Williams, S., Dawson, G. R., et al. (2011). Scopolamine disrupts hippocampal activity during allocentric spatial memory in humans: an fMRI study using a virtual reality analogue of the Morris Water Maze. J. Psychopharmacol. 25, 1256–1265. doi: 10.1177/0269881110379285
Avila, C., Barrós-Loscertales, A., Forn, C., Mallo, R., Parcet, M. A., Belloch, V., et al. (2006). Memory lateralization with 2 functional MR imaging tasks in patients with lesions in the temporal lobe. AJNR Am. J. Neuroradiol. 27, 498–503.
Avila, C., Parcet, M. A., Barros, A., Forn, C., Mallol, R., Gonzalez Darder, J. M., et al. (2004). [Memory evaluation using functional magnetic resonance: applications in preoperative patients and in Alzheimer’s disease]. Rev. Neurol. 38, 284–291.
Banta Lavenex, P., Boujon, V., Ndarugendamwo, A., and Lavenex, P. (2015). Human short-term spatial memory: precision predicts capacity. Cogn. Psychol. 77, 1–19. doi: 10.1016/j.cogpsych.2015.02.001
Bellmund, J. L. S., Gärdenfors, P., Moser, E. I., and Doeller, C. F. (2018). Navigating cognition: spatial codes for human thinking. Science 362:eaat6766. doi: 10.1126/science.aat6766
Bonelli, S. B., Powell, R. H., Yogarajah, M., Samson, R. S., Symms, M. R., Thompson, P. J., et al. (2010). Imaging memory in temporal lobe epilepsy: predicting the effects of temporal lobe resection. Brain 133(Pt 4), 1186–1199. doi: 10.1093/brain/awq006
Bonelli, S. B., Thompson, P. J., Yogarajah, M., Powell, R. H., Samson, R. S., McEvoy, A. W., et al. (2013). Memory reorganization following anterior temporal lobe resection: a longitudinal functional MRI study. Brain 136(Pt 6), 1889–1900. doi: 10.1093/brain/awt105
Bonnici, H. M., Kumaran, D., Chadwick, M. J., Weiskopf, N., Hassabis, D., and Maguire, E. A. (2012). Decoding representations of scenes in the medial temporal lobes. Hippocampus 22, 1143–1153. doi: 10.1002/hipo.20960
Chadwick, M. J., Bonnici, H. M., and Maguire, E. A. (2012). Decoding information in the human hippocampus: a user’s guide. Neuropsychologia 50, 3107–3121. doi: 10.1016/j.neuropsychologia.2012.07.007
Chadwick, M. J., Hassabis, D., and Maguire, E. A. (2011). Decoding overlapping memories in the medial temporal lobes using high-resolution fMRI. Learn. Mem. 18, 742–746. doi: 10.1101/lm.023671.111
Chadwick, M. J., Hassabis, D., Weiskopf, N., and Maguire, E. A. (2010). Decoding individual episodic memory traces in the human hippocampus. Curr. Biol. 20, 544–547. doi: 10.1016/j.cub.2010.01.053
Deuker, L., Bellmund, J. L., Navarro Schröder, T., and Doeller, C. F. (2016). An event map of memory space in the hippocampus. eLife 5:e16534.
Diaz-Asper, C. M., Dopkins, S., Potolicchio, S. J. Jr., and Caputy, A. (2006). Spatial memory following temporal lobe resection. J. Clin. Exp. Neuropsychol. 28, 1462–1481. doi: 10.1080/13803390500434359
Eichenbaum, H., Dudchenko, P., Wood, E., Shapiro, M., and Tanila, H. (1999). The hippocampus, memory, and place cells: is it spatial memory or a memory space? Neuron 23, 209–226.
Epstein, R. A., Patai, E. Z., Julian, J. B., and Spiers, H. J. (2017). The cognitive map in humans: spatial navigation and beyond. Nat. Neurosci. 20, 1504–1513. doi: 10.1038/nn.4656
Fan, L., Li, H., Zhuo, J., Zhang, Y., Wang, J., Chen, L., et al. (2016). The human brainnetome atlas: a new brain atlas based on connectional architecture. Cereb. Cortex 26, 3508–3526. doi: 10.1093/cercor/bhw157
Fein, G., Shimotsu, R., Chu, R., and Barakos, J. (2009). Parietal gray matter volume loss is related to spatial processing deficits in long-term abstinent alcoholic men. Alcohol Clin. Exp. Res. 33, 1806–1814. doi: 10.1111/j.1530-0277.2009.01019.x
Fernandez-Baizan, C., Arias, J. L., and Mendez, M. (2019a). Spatial memory in young adults: gender differences in egocentric and allocentric performance. Behav. Brain Res. 359, 694–700. doi: 10.1016/j.bbr.2018.09.017
Fernandez-Baizan, C., Diaz-Caceres, E., Arias, J. L., and Mendez, M. (2019b). Egocentric and allocentric spatial memory in healthy aging: performance on real-world tasks. Braz. J. Med. Biol. Res. 52:e8041.
Fritch, H. A., MacEvoy, S. P., Thakral, P. P., Jeye, B. M., Ross, R. S., and Slotnick, S. D. (2020). The anterior hippocampus is associated with spatial memory encoding. Brain Res. 1732:146696. doi: 10.1016/j.brainres.2020.146696
Gonsalves, B. D., Kahn, I., Curran, T., Norman, K. A., and Wagner, A. D. (2005). Memory strength and repetition suppression: multimodal imaging of medial temporal cortical contributions to recognition. Neuron 47, 751–761. doi: 10.1016/j.neuron.2005.07.013
Gottlieb, J., and Snyder, L. H. (2010). Spatial and non-spatial functions of the parietal cortex. Curr. Opin. Neurobiol. 20, 731–740. doi: 10.1016/j.conb.2010.09.015
Hassabis, D., Chu, C., Rees, G., Weiskopf, N., Molyneux, P. D., and Maguire, E. A. (2009). Decoding neuronal ensembles in the human hippocampus. Curr. Biol. 19, 546–554. doi: 10.1016/j.cub.2009.02.033
Janszky, J., Jokeit, H., Kontopoulou, K., Mertens, M., Ebner, A., Pohlmann-Eden, B., et al. (2005). Functional MRI predicts memory performance after right mesiotemporal epilepsy surgery. Epilepsia 46, 244–250. doi: 10.1111/j.0013-9580.2005.10804.x
Jeye, B. M., MacEvoy, S. P., Karanian, J. M., and Slotnick, S. D. (2018). Distinct regions of the hippocampus are associated with memory for different spatial locations. Brain Res. 1687, 41–49. doi: 10.1016/j.brainres.2018.02.029
Kase, C. S., Troncoso, J. F., Court, J. E., Tapia, J. F., and Mohr, J. P. (1977). Global spatial disorientation. Clinico-pathologic correlations. J. Neurol. Sci. 34, 267–278.
Konen, C. S., and Kastner, S. (2008). Two hierarchically organized neural systems for object information in human visual cortex. Nat. Neurosci. 11, 224–231. doi: 10.1038/nn2036
Kravitz, D. J., Saleem, K. S., Baker, C. I., and Mishkin, M. (2011). A new neural framework for visuospatial processing. Nat. Rev. Neurosci. 12, 217–230. doi: 10.1038/nrn3008
Lacy, J. W., Yassa, M. A., Stark, S. M., Muftuler, L. T., and Stark, C. E. (2011). Distinct pattern separation related transfer functions in human CA3/dentate and CA1 revealed using high-resolution fMRI and variable mnemonic similarity. Learn. Mem. 18, 15–18. doi: 10.1101/lm.1971111
Lambrey, S., Doeller, C., Berthoz, A., and Burgess, N. (2012). Imagining being somewhere else: neural basis of changing perspective in space. Cereb. Cortex 22, 166–174. doi: 10.1093/cercor/bhr101
Maguire, E. A. (2012). Studying the freely-behaving brain with fMRI. Neuroimage 62, 1170–1176. doi: 10.1016/j.neuroimage.2012.01.009
Maviel, T., Durkin, T. P., Menzaghi, F., and Bontempi, B. (2004). Sites of neocortical reorganization critical for remote spatial memory. Science 305, 96–99. doi: 10.1126/science.1098180
Moscovitch, M., Cabeza, R., Winocur, G., and Nadel, L. (2016). Episodic memory and beyond: the hippocampus and neocortex in transformation. Annu. Rev. Psychol. 67, 105–134. doi: 10.1146/annurev-psych-113011-143733
Mur, M., Bandettini, P. A., and Kriegeskorte, N. (2009). Revealing representational content with pattern-information fMRI–an introductory guide. Soc. Cogn. Affect. Neurosci. 4, 101–109. doi: 10.1093/scan/nsn044
Nichols, T., and Hayasaka, S. (2003). Controlling the familywise error rate in functional neuroimaging: a comparative review. Stat. Methods Med. Res. 12, 419–446. doi: 10.1191/0962280203sm341ra
Nielson, D. M., Smith, T. A., Sreekumar, V., Dennis, S., and Sederberg, P. B. (2015). Human hippocampus represents space and time during retrieval of real-world memories. Proc. Natl. Acad. Sci. U.S.A. 112, 11078–11083. doi: 10.1073/pnas.1507104112
Nilsson, J., Ferrier, N., Coventry, K., Bester, A., and Finkelmeyer, A. (2013). Negative BOLD response in the hippocampus during short-term spatial memory retrieval. J. Cogn. Neurosci. 25, 1358–1371. doi: 10.1162/jocn_a_00396
O’Keefe, J., and Dostrovsky, J. (1971). The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. Brain Res. 34, 171–175. doi: 10.1016/0006-8993(71)90358-1
Pereira, F., Mitchell, T., and Botvinick, M. (2009). Machine learning classifiers and fMRI: a tutorial overview. Neuroimage 45(1 Suppl), S199–S209.
Persson, J., Herlitz, A., Engman, J., Morell, A., Sjölie, D., Wikström, J., et al. (2013). Remembering our origin: gender differences in spatial memory are reflected in gender differences in hippocampal lateralization. Behav. Brain Res. 256, 219–228. doi: 10.1016/j.bbr.2013.07.050
Rand-Giovannetti, E., Chua, E. F., Driscoll, A. E., Schacter, D. L., Albert, M. S., and Sperling, R. A. (2006). Hippocampal and neocortical activation during repetitive encoding in older persons. Neurobiol. Aging 27, 173–182. doi: 10.1016/j.neurobiolaging.2004.12.013
Rekkas, P. V., Westerveld, M., Skudlarski, P., Zumer, J., Pugh, K., Spencer, D. D., et al. (2005). Neural correlates of temporal-order judgments versus those of spatial-location: deactivation of hippocampus may facilitate spatial performance. Brain Cogn. 59, 103–113. doi: 10.1016/j.bandc.2005.05.013
Reynolds, N. C., Zhong, J. Y., Clendinen, C. A., Moffat, S. D., and Magnusson, K. R. (2019). Age-related differences in brain activations during spatial memory formation in a well-learned virtual Morris water maze (vMWM) task. Neuroimage 202:116069. doi: 10.1016/j.neuroimage.2019.116069
Roland, P. E., Eriksson, L., Stone-Elander, S., and Widen, L. (1987). Does mental activity change the oxidative metabolism of the brain? J. Neurosci. 7, 2373–2389.
Sekeres, M. J., Winocur, G., and Moscovitch, M. (2018). The hippocampus and related neocortical structures in memory transformation. Neurosci. Lett. 680, 39–53. doi: 10.1016/j.neulet.2018.05.006
Simons, J. S., Peers, P. V., Mazuz, Y. S., Berryhill, M. E., and Olson, I. R. (2010). Dissociation between memory accuracy and memory confidence following bilateral parietal lesions. Cereb. Cortex 20, 479–485. doi: 10.1093/cercor/bhp116
Spets, D. S., Jeye, B. M., and Slotnick, S. D. (2019). Different patterns of cortical activity in females and males during spatial long-term memory. Neuroimage 199, 626–634. doi: 10.1016/j.neuroimage.2019.06.027
Strandberg, M., Mannfolk, P., Stenberg, L., Ljung, H., Rorsman, I., Larsson, E. M., et al. (2017). A functional MRI-based model for individual memory assessment in patients eligible for anterior temporal lobe resection. Open Neuroimag J. 11, 1–16. doi: 10.2174/1874440001711010001
Suzuki, M., Johnson, J. D., and Rugg, M. D. (2011). Decrements in hippocampal activity with item repetition during continuous recognition: an fMRI study. J. Cogn. Neurosci. 23, 1522–1532. doi: 10.1162/jocn.2010.21535
Teng, E., and Squire, L. R. (1999). Memory for places learned long ago is intact after hippocampal damage. Nature 400, 675–677. doi: 10.1038/23276
Tolman, E. C. (1948). Cognitive maps in rats and men. Psychol. Rev. 55, 189–208. doi: 10.1037/h0061626
Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., et al. (2002). Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15, 273–289. doi: 10.1006/nimg.2001.0978
Ungerleider, L. G., and Haxby, J. V. (1994). ‘What’ and ‘where’ in the human brain. Curr. Opin. Neurobiol. 4, 157–165. doi: 10.1016/0959-4388(94)90066-3
Vandenberghe, R., Molenberghs, P., and Gillebert, C. R. (2012). Spatial attention deficits in humans: the critical role of superior compared to inferior parietal lesions. Neuropsychologia 50, 1092–1103. doi: 10.1016/j.neuropsychologia.2011.12.016
Vann, S. D., and Albasser, M. M. (2011). Hippocampus and neocortex: recognition and spatial memory. Curr. Opin. Neurobiol. 21, 440–445. doi: 10.1016/j.conb.2011.02.002
Vannini, P., Hedden, T., Sullivan, C., and Sperling, R. A. (2013). Differential functional response in the posteromedial cortices and hippocampus to stimulus repetition during successful memory encoding. Hum. Brain Mapp. 34, 1568–1578. doi: 10.1002/hbm.22011
Keywords: spatial memory retrieval, cubical space, GLM, MVPA, occipitoparietal cortex, right middle temporal gyrus, task-based fMRI
Citation: Guo J, Zhang K, Zhang J, Zhao R, Liang Y, Lin Y, Yu S, Qin W and Yang X (2021) Decoding Spatial Memory Retrieval in Cubical Space Using fMRI Signals. Front. Neural Circuits 15:624352. doi: 10.3389/fncir.2021.624352
Received: 03 November 2020; Accepted: 30 March 2021;
Published: 18 May 2021.
Edited by:
Amir Shmuel, McGill University, CanadaReviewed by:
Meneka Sidhu, University College London, United KingdomSudarshan Patil, University of Bergen, Norway
Copyright © 2021 Guo, Zhang, Zhang, Zhao, Liang, Lin, Yu, Qin and Yang. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Xuejun Yang, ydenny@126.com
†These authors have contributed equally to this work