Elizabeth Martin1,2
Asadur Chowdury1,3
John Kopchick1Patricia Thomas1
Dalal Khatib1Usha Rajan1Caroline Zajac-Benitez1Luay Haddad1
Alireza Amirsadri1
Alfred J. Robison4
Katherine N. Thakkar5
Jeffrey A. Stanley1
Vaibhav A. Diwadkar1*- 1Department of Psychiatry & Behavioral Neurosciences, Wayne State University School of Medicine, Detroit, MI, United States
- 2Department of Psychiatry, University of Texas Austin, Austin, TX, United States
- 3Department of Neurosurgery, University of Michigan, Ann Arbor, MI, United States
- 4Department of Physiology, Michigan State University, East Lansing, MI, United States
- 5Department of Psychology, Michigan State University, East Lansing, MI, United States
Introduction: Schizophrenia is characterized by a loss of network features between cognition and reward sub-circuits (notably involving the mesolimbic system), and this loss may explain deficits in learning and cognition. Learning in schizophrenia has typically been studied with tasks that include reward related contingencies, but recent theoretical models have argued that a loss of network features should be seen even when learning without reward. We tested this model using a learning paradigm that required participants to learn without reward or feedback. We used a novel method for capturing higher order network features, to demonstrate that the mesolimbic system is heavily implicated in the loss of network features in schizophrenia, even when learning without reward.
Methods: fMRI data (Siemens Verio 3T) were acquired in a group of schizophrenia patients and controls (n=78; 46 SCZ, 18 ≤ Age ≤ 50) while participants engaged in associative learning without reward-related contingencies. The task was divided into task-active conditions for encoding (of associations) and cued-retrieval (where the cue was to be used to retrieve the associated memoranda). No feedback was provided during retrieval. From the fMRI time series data, network features were defined as follows: First, for each condition of the task, we estimated 2nd order undirected functional connectivity for each participant (uFC, based on zero lag correlations between all pairs of regions). These conventional 2nd order features represent the task/condition evoked synchronization of activity between pairs of brain regions. Next, in each of the patient and control groups, the statistical relationship between all possible pairs of 2nd order features were computed. These higher order features represent the consistency between all possible pairs of 2nd order features in that group and embed within them the contributions of individual regions to such group structure.
Results: From the identified inter-group differences (SCZ ≠ HC) in higher order features, we quantified the respective contributions of individual brain regions. Two principal effects emerged: 1) SCZ were characterized by a massive loss of higher order features during multiple task conditions (encoding and retrieval of associations). 2) Nodes in the mesolimbic system were over-represented in the loss of higher order features in SCZ, and notably so during retrieval.
Discussion: Our analytical goals were linked to a recent circuit-based integrative model which argued that synergy between learning and reward circuits is lost in schizophrenia. The model’s notable prediction was that such a loss would be observed even when patients learned without reward. Our results provide substantial support for these predictions where we observed a loss of network features between the brain’s sub-circuits for a) learning (including the hippocampus and prefrontal cortex) and b) reward processing (specifically constituents of the mesolimbic system that included the ventral tegmental area and the nucleus accumbens. Our findings motivate a renewed appraisal of the relationship between reward and cognition in schizophrenia and we discuss their relevance for putative behavioral interventions.
Introduction
A recent integrative model (1), hypothesized a loss of synergistic interactions between cognition and reward circuits in schizophrenia. The model further argued that this loss underpinned deficits in learning and cognition (and many other generalized performance deficits) that are a hallmark of the illness (2, 3). Extant behavioral studies in patients have largely relied on reward-related contingencies (during reinforcement learning). Patients show deficits in reward anticipation, linked to reduced activity in regions of the mesolimbic pathway in the ventral striatum (4, 5). Patients also show reduced sensitivity in frontal-striatal circuits in experienced compared to expected outcomes (5, 6), and fail to faithfully represent the expected reward values of actions and outcomes (7). Generally, altered reward processing has been linked to intrinsic motivational deficits (3), where a loss of motivation in turn negatively impacts cognitive proficiency (8). A notable idea suggested by Robison and colleagues was that a loss of synergy between learning and reward circuits would be observed even if learning took place without explicit contingencies.
This link between cognition and reward processing is increasingly material to schizophrenia. A loss of motivation in patients has been associated with the perceived difficulty of tasks (particularly physical tasks) (9), and motivation loss drives patients to expend less cognitive effort to maximize reward. This reduction in cognitive effort further impairs task performance (10, 11), creating a maladaptive cycle. Finally, decreased cognitive effort appears to be inextricably linked with intrinsically a-motivational states (12).
Loss of synergy can be operationalized as a loss of functional brain network features (“connectivity”) (13–15). In the context of the current work, such loss would be observed between circuits underpinning cognition (16) and separate circuits in the mesolimbic pathway sub serving reward processing (17, 18). Thus, if altered reward processing and intrinsic motivational deficits impact cognitive proficiency (8), and if a hallmark of schizophrenia is a loss of both (3), then patients will show a loss of brain network features between cognitive and reward circuits even when learning without expectation of/or working toward reward.
Preliminary support for this idea comes from two sources: a) meta-analyses from a cross-section of studies (19) showing hypo-activation in the ventral striatum, and b) learning-induced dysconnectivity between regions like the ventral tegmental area (VTA) and the Nucleus Accumbens (NAcc), and other constituents of the learning network (15). These referenced studies need to be extended because meta-analyses have primarily included studies with explicit contingencies and the connectivity studies have not explicitly assessed the involvement of the VTA and the NAcc in any loss of connectivity. Here we addressed these lacunae as follows: 1) fMRI data were collected using a performance-driven associative learning paradigm without explicit reward or feedback (20, 21); 2) Next, from the fMRI time series data, 2nd order network features (based on conventional zero-lag functional connectivity) (13, 22) were computed in each task condition for each participant across a common (SCZ HC) network of bilateral nodes in the brain. The network included nodes from a learning-related circuit (including nodes in the cortex, the dorsal striatum and medial temporal lobe) (23–28), and nodes in the reward processing circuit (including the nucleus accumbens, NAcc, and the ventral tegmental area, VTA); 3) Then, within each group (SCZ or HC), higher order network features were estimated (see Methods). These features capture the consistency in connectivity between pairs of brain regions and their computation was inspired by “higher order functional connectivity” approaches designed to capture inter-regional resemblance of functional connectivity topographical profiles (29). 4) Finally, as an analogue to graph theoretic motivations (30), we quantified the relative contributions of nodes to the aberrant loss (or gain) of higher order features. Such quantification provides insights on the relative contributions of the VTA and/or the NAcc to higher order feature loss.
If learning and reward interject (even without explicit contingencies), we would expect the heavy representation of the VTA and the NAcc in any higher order feature loss (31, 32). This evidence would support the hypothesized loss of synergy between cognition and reward circuits in schizophrenia (1).
Materials and methods
Participants
Wayne State University’s IRB approved all procedures. Participants (n = 78) provided informed consent and were compensated. HC participants (n = 33; Range:18- 50 years) were free of psychiatric or neurological conditions. Patients (SCZ; n = 45; Mean Range: 18-50) were identified through their treating physicians (L.H., A.A.), and diagnoses were confirmed by a research psychologist (U.R.) using DSM-V criteria for schizophrenia (33). Table 1 provides a comprehensive overview of the participant demographics.
Table 1. Demographic information for patients and controls are provided.
MRI acquisition
fMRI data (3T Siemens Verio scanner, 32-channel volume head coil) were acquired using a multiband gradient EPI sequence (TR = 3 s, TE = 2.46 ms, multiband factor = 3, FOV = 192 × 192 mm2, matrix = 96 × 96, 64 axial slices, resolution = 2 mm3). T1-weighted MRI images were collected for normalization and co-registration with the EPI scan (3D Magnetization Prepared Rapid Gradient Echo (MPRAGE) Sequence, TR = 2150 ms, TE = 3.5 ms, TI = 1100 ms, flip angle = 8 degrees, FOV = 256 × 256 × 160 mm3, 160 axial slices, resolution = 1 mm3).
Task
Network dynamics were evoked using an object-location associative learning paradigm (20). Subjects learned nine unique object-location associations (Figure 1), as the paradigm alternated between task-active epochs for Encoding and Retrieval (27 s each; ~13-minute acquisition)(with rest intervals interleaved). During encoding, nine equi-familiar objects (34) were presented in their associated grid location for naming (3 s/object). During retrieval (27 s), grid locations were cued (in random order) and subjects were required to name the associated object. Vocal responses were recorded by an experimenter using the pre-installed voice relay. During instruction-free rest intervals (27 s) participants were shown a cross-hair for fixation. Eight iterations of the learning cycle were employed. Participants received no feedback on their responses during Retrieval, and were not provided with any explicit contingencies (reward or punishment) for their performance.
Figure 1. Task paradigm. The figure schematically depicts the deployed paradigm. Participants viewed illustrations of nine common objects presented in sequential random order in their associated locations during Encoding (3 s per object; 27 s total, successive presentations of “Key” and “Tree” are depicted). After a brief rest period (27 s), locations were cued in random order. Following each cue, participants were required to verbally name the associated object (Retrieval; 3 s per object; 27 s total). A brief post-retrieval consolidation period followed (27 s). The entire cycle went through eight iterations.
fMRI data processing and time series
fMRI data were processed in SPM 12 using standard methods for temporal (slice-time correction) and spatial preprocessing. For spatial pre-processing, EPI images were oriented to the AC-PC line, corrected head movement through realignment to a reference image in the sequence, and co-registered to the anatomical high resolution T1 image. The deformations from normalizing the high resolution T1 image were applied to the co-registered EPI images to normalize the volumes to stereotactic space. A low pass filter (128 s) was applied to remove low-frequency components. At the first level, epochs were modeled with boxcar stimulus functions convolved with a canonical hemodynamic response function to form regressors of interest. In each first level model, the six motion parameters (3 for translation and 3 for rotation) from the co-registration were modeled as covariates of no interest (analyses of the six displacement parameters indicated that estimated head movement did not differ between groups;.19 ≤ p ≤.91). Images were resliced (2 mm3) and a Gaussian filter (8 mm FWHM) applied. Images exceeding 4 mm of movement (<1% of all images) were excised from analyses.
First level maps were forwarded for a mixed second level random effects analysis of covariance. The singular goal of the second level model was to motivate the definition of a statistically reliable co-activated (across groups and task conditions) network. This co-activated network would form the basis for subsequent connectivity analysis, and the co-activated bases of the network would ensure that any inter-group connectivity differences are not confounded by inter-group activation differences (35, 36). In the second level model, Group (HC vs. SCZ) was modeled as independent factor, and Condition (Encoding, Retrieval) as non-independent factor, with covariates included for age, gender, and full scale IQ (FSIQ). We used Nichols et al.’s version of the minimum-inference statistic (37) (minimum statistic compared to the conjunction null) to identify an appropriate conjunction of co-activated clusters across groups and conditions. Statistical thresholding was based on cluster level inference (38) appropriate for both group and case studies (39, 40). A Monte Carlo alpha probability simulation was used to estimate the minimum cluster extent sufficient to reject false positive (noise-only) clusters. The simulation computes the probability of a random field of noise (after accounting for the spatial correlations of voxels based on the image smoothness within each region of interest estimated directly from the data set).
Network space, time series and higher order feature analysis
The network definition was derived from a combination of meta-analytic priors patterns (41) and activation-based estimates paradigm (15, 21, 35). Priori studies have suggested that the learning sub-network includes portions of the early visual stream, including a) the occipital lobes (OCC) and the fusiform gyrus (FF), known to function in object identity processing (23–25, 42), b) the parahippocampal gyrus (PHG) and the body of the hippocampus (BHIPP) involved in episodic-based learning and memory (26, 28, 43), and c) frontal and striatal regions including the dorsolateral prefrontal cortex (DPFC), and the basal ganglia (BG) associated with task-relevant sub-processes for attention, working memory and contributions to the early stages of longer-term memory formation (44, 45). Notably, the basal ganglia also support working memory maintenance through frontal-striatal loops (46–48), and play a role in reward-prediction (49–51). Anatomical masks based on these regions were used as a filtration for the conjunction analyses (see below).
This learning circuit was complemented by nodes representing the NAcc and the VTA. The NAcc appears to direct behavior toward rewarding, or away from aversive stimuli (31, 32, 52, 53). More specifically, NAcc’s contributions toward goal-directed behavior are amplified in the context of external reward-based contingencies (54), where the explicit contingencies appear to prime the interjection between reward and cognition. Thus as a crucial constituent of the dopamine reward circuit, the NAcc is an interface between motivation and action (55). The structure receives neuronal projections from the VTA, and the NAcc and the VTA are the principal drivers of reward related contributions of the mesolimbic pathway toward goal-directed behavior (56–58). The mesolimbic dopaminergic system thus plays a central role in motivated behaviors (59), particularly in scenarios involving in external rewards (e.g., monetary incentives) (60). For the learning network, individual significant peaks were identified from within anatomical masks under regions of interests in a deterministic anatomical atlas (61).
Supplementary Figure 1A depicts the results of the conjunction analyses and the harvested loci in each of our regions (with labels), are depicted in Supplementary Figure 1B. All subsequent connectivity analyses were based on time series (averaged first eigenvariate) extracted from the depicted nodes (4 mm radius). The experimentally derived coordinates (depicted in red) were complemented by the meta-analytically derived coordinates for the NAcc and the VTA (depicted in grayscale) (41). For each of the NAcc and the VTA, an experimentally derived search space (10 mm diameter) was centered around priors (41), before identifying peaks for each participant within this space.
The extracted time series were forwarded for undirected functional connectivity (uFC) analysis (using bivariate zero-lag correlations) (13). Temporal vectors from the task paradigm were used to separate the time series into each of the task-active conditions of interest (Encoding and Retrieval). Then, for each subject, the full uFC adjacency matrix [120 unique node pairs, C(16,2)] was estimated in each task condition (implemented with in-house scripts in Matlab) before the Pearson’s r values were transformed using the Fisher’s Z transformation (62). Each cell value represents conventional 2nd order network features between pairs of nodes (e.g., for nodes A and B, uFCAB) in any given participant. Figure 2A schematically represents this part of the analytic pipeline (for a hypothetical four-node network space).
Figure 2. Methods outlined. The pipeline used to estimate higher order features is depicted. (A) In an initial step, the full second order functional connectivity matrix was formed for all sixteen nodes in the network (schematically depicted for four nodes, A-D). The matrix was derived from time series for each node, with each participant contributing matrices for Encoding and Retrieval. The undirected functional connectivity (uFC) was computed as the zero-lag correlation (r) between all unique pairs of nodes (i.e., rAB) for each subject, with the coefficient normalized (see Methods). Each correlation measure represents by convention a 2nd order connectivity feature. (B) Across all participants in each of the HC and SCZ groups, higher order features were estimated from these 2nd order matrices. As depicted for rAB and rCD, in each of the HC and SCZ groups, the resultant higher order feature (rAB • rCD) was estimated as the correlation in 2nd order features across all 32 and 46 participants respectively. (C) The resultant higher order feature matrices represent the intra-group regularities across quadruples of network nodes. From these, intra-group differences in regularity were estimated (see Methods) and statistically thresholded (bottom).
These 2nd order features formed the primary data for estimating higher order features (Figure 2B). Here, within each group, the cross-correlation computed between every possible pair of second order features (e.g., uFCAB × uFCCD), provides an index of the statistical regularity between that pair of 2nd order features. This estimate is an analogue of measures of the macroscopic consistency between pairs of brain circuits (63). In each group and in each condition, we constructed a higher order feature matrix from all possible combinations of 120 unique 2nd order features. This higher order feature matrix consisted of 7140 unique cells [C(120,2)]. The values in each cell were transformed and normalized, r’ (64), to estimate inter-group differences in r’ (SCZ ≠ HC) using the z statistic (65). The z statistics were thresholded (qFDR<.05) (66) to identify significant inter-group differences in the consistency of higher order features across the matrix (see Figure 2C).
Results
The results are organized as follows: a) We first provide the behavioral data from the task (Figure 3); b) Next, inter-group differences in higher order group features are presented using connectomic rings (Figure 4). The chords in each ring (Encoding and Retrieval respectively), denote significant inter-group differences in higher order group features (see Figure 2C, bottom). Each chord links two pairs of region pairs (formed by the region names on the outer ring and the inner ring); c) Figure 4 provides a gestalt of the results, but is not informative about the relative contributions of each node to the observed inter-group differences. In other words, how implicated is any node in a loss of higher order features? To capture this information, data from Figure 4 are re-expressed in Figure 5. Here, the frequency graphs indicate the frequency with which each node was present in any significant inter-group difference (i.e., present in each chord in Figure 4). These observed frequencies were subsequently submitted to non-parametric statistical analyses (X2) (67); (d) Finally, the deficit data from Figure 5 (SCZ < HC, red bars) are summarized on a brain map (Figure 6). Here, the size of each anatomically placed node is scaled by that node’s observed frequency (Figure 5). Thus, Figure 6 motivates the direct visual assessment of the importance of any single node to higher order feature loss in SCZ.
Figure 3. The figure provides a comprehensive accounting of the behavioral results. (A) Averaged learning data at each time point are presented where the curves represent negatively accelerated learning functions, , fit to the averaged data (shaded areas represent 95% confidence intervals). As seen, patients display slower learning. This intuition was confirmed in (B). Here, learning functions were separately fit to performance data from each of the participants, and the average learning rates, b are depicted in the bar graph (± s.e.m.). The bar graph confirms that learning rates in patients was significantly lower. (C) Finally, individual performance data were rendered using heat maps. Here each row depicts data from an individual participant (each column represents time, i.e. epoch). Participants in each group are arranged in descending order of learning rate (Top: Fastest → Bottom: Slowest).
Figure 4. Differences in higher Order Network Features for each of Encoding (A) and Retrieval (B) are represented using chord diagrams. To denote the specific higher order feature, the 16 node identities are denoted on the outer ring. Then, the labels in the inner ring are organized to form a unique pair of nodes that form one of the elements of the higher order feature. Finally, each visible chord links pairs of network pairs denoted by the combination of the outer and inner label. Red chords connect pairs with greater higher order significance in in HC while blue chords connect pairs with greater higher order significance in SCZ. As seen, SCZ are characterized by a massive loss of higher order network features.
Figure 5. The stacked bar graphs represent the total number of instances a node is a member of a given chord in Figure 4. These graphs are constructed separately for Encoding (left) and Retrieval (right) conditions. The graphs provide a measure of the relative contribution of any node to a loss or gain of higher order features in schizophrenia in each of the conditions. The color scheme (red/blue) is maintained from Figure 4. In addition to the notable contributions of regions central to learning and memory, the contributions of nodes in the mesolimbic system (bottom), particularly during Retrieval, are highly salient.
Figure 6. The data from Figure 5 are re-visualized for each of the (A) Encoding and (B) Retrieval conditions as numerically scaled circles (only where there is a loss of higher order features) where each circle represents a node placed in its approximate anatomical location on a lateral or medial surface of the brain. Each node’s diameter is scaled to reflect its contribution to higher order feature loss: diameter . The relative contributions of the nodes in the mesolimbic pathway (NAcc and VTA) are highly evident by their depicted sizes (highlighted for reference).
Behavioral results
Figure 3 provides an accounting of the behavioral results (data from three patients was lost on account of errors in recording responses over the voice relay). Behavioral results (proportion correct during each retrieval epoch) were analyzed in a two-way repeated measures analyses of covariance with factors for time (modeled as the repeated factor) and group (modeled as the non-repeated factor; age and FSIQ were modeled as covariates). Two salient effects emerged. First, we observed a significant main effect of time, F7,497 = 2.68, p<.01, MSe=.213, indicating that performance improved over time. Second, we observed a main effect of group, F1,71 = 11.16, p<.001, MSe=.363, indicating that learning proficiency was impaired in patients. Averaged learning curves are presented in Figure 3A.
Next, negatively accelerated learning functions using the classic single parameter psychometric learning function, ,were fit to available data from each of the 75 participants. Here, the parameter b represents learning rate (higher values indicate faster learning and faster transitions from linear to asymptotic performance) (68–70). The bar graph in Figure 3B, indicates that learning rate in patients was significantly lower, t73 = 5.12, p<.001, confirming the visual impressions from the data in Figure 3A. Finally, in Figure 3C, performance data in individual participants are rendered using heat maps. Here each row depicts data from an individual participant (each column represents time, i.e. epoch), with participants in each group arranged in descending order of learning rate.
Inter-group differences in higher order features: encoding & retrieval
Figure 4 depicts significant inter-group differences in higher order features during Encoding (a) and Retrieval (b). The colors represent the direction of feature loss (Blue: SCZ(A←→B, C←→D) > HC(A←→B, C←→D); Red: HC(A←→B, C←→D) > SCZ(A←→B, C←→D)). Each chord represents a result involving two 2nd order features. Therefore, the identities of the pairs can be derived from the combination on the label on the outer ring and the label on the inner ring.
The overall gestalt indicates two salient effects: a) During both Encoding and Retrieval, higher order feature loss was extensive in patients, with effects particularly pronounced during Retrieval. Next, we attempted to motivate inference on the contributions of individual nodes to this effect. Thus, for each of Encoding and Retrieval, we first calculated the frequency of every node’s involvement in aberrantly lost (or gained) second order features. These data are expressed in the stacked frequency bar graphs in Figure 5. The width of the bars express the frequency profiles for each node. This in turn, permits visual inspection of their relative importance in feature loss (or gain) vis a vis other nodes in the network.
During Encoding, nodes like the bilateral occipital cortex, the right dPFC, the left fusiform cortex, and notably the right NAcc contribute heavily to higher order feature loss in SCZ. The relative contributions of nodes in the mesolimbic pathway is amplified during Retrieval. Here, each of the bilateral nodes in the VTA and the NAcc, and right Basal Ganglia contribute heavily.
Next, we tested whether the observed frequencies of the contributions to the loss or gain of features was different than the expected frequencies (under the null hypothesis that these frequencies would be evenly distributed). This analyses was separately conducted in each condition using a two-way (Node and Group) X2 analysis using the X2 goodness of fit test:
We observed significant effects for both Encoding and Retrieval: Encoding: X2= 205.59, df=15, p<10-5; Retrieval: X2 = 908.08, df=15, p<10-5, indicating that the nodal contributions to higher order feature loss was unequal, and that mesolimbic nodes like the VTA and the NAcc contributed substantially, particularly during Retrieval.
Visualizing the relative contributions of nodes
The relative contributions of each node to the loss of higher order group are visualized in Figure 6. Here, each node is placed in its approximate anatomical location (either on a lateral or medial cortical surface), with node size scaled as a function of its frequency in Figure 4 (diameter ). Nodes in the mesolimbic pathway (VTA and NAcc) are shaded in darker red. As seen, during Encoding (Figure 6A), nodes associated with vision and object recognition, including occipital (ROCC and LOCC) and fusiform nodes (RFF and LFF) contribute heavily to higher order feature loss, as do nodes in the frontal cortex and the basal ganglia. Finally, the NAcc contributes substantially, underlining its relevance for learning deficits in schizophrenia (31, 32). The relative contributions of the bilateral NAcc and the VTA are amplified during Retrieval (Figure 6B).
Discussion
Our principal goals were to investigate whether learning without contingencies (or feedback) induced a loss of higher order network features in schizophrenia, and to assess the relative contributions of the mesolimbic system to this loss. Any higher order feature loss (or gain) was characterized during two task-active epochs (Encoding and Retrieval). Our results revealed: 1) that patients showed a cumulative loss of higher order features during both task-active conditions (Figure 4); 2) The contributions of the nucleus accumbens and the ventral tegmental area equaled or exceeded most other nodes in the investigated network (Figures 5, 6).
If a loss of synergy between cognition and reward circuits/regions is central to schizophrenia (1, 71), and if this loss is evoked independent of external contingencies, then one would expect heavy representation of regions like the NAcc and the VTA in our results (as indeed we observed). The remainder of the paper discusses aspects of the network bases of learning, the interpretation of higher order feature loss, and the plausible clinical relevance of these findings.
Network bases of learning
Learning is a dynamic, complex process featuring multiple interacting brain regions that form feedback and lateral loops (72). Our task loosely conformed to two general processes/stages linked with learning, specifically (1) Encoding, a dynamic process of perceiving new information or memoranda, initiated into the early process of memory formation and (2) Retrieval, the ability to access and recapture stored memory traces on demand (73–75). These processes involve regions including the Hippocampus, Para-hippocampus, the Basal ganglia and the DPFC (76), as well as other posterior brain regions associated with visually-driven learning (77). The roles of the NAcc and VTA on the other hand have primarily been studied in the context of motivational learning (78) and interactions between these regions and the hippocampus are assumed to be important in tuning the sensitivity to novelty. Sensitivity to novelty is a crucial element in learning and long-term memory formation (79, 80). The VTA strengthens encoding and retrieval by facilitating hippocampal and prefrontal co-activity (81, 82), and such mediation is presumably sub served by its dopaminergic projections. Thus, the encoding of novel information engages the hippocampus (83–85), thereby aiding the generation of memorial representations. These representations are in turn employed by the prefrontal cortex during executive functioning and working memory (86). In addition, cohesive activity between the basal ganglia and the hippocampus underpin the learning of arbitrary associations (87). Finally, the DPFC in contributing to multiple stages of learning, promotes the cognitive processes necessary for behavioral planning, executive processing, top-down processing, active maintenance of stored memories and cued retrieval (45, 88–91). This distributed narrative is consistent with the multiple memory systems theory (MMS) which postulates that information is stored based on the independent and parallel activity of a multiple brain modules, where each has distinct properties, dynamics, and neural bases (92).
The link between reward processing and cognitive behavior is central in the animal literature; the reward system sends modulatory inputs to regions like the hippocampus and entorhinal cortex, and these inputs are essential to behavior (93). However, animal studies (largely conducted at the cellular level) and human neuroimaging studies (almost entirely conducted at the system’s level) cannot easily be reconciled. Cellular processes are not straightforwardly expressed in neuroimaging signals (94) and human network architectures for any task can coopt a greater array of resources and rely on a greater degree of network complexity (95–97). These challenges notwithstanding, we draw tentative inferences regarding the clinical relevance of the observed higher order feature loss in schizophrenia.
Interpreting higher order feature loss in schizophrenia
As defined in our analyses, higher order features index the statistical relationship between any two second order features, where each second order feature is itself a relationship between two variables (98). The data in each participant represents a summary of a multi-variable complex system (e.g., a brain network) (14) and across members within any group (e.g., patients or controls), a higher order feature provides a measure of the intra-group consistency between pairs of system elements. Therefore, these features integrate across measures of functional connectivity in groups of participants (13). In the context of macroscopic network neuroscience (99), such higher order measures may aid in characterizing intra-group network organization, or (as we have done), or aid in identifying inter-group differences, and the relative contributions of nodes to these differences. The latter is somewhat analogous to the use of graph theory, which is frequently used to summarize nodal importance in brain networks (100, 101). From Figures 5, 6 (which elucidate the role of individual nodes in higher order feature loss), we can draw inferences on the importance of each to learning-related impairments in schizophrenia.
The representation of bilateral occipital nodes during Encoding (Figure 6A) underlines the integrative role of visual processing in learning and cognition (102) suggesting that learning-related network dysfunction in schizophrenia may originate in the primary and secondary (magno- and parvocellular pathways) visual pathways (42, 103). The representation of bilateral fusiform nodes reaffirms the important role of the forward visual pathways in schizophrenia where deficits in anatomy and function have been widely reported (104, 105). The representations of the DPFC and the BG are interpretable based on their central roles in memory, attention, and executive function (106, 107). Finally parahippocampal contributions to feature loss are consistent with the structure’s role in the early stages of memory consolidation (26, 28, 43).
In this context, the significant representation of both the NAcc and the VTA in is particularly salient. As noted, the NAcc plays a key role in tasks where learning is yoked to contingencies or external feedback (31, 32, 52, 53) but its role in the absence of feedback or external reward is less understood. This latter role may well loop into latent processes associated with internal motivation or motivated behavior (108). In the absence of explicit reward, the NAcc and the VTA may autonomously integrate different sources based on the assessment of implicit value (109). Moreover, the VTA’s heavy representation is also consistent with its role in linking motivation and action (110), where this link may be compromised in schizophrenia (111, 112). More generally the mesolimbic system plays a well-established role in facilitating reinforcement and motor learning through motivation and appetitive desire (56–58), but this role appears to be substantially impaired in schizophrenia patients during encoding even in the absence of reward related contingencies.
Retrieval, the only performance driven phase of the task amplified feature loss. During memory retrieval, cues to facilitate access to internally distributed memory representations originate in the prefrontal cortex (45, 88, 113) but may be compromised in schizophrenia for multiple reasons: a) functional deficits in the medial temporal lobe undermine memory formation (114), resulting in b) poorly consolidated associations that undermine subsequent retrieval (115) that are further compromised by hypo-functionality of the prefrontal cortex (116, 117). While prior accounts have suggested that hallucinatory experiences (by occupying functional space in the medial temporal lobe) interfere with the process of episodic memory formation (118), our results imply that the contributions from impaired functions of the mesolimbic system may be equally salient. Retrieval appears to rely on integration of the NAcc and the VTA in network-based memory signaling (119), because these signals also transmit information about the interjection between the affective states (elicited by successful recall) and cognitive processes (120) that are enhanced under positive affect (121). Therefore, a disease process like schizophrenia will be associated with the reduced integration of the NAcc and the VTA with cognitive circuits (1).
Data from at least one clinical scale provides a measure of clinical relevance to our results. The social adaption and self-evaluation scale (SASS) (122) is a 21-item scale developed to quantify social motivation and behavior. Studies have confirmed its validity in assessing perspective on self, environment perception, and social motivation in both healthy and clinical populations (123–125). Lower scores are indicative of a loss of motivational and hedonic drive, and this loss has been linked to altered processing of reward-related salience and diminished responses of the NAcc and the VTA (126, 127). Schizophrenia patients score significantly lower on the SASS (128), and this evidence validates the clinical impression that patients suffer from a loss of intrinsic motivation, curiosity and hedonic drive (129). Results from our sample are consistent with cited evidence. Patients scored significantly lower on the SASS (Table 1) suggesting a loss of intrinsic motivation, and (expectedly), patients also evinced significantly greater negative symptoms (PANSS). We cannot specifically relate deficits in the SASS with higher order group features, because by definition, the latter are defined at the group level (see Figure 2) and do not exist for an individual participant. However, in ongoing work (130) we are using complementary methods to partially addresses this shortcoming. Each participant’s N region 2nd order functional connectivity (FC) matrix is transformed into an N region higher order functional connectivity matrix (HOFC) (131). Each cell in the HOFC matrix encodes the inter-regional resemblance of the FC topographical profiles and can therefore be related to clinical measures. However, HOFC is distinct from the network features defined in the current investigation and further analyses will be need to elucidate the degree to which the two are complementary or supplementary.
Limitations and conclusions
Reverse inference is challenging (132, 133) because imaging results under-specify clinical relevance. However by modus tollens (If A, then B. ~B, therefore ~A) we can derive logically sound inferences regarding network dysfunction in neuropsychiatric illness (14). Accordingly, if the brain is intact, then we expect a certain pattern of network properties; If we do not find that pattern of network properties, then the brain is not intact. The challenges of reverse inference are acute for resting state analyses (134), but they are somewhat mitigated in the context of tightly defined experimental tasks. If tasks are reasonably well mapped to brain networks, then task conditions can also be reliably mapped to those network constituents (135). Accordingly, our choice of task and our analytic method were purposefully synchronized to a) examine the impact of learning without contingencies on b) contributions of the mesolimbic system to the loss of higher order structure in schizophrenia, before c) quantify the role of each of the NAcc and the VTA in b). With that said, the import of our work is constrained by notable limitations.
First, higher order features do not have any specific neuronal correlates, nor can any such correlates be derived because as examined here, these features are only defined at the level of the group (see Figure 2). This distinguishes our approach from studies that use functional (or effective) connectivity (13, 22); these methods use statistical (or generative) models that characterize “connectivity” at the level of the participant. Thus, higher order features are not a new model of network connectivity; rather they allow one to efficiently summarize the consistency of network connectivity (defined in each participant) across all participants in an a priori defined group. Conventional statistics can then be used to highlight inter-group differences in this consistency. In principle, this approach can be applied to any class of estimated 2nd order features, and we suggest that its neuronal relevance will be better understood when applied to electrophysiological data.
Our work would ideally want to parse apart effects associated with successful versus unsuccessful recall (136). Because successful recall appears to obligatorily engage regions in the ventral striatum (137), it may be intrinsically more rewarding than recall failure. However any such analyses would at the very least demand an event-related design, using which one could post-hoc cleave apart correct versus incorrect recall trials (138–140). However, here we were compelled to use a block design (without jittering of inter-stimulus intervals) (141) because recall was assessed by requiring participants to name the objects associated with the cued location (see Methods). Accordingly, each stimulus presentation was locked to each TR (and the whole brain image was acquired within the TR window, with a period of silence within which participants responded). Moreover, we were not merely interested in activation differences between recall success and recall failure (142). Rather, our analyses were predicated on the ability to first estimate functional connectivity from time series data, a class of analyses not typically used event-related designs, because the latter are optimized to identify differences in activation to difference classes of events. Nevertheless, and as noted earlier, published evidence using event-related designs supports some of our findings. Retrieval success (as opposed to failure) is associated with activation of the ventral striatum (137, 143), supporting our analyses where at a more macroscopic scale we captured effects associated with the actual task conditions (Figures 4–6).
Finally, we do not have a model for specifically how the NAcc and the VTA are involved when learning without contingencies, though widespread evidence indicates that regions like the NAcc play highly a generalized role relating to reward and threat. For instance, human studies have shown that when correct responses on a social incentive task are “rewarded” with simply the presentation of a positive expression from a romantic partner versus a stranger, activity patterns in the NAcc are strongly discriminative between the former and latter (144). Such studies imply that the NAcc may be involved in selective preference or salience. Thus, it is plausible that our observed results represent the inability of schizophrenia patients to experience the salience of reward (145). Further evidence of the broad scope of NAcc function comes from recent animal work. Rather than simply being involved in responses to reward, recent work shows that populations of NAcc neurons alter their firing patterns to cues indicating threat (146). Such results reinforce the crucial role of the mesolimbic system in supporting and organizing goal oriented appetitive and avoidant behaviors, and it is precisely this synergy that is lost in schizophrenia (1, 15).
Data availability statement
The original contributions presented in the study are included in the article/Supplementary Material. Further inquiries can be directed to the corresponding author.
Ethics statement
The studies involving humans were approved by Wayne State University Institutional Review Board. The studies were conducted in accordance with the local legislation and institutional requirements. The participants provided their written informed consent to participate in this.
Author contributions
EM: Visualization, Writing – original draft, Writing – review & editing. AC: Data curation, Formal analysis, Methodology, Conceptualization, Writing – review & editing. JK: Data curation, Formal analysis, Writing – review & editing. PT: Data curation, Project administration, Writing – review & editing. DK: Data curation, Project administration, Resources, Writing – review & editing. UR: Data curation, Project administration, Writing – review & editing. CZ: Project administration, Writing – review & editing. LH: Investigation, Resources, Writing – review & editing. AA: Investigation, Resources, Writing – review & editing. AR: Conceptualization, Writing – review & editing. KT: Conceptualization, Writing – review & editing. JS: Funding acquisition, Investigation, Project administration, Writing – review & editing. VD: Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing.
Funding
The author(s) declare financial support was received for the research, authorship, and/or publication of this article. This work was supported by the National Institutes of Mental Health (MH111177), the Cohen Neuroscience Endowment, the Dorsey Endowment, the Ethel & James Flinn Foundation, and the Lycaki-Young Funds from the State of Michigan.
Conflict of interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
The author(s) declared that they were an editorial board member of Frontiers, at the time of submission. This had no impact on the peer review process and the final decision.
Publisher’s note
All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Supplementary material
The Supplementary Material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyt.2024.1337882/full#supplementary-material
References
1. Robison AJ, Thakkar KN, Diwadkar VA. Cognition and reward circuits in schizophrenia: synergistic, not separate. Biol Psychiatry. (2020) 87:204–14. doi: 10.1016/j.biopsych.2019.09.021
2. Reichenberg AA. The assessment of neuropsychological functioning in schizophrenia. Dial Clin Neurosci. (2010) 12:383–92. doi: 10.31887/DCNS.2010.12.3/areichenberg
3. Strauss GP, Waltz JA, Gold JM. A review of reward processing and motivational impairment in schizophrenia. Schizophr Bull. (2014) 40 Suppl 2:S107–116. doi: 10.1093/schbul/sbt197
4. Schlagenhauf F, Sterzer P, Schmack K, Ballmaier M, Rapp M, Wrase J, et al. Reward feedback alterations in unmedicated schizophrenia patients: relevance for delusions. Biol Psychiatry. (2009) 65:1032–9. doi: 10.1016/j.biopsych.2008.12.016
5. Waltz JA, Xu Z, Brown EC, Ruiz RR, Frank MJ, Gold JM. Motivational deficits in schizophrenia are associated with reduced differentiation between gain and loss-avoidance feedback in the striatum. Biol Psychiatry Cogn Neurosci Neuroimaging. (2018) 3:239–47. doi: 10.1016/j.bpsc.2017.07.008
6. Culbreth AJ, Gold JM, Cools R, Barch DM. Impaired activation in cognitive control regions predicts reversal learning in schizophrenia. Schizophr Bull. (2016) 42:484–93. doi: 10.1093/schbul/sbv075
7. Gold JM, Waltz JA, Matveeva TM, Kasanova Z, Strauss GP, Herbener ES, et al. Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence. Arch Gen Psychiatry. (2012) 69:129–38. doi: 10.1001/archgenpsychiatry.2011.1269
8. Huskey R, Craighead B, Miller MB, Weber R. Does intrinsic reward motivate cognitive control? a naturalistic-fMRI study based on the synchronization theory of flow. Cogn Affect Behav Neurosci. (2018) 18:902–24. doi: 10.3758/s13415-018-0612-6
9. Decombe A, Brunel L, Capdevielle D, Raffard S. Too much or too little? Exploring effort perception in schizophrenia within the framework of motivational intensity theory. Cogn Neuropsychiatry. (2020) 25:312–27. doi: 10.1080/13546805.2020.1798220
10. Gold JM, Kool W, Botvinick MM, Hubzin L, August S, Waltz JA. Cognitive effort avoidance and detection in people with schizophrenia. Cogn Affect Behav Neurosci. (2015) 15:145–54. doi: 10.3758/s13415-014-0308-5
11. Bismark AW, Thomas ML, Tarasenko M, Shiluk AL, Rackelmann SY, Young JW, et al. Relationship between effortful motivation and neurocognition in schizophrenia. Schizophr Res. (2018) 193:69–76. doi: 10.1016/j.schres.2017.06.042
12. Luther L, Lysaker PH, Firmin RL, Breier A, Vohs JL. Intrinsic motivation and amotivation in first episode and prolonged psychosis. Schizophr Res. (2015) 169:418–22. doi: 10.1016/j.schres.2015.08.040
13. Silverstein B, Bressler S, Diwadkar VA. Inferring the disconnection syndrome in schizophrenia: Interpretational considerations on methods for the network analyses of fMRI data. Front Psychiatry. (2016) 7:132. doi: 10.3389/fpsyt.2016.00132
14. Diwadkar VA, Eickhoff SB. Brain network dysfunction in neuropsychiatric disorders: The practice of “normal science”. In: Diwadkar VA, Eickhoff SB, editors. Brain network dysfunction in neuropsychiatric illness: Methods, applications, implications. Springer International Publishing, New York (2021).
15. Hasan SM, Huq MS, Chowdury AZ, Baajour S, Kopchick J, Robison AJ, et al. Learning without contingencies: A loss of synergy between memory and reward circuits in schizophrenia. Schizophr Res. (2023) 258:21–35. doi: 10.1016/j.schres.2023.06.004
16. Zimmermann J, Griffiths JD, Mcintosh AR. Unique mapping of structural and functional connectivity on cognition. J Neurosci. (2018) 38:9658–67. doi: 10.1523/JNEUROSCI.0900-18.2018
17. Wittmann BC, Schiltz K, Boehler CN, Duzel E. Mesolimbic interaction of emotional valence and reward improves memory formation. Neuropsychologia. (2008) 46:1000–8. doi: 10.1016/j.neuropsychologia.2007.11.020
18. Cho YT, Fromm S, Guyer AE, Detloff A, Pine DS, Fudge JL, et al. Nucleus accumbens, thalamus and insula connectivity during incentive anticipation in typical adults and adolescents. Neuroimage. (2013) 66:508–21. doi: 10.1016/j.neuroimage.2012.10.013
19. Chase HW, Loriemi P, Wensing T, Eickhoff SB, Nickl-Jockschat T. Meta-analytic evidence for altered mesolimbic responses to reward in schizophrenia. Hum Brain Mapp. (2018) 39:2917–28. doi: 10.1002/hbm.24049
20. Stanley JA, Burgess A, Khatib D, Ramaseshan K, Arshad M, Wu H, et al. Functional dynamics of hippocampal glutamate during associative learning assessed with in vivo 1H functional magnetic resonance spectroscopy. Neuroimage. (2017) 153:189–97. doi: 10.1016/j.neuroimage.2017.03.051
21. Ravishankar M, Morris A, Burgess A, Khatib D, Stanley JA, Diwadkar VA. Cortical-hippocampal functional connectivity during covert consolidation sub-serves associative learning: Evidence for an active “rest” state. Brain Cogn. (2019) 131:45–55. doi: 10.1016/j.bandc.2017.10.003
22. Friston KJ. Functional and effective connectivity: a review. Brain Connect. (2011) 1:13–36. doi: 10.1089/brain.2011.0008
23. Gilbert CD, Das A, Ito M, Kapadia M, Westheimer G. Spatial integration and cortical dynamics. Proc Natl Acad Sci USA. (1996) 93:615–22. doi: 10.1073/pnas.93.2.615
24. Kanwisher N, Mcdermott J, Chun MM. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J Neurosci. (1997) 17:4302–11. doi: 10.1523/JNEUROSCI.17-11-04302.1997
25. Fairhall SL, Ishai A. Effective connectivity within the distributed cortical network for face perception. Cereb Cortex. (2007) 17:2400–6. doi: 10.1093/cercor/bhl148
26. Velazquez R, Ferreira E, Tran A, Turner EC, Belfiore R, Branca C, et al. Acute tau knockdown in the hippocampus of adult mice causes learning and memory deficits. Aging Cell. (2018) 17:e12775. doi: 10.1111/acel.12775
27. Finn ES, Huber L, Jangraw DC, Molfese PJ, Bandettini PA. Layer-dependent activity in human prefrontal cortex during working memory. Nat Neurosci. (2019) 22:1687–95. doi: 10.1038/s41593-019-0487-z
28. Lin YH, Dhanaraj V, Mackenzie AE, Young IM, Tanglay O, Briggs RG, et al. Anatomy and white matter connections of the parahippocampal gyrus. World Neurosurg. (2021) 148:e218–26. doi: 10.1016/j.wneu.2020.12.136
29. Zhang H, Chen X, Shi F, Li G, Kim M, Giannakopoulos P, et al. Topographical information-based high-order functional connectivity and its application in abnormality detection for mild cognitive impairment. J Alzheimers Dis. (2016) 54:1095–112. doi: 10.3233/JAD-160092
30. Centeno EGZ, Moreni G, Vriend C, Douw L, Santos FAN. A hands-on tutorial on network and topological neuroscience. Brain Struct Funct. (2022) 227(3):741–62. doi: 10.1007/s00429-021-02435-0
31. Al-Hasani R, Mccall JG, Shin G, Gomez AM, Schmitz GP, Bernardi JM, et al. Distinct subpopulations of nucleus accumbens dynorphin neurons drive aversion and reward. Neuron. (2015) 87:1063–77. doi: 10.1016/j.neuron.2015.08.019
32. Cui W, Aida T, Ito H, Kobayashi K, Wada Y, Kato S, et al. Dopaminergic signaling in the nucleus accumbens modulates stress-coping strategies during inescapable stress. J Neurosci. (2020) 40:7241–54. doi: 10.1523/JNEUROSCI.0444-20.2020
33. American Psychiatric Association. Diagnostic and statistical manual of mental disorders. Arlington, VA: American Psychiatric Press (2013).
34. Rossion B, Pourtois G. Revisiting Snodgrass and Vanderwart’s object pictorial set: the role of surface detail in basic-level object recognition. Perception. (2004) 33:217–36. doi: 10.1068/p5117
35. Baajour SJ, Chowdury A, Thomas P, Rajan U, Khatib D, Zajac-Benitez C, et al. Disordered directional brain network interactions during learning dynamics in schizophrenia revealed by multivariate autoregressive models. Hum Brain Mapp. (2020) 41:3594–607. doi: 10.1002/hbm.25032
36. Yacou MA, Chowdury A, Easter P, Hanna GL, Rosenberg DR, Diwadkar VA. Sustained attention induces altered effective connectivity of the ascending thalamo-cortical relay in obsessive-compulsive disorder. Front Psychiatry. (2022) 13:869106. doi: 10.3389/fpsyt.2022.869106
37. Nichols T, Brett M, Andersson J, Wager T, Poline JB. Valid conjunction inference with the minimum statistic. Neuroimage. (2005) 25:653–60. doi: 10.1016/j.neuroimage.2004.12.005
38. Ward BD. Simultaneous inference for fMRI data. Milwaukee, WI: Medical College of Wisconsin (2000).
39. Muzik O, Reilly KT, Diwadkar VA. Brain over body”-A study on the willful regulation of autonomic function during cold exposure. Neuroimage. (2018) 172:632–41. doi: 10.1016/j.neuroimage.2018.01.067
40. Muzik O, Baajour S, Chowdury A, Diwadkar VA. Effective connectivity of brain networks controlling human thermoregulation. Brain Struct Funct. (2022) 227:299–312. doi: 10.1007/s00429-021-02401-w
41. Kahn I, Shohamy D. Intrinsic connectivity between the hippocampus, nucleus accumbens, and ventral tegmental area in humans. Hippocampus. (2013) 23:187–92. doi: 10.1002/hipo.22077
42. Kody E, Diwadkar VA. Magnocellular and parvocellular contributions to brain network dysfunction during learning and memory: Implications for schizophrenia. J Psychiatr Res. (2022) 156:520–31. doi: 10.1016/j.jpsychires.2022.10.055
43. Wiklund-Hörnqvist C, Stillesjö S, Andersson M, Jonsson B, Nyberg L. Retrieval practice facilitates learning by strengthening processing in both the anterior and posterior hippocampus. Brain Behav. (2021) 11:e01909. doi: 10.1002/brb3.1909
44. Mottaghy FM, Gangitano M, Sparing R, Krause BJ, Pascual-Leone A. Segregation of areas related to visual working memory in the prefrontal cortex revealed by rTMS. Cereb Cortex. (2002) 12:369–75. doi: 10.1093/cercor/12.4.369
45. Woodcock EA, White R, Diwadkar VA. The dorsal prefrontal and dorsal anterior cingulate cortices exert complementary network signatures during encoding and retrieval in associative memory. Behav Brain Res. (2015) 290:152–60. doi: 10.1016/j.bbr.2015.04.050
46. Foerde K, Shohamy D. The role of the basal ganglia in learning and memory: insight from Parkinson’s disease. Neurobiol Learn Mem. (2011) 96:624–36. doi: 10.1016/j.nlm.2011.08.006
47. Quide Y, Morris RW, Shepherd AM, Rowland JE, Green MJ. Task-related fronto-striatal functional connectivity during working memory performance in schizophrenia. Schizophr Res. (2013) 150:468–75. doi: 10.1016/j.schres.2013.08.009
48. Geiger LS, Moessnang C, Schäfer A, Zang Z, Zangl M, Cao H, et al. Novelty modulates human striatal activation and prefrontal–striatal effective connectivity during working memory encoding. Brain Struct Funct. (2018) 223:3121–32. doi: 10.1007/s00429-018-1679-0
49. Kawagoe R, Takikawa Y, Hikosaka O. Expectation of reward modulates cognitive signals in the basal ganglia. Nat Neurosci. (1998) 1:411–6. doi: 10.1038/1625
50. Hikosaka O, Nakamura K, Nakahara H. Basal ganglia orient eyes to reward. J Neurophysiol. (2006) 95:567–84. doi: 10.1152/jn.00458.2005
51. Schultz W. Reward functions of the basal ganglia. J Neural Transm. (2016) 123:679–93. doi: 10.1007/s00702-016-1510-0
52. Beny-Shefer Y, Zilkha N, Lavi-Avnon Y, Bezalel N, Rogachev I, Brandis A, et al. Nucleus accumbens dopamine signaling regulates sexual preference for females in male mice. Cell Rep. (2017) 21:3079–88. doi: 10.1016/j.celrep.2017.11.062
53. Wilson RP, Colizzi M, Bossong MG, Allen P, Kempton M, Abe N, et al. The neural substrate of reward anticipation in health: A meta-analysis of fMRI findings in the monetary incentive delay task. Neuropsychol Rev. (2018) 28:496–506. doi: 10.1007/s11065-018-9385-5
54. Floresco SB, Montes DR, Tse MMT, Van Holstein M. Differential contributions of nucleus accumbens subregions to cue-guided risk/reward decision making and implementation of conditional rules. J Neurosci. (2018) 38:1901–14. doi: 10.1523/JNEUROSCI.3191-17.2018
55. Soares-Cunha C, De Vasconcelos NAP, Coimbra B, Domingues AV, Silva JM, Loureiro-Campos E, et al. Nucleus accumbens medium spiny neurons subtypes signal both reward and aversion. Mol Psychiatry. (2020) 25:3241–55. doi: 10.1038/s41380-019-0484-3
56. Sesack SR, Grace AA. Cortico-basal ganglia reward network: microcircuitry. Neuropsychopharmacology. (2010) 35:27–47. doi: 10.1038/npp.2009.93
57. Papenberg G, Jonasson L, Karalija N, Johansson J, Köhncke Y, Salami A, et al. Mapping the landscape of human dopamine D2/3 receptors with [11C]raclopride. Brain Struct Funct. (2019) 224:2871–82. doi: 10.1007/s00429-019-01938-1
58. Radke AK, Kocharian A, Covey DP, Lovinger DM, Cheer JF, Mateo Y, et al. Contributions of nucleus accumbens dopamine to cognitive flexibility. Eur J Neurosci. (2019) 50:2023–35. doi: 10.1111/ejn.14152
59. Verger A, Horowitz T, Chawki MB, Eusebio A, Bordonne M, Azulay J-P, et al. From metabolic connectivity to molecular connectivity: application to dopaminergic pathways. Eur J Nucl Med Mol Imaging. (2020) 47:413–24. doi: 10.1007/s00259-019-04574-3
60. Adcock RA, Thangavel A, Whitfield-Gabrieli S, Knutson B, Gabrieli JD. Reward-motivated learning: mesolimbic activation precedes memory formation. Neuron. (2006) 50:507–17. doi: 10.1016/j.neuron.2006.03.036
61. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N, et al. Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage. (2002) 15:273–89. doi: 10.1006/nimg.2001.0978
62. Thompson WH, Fransson P. On stabilizing the variance of dynamic functional brain connectivity time series. Brain Connect. (2016) 6:735–46. doi: 10.1089/brain.2016.0454
63. Krajcovic B, Fajnerova I, Horacek J, Kelemen E, Kubik S, Svoboda J, et al. Neural and neuronal discoordination in schizophrenia: From ensembles through networks to symptoms. Acta Physiol (Oxf). (2019) 226:e13282. doi: 10.1111/apha.13282
64. Fisher RA. Frequency distribution of the values of the correlation coefficient in samples of an indefinitely large population. Biometrika. (1915) 10:507–21. doi: 10.2307/2331838
65. Wilcox RR. Comparing pearson correlations: dealing with heteroscedasticity and nonnormality. Commun Stat-Simul C. (2009) 38:2220–34. doi: 10.1080/03610910903289151
66. Benjamini Y, Hochberg Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J R Stat Society Ser B (Methodological). (1995) 57:289–300. doi: 10.1111/j.2517-6161.1995.tb02031.x
67. Campbell I. Chi-squared and Fisher–Irwin tests of two-by-two tables with small sample recommendations. Stat Med. (2007) 26:3661–75. doi: 10.1002/sim.2832
68. Büchel C, Coull JT, Friston KJ. The predictive value of changes in effective connectivity for human learning. Science. (1999) 283:1538–41. doi: 10.1126/science.283.5407.1538
69. Gallistel CR, Fairhurst S, Balsam P. The learning curve: implications of a quantitative analysis. Proc Natl Acad Sci USA. (2004) 101:13124–31. doi: 10.1073/pnas.0404965101
70. Diwadkar VA, Flaugher B, Jones T, Zalanyi L, Ujfalussy B, Keshavan MS, et al. Impaired associative learning in schizophrenia: behavioral and computational studies. Cogn Neurodyn. (2008) 2:207–19. doi: 10.1007/s11571-008-9054-0
71. Heinz A, Murray GK, Schlagenhauf F, Sterzer P, Grace AA, Waltz JA. Towards a unifying cognitive, neurophysiological, and computational neuroscience account of schizophrenia. Schizophr Bull. (2019) 45:1092–100. doi: 10.1093/schbul/sby154
72. Brem AK, Ran K, Pascual-Leone A. Learning and memory. Handb Clin Neurol. (2013) 116:693–737. doi: 10.1016/B978-0-444-53497-2.00055-3
73. Inda MC, Muravieva EV, Alberini CM. Memory retrieval and the passage of time: from reconsolidation and strengthening to extinction. J Neurosci. (2011) 31:1635–43. doi: 10.1523/JNEUROSCI.4736-10.2011
74. Nadel L, Hupbach A, Gomez R, Newman-Smith K. Memory formation, consolidation and transformation. Neurosci Biobehav Rev. (2012) 36:1640–5. doi: 10.1016/j.neubiorev.2012.03.001
75. Lee JLC, Nader K, Schiller D. An update on memory reconsolidation updating. Trends Cogn Sci. (2017) 21:531–45. doi: 10.1016/j.tics.2017.04.006
76. Cabeza R, Nyberg L. Neural bases of learning and memory: functional neuroimaging evidence. Curr Opin Neurol. (2000) 13:415–21. doi: 10.1097/00019052-200008000-00008
77. Frangou P, Correia M, Kourtzi Z. GABA, not BOLD, reveals dissociable learning-dependent plasticity mechanisms in the human brain. Elife. (2018) 7. doi: 10.7554/eLife.35854
78. Linke J, Kirsch P, King AV, Gass A, Hennerici MG, Bongers A, et al. Motivational orientation modulates the neural response to reward. Neuroimage. (2010) 49:2618–25. doi: 10.1016/j.neuroimage.2009.09.013
79. Lisman JE, Grace AA. The hippocampal-VTA loop: controlling the entry of information into long-term memory. Neuron. (2005) 46:703–13. doi: 10.1016/j.neuron.2005.05.002
80. Krebs RM, Heipertz D, Schuetze H, Duzel E. Novelty increases the mesolimbic functional connectivity of the substantia nigra/ventral tegmental area (SN/VTA) during reward anticipation: Evidence from high-resolution fMRI. Neuroimage. (2011) 58:647–55. doi: 10.1016/j.neuroimage.2011.06.038
81. Arias-Carrión O, Stamelou M, Murillo-Rodríguez E, Menéndez-González M, Pöppel E. Dopaminergic reward system: a short integrative review. Int Arch Med. (2010) 3:24. doi: 10.1186/1755-7682-3-24
82. Wolosin SM, Zeithamova D, Preston AR. Reward modulation of hippocampal subfield activation during successful associative encoding and retrieval. J Cogn Neurosci. (2012) 24:1532–47. doi: 10.1162/jocn_a_00237
83. Stern CE, Corkin S, González RG, Guimaraes AR, Baker JR, Jennings PJ, et al. The hippocampal formation participates in novel picture encoding: evidence from functional magnetic resonance imaging. Proc Natl Acad Sci USA. (1996) 93:8660–5. doi: 10.1073/pnas.93.16.8660
84. Zeineh MM, Engel SA, Thompson PM, Bookheimer SY. Dynamics of the hippocampus during encoding and retrieval of face-name pairs. Science. (2003) 299:577–80. doi: 10.1126/science.1077775
85. Kafkas A, Montaldi D. How do memory systems detect and respond to novelty? Neurosci Lett. (2018) 680:60–8. doi: 10.1016/j.neulet.2018.01.053
86. Preston AR, Eichenbaum H. Interplay of hippocampus and prefrontal cortex in memory. Curr Biol. (2013) 23:R764–73. doi: 10.1016/j.cub.2013.05.041
87. Mattfeld AT, Stark CE. Functional contributions and interactions between the human hippocampus and subregions of the striatum during arbitrary associative learning and memory. Hippocampus. (2015) 25:900–11. doi: 10.1002/hipo.v25.8
88. Simons JS, Spiers HJ. Prefrontal and medial temporal lobe interactions in long-term memory. Nat Rev Neurosci. (2003) 4:637–48. doi: 10.1038/nrn1178
89. Banich MT. Executive function: The Search for an integrated account. Curr Dir psychol Sci. (2009) 18:89–94. doi: 10.1111/j.1467-8721.2009.01615.x
90. Banich MT, Mackiewicz KL, Depue BE, Whitmer AJ, Miller GA, Heller W. Cognitive control mechanisms, emotion and memory: a neural perspective with implications for psychopathology. Neurosci Biobehav Rev. (2009) 33:613–30. doi: 10.1016/j.neubiorev.2008.09.010
91. Sehatpour P, Dias EC, Butler PD, Revheim N, Guilfoyle DN, Foxe JJ, et al. Impaired visual object processing across an occipital-frontal-hippocampal brain network in schizophrenia: an integrated neuroimaging study. Arch Gen Psychiatry. (2010) 67:772–82. doi: 10.1001/archgenpsychiatry.2010.85
92. Ferbinteanu J. Memory systems 2018 - Towards a new paradigm. Neurobiol Learn Mem. (2019) 157:61–78. doi: 10.1016/j.nlm.2018.11.005
93. Sosa M, Giocomo LM. Navigating for reward. Nat Rev Neurosci. (2021) 22:472–87. doi: 10.1038/s41583-021-00479-z
94. Logothetis NK. What we can do and what we cannot do with fMRI. Nature. (2008) 453:869–78. doi: 10.1038/nature06976
95. Lisman J. The challenge of understanding the brain: where we stand in 2015. Neuron. (2015) 86:864–82. doi: 10.1016/j.neuron.2015.03.032
96. Cruz KG, Leow YN, Le NM, Adam E, Huda R, Sur M. Cortical-subcortical interactions in goal-directed behavior. Physiol Rev. (2023) 103:347–89. doi: 10.1152/physrev.00048.2021
97. Muzik O, Diwadkar VA. Depth and hierarchies in the predictive brain: From reaction to action. Wiley Interdiscip Rev Cogn Sci. (2023) 14(6):e1664. doi: 10.1002/wcs.1664
98. Elston RC. On the correlation between correlations. Biometrika. (1975) 62:133–40. doi: 10.1093/biomet/62.1.133
99. Uddin LQ, Betzel RF, Cohen JR, Damoiseaux JS, De Brigard F, Eickhoff SB, et al. Controversies and progress on standardization of large-scale brain network nomenclature. Netw Neurosci. (2023) 7:864–905. doi: 10.1162/netn_a_00323
100. Fornito A, Bullmore ET, Zalesky A. Opportunities and challenges for psychiatry in the connectomic era. Biol Psychiatry Cogn Neurosci Neuroimaging. (2017) 2:9–19. doi: 10.1016/j.bpsc.2016.08.003
101. Meram ED, Baajour S, Chowdury A, Kopchick J, Thomas P, Rajan U, et al. The topology, stability, and instability of learning-induced brain network repertoires in schizophrenia. Netw Neurosci. (2023) 7:184–212. doi: 10.1162/netn_a_00278
102. Peelle JE, Spehar B, Jones MS, Mcconkey S, Myerson J, Hale S, et al. Increased Connectivity among Sensory and Motor Regions during Visual and Audiovisual Speech Perception. J Neurosci. (2022) 42:435–42. doi: 10.1523/JNEUROSCI.0114-21.2021
103. Butler PD, Zemon V, Schechter I, Saperstein AM, Hoptman MJ, Lim KO, et al. Early-stage visual processing and cortical amplification deficits in schizophrenia. Arch Gen Psychiatry. (2005) 62:495–504. doi: 10.1001/archpsyc.62.5.495
104. Onitsuka T, Shenton ME, Kasai K, Nestor PG, Toner SK, Kikinis R, et al. Fusiform gyrus volume reduction and facial recognition in chronic schizophrenia. Arch Gen Psychiatry. (2003) 60:349–55. doi: 10.1001/archpsyc.60.4.349
105. Kang SS, Sponheim SR, Chafee MV, Macdonald AW 3rd. Disrupted functional connectivity for controlled visual processing as a basis for impaired spatial working memory in schizophrenia. Neuropsychologia. (2011) 49:2836–47. doi: 10.1016/j.neuropsychologia.2011.06.009
106. Fuster JM. The prefrontal cortex: anatomy, physiology, and neuropsychology of the frontal lobe. 2nd edition. New York: Raven Press (1989).
107. Yuan P, Raz N. Prefrontal cortex and executive functions in healthy adults: a meta-analysis of structural neuroimaging studies. Neurosci Biobehav Rev. (2014) 42:180–92. doi: 10.1016/j.neubiorev.2014.02.005
108. Matthews TE, Witek MAG, Lund T, Vuust P, Penhune VB. The sensation of groove engages motor and reward networks. Neuroimage. (2020) 214:116768. doi: 10.1016/j.neuroimage.2020.116768
109. Mannella F, Gurney K, Baldassarre G. The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis. Front Behav Neurosci. (2013) 7:135. doi: 10.3389/fnbeh.2013.00135
110. Oades RD, Halliday GM. Ventral tegmental (A10) system: neurobiology. 1. Anatomy and connectivity. Brain Res. (1987) 434:117–65. doi: 10.1016/0165-0173(87)90011-7
111. Saleh Y, Jarratt-Barnham I, Fernandez-Egea E, Husain M. Mechanisms underlying motivational dysfunction in schizophrenia. Front Behav Neurosci. (2021) 15:709753. doi: 10.3389/fnbeh.2021.709753
112. Phillips AG, Ahn S. Anticipation: an essential feature of anhedonia. Curr Top Behav Neurosci. (2022) 58:305–23. doi: 10.1007/7854_2022_317
113. Tarder-Stoll H, Jayakumar M, Dimsdale-Zucker HR, Gunseli E, Aly M. Dynamic internal states shape memory retrieval. Neuropsychologia. (2020) 138:107328. doi: 10.1016/j.neuropsychologia.2019.107328
114. Heckers S, Konradi C. Hippocampal neurons in schizophrenia. J Neural Transm. (2002) 109:891–905. doi: 10.1007/s007020200073
115. Wadehra S, Pruitt P, Murphy ER, Diwadkar VA. Network dysfunction during associative learning in schizophrenia: Increased activation, but decreased connectivity: an fMRI study. Schizophr Res. (2013) 148:38–49. doi: 10.1016/j.schres.2013.05.010
116. Woodcock EA, Wadehra S, Diwadkar VA. Network profiles of the dorsal anterior cingulate and dorsal prefrontal cortex in schizophrenia during hippocampal-based associative memory. Front Syst Neurosci. (2016) 10:32. doi: 10.3389/fnsys.2016.00032
117. Cao H, Mcewen SC, Chung Y, Chen OY, Bearden CE, Addington J, et al. Altered brain activation during memory retrieval precedes and predicts conversion to psychosis in individuals at clinical high risk. Schizophr Bull. (2019) 45:924–33. doi: 10.1093/schbul/sby122
118. Behrendt RP. Hallucinatory experience as aberrant event memory formation: Implications for the pathophysiology of schizophrenia. Prog Neuropsychopharmacol Biol Psychiatry. (2016) 71:203–9. doi: 10.1016/j.pnpbp.2016.07.009
119. Bauch EM, Bunzeck N, Hinrichs H, Schmitt FC, Voges J, Heinze H-J, et al. Theta oscillations underlie retrieval success effects in the nucleus accumbens and anterior thalamus: Evidence from human intracranial recordings. Neurobiol Learn Memory. (2018) 155:104–12. doi: 10.1016/j.nlm.2018.07.001
120. Kellermann TS, Caspers S, Fox PT, Zilles K, Roski C, Laird AR, et al. Task- and resting-state functional connectivity of brain regions related to affection and susceptible to concurrent cognitive demand. Neuroimage. (2013) 72:69–82. doi: 10.1016/j.neuroimage.2013.01.046
121. Hostler TJ, Wood C, Armitage CJ. The influence of emotional cues on prospective memory: a systematic review with meta-analyses. Cogn Emot. (2018) 32:1578–96. doi: 10.1080/02699931.2017.1423280
122. Bosc M, Dubini A, Polin V. Development and validation of a social functioning scale, the Social Adaptation Self-evaluation Scale. Eur Neuropsychopharmacol. (1997) 7 Suppl 1:S57–70. doi: 10.1016/S0924-977X(97)00420-3
123. Bosc M. Assessment of social functioning in depression. Compr Psychiatry. (2000) 41:63–9. doi: 10.1016/S0010-440X(00)90133-0
124. Paccagnella M, Grove JR. Attitudes towards high achievers in sport: an adaptation of Feather’s Tall Poppy Scale. J Sci Med Sport. (2001) 4:310–23. doi: 10.1016/S1440-2440(01)80040-2
125. Briley M, Moret C. Improvement of social adaptation in depression with serotonin and norepinephrine reuptake inhibitors. Neuropsychiatr Dis Treat. (2010) 6:647–55. doi: 10.2147/NDT
126. Wang KS, Zegel M, Molokotos E, Moran LV, Olson DP, Pizzagalli DA, et al. The acute effects of nicotine on corticostriatal responses to distinct phases of reward processing. Neuropsychopharmacology. (2020) 45:1207–14. doi: 10.1038/s41386-020-0611-5
127. Bracht T, Mertse N, Walther S, Lüdi K, Breit S, Federspiel A, et al. Link between structural connectivity of the medial forebrain bundle, functional connectivity of the ventral tegmental area, and anhedonia in unipolar depression. NeuroImage Clin. (2022) 34:102961. doi: 10.1016/j.nicl.2022.102961
128. Vyas NS, Hadjulis M, Vourdas A, Byrne P, Frangou S. The Maudsley early onset schizophrenia study. Eur Child Adolesc Psychiatry. (2007) 16:465–70. doi: 10.1007/s00787-007-0621-4
129. Nakagami E, Xie B, Hoe M, Brekke JS. Intrinsic motivation, neurocognition and psychosocial functioning in schizophrenia: testing mediator and moderator effects. Schizophr Res. (2008) 105:95–104. doi: 10.1016/j.schres.2008.06.015
130. Saad H, Kopchick J, Stanley JA, Diwadkar VA. Altered higher order network features in schizophrenia during learning and memory. Seoul, South Korea: Paper presented at the Organization of Human Brain Mapping (2024).
131. Zhang H, Giannakopoulos P, Haller S, Lee SW, Qiu S, Shen D. Inter-network high-order functional connectivity (IN-HOFC) and its alteration in patients with mild cognitive impairment. Neuroinformatics. (2019) 17:547–61. doi: 10.1007/s12021-018-9413-x
132. Sprooten E, Rasgon A, Goodman M, Carlin A, Leibu E, Lee WH, et al. Addressing reverse inference in psychiatric neuroimaging: Meta-analyses of task-related brain activation in common mental disorders. Hum Brain Mapp. (2017) 38:1846–64. doi: 10.1002/hbm.23486
133. Falco D, Chowdury A, Rosenberg DR, Bressler SL, Diwadkar VA. ALE meta-analysis, its role in node identification and the effects on estimates of local network organization. Brain Struct Funct. (2020) 225:1089–102. doi: 10.1007/s00429-020-02061-2
134. Chen K, Azeez A, Chen DY, Biswal BB. Resting-state functional connectivity: signal origins and analytic methods. Neuroimaging Clin N Am. (2020) 30:15–23. doi: 10.1016/j.nic.2019.09.012
135. Del Pinal G, Nathan MJ. There and up again: on the uses and misuses of neuroimaging in psychology. Cogn Neuropsychol. (2013) 30:233–52. doi: 10.1080/02643294.2013.846254
136. Cansino S, Trejo-Morales P, Estrada-Manilla C, Pasaye-Alcaraz EH, Aguilar-Castañeda E, Salgado-Lujambio P, et al. Effective connectivity during successful and unsuccessful recollection in young and old adults. Neuropsychologia. (2017) 103:168–82. doi: 10.1016/j.neuropsychologia.2017.07.016
137. King DR, Chastelaine M, Elward RL, Wang TH, Rugg MD. Dissociation between the neural correlates of recollection and familiarity in the striatum and hippocampus: Across-study convergence. Behav Brain Res. (2018) 354:1–7. doi: 10.1016/j.bbr.2017.07.031
138. Josephs O, Henson RN. Event-related functional magnetic resonance imaging: modelling, inference and optimization. Philos Trans R Soc Lond B Biol Sci. (1999) 354:1215–28. doi: 10.1098/rstb.1999.0475
139. Oztekin I, Long NM, Badre D. Optimizing design efficiency of free recall events for FMRI. J Cogn Neurosci. (2010) 22:2238–50. doi: 10.1162/jocn.2009.21350
140. Diwadkar VA, Pruitt P, Zhang A, Radwan J, Keshavan MS, Murphy E, et al. The neural correlates of performance in adolescents at risk for schizophrenia: Inefficiently increased cortico-striatal responses measured with fMRI. J Psychiatr Res. (2012) 46:12–21. doi: 10.1016/j.jpsychires.2011.09.016
141. Amaro E Jr, Barker GJ. Study design in fMRI: Basic principles. Brain Cogn. (2006) 60:220–32. doi: 10.1016/j.bandc.2005.11.009
142. Tan RJ, Rugg MD, Lega BC. Direct brain recordings identify hippocampal and cortical networks that distinguish successful versus failed episodic memory retrieval. Neuropsychologia. (2020) 147:107595. doi: 10.1016/j.neuropsychologia.2020.107595
143. Schwarze U, Bingel U, Badre D, Sommer T. Ventral striatal activity correlates with memory confidence for old- and new-responses in a difficult recognition test. PloS One. (2013) 8:e54324. doi: 10.1371/journal.pone.0054324
144. Ueda R, Abe N. Neural representations of the committed romantic partner in the nucleus accumbens. Psychol Sci. (2021) 32:1884–95. doi: 10.1177/09567976211021854
145. Li LY, Castro MK, Martin EA. What you want may not be what you like: A test of the aberrant salience hypothesis in schizophrenia risk. Cogn Affect Behav Neurosci. (2020) 20:873–87. doi: 10.3758/s13415-020-00807-3
Keywords: schizophrenia, learning, memory, functional MRI, cognition, mesolimbic system
Citation: Martin E, Chowdury A, Kopchick J, Thomas P, Khatib D, Rajan U, Zajac-Benitez C, Haddad L, Amirsadri A, Robison AJ, Thakkar KN, Stanley JA and Diwadkar VA (2024) The mesolimbic system and the loss of higher order network features in schizophrenia when learning without reward. Front. Psychiatry 15:1337882. doi: 10.3389/fpsyt.2024.1337882
Received: 13 November 2023; Accepted: 16 August 2024;
Published: 03 September 2024.
Edited by:
Stefan Borgwardt, University of Lübeck, GermanyReviewed by:
Sadia Shakil, The Chinese University of Hong Kong, ChinaJames P. Kesby, University of Queensland, Australia
Copyright © 2024 Martin, Chowdury, Kopchick, Thomas, Khatib, Rajan, Zajac-Benitez, Haddad, Amirsadri, Robison, Thakkar, Stanley and Diwadkar. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Vaibhav A. Diwadkar, vdiwadka@med.wayne.edu