Hackjin Kim- Department of Psychology, Korea University, Seoul, South Korea
The medial prefrontal cortex (mPFC) has long been recognized as the key component of the neurocircuitry involved in various social as well as non-social behaviors, however, little is known regarding the organizing principle of distinctive subregions in the mPFC that integrates a wide range of mPFC functions. The present study proposes a hierarchical model of mPFC functionality, where three functionally dissociable subregions, namely, the ventromedial prefrontal cortex (vmPFC), rostromedial prefrontal cortex (rmPFC), and dorsomedial prefrontal cortex (dmPFC), are differentially involved in computing values of decision-making. According to this model, the mPFC subregions interact with each other in such a way that more dorsal regions utilize additional external sensory information from environment to predict and prevent conflicts occurring in more ventral regions tuned to internal bodily signals, thereby exerting the hierarchically organized allostatic regulatory control over homeostatic reflexes. This model also emphasizes the role of the thalamic reticular nucleus (TRN) in arbitrating the transitions between different thalamo-cortical loops, detecting conflicts between competing options for decision-making, and in shifting flexibly between decision modes. The hierarchical architecture of the mPFC working in conjunction with the TRN may play a key role in adjusting the internal (bodily) needs to suit the constraints of external (environmental) variables better, thus effectively addressing the stability-plasticity dilemma.
Introduction
Imagine you are an international student who came to study in a country that is culturally very different from that you grew up. How would you maintain stable codes of conduct while updating other codes in a novel social situation? The problem of acquiring new knowledge without disrupting the existing knowledge, the so-called stability-plasticity dilemma, is one of the major obstacles encountered by any adaptive agent (Grossberg, 2013). The human brain is known to be one of the most successful systems for dealing with the stability-plasticity dilemma. Multitudes of researchers in a wide range of academic disciplines, from computer scientists to neuroscientists, have extensively investigated the way the human brain resolves this dilemma. Our knowledge on the exact mechanisms for such a capacity, particularly under social contexts, remains limited.
This article suggests that such a stability-plasticity dilemma can be effectively addressed by the brain’s capacity to predict and prevent homeostatic imbalance, which is called allostasis (Sterling and Eyer, 1988; McEwen and Stellar, 1993; Schulkin, 2003), to maintain a state of homeostasis. For example, the brain constantly seeks the optimal regulation of bodily homeostasis by adding increasing amounts of external sensory inputs (e.g., visual, auditory, tactile stimuli) in order to predict and prevent anticipated homeostatic imbalance as early and accurately as possible (External valuation). As a result, the most parsimonious pattern of external inputs that led to a successful prediction and prevention of homeostatic imbalance becomes associated with a specific coordinated pattern of somatic or visceral reflexes or both, which is then engaged in a reflex-like fashion whenever the same or a similar input pattern is presented (Internal valuation). Importantly, when internal valuation fails to achieve the state of homeostasis, then external valuation will be engaged again to update the internal valuation. This internal-external valuation cycle may be at the heart of the allostatic regulation and also likely to reflect how the brain deals with the stability-plasticity dilemma.
To illustrate how such an allostatic regulation can be linked to social valuation, this article first reviews recent findings of the roles of the medial prefrontal cortex (mPFC) in decision-making in social situations. Next, the hierarchical allostatic regulation model of the mPFC function for computing values of social decision-making is proposed, with an emphasis on the three functionally and anatomically dissociable subregions of the mPFC: the ventromedial prefrontal cortex (vmPFC), the rostromedial prefrontal cortex (rmPFC), and the dorsomedial prefrontal cortex (dmPFC). In this model, the mPFC subregions are organized such that more ventral and more dorsal regions are involved in internal and external valuation, respectively, and the intermediate areas are functionally and spatially graded concerning such dimensions. More ventral regions are involved in intuitive value computation to meet internal needs, prioritizing stability, whereas more dorsal regions are involved in deliberative value computation to utilize external information, prioritizing plasticity. External valuation in more dorsal regions is engaged to resolve a conflict that occurs when mutually competing units are simultaneously activated in more ventral regions. Following repeated engagements, such external valuation can serve to update internalized values encoded in the ventral regions. Based on all of these properties above, this model can efficiently address the stability-plasticity dilemma and why such functionality is critical for adaptive behavior in constantly changing social situations.
This review includes literatures from human as well as non-human research including monkeys and rats. Despite some evidence for remarkable cross-species homology among rats, macaques, and humans in the anatomy of the medial prefrontal cortex (Vogt et al., 2013), attention should be paid to the interpretation of the cross-species comparisons reported in the present study regarding functional differences among different subregions of the medial prefrontal cortex.
Anatomically and Functionally Dissociable Subregions in the Medial Prefrontal Cortex
Anatomical Boundaries Between the Medial Prefrontal Cortex Subregions
According to the influential anatomical studies (Vogt, 2005; Mackey and Petrides, 2014; Joyce and Barbas, 2018; Palomero-Gallagher et al., 2019), human mPFC can be broadly divided into three functionally and anatomically dissociable subregions: (1) the vmPFC [roughly corresponds to the medial aspect of Brodmann area (BA) 11, BA 12, BA 14, and BA 25], (2) dmPFC [BA 9, BA 24 (the pregenual anterior cingulate cortex), and BA 32 (the anterior midcingulate cortex)], and (3) rmPFC [BA 10, BA 24 (the pregenual anterior cingulate cortex), and BA 32 (the pregenual anterior cingulate cortex)]. For a practical purpose, a recent neuroimaging study utilized the MNI coordinate system such that the vmPFC and rmPFC are divided by the z-plane of –10 (MNI coordinate system), and the dmPFC and the rmPFC are divided by the z-plane of +22 (Lieberman et al., 2019; Figure 1).
Figure 1. Schematic diagram of anatomical segregation within the medial prefrontal cortex. mPFC can be broadly divided into three functionally and anatomically dissociable subregions: the ventromedial prefrontal cortex (vmPFC) [roughly corresponds to the medial aspect of Brodmann area (BA 11, BA 12, BA 14, and BA 25)], the dorsomedial prefrontal cortex (dmPFC) [BA 9, BA 24 (the pregenual anterior cingulate cortex), and BA 32 (the anterior midcingulate cortex)], and the rostromedial prefrontal cortex (rmPFC) [BA 10, BA 24 (the pregenual anterior cingulate cortex), and BA 32 (the pregenual anterior cingulate cortex)]. The dmPFC and rmPFC are divided by the z-plane of +22, and the rmPFC and vmPFC are divided by the z-plane of –10 (Lieberman et al., 2019). cc, corpus callosum.
It is well-known that these subregions have unique patterns of anatomical (Haruno and Kawato, 2006; Yin and Knowlton, 2006; Haber and Knutson, 2010) as well as functional (Bzdok et al., 2013; de la Vega et al., 2016) connections with other neural structures. More specifically, recent meta-analyses of functional connectivity revealed that the vmPFC is functionally connected with the nucleus accumbens, amygdala, and thalamus; the rmPFC with the nucleus accumbens, hippocampus, posterior cingulate cortex, and retrosplenial cortex; and the dmPFC with the inferior frontal gyrus, temporo-parietal junction, and middle temporal gyrus (Bzdok et al., 2013; de la Vega et al., 2016). It should be noted, however, that these meta-analyses may not reflect the full connectivity because they are based on fMRI studies with limited spatial and temporal resolution.
The mPFC subregions do not seem to be mutually independent, but functionally inter-connected with each other. For example, it has been proposed that reinforcement learning occurs through multiple mutually interacting cortico-thalamo-striatal loops, propagating information mostly from a ventral to a dorsal direction (Yin and Knowlton, 2006). Despite the recent suggestion that the more dorsal mPFC handles more abstract and complex information than the more ventral mPFC (Denny et al., 2012; Suzuki et al., 2012), the specific roles of distinctive mPFC subregions and the exact nature of the interaction between them in the service of social behavior are currently unknown. In the next section, I will review the empirical and theoretical works on the functional properties of each subregion in more detail before proposing an integrative model of the mPFC function.
Role of the Ventromedial Prefrontal Cortex (vmPFC) in Social Valuation
Many animal and human studies have described various aspects of the function of the vmPFC, including the regulation of emotions (Quirk and Beer, 2006; Milad et al., 2009; LaLumiere et al., 2010; Delgado et al., 2016), valuation for decision-making (Kable and Glimcher, 2007; Kim et al., 2007; Bartra et al., 2013), and goal-directed actions (O’Doherty, 2011). The vmPFC is also thought to be a key cortical component of the central autonomic network (Beissner et al., 2013). Consistent with this, there is additional evidence that the vmPFC may be involved in encoding internally driven valuation. For example, the vmPFC is the main target of the dopaminergic projection from the midbrain modulated by either food intake (de Araujo et al., 2012) or direct vagus nerve stimulation (Han et al., 2018). The vmPFC activity is also modulated by the experimentally-induced dopamine level (Jocham et al., 2011), visceral signals like hunger and satiety (Roy et al., 2012; Howard et al., 2015), and outcome devaluation (Valentin et al., 2007; de Wit et al., 2009). Also, vmPFC activity covaries with heart rate variability (Ziegler et al., 2009), and vmPFC lesions impair expression of normal physiological responses during decision-making (Bechara et al., 1996).
The vmPFC is known to have dense anatomical connections with both the nucleus accumbens (Haber et al., 2006) and the amygdala (Carmichael and Price, 1995; Ghashghaei et al., 2007). The former is mainly involved in learning reward-seeking behavior by reinforcing actions to obtain reward (Ikemoto and Panksepp, 1999; Demos et al., 2012; Lawrence et al., 2012), whereas the latter is primarily involved in learning defensive behaviors to avoid potentially dangerous or unpleasant stimuli (Schwartz et al., 2003; Mason et al., 2006; De Martino et al., 2010). These connections may allow the vmPFC to generate rapid avoidance or approach responses, making it an ideal system for a cost-benefit analysis to achieve homeostatic balance in a given situation (Schneirla, 1959; Kim et al., 2006; Basten et al., 2010).
In the field of social neuroscience, the vmPFC has been strongly implicated in processing “first-person” information (Kim et al., 2007; Denny et al., 2012; Bzdok et al., 2013; Lebreton et al., 2009; Levy et al., 2011), although several studies have also shown that the vmPFC activity can be commonly involved in decisions for both self and others (Nicolle et al., 2012; Janowski et al., 2013). Such an inconsistency can be reconciled by assuming the role of the vmPFC function in intuitive, internalized valuation for other-regarding decisions. Supporting this idea, the vmPFC was shown to be involved in decision-making for others, when people apply self-simulation to estimate a stranger’s preferences (Janowski et al., 2013; Kang et al., 2013) and when people are fully familiarized with others’ preferences through practice (Nicolle et al., 2012). These findings, therefore, indicate that the vmPFC could be involved in computing the value of choices for others, only when such valuation process is internally driven via familiarization of others’ preferences or through egocentric simulations.
Similarly, in the specific context of prosociality, the vmPFC seems to encode decision values for highly internalized forms of altruistic behaviors (i.e., internalized prosocial valuation) as in harm-aversion in social dilemma and moral emotions (Moll et al., 2006; Hare et al., 2010; Shenhav and Greene, 2010; Tricomi et al., 2010; Zaki and Mitchell, 2011; Buckholtz and Marois, 2012; Crockett, 2013; Sul et al., 2015). For example, a more recent study showed that selfish people used the vmPFC only when calculating the value of the choices for themselves but not those for strangers, unlike altruistic people who used the vmPFC for both self and other (Sul et al., 2015). Besides, more prosocial people showed higher vmPFC activity during prosocial choice, whether they are observed by others or not, and higher vmPFC activity was associated with faster response time for prosocial choices (Jung et al., 2018). Taken together, these findings suggest that prosocial valuation encoded by vmPFC may be intuitively engaged and immune to social context.
According to recent theories on morality and altruism (Haidt, 2007), the ultimate desire for survival and reproduction can be extended to creating an altruistic instrumental desire to sacrifice oneself for others. That is, people can learn the belief that the act of helping others is an effective way to draw a favorable impression from others, and such a belief can be internalized to create a new instrumental desire. Such an instrumental desire for altruism may be internalized in the vmPFC, which may then facilitate prosocial behavior automatically and intuitively, more or less independently of social context (Rand et al., 2012; Sul et al., 2015; Jung et al., 2018). This idea is also consistent with the findings that the vmPFC is associated with seeking social status (Milad et al., 2009; Hughes and Beer, 2012, 2013). For example, an altruistic decision may result from the motivation to avoid the possibility of losing reputation due to selfish behavior. In this sense, the vmPFC activity associated with prosocial behavior may indicate the degree to which one’s valuation for social reward is internalized, and, therefore, is resistant to contextual changes.
Role of the Dorsomedial Prefrontal Cortex (dmPFC) in Social Valuation
The dorsomedial prefrontal cortex (dmPFC) has been implicated in numerous aspects of psychological functions (Ebitz and Hayden, 2016), such as detecting and resolving conflicts among competitive responses (Shenhav et al., 2016), searching for a new value beyond the current familiar state (Kolling et al., 2016), and computing decision values based on external sensory signals from the environment, unlike the vmPFC involved in internal valuation (Bouret and Richmond, 2010; Nakao et al., 2012; Howard et al., 2015). Consistent with the functional dissociation between dmPFC and vmPFC in humans, recent studies on rats have also shown a functionally competitive relationship between dorsal and ventral subregion of the mPFC (Coutureau and Killcross, 2003). For example, the prelimbic cortex, a more dorsal part of the mPFC in rats comparable to BA 32 in primates (Vogt et al., 2013), is responsible for voluntary and goal-directed initial responses, whereas the infralimbic cortex, a more ventral part of mPFC in rats comparable to BA 25 in primates, is responsible for developing habit-like behaviors, which are formed progressively through overtraining (Killcross and Coutureau, 2003). In addition, the BA 32 along with its neighboring cortical regions including the rmPFC or the dmPFC have heavy anatomical connections with the hippocampus and the related rhinal cortex (Barbas, 2015), and lesioning these cortices resulted in significant impairment in the mnemonic retrieval of context within which external sensory stimuli are experienced (Chapados and Petrides, 2015). Based on these findings, it can be speculated that, when two or more competing responses come into conflict, the dmPFC is engaged to search for a new and more appropriate response to resolve the conflict by directing attention to external sensory information from the environment or information available in memory (Cabeza et al., 2002; Horst and Laubach, 2009), which may have little to do with fulfilling the immediate internal needs of the body.
The dmPFC has been often shown to respond to negative outcomes such as pain (Rainville et al., 1997), monetary loss (Liu et al., 2011), as well as social rejection (Eisenberger et al., 2003). Some recent theoretical works also suggested a more general function of the dmPFC, that is, to integrate multiple sources of information from a wide range of brain network to guide our thoughts and actions (Shackman et al., 2011), or to maintain the representation of expected reward and to allocate available physiological resources to meet or exceed task demands (Touroutoglou et al., 2020). One can speculate that experiencing negative outcome may trigger neural processes of re-allocating attention to the environment in order to search for a new potentially better alternative, whereas experiencing positive outcome may elicit a simpler strategy of maintaining previously chosen behavior that have led to the successful consequence. Consistent with the evolutionarily advantageous decision heuristic of win-stay lose-shift (Nowak and Sigmund, 1993), this view suggests that positive and negative outcomes are naturally associated with internal and external valuation process, which are mainly subserved by the vmPFC and the dmPFC, respectively.
In social neuroscience, contrary to the role of the vmPFC in processing “first-person” information, the dmPFC appears to be more involved in processing “third-person” information, which includes mentalization or perspective-taking (Amodio and Frith, 2006; Frith and Frith, 2006; Mitchell et al., 2006; Hampton et al., 2008; Behrens et al., 2009; Kang et al., 2013), valuation of decisions for others (Suzuki et al., 2012; Jung et al., 2013; Hutcherson et al., 2015; Sul et al., 2015), evaluation of outcomes given to others (Chang et al., 2013; Apps and Ramnani, 2014; Lockwood et al., 2015), and prosocial behavior (Waytz et al., 2012). Despite these other-centered functions, the dmPFC activity is not always associated with prosocial behavior. For example, the dmPFC activity encoding value of decision for others was more prominent among selfish compared to prosocial people (Sul et al., 2015), and the value-related dmPFC activity was stronger for self-centered than other-oriented decisions under social observation (Jung et al., 2018). These inconsistencies about the role of the dmPFC in prosocial decisions should be examined more carefully by considering the differences among studies in the experimental context. Given that the dmPFC is also associated with strategic decisions that maximize profits (Rilling et al., 2004; Hampton et al., 2008; Behrens et al., 2009; Seo et al., 2014), it can be inferred that the dmPFC activity can lead to prosocial behavior only when such deliberate decisions regarding others are strategically beneficial to decision-makers.
Taken together, these findings suggest that the dmPFC activity may predict prosocial behavior only when the context intuitively triggers selfish behavior, however, prosocial behavior can be strategically more beneficial. Conversely, the same region may be engaged even when the context automatically triggers prosocial motivation, however, economic value maximization can be strategically more beneficial. Therefore, the dmPFC can be engaged whenever a conflict occurs among two or more responses, and consideration of additional (external) information is necessary for value-maximization, regardless of whether its activity leads to a prosocial outcome or not.
Role of the Rostromedial Prefrontal Cortex (rmPFC) in Social Valuation
The rmPFC, which lies between the vmPFC and the dmPFC, has unique and privileged anatomical features because of its widespread anatomical connections with many cortical and subcortical structures including the brainstem, the insula, and most of the other mPFC subregions (Dixon et al., 2017). This region has been implicated in various functions such as default-mode processing (Uddin et al., 2009; Andrews-Hanna et al., 2010), far-sighted decisions, where one needs to choose between immediate smaller and delayed more substantial reward (Kable and Glimcher, 2007), and, most notably, cognitive branching, that is, pursuing a long-term mental plan by tracking the values of ongoing and alternative behavioral strategies and switching to the better option (Koechlin and Hyafil, 2007; Mansouri et al., 2017).
In social neuroscience, the rmPFC has been best known for its prioritized role in self-referential processing (Kelley et al., 2002; Moran et al., 2006; Northoff et al., 2006), although it also has been shown to encode decision values for both self and others (Hutcherson et al., 2015; Sul et al., 2015). For example, in a typical self-referential task where participants view a list of trait-related words and report whether they are self- or other-descriptive, increased activity is found in the rmPFC during conditions of self vs. other (Kelley et al., 2002). Different groups of researchers have interpreted such a self-referential activity in the rmPFC as perceived similarity (Mitchell et al., 2006), personal significance (Krienen et al., 2010; Kim and Johnson, 2015), and social valuation (D’Argembeau, 2013). An alternate, possibly more plausible, reason for the rmPFC activity during a self-referential task might be that it reflects heightened motivation for seeking self-enhancement, including both self-promotion (approach) and self-protection (avoidance), which is similar to its suggested role in reputation management (Amodio and Frith, 2006; Izuma, 2012). According to this account, the rmPFC activity increases during self- vs. other-referential task because one feels a greater need to engage motivation for self-enhancement. This alternative view can be supported by several recent findings listed below.
First, the rmPFC activity is often associated with different types of self-conscious emotions that can occur depending on whether one’s behavior is appropriate to social standards or not (Edelmann, 1987; Leary and Kowalski, 1990; Keltner and Buswell, 1997; Tracy and Robins, 2004; Tangney et al., 2007). For example, in many studies using emotion-evoking scenarios, rmPFC activity has been linked to subjective experience of various self-conscious emotions such as embarrassment (Takahashi et al., 2004; Burnett et al., 2009; Bas-Hoogendam et al., 2017), shame (Michl et al., 2012), guilt (Shin et al., 2000; Takahashi et al., 2004; Zahn et al., 2008; Burnett et al., 2009; Basile et al., 2011; Wagner et al., 2011; Fourie et al., 2014; Gilead et al., 2016), and pride (Zahn et al., 2008; Gilead et al., 2016).
Second, the structural and functional integrity of the rmPFC is linked to individual differences in motivation for self-enhancement. For example, people with high rejection sensitivity showed increased rmPFC activity when anticipating social evaluation (Powers et al., 2013), and those with high trait social anxiety are characterized with heightened rmPFC activity during social observation (Müller-Pinzler et al., 2015). Also, patients with lesions in areas including rmPFC failed to exhibit self-conscious emotion (Sturm et al., 2006, 2008; Krajbich et al., 2009; Moll et al., 2011) and expressed socially inappropriate self-disclosing behavior (Beer et al., 2006), and those with smaller volume of rmPFC showed reduced physiological and behavioral indices of self-conscious emotional responses when watching a video clip of themselves singing (Sturm et al., 2012). Recently, it was also demonstrated that the developmental maturity of the rmPFC may be critical for a more sophisticated and socially appropriate expression of self-protective motivation in response to negative evaluation from others (Yoon et al., 2018).
Third, social observation, one of the most potent situational factors boosting self-enhancement motivation, can modulate the rmPFC activity, often leading to increase in a socially desirable behavior. For example, social observation increased rmPFC activity during judgment about self and social appropriateness (Izuma et al., 2010), public success or failure on a cognitive task (Müller-Pinzler et al., 2015), and an economic game (Van Hoorn et al., 2016), often being accompanied by subjectively experienced self-conscious emotion (Somerville et al., 2013). Consistent with the “costly signaling theory,” which views altruistic or prosocial behavior as a signal of willingness and ability to help others (Zahavi, 1975; Nowak and Sigmund, 1998; Fehr and Fischbacher, 2003; Hardy and Van Vugt, 2006), social observation by others or even subtle surveillance cues can be powerful enough to increase prosocial behavior (Soetevent, 2005; Bereczkei et al., 2010; Griskevicius et al., 2010; Izuma, 2012; Kimura et al., 2012). In line with the behavioral evidence of costly signaling theory, social observation also increased the rmPFC activity encoding the value of prosocial decisions, and such a context-dependent prosocial valuation of the rmPFC was clearly distinguishable from those of the vmPFC and the dmPFC (Figure 2; Jung et al., 2018). It should be noted, however, that context-dependent functionality of rmPFC for social valuation does not necessarily require social observation. For example, increased rmPFC activity was associated with strategic prosocial behavior when participants had been explicitly instructed to make a donation with money endowed by the experimenter, which may have posed a substantial social pressure, similar to a social observation (Tusche et al., 2016; Cutler and Campbell-Meiklejohn, 2019; Fukuda et al., 2019).
Figure 2. Functional segregation of mPFC function during ethical consumption under social observation. The rmPFC and the dmPFC encode subject-specific values of purchasing social products (prosocial decision) and non-social products (self-centered decision), respectively, under social observation (context-dependent), whereas the vmPFC encodes subject-specific values of purchasing social products regardless of social observation (context-independent) (Adapted from Jung et al., 2018).
Lastly, the rmPFC integrates social information to update the subjective estimation of self-efficacy or social status under competitive or cooperative social contexts. For example, several recent studies have shown that the rmPFC activity tracks trial-by-trial fluctuation of expected social dominance during competitive perceptual decision tasks (Ligneul et al., 2016), dynamic updates of self-efficacy, estimated based on self and other’s performances in perceptual decision task (Wittmann et al., 2016), prediction error signals between expected and observed social feedback from others (Korn et al., 2012; Will et al., 2017), updating knowledge of one’s own social hierarchy (Kumaran et al., 2016), and value of self-protective behavior in response to negative social feedback (Yoon et al., 2018). According to a recent hypothesis, self-efficacy can be metacognitive beliefs about the brain’s capacity to successfully regulate bodily states and the rmPFC plays a crucial role in such “allostatic self-efficacy” (Wager et al., 2009; Stephan et al., 2016). Taken together, these studies indicate that at the core of self-enhancement motivation lies the allostatic regulatory function of the rmPFC, that is, shaping the internal drive for (bodily) homeostasis so that it better fits into the constraints of external (environmental) contextual variables (Smith et al., 2017).
In summary, under situations where one’s impression or reputation is at stake, the rmPFC may arbitrate between intuitive motivation for self-enhancement (i.e., internal valuation) and careful consideration of contextual information (i.e., external valuation). Such an rmPFC arbitration function may be critical for the neural mechanism of allostatic regulatory control that serves to meet internal bodily needs in a socially relevant manner.
In the next section, I will introduce the hierarchical allostatic regulation model of mPFC function and show how hierarchically organized subregions of mPFC can interact with each other in such a way that more dorsal regions utilize additional external information from environment to predict and prevent conflicts occurring in more ventral regions tuned to internal bodily signals. In the end, I will show how such a hierarchical allostatic regulatory mPFC function can effectively address the stability-plasticity dilemma in a constantly changing social environment.
Hierarchical Allostatic Regulation Model of mPFC Function for Social Valuation
mPFC Subregions Encoding Gradient of Internal-to-External Valuation
In the hierarchical model of social valuation, the mPFC comprises three functionally dissociable and hierarchically organized subregions: vmPFC, rmPFC, and dmPFC. These regions are differentially involved in computing values of decision along the ventral-to-dorsal spatial gradient of increasing external sensory inputs (e.g., via the temporal cortex and the parietal cortex) and decreasing internal inputs (e.g., via the brainstem, the hypothalamus, the amygdala, and the nucleus accumbens) (Dixon et al., 2017). Such an mPFC functional gradient is also consistent with the direction of evolutionary progress revealed by a recent analysis of the sulcal organization pattern across primate species (Amiez et al., 2019).
It should be noted, however, that the boundary between internal and external valuation is only a relative one. A level can be either internal or external depending on whether it is compared with its upper or lower level, respectively. For example, the vmPFC can be an internal valuation system when compared with the rmPFC but can also be an external valuation system when compared with the amygdala and the nucleus accumbens. In addition, the internal valuation of the vmPFC should be distinguished from instinctive or reflex-like responses that may be controlled by other structures, such as the amygdala, nucleus accumbens, and the spinal cord (located at a level further below the vmPFC). Therefore, the vmPFC can also be involved in valuation that requires abstract and sophisticated representations of a task structure if such representations became internalized through repetition (Hampton et al., 2008) as well as in goal-directed decisions when goals are primarily determined by internal signals carrying a homeostatic bodily state (Valentin et al., 2007).
Briefly speaking, the model detects prediction error in the internal valuation at the lower level and triggers the external valuation at the upper level to update the preexisting values at the lower level. Both external and internal input can trigger internalized values encoded by the vmPFC, which then activate interoceptive prediction signals that trigger a familiar, intuitive, and habit-like response to prevent anticipated bodily imbalance. Such a process is called internal valuation. However, when two or more mutually incompatible values are simultaneously activated at the level of the vmPFC, a conflict (i.e., prediction error) occurs, which then disengages the internal valuation and engages the upper levels (i.e., either rmPFC or dmPFC). The upper levels would then engage in resolving the conflict at the lower level by increasing sensitivity to incoming sensory signals from the external environment, taking over the decision control temporarily by searching for a new and more sophisticated stimulus-response mapping. Such a process, called external valuation, sends prediction signals to update the pre-existing mapping at the lower level, and continues until it finds a new mapping that resolves the conflict. The new mapping will be strengthened and internalized through repetition so that it is activated quicker and more comfortably in similar future situations without causing a conflict (Figure 3).
Figure 3. The hierarchical allostatic regulation model of mPFC function for social valuation. The mPFC comprises of three functionally dissociable hierarchically organized subregions: the vmPFC, rmPFC, and dmPFC, which are differentially involved in computing values of decision along the ventral-to-dorsal spatial gradient of increasing external sensory inputs (e.g., via the temporal cortex and the parietal cortex) and decreasing internal inputs (e.g., via the brainstem, the hypothalamus, the amygdala, and the nucleus accumbens). The vmPFC computes the internal valuation that generates interoceptive prediction signals and elicits a familiar intuitive response to prevent foreseen bodily imbalance. When two or more mutually incompatible values are simultaneously activated at the level of vmPFC, a conflict (prediction error) may occur triggering the upper levels (i.e., either rmPFC or dmPFC), which would then disengage internal valuation and increase the sensitivity to incoming sensory signals from the external environment to resolve the conflict. Such a process, called external valuation, sends prediction signals to update the preexisting value encoded at the lower level and continues until it finds a new value that resolves the conflict. The newly updated value will be strengthened and internalized through repetition so that it is activated more quickly and easily in similar situations later without causing a conflict.
This model naturally predicts that easy decisions should activate the vmPFC due to a weak conflict between options, whereas difficult decisions should elicit the dmPFC due to a strong conflict between options with similar value. Supporting this prediction, larger and smaller differences in value between two alternative options in a choice task were associated with greater activity in the vmPFC and the dmPFC, respectively (Hackel et al., 2017; Piva et al., 2019). According to the model, in the case of larger value difference, the vmPFC alone can handle the value computation for decision, whereas, in the case of smaller value difference, the dmPFC needs to be engaged to integrate additional information from the environment to resolve the conflicts in the vmPFC.
To illustrate better how the model works, especially in the social domain, prosocial behavior can be a good example. If the value for a prosocial decision does not conflict with the value for a self-interested decision, then the prosocial behavior can be triggered rapidly via the intuitive internal valuation by the vmPFC. However, in cases where the two values conflict with each other in the vmPFC, additional information must be considered to resolve the conflict and to choose a more appropriate value in each context or to create a new value as a more appropriate alternative. By incorporating increasingly complex external information, the process of creating more efficient and sophisticated behavioral rules can produce various abstract social values, which can later be internalized through repetition. For example, an infant may learn to attract the attention of his/her caregiver to keep the caregiver closer. Such behaviors are often reinforced by the successful avoidance of hunger and insecurity. These primary forms of social reward can later serve as powerful internalized motivation for making friends and pursuing social status as a child grows up. Possibly, various secondary reinforcers, such as money and social reward, are learned because they serve the common goal of preventing anticipated homeostatic imbalance (e.g., hunger or pain), and these newly acquired values can be internalized in the vmPFC to enable rapid comparisons between various types of reward, serving as the common neural currency (Izuma et al., 2008; Chib et al., 2009; Kim et al., 2011; Levy and Glimcher, 2012; Lin et al., 2012).
Role of the Thalamic Reticular Nucleus in Switching Between Thalamo-Cortical Loops
As mentioned above, a successful adaptation in a continually changing environment would require a careful assessment of the efficiency of the currently engaged decision system as well as a flexible transition between intuitive (internal) and deliberative (external) decision systems. What makes our brain achieve such an elegantly complex adaptive function? One potential neural candidate that is crucial for such functions may be the thalamic reticular nucleus (TRN). The TRN consists of a layer of inhibitory neurons surrounding the thalamic nuclei, and can be divided into several sectors connected to different thalamic nuclei and their associated cortical regions, and is believed to serve as a nexus that moderates the interaction between separate sectors of thalamo-cortical loops and controls the transition between distinctive attentional modes (Crick, 1984; Guillery et al., 1998; Pinault, 2004). The TRN neurons exert an inhibitory control not only on the thalamo-cortical neurons but also on local inhibitory interneurons, which may lead to the disinhibition of the thalamo-cortical projection neurons (Steriade et al., 1985). The connection between the TRN neurons and the local inhibitory cells in the thalamus is believed to be subservient to the processes for focusing attention to relevant signals by suppressing other competing sub-networks processing non-relevant signals (Steriade, 1999), making the TRN neurons capable of detecting changes in the environment and modulating excitability of their target thalamic relay neurons (Yu et al., 2009).
The TRN neurons can be segregated into at least two functionally and anatomically distinctive groups: the anterior (or limbic) TRN sector and the posterior (or sensory) TRN sector, which have distinct connectivity patterns (Zikopoulos and Barbas, 2012) and are shown to control different behavioral states (Halassa et al., 2014). The former has dense connections with the limbic regions, including the vmPFC and the amygdala, whereas the latter is connected more strongly with the sensory cortices and corresponding thalamic nuclei (Zikopoulos and Barbas, 2006, 2007, 2012), possibly being involved in focusing attention to internal signals and external stimuli, respectively (Zikopoulos and Barbas, 2012; Halassa et al., 2014).
How could the TRN contribute to the transitions between internal and external processing? First, the TRN may be capable of hijacking on-going behaviors and mediates a rapid transition from the external (dorsal) to the internal (ventral) thalamocortical sector. More specifically, the internal sector can be engaged by default to address internal signals carrying information on anticipated homeostatic imbalance, and any sudden transition from an external sector to an internal sector appears to be driven by inputs from other internal sectors that are located even closer to the root of the hierarchical structure. Supporting this idea, the anterior sector of the TRN can be quickly engaged by the inputs from the amygdala and the vmPFC (Zikopoulos and Barbas, 2012). Such input signals can allow the TRN to interrupt and control on-going exploratory behaviors or external sensory processing and to initiate a rapid switch to the internal thalamocortical sector, which can then trigger stereotypical instinctive or reflexive behavioral responses that had been engaged repeatedly to deal with previous similar situations.
Second, the TRN is also capable of switching between thalamocortical sectors in the opposite direction, that is, from internal to external sectors. Such shifts can be achieved by the densely distributed inhibitory neurons in the TRN, which are responsible for lateral inhibition between different thalamocortical loops via direct mutual inhibition or inhibitory projection to the thalamic projection cells (John et al., 2016; Crabtree, 2018). Therefore, these neurons are ideally suited for detecting conflicts between simultaneously activated competing units in the internal sector of the TRN, which can lead to disinhibition of other non-occupied units in the external sector of the TRN network. To better illustrate the complex dynamics of the TRN network, a simplified diagram of the TRN networks is shown in Figure 4.
Figure 4. Role of the thalamic reticular nucleus (TRN) in shifting between the thalamo-cortical loops. Mutually inhibiting interneurons densely distributed in the TRN are perfectly suited for detecting conflicts between non-compatible units being engaged simultaneously, which can lead to disinhibition of other non-occupied units in the external sector, resulting in an attentional shift between different thalamo-cortical loops. In this diagram, simultaneous activation of two mutually competitive units (i.e., A and B) in the internal sector would lead to a sector-wide disinhibition of the thalamic projection neurons (i.e., C′ and D′) in the external sector, which would then gate the external sector, initiating more elaborated processing of additional external sensory information. Such inhibitory connections are likely to be asymmetrical, that is, favoring the direction from internal to external sectors and therefore prioritizing internal over external valuation. Note that not all the necessary connections are shown for visualization purpose. CTX, cortex; TRN, thalamic reticular nucleus; Thal: thalamus; BF: basal forebrain.
For example, simultaneous activation of two mutually competitive units (i.e., A and B) in the internal sector could lead to a sector-wide disinhibition of the thalamic projection neurons (i.e., C′ and D′) in the external sector. Such a disinhibition would then gate the external sector, initiating more elaborated processing of additional external sensory information. Considering that intra-TRN connections are mainly formed by gap junctions (Hou et al., 2016), the inter-sector inhibition could be best achieved by multiple divergent inhibitory projections from the TRN cells to the thalamic projection cells (Crabtree, 2018). Supporting this idea, such an “open-loop” TRN network, wherein a thalamic projection neuron is inhibited by the TRN neuron excited not by itself but by another thalamic projection neuron, has been identified in anatomical studies (Pinault and Deschenes, 1998; Kimura et al., 2007), and demonstrated to play a major role in signal propagation across distinct thalamocortical loops in a recent computation modeling study (Brown et al., 2020). It is noteworthy that such inter-sector inhibitory connections are assumed to be largely asymmetrical, that is, favoring the direction from internal to external sectors and therefore prioritizing internal over external valuation, consistent with the proposal that information propagates preferentially from a ventromedial to a dorsolateral direction across the thalamo-cortico-striatal loops (Yin and Knowlton, 2006). Although this is a speculative hypothesis that needs more concrete additional evidence, such an anatomical structure of the TRN network may be suitable for the mechanism of switching from the ventral (or internal) to the dorsal (external) thalamocortical sector that is functionally equivalent to the transition from an intuitive to a deliberative decision mode.
Factors Affecting the Optimal Balance Between Stability and Plasticity
In the model mentioned above, the external valuation process in the upper level continues until the conflict is resolved at the lower level. Thus, it is reasonable to question how much conflict in the lower level is large enough to trigger the external valuation process, and to what degree the conflict needs to be resolved before disengaging the external valuation process. Answers to these questions are essential to understand how our brains deal with the challenging problem of the stability-plasticity dilemma. That is, any adaptive agent is expected to effectively address the stability-plasticity dilemma (Grossberg, 2013) to avoid either catastrophic forgetting (i.e., extreme plasticity) (Ratcliff, 1990) or the entrenchment effect (i.e., extreme stability) (Zevin and Seidenberg, 2004). For the optimal balance between stability and plasticity, therefore, an agent needs to carefully determine the optimal level of tolerance for mismatches between incoming sensory inputs and previously learned categorical representation. However, an agent often fails to maintain the balance due to the lack of information about the ultimate goal of an organism, which has to do with how precisely a prediction or model generated at the moment matches forthcoming internal and external states (Friston, 2010).
Pursuing the optimal balance between stability and plasticity can be related to the concept of allostasis, which allows an organism to produce system-wide behavioral and physiological adjustments to environmental challenges through prediction in advance of a need (Sterling and Eyer, 1988; McEwen and Stellar, 1993; Schulkin, 2003). Several recent theories suggest that the mPFC along with the insula form a neurocircuitry thought to convey allostatic predictions that modulate the set points of homeostatic reflexes (Critchley and Harrison, 2013; Sterling, 2014; Barrett and Simmons, 2015; Stephan et al., 2016; Kleckner et al., 2017), possibly via rapid direct or indirect communications with the brainstem (Allman et al., 2010; Fischer et al., 2016). Perhaps, the role of the mPFC in allostasis can be best understood by examining this region as one of the key cortical substrates for heart-rate variability (HRV) (Thayer et al., 2012). HRV is known to reflect the heart’s ability to detect and respond adaptively to unpredictable environmental changes and is regarded as a possible indicator of allostatic capacity to integrate behavioral strategies and energy stores in response to environmental demands (Grossman and Taylor, 2007).
Consistent with the hierarchical allostatic regulation model of mPFC function proposed in the present study, different mPFC subregions may be involved in distinctive aspects of HRV-related functions. For example, the vmPFC activity is known to covary with HRV, and the rmPFC is suggested to play a regulatory role over the autonomic response initiated by the vmPFC (Ziegler et al., 2009). This idea is further supported by a recent meta-analysis showing that the vmPFC and the rmPFC are involved in sympathetic and parasympathetic processes, respectively (Beissner et al., 2013). In line with this, a recent finding showed that pharmacological inactivation of the vmPFC and the rmPFC led to decreased and increased autonomic and behavioral responses, respectively, to negative emotional stimuli in non-human primates (Wallis et al., 2017). These findings suggest that, while the vmPFC quickly elicits familiar, internalized responses to cope with anticipated physical consequences of external stimuli, the rmPFC appears to seek a more holistic solution for harmonization between the fast-autonomic response and the constraints of the external environment.
Perhaps, another key contributor to the optimal balance between stability and plasticity may be the neuromodulatory afferent signals targeting the allostatic neurocircuitry mentioned earlier as well as the TRN network. For example, there is evidence that the insula, the mPFC, and the TRN are the major targets of the cholinergic signals from the basal forebrain (Haber and Calzavara, 2009). In general, these neuromodulatory signals can potentiate presynaptic glutamatergic and GABAergic neurotransmission (Freund et al., 1988; Alkondon et al., 1997; Radcliffe et al., 1999). These signals can facilitate the competition between simultaneously activated mutually incompatible units, leading to an enhanced signal-to-noise ratio in the target area (Everitt and Robbins, 1997; Sarter and Bruno, 1997). Therefore, such cholinergic neuromodulatory inputs to the TRN inhibitory network could increase the sensitivity to the conflict in the internal sector as well as the likelihood of disinhibiting otherwise suppressed units in the external sector, which could then lead to enhanced precision in the environmental sensory information (Feldman and Friston, 2010). Through this process, cholinergic signals can lower the degree of tolerance for a mismatch between actual and predicted bodily states, which can then lead to frequent and prolonged engagement of the external valuation process that will continue to search for a new categorical representation to resolve the mismatch. In this sense, the role of cholinergic signals in modulating competition in the TRN is analogous to the concept of vigilance parameter that determines the allowable degree of mismatch between any input pattern and any stored patterns, resulting in either crude (i.e., low vigilance) or fine (i.e., high vigilance) categorization of incoming stimuli (Grossberg, 2013).
In addition to cholinergic signals, some other neuromodulatory signals, such as dopamine and noradrenaline, have been shown to serve similar functions; that is, signaling the degree of sensitivity to the discrepancy between prediction (or belief) and actual sensory information (Friston et al., 2014). For example, the dopamine neurons in the midbrain signal the discrepancy between predicted and actual reward (Schultz, 1998), and the noradrenergic neurons in the locus coeruleus can interrupt the activity of on-going functional networks and facilitate their reorganization to promote rapid behavioral adaptation (Bouret and Sara, 2005). These different neuromodulatory signals may serve a common goal of adjusting the balance between stability and plasticity, by reporting an integrative sum of internal milieu or interoceptive prediction errors to the brain (Fadel and Burk, 2010). To this end, a higher sensitivity to interoceptive prediction errors can lead to a higher vigilance, resulting in finer mappings between internal needs and external environment, which may indicate a more adaptive capacity for allostatic regulation. As an example in the domain of social neuroscience, people with a polymorphism in the dopamine D4 receptor gene (DRD4), which is associated with a higher sensitivity to environmental reward, are more likely to display behaviors that are more culturally dominant and socially desirable, compared to those with other types of DRD4 polymorphisms (Kitayama et al., 2014). In summary, different types of neuromodulatory signals may share a common goal of allowing the brain to continuously check and modulate the precision of interoceptive prediction and to build an accurate and sophisticated internal model of visceral states (Friston et al., 2014), which can be advantageous for pursing adaptive behavior in a constantly changing social environment.
Self-Control, Self-Efficacy, and Metacognition as Types of Allostatic Regulation
Recent theories suggest that interoceptive prediction errors reporting homeostatic or allostatic imbalance are essential for valuation of decisions (Gu and FitzGerald, 2014) as well as cognitive and goal-directed control over habitual actions (Pezzulo et al., 2015). These theories can be further refined by considering the allostatic function of the rmPFC in solving the stability-plasticity dilemma. For example, people with high baseline HRV showed greater self-control during a food choice task and higher rmPFC activity when the participants had to overcome their taste preferences to choose the healthier option (Maier and Hare, 2017). Similarly, the rmPFC has also been shown to be involved in meta-decision, that is, choosing between distinctive decision systems. For example, the rmPFC is known to play a vital role in arbitrating the transition from the intuitive (model-free) to the analytical (model-based) decision systems, by tracking prediction error signals arising from the performance of the model-free system (Lee et al., 2014). Based on the model introduced above, such arbitration can be best explained by the function of the rmPFC in detecting and resolving conflict in internal valuation by referring to additional external information. When engaged, the rmPFC may quickly resolve the conflict in the vmPFC, or it may trigger an even higher level of external valuation computed by the dmPFC. The rmPFC may be particularly suitable for such a function of arbitration between internal and external valuation, because of its privileged anatomical feature of integrating balanced inputs from both internal and external sources of incoming information.
The rmPFC has also been implicated in metacognition. For example, the rmPFC has been shown to track changes in the subjective sense of decision confidence (Bang and Fleming, 2018), and lesions to the anterior sectors of the prefrontal cortex, including rmPFC, led to an impairment of perceptual metacognitive accuracy (Fleming et al., 2014). Similarly, the rmPFC function in context-sensitive reputation management (Jung et al., 2018) may reflect metacognitive monitoring of the appropriateness of intuitive and internalized valuation for self-enhancement under the constraints of social contexts, seeking the optimal decision via referring to interoceptive prediction error signals and engaging external valuation whenever necessary. From this point of view, the role of the rmPFC in seeking the balance between internal and external valuation, which may be critical for successful allostatic regulation, may also be the core neural foundation shared among various forms of adaptive functions such as self-efficacy, self-regulation, and metacognition (Zimmerman and Moylan, 2009).
Conclusion
The present study proposes that the mPFC subregions are hierarchically organized and differentially involved in computing values of decision, forming the ventral-to-dorsal spatial gradient of increasing external sensory inputs and decreasing internal inputs and exerting the hierarchical allostatic regulatory control over homeostatic reflexes. This hierarchical allostatic regulation model of mPFC function also emphasizes the role of the TRN in arbitrating the transitions between functionally dissociable thalamo-cortical loops. Because of its unique anatomical architecture with a robust inhibitory network, the TRN is capable of rapid and powerful orchestration over multiple thalamo-cortical loops and is critical for detecting and resolving conflicts between available options for decision-making and in shifting flexibly between decision modes. Importantly, neuromodulatory afferents to the TRN, signaling overall misfit of the interoceptive prediction model, can modulate the degree of sensitivity to the mismatch between predicted and observed bodily states. Such modulatory signals are critical for the mPFC function in allostatic regulation, which seeks an optimal balance between stability and plasticity, which can serve to maximize the probability of survival. In conclusion, the present model of the mPFC function can provide a useful theoretical framework, whereby previous findings once scattered around the mPFC area can be incorporated to generate and test novel hypotheses. Furthermore, future studies focusing on the hierarchical nature of the mPFC function can further expand our knowledge in various clinical symptoms, such as addiction, anxiety, and depression, which may be caused by a failure of the key neural mechanism for dealing with the stability-plasticity dilemma.
Author Contributions
The author confirms being the sole contributor of this work and has approved it for publication.
Funding
The present study was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (grant number: NRF-2018S1A3A2075114) and by the Air Force Office of Scientific Research, Asian Office of Aerospace Research and Development (AOARD) (grant number: FA2386-15-1-4065).
Conflict of Interest
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Acknowledgments
The author is grateful to the members of the laboratory of Social and Decision Neuroscience as well as the reviewers for many helpful comments and feedbacks on earlier version of the manuscript.
Abbreviations
dmPFC, dorsomedial prefrontal cortex; HRV, heart-rate variability; mPFC, medial prefrontal cortex; rmPFC, rostromedial prefrontal cortex; TRN, thalamic reticular nucleus; vmPFC, ventromedial prefrontal cortex.
References
Alkondon, M., Pereira, E. F., Barbosa, C. T., and Albuquerque, E. X. (1997). Neuronal nicotinic acetylcholine receptor activation modulates gamma-aminobutyric acid release from CA1 neurons of rat hippocampal slices. J. Pharmacol. Exp. Ther. 283, 1396–1411.
Allman, J. M., Tetreault, N. A., Hakeem, A. Y., Manaye, K. F., Semendeferi, K., Erwin, J. M., et al. (2010). The von economo neurons in frontoinsular and anterior cingulate cortex in great apes and humans. Brain Struct. Funct. 214, 495–517. doi: 10.1007/s00429-010-0254-0
Amiez, C., Sallet, J., Hopkins, W. D., Meguerditchian, A., Hadj-Bouziane, F., Hamed, S. B., et al. (2019). Sulcal organization in the medial frontal cortex reveals insights into primate brain evolution. Nat. Commun. 10:3437.
Amodio, D. M., and Frith, C. D. (2006). Meeting of minds: the medial frontal cortex and social cognition. Nat. Rev. Neurosci. 7, 268–277. doi: 10.1038/nrn1884
Andrews-Hanna, J. R., Reidler, J. S., Sepulcre, J., Poulin, R., and Buckner, R. L. (2010). Functional-anatomic fractionation of the brain’s default network. Neuron 65, 550–562. doi: 10.1016/j.neuron.2010.02.005
Apps, M. A., and Ramnani, N. (2014). The anterior cingulate gyrus signals the net value of others’ rewards. J. Neurosci. 34, 6190–6200. doi: 10.1523/JNEUROSCI.2701-13.2014
Bang, D., and Fleming, S. M. (2018). Distinct encoding of decision confidence in human medial prefrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 115, 6082–6087. doi: 10.1073/pnas.1800795115
Barbas, H. (2015). General cortical and special prefrontal connections: principles from structure to function. Annu. Rev. Neurosci. 38, 269–289. doi: 10.1146/annurev-neuro-071714-033936
Barrett, L. F., and Simmons, W. K. (2015). Interoceptive predictions in the brain. Nat. Rev. Neurosci. 16, 419–429. doi: 10.1038/nrn3950
Bartra, O., McGuire, J. T., and Kable, J. W. (2013). The valuation system: a coordinate-based meta-analysis of BOLD fMRI experiments examining neural correlates of subjective value. Neuroimage 76, 412–427. doi: 10.1016/j.neuroimage.2013.02.063
Bas-Hoogendam, J. M., van Steenbergen, H., Kreuk, T., van der Wee, N. J. A., and Westenberg, P. M. (2017). How embarrassing! The behavioral and neural correlates of processing social norm violations. PLoS ONE 12:e0176326. doi: 10.1371/journal.pone.0176326
Basile, B., Mancini, F., Macaluso, E., Caltagirone, C., Frackowiak, R. S. J., and Bozzali, M. (2011). Deontological and altruistic guilt: evidence for distinct neurobiological substrates. Hum. Brain Mapp. 32, 229–239. doi: 10.1002/hbm.21009
Basten, U., Biele, G., Heekeren, H. R., and Fiebach, C. J. (2010). How the brain integrates costs and benefits during decision making. Proc. Natl. Acad. Sci. U.S.A. 107, 21767–21772. doi: 10.1073/pnas.0908104107
Bechara, A., Tranel, D., Damasio, H., and Damasio, A. R. (1996). Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. Cereb. Cortex 6, 215–225. doi: 10.1093/cercor/6.2.215
Beer, J. S., John, O. P., Scabini, D., and Knight, R. T. (2006). Orbitofrontal cortex and social behavior: integrating self-monitoring and emotion-cognition interactions. J. Cognit. Neurosci. 18, 871–879. doi: 10.1162/jocn.2006.18.6.871
Behrens, T. E., Hunt, L. T., and Rushworth, M. F. (2009). The computation of social behavior. Science 324, 1160–1164. doi: 10.1126/science.1169694
Beissner, F., Meissner, K., Bar, K. J., and Napadow, V. (2013). The autonomic brain: an activation likelihood estimation meta-analysis for central processing of autonomic function. J. Neurosci. 33, 10503–10511. doi: 10.1523/JNEUROSCI.1103-13.2013
Bereczkei, T., Birkas, B., and Kerekes, Z. (2010). Altruism towards strangers in need: costly signaling in an industrial society. Evol. Hum. Behav. 31, 95–103. doi: 10.1016/j.evolhumbehav.2009.07.004
Bouret, S., and Richmond, B. J. (2010). Ventromedial and orbital prefrontal neurons differentially encode internally and externally driven motivational values in monkeys. J. Neurosci. 30, 8591–8601. doi: 10.1523/JNEUROSCI.0049-10.2010
Bouret, S., and Sara, S. J. (2005). Network reset: a simplified overarching theory of locus coeruleus noradrenaline function. Trends Neurosci. 28, 574–582. doi: 10.1016/j.tins.2005.09.002
Brown, J. W., Taheri, A., Kenyon, R. V., Berger-Wolf, T., and Llano, D. A. (2020). Signal propagation via open-loop intrathalamic architectures: a computational model. eNeuro 7:ENEURO.441–ENEURO.419. doi: 10.1523/ENEURO.0441-19.2020
Buckholtz, J. W., and Marois, R. (2012). The roots of modern justice: cognitive and neural foundations of social norms and their enforcement. Nat. Neurosci. 15, 655–661. doi: 10.1038/nn.3087
Burnett, S., Bird, G., Moll, J., Frith, C. D., and Blakemore, S. (2009). Development during adolescence of the neural processing of social emotion. J. Cognit. Neurosci. 21, 1736–1750. doi: 10.1162/jocn.2009.21121
Bzdok, D., Langner, R., Schilbach, L., Engemann, D. A., Laird, A. R., Fox, P. T., et al. (2013). Segregation of the human medial prefrontal cortex in social cognition. Front. Hum. Neurosci. 7:232. doi: 10.3389/fnhum.2013.00232
Cabeza, R., Dolcos, F., Graham, R., and Nyberg, L. (2002). Similarities and differences in the neural correlates of episodic memory retrieval and working memory. Neuroimage 16, 317–330. doi: 10.1006/nimg.2002.1063
Carmichael, S. T., and Price, J. L. (1995). Limbic connections of the orbital and medial prefrontal cortex in macaque monkeys. J. Compar. Neurol. 363, 615–641. doi: 10.1002/cne.903630408
Chang, S. W., Gariepy, J. F., and Platt, M. L. (2013). Neuronal reference frames for social decisions in primate frontal cortex. Nat. Neurosci. 16, 243–250. doi: 10.1038/nn.3287
Chapados, C., and Petrides, M. (2015). Ventrolateral and dorsomedial frontal cortex lesions impair mnemonic context retrieval. Proc. Biol. Sci. 282:20142555. doi: 10.1098/rspb.2014.2555
Chib, V. S., Rangel, A., Shimojo, S., and O’Doherty, J. P. (2009). Evidence for a common representation of decision values for dissimilar goods in human ventromedial prefrontal cortex. J. Neurosci. 29, 12315–12320. doi: 10.1523/JNEUROSCI.2575-09.2009
Coutureau, E., and Killcross, S. (2003). Inactivation of the infralimbic prefrontal cortex reinstates goal-directed responding in overtrained rats. Behav. Brain Res. 146, 167–174. doi: 10.1016/j.bbr.2003.09.025
Crabtree, J. W. (2018). Functional diversity of thalamic reticular subnetworks. Front. Syst. Neurosci. 12:41. doi: 10.3389/fnsys.2018.00041
Crick, F. (1984). Function of the thalamic reticular complex: the searchlight hypothesis. Proc. Natl. Acad. Sci. U.S.A. 81, 4586–4590. doi: 10.1073/pnas.81.14.4586
Critchley, H. D., and Harrison, N. A. (2013). Visceral influences on brain and behavior. Neuron 77, 624–638. doi: 10.1016/j.neuron.2013.02.008
Crockett, M. J. (2013). Models of morality. Trends Cogn. Sci. 17, 363–366. doi: 10.1016/j.tics.2013.06.005
Cutler, J., and Campbell-Meiklejohn, D. (2019). A comparative fMRI meta-analysis of altruistic and strategic decisions to give. Neuroimage 184, 227–241. doi: 10.1016/j.neuroimage.2018.09.009
D’Argembeau, A. (2013). On the role of the ventromedial prefrontal cortex in self-processing: the valuation hypothesis. Front. Hum. Neurosci. 7:372. doi: 10.3389/fnhum.2013.00372
de Araujo, I. E., Ferreira, J. G., Tellez, L. A., Ren, X., and Yeckel, C. W. (2012). The gut-brain dopamine axis: a regulatory system for caloric intake. Physiol. Behav. 106, 394–399. doi: 10.1016/j.physbeh.2012.02.026
de la Vega, A., Chang, L. J., Banich, M. T., Wager, T. D., and Yarkoni, T. (2016). Large-scale meta-analysis of human medial frontal cortex reveals tripartite functional organization. J. Neurosci. 36, 6553–6562. doi: 10.1523/JNEUROSCI.4402-15.2016
De Martino, B., Camerer, C. F., and Adolphs, R. (2010). Amygdala damage eliminates monetary loss aversion. Proc. Natl. Acad. Sci. U.S.A. 107, 3788–3792. doi: 10.1073/pnas.0910230107
de Wit, S., Corlett, P. R., Aitken, M. R., Dickinson, A., and Fletcher, P. C. (2009). Differential engagement of the ventromedial prefrontal cortex by goal-directed and habitual behavior toward food pictures in humans. J. Neurosci. 29, 11330–11338. doi: 10.1523/JNEUROSCI.1639-09.2009
Delgado, M. R., Beer, J. S., Fellows, L. K., Huettel, S. A., Platt, M. L., Quirk, G. J., et al. (2016). Viewpoints: dialogues on the functional role of the ventromedial prefrontal cortex. Nat. Neurosci. 19, 1545–1552. doi: 10.1038/nn.4438
Demos, K. E., Heatherton, T. F., and Kelley, W. M. (2012). Individual differences in nucleus accumbens activity to food and sexual images predict weight gain and sexual behavior. J. Neurosci. 32, 5549–5552. doi: 10.1523/Jneurosci.5958-11.2012
Denny, B. T., Kober, H., Wager, T. D., and Ochsner, K. N. (2012). A meta-analysis of functional neuroimaging studies of self- and other judgments reveals a spatial gradient for mentalizing in medial prefrontal cortex. J. Cogn. Neurosci. 24, 1742–1752. doi: 10.1162/jocn_a_00233
Dixon, M. L., Thiruchselvam, R., Todd, R., and Christoff, K. (2017). Emotion and the prefrontal cortex: an integrative review. Psychol. Bull. 143, 1033–1081. doi: 10.1037/bul0000096
Ebitz, R. B., and Hayden, B. Y. (2016). Dorsal anterior cingulate: a Rorschach test for cognitive neuroscience. Nat. Neurosci. 19, 1278–1279. doi: 10.1038/nn.4387
Eisenberger, N. I., Lieberman, M. D., and Williams, K. D. (2003). Does rejection hurt? An FMRI study of social exclusion. Science 302, 290–292. doi: 10.1126/science.1089134
Everitt, B. J., and Robbins, T. W. (1997). Central cholinergic systems and cognition. Annu. Rev. Psychol. 48, 649–684. doi: 10.1146/annurev.psych.48.1.649
Fadel, J., and Burk, J. A. (2010). Orexin/hypocretin modulation of the basal forebrain cholinergic system: role in attention. Brain Res. 1314, 112–123. doi: 10.1016/j.brainres.2009.08.046
Fehr, E., and Fischbacher, U. (2003). The nature of human altruism. Nature 425, 785–791. doi: 10.1038/nature02043
Feldman, H., and Friston, K. J. (2010). Attention, uncertainty, and free-energy. Front. Hum. Neurosci. 4:215. doi: 10.3389/fnhum.2010.00215
Fischer, D. B., Boes, A. D., Demertzi, A., Evrard, H. C., Laureys, S., Edlow, B. L., et al. (2016). A human brain network derived from coma-causing brainstem lesions. Neurology 87, 2427–2434. doi: 10.1212/WNL.0000000000003404
Fleming, S. M., Ryu, J., Golfinos, J. G., and Blackmon, K. E. (2014). Domain-specific impairment in metacognitive accuracy following anterior prefrontal lesions. Brain 137(Pt 10), 2811–2822. doi: 10.1093/brain/awu221
Fourie, M. M., Thomas, K. G. F., Amodio, D. M., Warton, C. M. R., and Meintjes, E. M. (2014). Neural correlates of experienced moral emotion: an fMRI investigation of emotion in response to prejudice feedback. Soc. Neurosci. 9, 203–218. doi: 10.1080/17470919.2013.878750
Freund, R. K., Jungschaffer, D. A., Collins, A. C., and Wehner, J. M. (1988). Evidence for modulation of GABAergic neurotransmission by nicotine. Brain Res. 453, 215–220. doi: 10.1016/0006-8993(88)90160-6
Friston, K. J. (2010). The free-energy principle: a unified brain theory? Nat. Rev. Neurosci. 11, 127–138. doi: 10.1038/nrn2787
Friston, K. J., Schwartenbeck, P., FitzGerald, T., Moutoussis, M., Behrens, T., and Dolan, R. J. (2014). The anatomy of choice: dopamine and decision-making. Philos. Trans. R. Soc. Lond. B Biol. Sci. 369:20130481. doi: 10.1098/rstb.2013.0481
Frith, C. D., and Frith, U. (2006). The neural basis of mentalizing. Neuron 50, 531–534. doi: 10.1016/j.neuron.2006.05.001
Fukuda, H., Ma, N., Suzuki, S., Harasawa, N., Ueno, K., Gardner, J. L., et al. (2019). Computing social value conversion in the human brain. J. Neurosci. 39, 5153–5172. doi: 10.1523/JNEUROSCI.3117-18.2019
Ghashghaei, H. T., Hilgetag, C. C., and Barbas, H. (2007). Sequence of information processing for emotions based on the anatomic dialogue between prefrontal cortex and amygdala. Neuroimage 34, 905–923. doi: 10.1016/j.neuroimage.2006.09.046
Gilead, M., Katzir, M., Eyal, T., and Liberman, N. (2016). Neural correlates of processing “self-conscious” vs.“basic” emotions. Neuropsychologia 81, 207–218. doi: 10.1016/j.neuropsychologia.2015.12.009
Griskevicius, V., Tybur, J. M., and Van den Bergh, B. (2010). Going green to be seen: status, reputation, and conspicuous conservation. J. Pers. Soc. Psychol. 98, 392–404. doi: 10.1037/a0017346
Grossberg, S. (2013). Adaptive resonance theory: how a brain learns to consciously attend, learn, and recognize a changing world. Neural Netw. 37, 1–47. doi: 10.1016/j.neunet.2012.09.017
Grossman, P., and Taylor, E. W. (2007). Toward understanding respiratory sinus arrhythmia: relations to cardiac vagal tone, evolution and biobehavioral functions. Biol. Psychol. 74, 263–285. doi: 10.1016/j.biopsycho.2005.11.014
Gu, X., and FitzGerald, T. H. (2014). Interoceptive inference: homeostasis and decision-making. Trends Cogn. Sci. 18, 269–270. doi: 10.1016/j.tics.2014.02.001
Guillery, R. W., Feig, S. L., and Lozsadi, D. A. (1998). Paying attention to the thalamic reticular nucleus. Trends Neurosci. 21, 28–32. doi: 10.1016/s0166-2236(97)01157-0
Haber, S. N., and Calzavara, R. (2009). The cortico-basal ganglia integrative network: the role of the thalamus. Brain Res. Bull. 78, 69–74. doi: 10.1016/j.brainresbull.2008.09.013
Haber, S. N., Kim, K. S., Mailly, P., and Calzavara, R. (2006). Reward-related cortical inputs define a large striatal region in primates that interface with associative cortical connections, providing a substrate for incentive-based learning. J. Neurosci. 26, 8368–8376. doi: 10.1523/JNEUROSCI.0271-06.2006
Haber, S. N., and Knutson, B. (2010). The reward circuit: linking primate anatomy and human imaging. Neuropsychopharmacology 35, 4–26. doi: 10.1038/npp.2009.129
Hackel, L. M., Zaki, J., and Van Bavel, J. J. (2017). Social identity shapes social valuation: evidence from prosocial behavior and vicarious reward. Soc. Cogn. Affect. Neurosci. 12, 1219–1228. doi: 10.1093/scan/nsx045
Haidt, J. (2007). The new synthesis in moral psychology. Science 316, 998–1002. doi: 10.1126/science.1137651
Halassa, M. M., Chen, Z., Wimmer, R. D., Brunetti, P. M., Zhao, S., Zikopoulos, B., et al. (2014). State-dependent architecture of thalamic reticular subnetworks. Cell 158, 808–821. doi: 10.1016/j.cell.2014.06.025
Hampton, A. N., Bossaerts, P., and O’Doherty, J. P. (2008). Neural correlates of mentalizing-related computations during strategic interactions in humans. Proc. Natl. Acad. Sci. U.S.A. 105, 6741–6746. doi: 10.1073/pnas.0711099105
Han, W., Tellez, L. A., Perkins, M. H., Perez, I. O., Qu, T., Ferreira, J., et al. (2018). A neural circuit for gut-induced reward. Cell 175, 887–888. doi: 10.1016/j.cell.2018.10.018
Hardy, C. L., and Van Vugt, M. (2006). Nice guys finish first: the competitive altruism hypothesis. Pers. Soc. Psychol. Bull. 32, 1402–1413. doi: 10.1177/0146167206291006
Hare, T. A., Camerer, C. F., Knoepfle, D. T., and Rangel, A. (2010). Value computations in ventral medial prefrontal cortex during charitable decision making incorporate input from regions involved in social cognition. J. Neurosci. 30, 583–590. doi: 10.1523/JNEUROSCI.4089-09.2010
Haruno, M., and Kawato, M. (2006). Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning. Neural Netw. 19, 1242–1254. doi: 10.1016/j.neunet.2006.06.007
Horst, N. K., and Laubach, M. (2009). The role of rat dorsomedial prefrontal cortex in spatial working memory. Neuroscience 164, 444–456. doi: 10.1016/j.neuroscience.2009.08.004
Hou, G., Smith, A. G., and Zhang, Z. W. (2016). Lack of intrinsic GABAergic connections in the thalamic reticular nucleus of the mouse. J. Neurosci. 36, 7246–7252. doi: 10.1523/JNEUROSCI.0607-16.2016
Howard, J. D., Gottfried, J. A., Tobler, P. N., and Kahnt, T. (2015). Identity-specific coding of future rewards in the human orbitofrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 112, 5195–5200. doi: 10.1073/pnas.1503550112
Hughes, B. L., and Beer, J. S. (2012). Medial orbitofrontal cortex is associated with shifting decision thresholds in self-serving cognition. Neuroimage 61, 889–898. doi: 10.1016/j.neuroimage.2012.03.011
Hughes, B. L., and Beer, J. S. (2013). Protecting the self: the effect of social-evaluative threat on neural representations of self. J. Cognit. Neurosci. 25, 613–622. doi: 10.1162/jocn_a_00343
Hutcherson, C. A., Bushong, B., and Rangel, A. (2015). A Neurocomputational model of altruistic choice and its implications. Neuron 87, 451–462. doi: 10.1016/j.neuron.2015.06.031
Ikemoto, S., and Panksepp, J. (1999). The role of nucleus accumbens dopamine in motivated behavior: a unifying interpretation with special reference to reward-seeking. Brain Res. Rev. 31, 6–41. doi: 10.1016/S0165-0173(99)00023-5
Izuma, K. (2012). The social neuroscience of reputation. Neurosci. Res. 72, 283–288. doi: 10.1016/j.neures.2012.01.003
Izuma, K., Saito, D. N., and Sadato, N. (2008). Processing of social and monetary rewards in the human striatum. Neuron 58, 284–294. doi: 10.1016/j.neuron.2008.03.020
Izuma, K., Saito, D. N., and Sadato, N. (2010). The roles of the medial prefrontal cortex and striatum in reputation processing. Soc. Neurosci. 5, 133–147. doi: 10.1080/17470910903202559
Janowski, V., Camerer, C., and Rangel, A. (2013). Empathic choice involves vmPFC value signals that are modulated by social processing implemented in IPL. Soc. Cogn. Affect. Neurosci. 8, 201–208. doi: 10.1093/scan/nsr086
Jocham, G., Klein, T. A., and Ullsperger, M. (2011). Dopamine-mediated reinforcement learning signals in the striatum and ventromedial prefrontal cortex underlie value-based choices. J. Neurosci. 31, 1606–1613. doi: 10.1523/JNEUROSCI.3904-10.2011
John, Y. J., Zikopoulos, B., Bullock, D., and Barbas, H. (2016). The emotional gatekeeper: a computational model of attentional selection and suppression through the pathway from the amygdala to the inhibitory thalamic reticular nucleus. PLoS Comput. Biol. 12:e1004722. doi: 10.1371/journal.pcbi.1004722
Joyce, M. K. P., and Barbas, H. (2018). Cortical connections position primate area 25 as a keystone for interoception. Emot. Mem. J. Neurosci. 38, 1677–1698. doi: 10.1523/JNEUROSCI.2363-17.2017
Jung, D., Sul, S., and Kim, H. (2013). Dissociable neural processes underlying risky decisions for self versus other. Front. Neurosci. 7:15. doi: 10.3389/fnins.2013.00015
Jung, D., Sul, S., Lee, M., and Kim, H. (2018). Social observation increases functional segregation between MPFC subregions predicting prosocial consumer decisions. Sci. Rep. 8:3368. doi: 10.1038/s41598-018-21449-z
Kable, J. W., and Glimcher, P. W. (2007). The neural correlates of subjective value during intertemporal choice. Nat. Neurosci. 10, 1625–1633. doi: 10.1038/nn2007
Kang, P., Lee, J., Sul, S., and Kim, H. (2013). Dorsomedial prefrontal cortex activity predicts the accuracy in estimating others’ preferences. Front. Hum. Neurosci. 7:686. doi: 10.3389/fnhum.2013.00686
Kelley, W. M., Macrae, C. N., Wyland, C. L., Caglar, S., Inati, S., and Heatherton, T. F. (2002). Finding the self? An event-related fMRI study. J. Cogn. Neurosci. 14, 785–794. doi: 10.1162/08989290260138672
Keltner, D., and Buswell, B. N. (1997). Embarrassment: its distinct form and appeasement functions. Psychol. Bull. 122, 250–270. doi: 10.1037/0033-2909.122.3.250
Killcross, S., and Coutureau, E. (2003). Coordination of actions and habits in the medial prefrontal cortex of rats. Cereb. Cortex 13, 400–408. doi: 10.1093/cercor/13.4.400
Kim, H., Adolphs, R., O’Doherty, J. P., and Shimojo, S. (2007). Temporal isolation of neural processes underlying face preference decisions. Proc. Natl. Acad. Sci. U.S.A. 104, 18253–18258. doi: 10.1073/pnas.0703101104
Kim, H., Shimojo, S., and O’Doherty, J. P. (2006). Is avoiding an aversive outcome rewarding? Neural substrates of avoidance learning in the human brain. PLoS Biol. 4:e233. doi: 10.1371/journal.pbio.0040233
Kim, H., Shimojo, S., and O’Doherty, J. P. (2011). Overlapping responses for the expectation of juice and money rewards in human ventromedial prefrontal cortex. Cereb. Cortex 21, 769–776. doi: 10.1093/cercor/bhq145
Kim, K., and Johnson, M. K. (2015). Activity in ventromedial prefrontal cortex during self-related processing: positive subjective value or personal significance? Soc. Cogn. Affect. Neurosci. 10, 494–500. doi: 10.1093/scan/nsu078
Kimura, A., Imbe, H., Donishi, T., and Tamai, Y. (2007). Axonal projections of single auditory neurons in the thalamic reticular nucleus: implications for tonotopy-related gating function and cross-modal modulation. Eur. J. Neurosci. 26, 3524–3535. doi: 10.1111/j.1460-9568.2007.05925.x
Kimura, A., Mukawa, N., Yamamoto, M., Masuda, T., Yuasa, M., Goto, S., et al. (2012). The influence of reputational concerns on purchase intention of fair-trade foods among young Japanese adults. Food Qual. Preference 26, 204–210. doi: 10.1016/j.foodqual.2012.05.002
Kitayama, S., King, A., Yoon, C., Tompson, S., Huff, S., and Liberzon, I. (2014). The dopamine D4 receptor gene (DRD4) moderates cultural difference in independent versus interdependent social orientation. Psychol. Sci. 25, 1169–1177. doi: 10.1177/0956797614528338
Kleckner, I. R., Zhang, J., Touroutoglou, A., Chanes, L., Xia, C., Simmons, W. K., et al. (2017). Evidence for a large-scale brain system supporting allostasis and interoception in humans. Nat. Hum. Behav. 1:0069. doi: 10.1038/s41562-017-0069
Koechlin, E., and Hyafil, A. (2007). Anterior prefrontal function and the limits of human decision-making. Science 318, 594–598. doi: 10.1126/science.1142995
Kolling, N., Wittmann, M. K., Behrens, T. E. J., Boorman, E. D., Mars, R. B., and Rushworth, M. F. S. (2016). Value, search, persistence and model updating in anterior cingulate cortex. Nat. Neurosci. 19, 1280–1285. doi: 10.1038/nn.4382
Korn, C. W., Prehn, K., Park, S. Q., Walter, H., and Heekeren, H. R. (2012). Positively biased processing of self-relevant social feedback. J. Neurosci. 32, 16832–16844. doi: 10.1523/JNEUROSCI.3016-12.2012
Krajbich, I., Adolphs, R., Tranel, D., Denburg, N. L., and Camerer, C. F. (2009). Economic games quantify diminished sense of guilt in patients with damage to the prefrontal cortex. J. Neurosci. 29, 2188–2192. doi: 10.1523/jneurosci.5086-08.2009
Krienen, F. M., Tu, P. C., and Buckner, R. L. (2010). Clan mentality: evidence that the medial prefrontal cortex responds to close others. J. Neurosci. 30, 13906–13915. doi: 10.1523/JNEUROSCI.2180-10.2010
Kumaran, D., Banino, A., Blundell, C., Hassabis, D., and Dayan, P. (2016). Computations underlying social hierarchy learning: distinct neural mechanisms for updating and representing self-relevant information. Neuron 92, 1135–1147. doi: 10.1016/j.neuron.2016.10.052
LaLumiere, R. T., Niehoff, K. E., and Kalivas, P. W. (2010). The infralimbic cortex regulates the consolidation of extinction after cocaine self-administration. Learn. Mem. 17, 168–175. doi: 10.1101/lm.1576810
Lawrence, N. S., Hinton, E. C., Parkinson, J. A., and Lawrence, A. D. (2012). Nucleus accumbens response to food cues predicts subsequent snack consumption in women and increased body mass index in those with reduced self-control. Neuroimage 63, 415–422. doi: 10.1016/j.neuroimage.2012.06.070
Leary, M. R., and Kowalski, R. M. (1990). Impression management: a literature review and two-component model. Psychol. Bull. 107, 34–47. doi: 10.1037/0033-2909.107.1.34
Lebreton, M., Jorge, S., Michel, V., Thirion, B., and Pessiglione, M. (2009). An automatic valuation system in the human brain: evidence from functional neuroimaging. Neuron 64, 431–439. doi: 10.1016/j.neuron.2009.09.040
Lee, S. W., Shimojo, S., and O’Doherty, J. P. (2014). Neural computations underlying arbitration between model-based and model-free learning. Neuron 81, 687–699. doi: 10.1016/j.neuron.2013.11.028
Levy, D. J., and Glimcher, P. W. (2012). The root of all value: a neural common currency for choice. Curr. Opin. Neurobiol. 22, 1027–1038. doi: 10.1016/j.conb.2012.06.001
Levy, I., Lazzaro, S. C., Rutledge, R. B., and Glimcher, P. W. (2011). Choice from non-choice: predicting consumer preferences from blood oxygenation level-dependent signals obtained during passive viewing. J. Neurosci. 31, 118–125. doi: 10.1523/JNEUROSCI.3214-10.2011
Lieberman, M. D., Straccia, M. A., Meyer, M. L., Du, M., and Tan, K. M. (2019). Social, self, (situational), and affective processes in medial prefrontal cortex (MPFC): causal, multivariate, and reverse inference evidence. Neurosci. Biobehav. Rev. 99, 311–328. doi: 10.1016/j.neubiorev.2018.12.021
Ligneul, R., Obeso, I., Ruff, C. C., and Dreher, J. C. (2016). Dynamical representation of dominance relationships in the human rostromedial prefrontal cortex. Curr. Biol. 26, 3107–3115. doi: 10.1016/j.cub.2016.09.015
Lin, A., Adolphs, R., and Rangel, A. (2012). Social and monetary reward learning engage overlapping neural substrates. Soc. Cogn. Affect. Neurosci. 7, 274–281. doi: 10.1093/scan/nsr006
Liu, X., Hairston, J., Schrier, M., and Fan, J. (2011). Common and distinct networks underlying reward valence and processing stages: a meta-analysis of functional neuroimaging studies. Neurosci. Biobehav. Rev. 35, 1219–1236. doi: 10.1016/j.neubiorev.2010.12.012
Lockwood, P. L., Apps, M. A., Roiser, J. P., and Viding, E. (2015). Encoding of vicarious reward prediction in anterior cingulate cortex and relationship with trait empathy. J. Neurosci. 35, 13720–13727. doi: 10.1523/JNEUROSCI.1703-15.2015
Mackey, S., and Petrides, M. (2014). Architecture and morphology of the human ventromedial prefrontal cortex. Eur. J. Neurosci. 40, 2777–2796. doi: 10.1111/ejn.12654
Maier, S. U., and Hare, T. A. (2017). Higher heart-rate variability is associated with ventromedial prefrontal cortex activity and increased resistance to temptation in dietary self-control challenges. J. Neurosci. 37, 446–455. doi: 10.1523/JNEUROSCI.2815-16.2016
Mansouri, F. A., Koechlin, E., Rosa, M. G. P., and Buckley, M. J. (2017). Managing competing goals – A key role for the frontopolar cortex. Nat. Rev. Neurosci. 18, 645–657. doi: 10.1038/nrn.2017.111
Mason, W. A., Capitanio, J. P., Machado, C. J., Mendoza, S. P., and Amaral, D. G. (2006). Amygdalectomy and responsiveness to novelty in rhesus monkeys (Macaca mulatta): generality and individual consistency of effects. Emotion 6, 73–81. doi: 10.1037/1528-3542.6.1.73
McEwen, B. S., and Stellar, E. (1993). Stress and the individual. Mechanisms leading to disease. Arch. Int. Med. 153, 2093–2101. doi: 10.1001/archinte.153.18.2093
Michl, P., Meindl, T., Meister, F., Born, C., Engel, R. R., Reiser, M., et al. (2012). Neurobiological underpinnings of shame and guilt: a pilot fMRI study. Soc. Cognit. Affect. Neurosci. 9, 150–157. doi: 10.1093/scan/nss114
Milad, M. R., Pitman, R. K., Ellis, C. B., Gold, A. L., Shin, L. M., Lasko, N. B., et al. (2009). Neurobiological basis of failure to recall extinction memory in posttraumatic stress disorder. Biol. Psychiatry 66, 1075–1082. doi: 10.1016/j.biopsych.2009.06.026
Mitchell, J. P., Macrae, C. N., and Banaji, M. R. (2006). Dissociable medial prefrontal contributions to judgments of similar and dissimilar others. Neuron 50, 655–663. doi: 10.1016/j.neuron.2006.03.040
Moll, J., Krueger, F., Zahn, R., Pardini, M., de Oliveira-Souza, R., and Grafman, J. (2006). Human fronto-mesolimbic networks guide decisions about charitable donation. Proc. Natl. Acad. Sci. U.S.A. 103, 15623–15628. doi: 10.1073/pnas.0604475103
Moll, J., Zahn, R., de Oliveira-Souza, R., Bramati, I. E., Krueger, F., Tura, B., et al. (2011). Impairment of prosocial sentiments is associated with frontopolar and septal damage in frontotemporal dementia. Neuroimage 54, 1735–1742. doi: 10.1016/j.neuroimage.2010.08.026
Moran, J. M., Macrae, C. N., Heatherton, T. F., Wyland, C. L., and Kelley, W. M. (2006). Neuroanatomical evidence for distinct cognitive and affective components of self. J. Cogn. Neurosci. 18, 1586–1594. doi: 10.1162/jocn.2006.18.9.1586
Müller-Pinzler, L., Gazzola, V., Keysers, C., Sommer, J., Jansen, A., Frässle, S., et al. (2015). Neural pathways of embarrassment and their modulation by social anxiety. NeuroImage 119, 252–261. doi: 10.1016/j.neuroimage.2015.06.036
Nakao, T., Ohira, H., and Northoff, G. (2012). Distinction between externally vs. internally guided decision-making: operational differences, meta-analytical comparisons and their theoretical implications. Front. Neurosci. 6:31. doi: 10.3389/fnins.2012.00031
Nicolle, A., Klein-Flugge, M. C., Hunt, L. T., Vlaev, I., Dolan, R. J., and Behrens, T. E. (2012). An agent independent axis for executed and modeled choice in medial prefrontal cortex. Neuron 75, 1114–1121. doi: 10.1016/j.neuron.2012.07.023
Northoff, G., Heinzel, A., de Greck, M., Bermpohl, F., Dobrowolny, H., and Panksepp, J. (2006). Self-referential processing in our brain—a meta-analysis of imaging studies on the self. Neuroimage 31, 440–457. doi: 10.1016/j.neuroimage.2005.12.002
Nowak, M. A., and Sigmund, K. (1993). A strategy of win-stay, lose-shift that outperforms tit-for-tat in the Prisoner’s Dilemma game. Nature 364, 56–58. doi: 10.1038/364056a0
Nowak, M. A., and Sigmund, K. (1998). Evolution of indirect reciprocity by image scoring. Nature 393, 573–577. doi: 10.1038/31225
O’Doherty, J. P. (2011). Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Ann. N. Y. Acad. Sci. 1239, 118–129. doi: 10.1111/j.1749-6632.2011.06290.x
Palomero-Gallagher, N., Hoffstaedter, F., Mohlberg, H., Eickhoff, S. B., Amunts, K., and Zilles, K. (2019). Human pregenual anterior cingulate cortex: structural, functional, and connectional heterogeneity. Cereb. Cortex 29, 2552–2574. doi: 10.1093/cercor/bhy124
Pezzulo, G., Rigoli, F., and Friston, K. (2015). Active Inference, homeostatic regulation and adaptive behavioural control. Prog. Neurobiol. 134, 17–35. doi: 10.1016/j.pneurobio.2015.09.001
Pinault, D. (2004). The thalamic reticular nucleus: structure, function and concept. Brain Res. Brain Res. Rev. 46, 1–31. doi: 10.1016/j.brainresrev.2004.04.008
Pinault, D., and Deschenes, M. (1998). Anatomical evidence for a mechanism of lateral inhibition in the rat thalamus. Eur. J. Neurosci. 10, 3462–3469. doi: 10.1046/j.1460-9568.1998.00362.x
Piva, M., Velnoskey, K., Jia, R., Nair, A., Levy, I., and Chang, S. W. (2019). The dorsomedial prefrontal cortex computes task-invariant relative subjective value for self and other. Elife 8:e44939. doi: 10.7554/eLife.44939
Powers, K. E., Somerville, L. H., Kelley, W. M., and Heatherton, T. F. (2013). Rejection sensitivity polarizes striatal–medial prefrontal activity when anticipating social feedback. J. Cognit. Neurosci. 25, 1887–1895. doi: 10.1162/jocn_a_00446
Quirk, G. J., and Beer, J. S. (2006). Prefrontal involvement in the regulation of emotion: convergence of rat and human studies. Curr. Opin. Neurobiol. 16, 723–727. doi: 10.1016/j.conb.2006.07.004
Radcliffe, K. A., Fisher, J. L., Gray, R., and Dani, J. A. (1999). Nicotinic modulation of glutamate and GABA synaptic transmission of hippocampal neurons. Ann. N. Y. Acad. Sci. 868, 591–610. doi: 10.1111/j.1749-6632.1999.tb11332.x
Rainville, P., Duncan, G. H., Price, D. D., Carrier, B., and Bushnell, M. C. (1997). Pain affect encoded in human anterior cingulate but not somatosensory cortex. Science 277, 968–971. doi: 10.1126/science.277.5328.968
Rand, D. G., Greene, J. D., and Nowak, M. A. (2012). Spontaneous giving and calculated greed. Nature 489, 427–430. doi: 10.1038/nature11467
Ratcliff, R. (1990). Connectionist models of recognition memory: constraints imposed by learning and forgetting functions. Psychol. Rev. 97, 285–308. doi: 10.1037/0033-295x.97.2.285
Rilling, J. K., Sanfey, A. G., Aronson, J. A., Nystrom, L. E., and Cohen, J. D. (2004). The neural correlates of theory of mind within interpersonal interactions. Neuroimage 22, 1694–1703. doi: 10.1016/j.neuroimage.2004.04.015
Roy, M., Shohamy, D., and Wager, T. D. (2012). Ventromedial prefrontal-subcortical systems and the generation of affective meaning. Trends Cogn. Sci. 16, 147–156. doi: 10.1016/j.tics.2012.01.005
Sarter, M., and Bruno, J. P. (1997). Cognitive functions of cortical acetylcholine: toward a unifying hypothesis. Brain Res. Brain Res. Rev. 23, 28–46. doi: 10.1016/s0165-0173(96)00009-4
Schneirla, T. C. (1959). An evolutionary and developmental theory of biphasic processes underlying approach and withdrawal. Nebraska Symp. Motiv. 7, 1–42.
Schultz, W. (1998). Predictive reward signal of dopamine neurons. J. Neurophysiol. 80, 1–27. doi: 10.1152/jn.1998.80.1.1
Schwartz, C. E., Wright, C. I., Shin, L. M., Kagan, J., and Rauch, S. L. (2003). Inhibited and uninhibited infants “grown up”: adult amygdalar response to novelty. Science 300, 1952–1953. doi: 10.1126/science.1083703
Seo, H., Cai, X., Donahue, C. H., and Lee, D. (2014). Neural correlates of strategic reasoning during competitive games. Science 346, 340–343. doi: 10.1126/science.1256254
Shackman, A. J., Salomons, T. V., Slagter, H. A., Fox, A. S., Winter, J. J., and Davidson, R. J. (2011). The integration of negative affect, pain and cognitive control in the cingulate cortex. Nat. Rev. Neurosci. 12, 154–167. doi: 10.1038/nrn2994
Shenhav, A., Cohen, J. D., and Botvinick, M. M. (2016). Dorsal anterior cingulate cortex and the value of control. Nat. Neurosci. 19, 1286–1291. doi: 10.1038/nn.4384
Shenhav, A., and Greene, J. D. (2010). Moral judgments recruit domain-general valuation mechanisms to integrate representations of probability and magnitude. Neuron 67, 667–677. doi: 10.1016/j.neuron.2010.07.020
Shin, L. M., Dougherty, D. D., Orr, S. P., Pitman, R. K., Lasko, M., Macklin, M. L., et al. (2000). Activation of anterior paralimbic structures during guilt-related script-driven imagery. Biol. Psychiatry 48, 43–50. doi: 10.1016/s0006-3223(00)00251-1
Smith, R., Thayer, J. F., Khalsa, S. S., and Lane, R. D. (2017). The hierarchical basis of neurovisceral integration. Neurosci. Biobehav. Rev. 75, 274–296. doi: 10.1016/j.neubiorev.2017.02.003
Soetevent, A. R. (2005). Anonymity in giving in a natural context—a field experiment in 30 churches. J. Public Econ. 89, 2301–2323. doi: 10.1016/j.jpubeco.2004.11.002
Somerville, L. H., Jones, R. M., Ruberry, E. J., Dyke, J. P., Glover, G., and Casey, B. J. (2013). The medial prefrontal cortex and the emergence of self-conscious emotion in adolescence. Psychol. Sci. 24, 1554–1562. doi: 10.1177/0956797613475633
Stephan, K. E., Manjaly, Z. M., Mathys, C. D., Weber, L. A., Paliwal, S., Gard, T., et al. (2016). Allostatic self-efficacy: a metacognitive theory of dyshomeostasis-induced fatigue and depression. Front. Hum. Neurosci. 10:550. doi: 10.3389/fnhum.2016.00550
Steriade, M. (1999). Coherent oscillations and short-term plasticity in corticothalamic networks. Trends Neurosci. 22, 337–345. doi: 10.1016/s0166-2236(99)01407-1
Steriade, M., Deschenes, M., Domich, L., and Mulle, C. (1985). Abolition of spindle oscillations in thalamic neurons disconnected from nucleus reticularis thalami. J. Neurophysiol. 54, 1473–1497. doi: 10.1152/jn.1985.54.6.1473
Sterling, P. (2014). Homeostasis vs allostasis: implications for brain function and mental disorders. JAMA Psychiatry 71, 1192–1193. doi: 10.1001/jamapsychiatry.2014.1043
Sterling, P., and Eyer, J. (1988). “Allostasis: a new paradigm to explain arousal pathology,” in Handbook of Life Stress, Cognition, and Health, eds S. Fisher and J. Reason (New York, NY: John Wiley and Sons), 629–649.
Sturm, V. E., Ascher, E. A., Miller, B. L., and Levenson, R. W. (2008). Diminished self-conscious emotional responding in frontotemporal lobar degeneration patients. Emotion 8:861. doi: 10.1037/a0013765
Sturm, V. E., Rosen, H. J., Allison, S., Miller, B. L., and Levenson, R. W. (2006). Self-conscious emotion deficits in frontotemporal lobar degeneration. Brain 129, 2508–2516. doi: 10.1093/brain/awl145
Sturm, V. E., Sollberger, M., Seeley, W. W., Rankin, K. P., Ascher, E. A., Rosen, H. J., et al. (2012). Role of right pregenual anterior cingulate cortex in self-conscious emotional reactivity. Soc. Cognit. Affect. Neurosci. 8, 468–474. doi: 10.1093/scan/nss023
Sul, S., Tobler, P. N., Hein, G., Leiberg, S., Jung, D., Fehr, E., et al. (2015). Spatial gradient in value representation along the medial prefrontal cortex reflects individual differences in prosociality. Proc. Natl. Acad. Sci. U.S.A. 112, 7851–7856. doi: 10.1073/pnas.1423895112
Suzuki, S., Harasawa, N., Ueno, K., Gardner, J. L., Ichinohe, N., Haruno, M., et al. (2012). Learning to simulate others’ decisions. Neuron 74, 1125–1137. doi: 10.1016/j.neuron.2012.04.030
Takahashi, H., Yahata, N., Koeda, M., Matsuda, T., Asai, K., and Okubo, Y. (2004). Brain activation associated with evaluative processes of guilt and embarrassment: an fMRI study. Neuroimage 23, 967–974. doi: 10.1016/j.neuroimage.2004.07.054
Tangney, J. P., Stuewig, J., and Mashek, D. J. (2007). Moral emotions and moral behavior. Annu. Rev. Psychol. 58, 345–372. doi: 10.1146/annurev.psych.56.091103.070145
Thayer, J. F., Ahs, F., Fredrikson, M., Sollers, J. J., and Wager, T. D. (2012). A meta-analysis of heart rate variability and neuroimaging studies: implications for heart rate variability as a marker of stress and health. Neurosci. Biobehav. Rev. 36, 747–756. doi: 10.1016/j.neubiorev.2011.11.009
Touroutoglou, A., Andreano, J., Dickerson, B. C., and Barrett, L. F. (2020). The tenacious brain: how the anterior mid-cingulate contributes to achieving goals. Cortex 123, 12–29. doi: 10.1016/j.cortex.2019.09.011
Tracy, J. L., and Robins, R. W. (2004). Target article: “putting the self into self-conscious emotions: a theoretical model”. Psychol. Inq. 15, 103–125. doi: 10.1207/s15327965pli1502_01
Tricomi, E., Rangel, A., Camerer, C. F., and O’Doherty, J. P. (2010). Neural evidence for inequality-averse social preferences. Nature 463, 1089–1091. doi: 10.1038/nature08785
Tusche, A., Bockler, A., Kanske, P., Trautwein, F. M., and Singer, T. (2016). Decoding the charitable brain: empathy, perspective taking, and attention shifts differentially predict altruistic giving. J. Neurosci. 36, 4719–4732. doi: 10.1523/JNEUROSCI.3392-15.2016
Uddin, L. Q., Kelly, A. M., Biswal, B. B., Castellanos, F. X., and Milham, M. P. (2009). Functional connectivity of default mode network components: correlation, anticorrelation, and causality. Hum. Brain Mapp. 30, 625–637. doi: 10.1002/hbm.20531
Valentin, V. V., Dickinson, A., and O’Doherty, J. P. (2007). Determining the neural substrates of goal-directed learning in the human brain. J. Neurosci. 27, 4019–4026. doi: 10.1523/JNEUROSCI.0564-07.2007
Van Hoorn, J., Van Dijk, E., Güroğlu, B., and Crone, E. A. (2016). Neural correlates of prosocial peer influence on public goods game donations during adolescence. Soc. Cognit. Affect. Neurosci. 11, 923–933. doi: 10.1093/scan/nsw013
Vogt, B. A. (2005). Pain and emotion interactions in subregions of the cingulate gyrus. Nat. Rev. Neurosci. 6, 533–544. doi: 10.1038/nrn1704
Vogt, B. A., Hof, P. R., Zilles, K., Vogt, L. J., Herold, C., and Palomero-Gallagher, N. (2013). Cingulate area 32 homologies in mouse, rat, macaque and human: cytoarchitecture and receptor architecture. J. Compar. Neurol. 521, 4189–4204. doi: 10.1002/cne.23409
Wager, T. D., Waugh, C. E., Lindquist, M., Noll, D. C., Fredrickson, B. L., and Taylor, S. F. (2009). Brain mediators of cardiovascular responses to social threat: part I: reciprocal dorsal and ventral sub-regions of the medial prefrontal cortex and heart-rate reactivity. Neuroimage 47, 821–835. doi: 10.1016/j.neuroimage.2009.05.043
Wagner, U., N’diaye, K., Ethofer, T., and Vuilleumier, P. (2011). Guilt-specific processing in the prefrontal cortex. Cereb. Cortex 21, 2461–2470. doi: 10.1093/cercor/bhr016
Wallis, C. U., Cardinal, R. N., Alexander, L., Roberts, A. C., and Clarke, H. F. (2017). Opposing roles of primate areas 25 and 32 and their putative rodent homologs in the regulation of negative emotion. Proc. Natl. Acad. Sci. U.S.A. 114, E4075–E4084. doi: 10.1073/pnas.1620115114
Waytz, A., Zaki, J., and Mitchell, J. P. (2012). Response of dorsomedial prefrontal cortex predicts altruistic behavior. J. Neurosci. 32, 7646–7650. doi: 10.1523/JNEUROSCI.6193-11.2012
Will, G. J., Rutledge, R. B., Moutoussis, M., and Dolan, R. J. (2017). Neural and computational processes underlying dynamic changes in self-esteem. Elife 6:e28098. doi: 10.7554/eLife.28098
Wittmann, M. K., Kolling, N., Faber, N. S., Scholl, J., Nelissen, N., and Rushworth, M. F. (2016). Self-other mergence in the frontal cortex during cooperation and competition. Neuron 91, 482–493. doi: 10.1016/j.neuron.2016.06.022
Yin, H. H., and Knowlton, B. J. (2006). The role of the basal ganglia in habit formation. Nat. Rev. Neurosci. 7, 464–476. doi: 10.1038/nrn1919
Yoon, L., Somerville, L. H., and Kim, H. (2018). Development of MPFC function mediates shifts in self-protective behavior provoked by social feedback. Nat. Commun. 9:3086. doi: 10.1038/s41467-018-05553-2
Yu, X. J., Xu, X. X., He, S., and He, J. (2009). Change detection by thalamic reticular neurons. Nat. Neurosci. 12, 1165–1170. doi: 10.1038/nn.2373
Zahavi, A. (1975). Mate selection-a selection for a handicap. J. Theor. Biol. 53, 205–214. doi: 10.1016/0022-5193(75)90111-3
Zahn, R., Moll, J., Paiva, M., Garrido, G., Krueger, F., Huey, E. D., et al. (2008). The neural basis of human social values: evidence from functional MRI. Cereb. Cortex 19, 276–283. doi: 10.1093/cercor/bhn080
Zaki, J., and Mitchell, J. P. (2011). Equitable decision making is associated with neural markers of intrinsic value. Proc. Natl. Acad. Sci. U.S.A. 108, 19761–19766. doi: 10.1073/pnas.1112324108
Zevin, J. D., and Seidenberg, M. S. (2004). Age-of-acquisition effects in reading aloud: tests of cumulative frequency and frequency trajectory. Mem. Cognit. 32, 31–38. doi: 10.3758/bf03195818
Ziegler, G., Dahnke, R., Yeragani, V. K., and Bar, K. J. (2009). The relation of ventromedial prefrontal cortex activity and heart rate fluctuations at rest. Eur. J. Neurosci. 30, 2205–2210. doi: 10.1111/j.1460-9568.2009.07008.x
Zikopoulos, B., and Barbas, H. (2006). Prefrontal projections to the thalamic reticular nucleus form a unique circuit for attentional mechanisms. J. Neurosci. 26, 7348–7361. doi: 10.1523/JNEUROSCI.5511-05.2006
Zikopoulos, B., and Barbas, H. (2007). Circuits formultisensory integration and attentional modulation through the prefrontal cortex and the thalamic reticular nucleus in primates. Rev. Neurosci. 18, 417–438.
Zikopoulos, B., and Barbas, H. (2012). Pathways for emotions and attention converge on the thalamic reticular nucleus in primates. J. Neurosci. 32, 5338–5350. doi: 10.1523/JNEUROSCI.4793-11.2012
Keywords: thalamic reticular nucleus, insula, allostasis, interoception, decision-making, prosociality, self-enhancement
Citation: Kim H (2020) Stability or Plasticity? – A Hierarchical Allostatic Regulation Model of Medial Prefrontal Cortex Function for Social Valuation. Front. Neurosci. 14:281. doi: 10.3389/fnins.2020.00281
Received: 05 January 2020; Accepted: 12 March 2020;
Published: 31 March 2020.
Edited by:
Monica Luciana, University of Minnesota, United StatesReviewed by:
Basilis Zikopoulos, Boston University, United StatesPaola Devoto, University of Cagliari, Italy
Jeff Steketee, The University of Tennessee Health Science Center (UTHSC), United States
Copyright © 2020 Kim. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: Hackjin Kim, hackjinkim@korea.ac.kr; hackjinkim@gmail.com