David L. Barack1,2,3*
Michael L. Platt3,4,5- 1Departments of Philosophy, Neuroscience, and Economics, Center for Science and Society, Columbia University in the City of New York, New York, NY, USA
- 2Department of Philosophy, Duke University, Durham, NC, USA
- 3Duke Institute for Brain Sciences, Duke University, Durham, NC, USA
- 4Departments of Neurobiology and Psychology and Neuroscience, Duke University, Durham, NC, USA
- 5Departments of Neuroscience, Psychology, and Marketing, University of Pennsylvania, Philadelphia, PA, USA
Executive dysfunctions, psychopathologies arising from problems in the control and regulation of behavior, can occur as a result of the faulty execution of formal information processing models or as a result of malfunctioning neural mechanisms. The models correspond to the formal descriptions of how signals in the environment must be transformed in order to behave adaptively, and the mechanisms correspond to the signal transformations that nervous systems implement in order to execute those cognitive functions. Mechanisms in the form of repeated patterns of neural dynamics execute information processing models. Two distinct modes of malfunction can occur when neural dynamics execute models of information processing. The processing models describing behavior may fail to be executed correctly by neural mechanisms. Or, the neural mechanisms may malfunction, failing to implement the right computation. As an example of malfunctioning models in executive cognition, purported failures of rule following can be understood as failures to appropriately execute a suite of processing models. As an example of malfunctioning mechanisms of executive cognition, maladaptive behavior resulting from dysfunction in the medial prefrontal cortex (mPFC) can be understood as failures in the signal transformations carried out therein. The purpose of these examples is to illustrate the potential benefits of considering models and mechanisms in the diagnosis and etiology of neuropsychological illness and dysfunction, especially disorders of executive cognition.
Introduction
In 1967, a subway train tragically struck Vladimir, a Muscovite engineering student, resulting in the resection of his frontal poles (Goldberg, 2001). Vladimir exhibited a range of deficits in complex behavior. When instructed to repeat a story, he was unable to recapitulate the correct narrative, as well as being unable to stop the rambling, incoherent narrative he did produce. When instructed to draw a circle, he drew multiple; when instructed to draw a cross, a circle, and a square in sequence, the cross appeared in all three shapes; when instructed to draw a circle, a cross, and a circle in sequence, Vladimir drew a donut last, persevering in drawing two lines as he had done for the cross. The annals of neurology are replete with examples of deficits in complex behavior such as Vladimir's.
Tempting though it may be to describe Vladimir as inappropriately persisting in following a rule, the accurate description and diagnosis of his dysfunctional psychology is an open scientific question. Understanding the information processing models and dynamical mechanisms of cognition is critical to understanding and diagnosing mental illness, including maladaptive perseverative behavior like Vladimir's. Here we discuss how models and mechanisms can provide new insight into psychiatric nosology. In particular, psychiatric pathology results from misexecution of processing models by dynamical mechanisms in the brain. We illustrate this approach by examining how a model-based view interprets pathology evident in rule-following tasks and how a mechanism-based view interprets pathology evident in medial prefrontal cortex (mPFC) dysfunction.
The models describe how signals in the environment must be transformed in order to behave adaptively, and the mechanisms describe the dynamics of neural circuits that execute those cognitive functions (Marr, 1982; Adams et al., 2012). Neuroscientists, psychologists, philosophers, and others who study the mind invoke formal, mathematical models of behavior to characterize cognitive functions. These models are mathematical formulae that contain variables, picking out which properties of the environment the system must track, and the mathematical relations between those variables, how they must be transformed, for adaptive behavior. For example, in the case of simple decisions, such as deciding between different size rewards or deciding when to leave a depleting resource, the models can be drawn from economic models of maximization of value (Bernoulli, 1738; Platt and Glimcher, 1999) or from optimal foraging theory (Charnov, 1976; Stephens and Krebs, 1986). The dynamics of the neural mechanisms, the neurons or neural circuits, execute these processing models by implementing neural computations over signals (Herz et al., 2006; Adams et al., 2012; Carandini and Heeger, 2012). These circuits implement these computations by transforming afferent signals they receive into efferent signals passed on to later processing areas. One example is the integrate-to-bound dynamical system, a neurocomputation for integrating noisy perceptual evidence during decision-making (Gold and Shadlen, 2001, 2007; Roitman and Shadlen, 2002) as well as potentially playing a role in strategic decisions to depart depleting resources (Hayden et al., 2011). Another example is divisive normalization, a neurocomputation involved in such diverse cognitive functions as attention (Reynolds and Heeger, 2009), value encoding (Louie et al., 2011), multisensory integration (Ohshiro et al., 2011), and others. The discovery that neural mechanisms repeatedly use a discrete number of neurocomputations, concatenated and combined to execute processing models, is a hallmark of recent advances in understanding the neural basis of cognition. In sum, information processing models are executed by the computational dynamics of neural circuits.
Two distinct modes of malfunction can occur when circuit dynamics execute models of information processing. The processing models describing behavior may fail to be executed correctly by neural mechanisms, without the physiological mechanism itself malfunctioning. Or, the neural mechanisms may malfunction, thereby failing to implement the right computation. To illustrate this view, we will assess two examples of psychiatric deficits, one each from a model and a mechanism malfunction. As an example of malfunctioning models, purported failures of rule following can be understood as failures to appropriately execute a suite of processing models. As an example of malfunctioning mechanisms, maladaptive behavior resulting from dysfunction in the mPFC can be understood as failures in the signal transformations carried out therein. The purpose of these examples is not to be definitive but rather descriptive, to illustrate our approach to neuropsychiatric nosology and the potential benefits it holds for the diagnosis and etiology of neuropsychiatric illness and dysfunction.
Model-Based Dysfunction: Failures to Follow Rules
A fundamental executive function in cognitive systems is the ability to follow rules. Two prominent clinical assessments of rule-following are the Iowa Gambling Task (IGT) (Bechara, 2007) and the Wisconsin Card Sort Task (WCST) (Milner, 1963). Both tasks have been proposed to assess the ability of patients to appropriately incorporate information to augment future behavior (“rule following”). We contend that these tasks probe many cognitive functions at once, thus failing to probe a unique cognitive function, due to each task enlisting multiple cognitive functions for successful performance.
The IGT (Bechara et al., 1994; Bechara, 2007) is a risk-based gambling task. Subjects are given an initial sum of money and attempt to maximize their profit by selecting cards from one of four decks. The different decks pay out randomly, with some decks advantageous over the long term, resulting in a net gain, and others not, resulting in a net loss. The IGT is utilized to assess cognitive function in patients with focal brain lesions, as well as a number of psychiatric illnesses (Bechara, 2007). Patients with ventromedial prefrontal cortex (vmPFC) lesions exhibit more disadvantageous deck choices (Anderson et al., 1999) and though they exhibit appropriate physiological responses to outcomes on the task, these patients show no anticipatory affective autonomic response prior to selecting from the risky decks (Bechara et al., 1996, 1999). There is also a laterality effect, where right vmPFC damage results in impairment and left vmPFC damage does not, hypothesized to be connected to the association of right hemispheric activity with affective processing (Tranel et al., 2002; Clark et al., 2003; Buelow and Suhr, 2009). Some studies find that dorsolateral prefrontal cortex (dlPFC) and dorsomedial prefrontal cortex (dmPFC) damage results in deficient choices compared to controls (Manes et al., 2002; Fellows and Farah, 2005), while others fail to find such deficits in dlPFC lesioned patients (Bechara et al., 1998; Bechara and Damasio, 2002; Bechara, 2003; Fellows, 2004). Patients with amygdalar lesions show a deficit in IGT performance (Bechara et al., 1999; Brand et al., 2007a,b), though such patients exhibit general physiological deficits. Adding to this confusion, neuroimaging studies of healthy controls implicate medial orbitofrontal cortex (mOFC) in mediating IGT performance (Ernst et al., 2002; Bolla et al., 2003; Tucker et al., 2004; Windmann et al., 2006) (for review, see Buelow and Suhr, 2009).
Although there has been criticism of the IGT in the past (Buelow and Suhr, 2009; Gansler et al., 2011a,b), the IGT is a perfect illustration of the shortcomings of focusing on gross anatomical and behavioral deficit. What formal processing must the patient's brain execute in order to behave optimally on the task? Patients must track the values of each of the decks. Tracking this value requires risk encoding, encoding of the variance of rewards relative to the mean reward (Weber et al., 2004; McCoy and Platt, 2005). Risk and value computations potentially explain the mOFC activation present in neuroimaging during the IGT, as the mOFC encodes the value of options in the environment and mediates reward-guided decision making (Padoa-Schioppa and Assad, 2006; Noonan et al., 2010; Walton et al., 2010; Watson and Platt, 2012). In addition to value and risk, optimal performance on the IGT requires tracking reward rates over time, a fundamental capacity of organisms that is aptly captured by optimal foraging theory (Stephens and Krebs, 1986). Dopaminergic signals originating in the basal ganglia (BG) play a fundamental role in reward signaling (Schultz et al., 1997, 1998), subjects with dopaminergic disorders such as Parkinson's patients show deficits in foraging behavior (Rutledge et al., 2009), and dopaminergic pathways originating in the BG innervate the PFC (Williams and Goldman-Rakic, 1993; Björklund and Dunnett, 2007). Disorders evident in IGT behavior may result from a failure to execute the computations described by foraging models, particularly resulting from deficits in the targets of dopaminergic projections to prefrontal areas. Risk assessment, expected value computations, reward intake rates, and presumably other cognitive processes are implicated in successful IGT performance. Thus, the IGT assesses behavior in a fashion that combines multiple cognitive functions.
Analyzing evidence from the WCST suggests a similar conclusion. Utilized in the assessment of frontal lobe dysfunction, the WCST requires the subject to match a sample card with one of four key cards along one of three dimensions: color, number and shape (Grant and Berg, 1948; Milner, 1963; Heaton, 1981, 1993). The subject is not informed of the matching rule, but receives feedback after each sample card about whether the categorization was correct. After 10 consecutive correct matches, an unsignaled change in the active matching rule occurs, and the subject has to explore to determine the new rule. The subject's performance can be analyzed along a number of dimensions, including the number of completed rule switches, number of perseverative errors (sticking with an old rule after a switch), and number of non-perseverative errors (switching from a correct rule) (Nyhus and Barceló, 2009). A number of brain regions have been implicated in successful WCST performance. Milner's original 1963 study found more perseverative errors for dlPFC lesioned patients than those with OFC, temporal, or parietal lesions (Milner, 1963). The relative importance of frontal cortex for WCST has since been corroborated by a large number of studies (see Nyhus and Barceló, 2009 for recent review). However, damage to temporal (Hermann et al., 1988; Corcoran and Upton, 1993; Strauss et al., 1993; Horner et al., 1996; Giovagnoli, 2001), subcortical (Mukhopadhyay et al., 2007), hippocampal (Corcoran and Upton, 1993; Giovagnoli, 2001; Igarashi et al., 2002), and cerebellar (Mukhopadhyay et al., 2007) regions impairs WCST performance. Neuroimaging studies of patients or normal controls have linked increased activation of the dlPFC (Kawasaki et al., 1993; Marenco et al., 1993; Berman et al., 1995; Nagahama et al., 1996, 1997; Volz et al., 1997; Mentzel et al., 1998; Nagahama et al., 1998; Ragland et al., 1998; Lombardi et al., 1999; Rogers et al., 2000; Monchi et al., 2001; Wang et al., 2001; González-Hernández et al., 2002; Lie et al., 2006) and vlPFC (Monchi et al., 2001; Lie et al., 2006), among other, non-frontal areas (Nyhus and Barceló, 2009), to successful behavior on the task.
The breadth and number of regions activated suggests that the WCST requires a number of different cognitive functions for successful performance. For example, “set-shifting,” the ability to switch between active rules, is often invoked as one of the main functions probed by the WCST and disturbed in patient populations that exhibit WCST deficits (Barceló et al., 1997; Rubinstein et al., 2001; Monsell, 2003; Braver et al., 2006; Shallice, 2006; Nyhus and Barceló, 2009). The notion of set-shifting as switching between encoded rules may be an outdated legacy of the classical approach to theorizing about how rules are executed (Haugeland, 1985). Instead, as with the IGT, optimal performance on the task may be driven by cognitive foraging mechanisms as subjects search through an abstract space of possible patterns of behavior to determine the adaptive response (Hills et al., 2008), which requires keeping track of reward rates or constructing and updating models of the environment. In particular, upon a decrease in the local reward rate, the system may be forced into an exploratory regime where it attempts to determine the current rule. Individuals with nonspecific brain injury have been shown to exhibit deficits on the WCST and a foraging task, exhibiting a preference for local reward rates (Schlund, 2002), indicating the potential benefits of viewing aberrant WCST behavior through the lens of formal foraging theory. Similar lessons may be gleaned by reconceptualizing how errors on the WCST are classified and analyzed. Non-perseverative errors have been criticized in the past as conflating two types of error, called efficient (appropriately exploring for a new rule) and random (inappropriately switching rules) errors (Barceló and Knight, 2002). Perhaps, however, the neural mechanisms underlying WCST performance evolved to support exploratory search, where changes in behavior permit exploration for and potential exploitation of new resources. If so, both types of error are forms of exploratory behavior owing to foraging through possible behavioral patterns in order to optimize reward rates. Likewise, perseverative errors, associated with dlPFC lesions (Rogers, 1998; Shallice, 2006), may not result from failures to disengage from previously activated rules, but failures to appropriately assess reward rates or failures to integrate local reward rates with information about the environment, both resulting in failures to forage in the space of possible actions to maximize reward. Much like the IGT, the WCST assesses cognitive function in a fashion that may in fact cut orthogonally across multiple different cognitive computations needed for successful performance on the task.
Mechanism-Based Dysfunction: Malfunction in the Medial Prefrontal Cortex
The mPFC consists of a group of cortical structures in the anterior end of the brain and includes the anterior cingulate cortex (ACC), the dmPFC, and the vmPFC, as well as other areas. The mPFC has been implicated in social cognition (Amodio and Frith, 2006), default mode activity (Buckner et al., 2008), cognitive control (Ridderinkhof et al., 2004), affective processing (Etkin et al., 2011), and other processes. Here we focus on the ACC and its role in implementing the mechanisms that subserve information processing in cognitive control and social cognition.
Recent research has revealed a stereotyped signal transformation in the ACC sulcus (ACCs) exhibiting integrate-to-bound dynamics and that may be instructive for psychiatric pathologies like obsessive-compulsive disorder (OCD). Integrate-to-bound dynamics in neuronal mechanisms implement a basic exponentiation function that starts at a baseline, integrates some incoming signal until reaching a threshold, and then resets (Usher and McClelland, 2001; Wang, 2002). This basic circuit has been implicated in a diverse array of functions from eye movement control (Andersen, 1989; Seung, 1996, 2003) to perceptual decision-making across modalities (Hernandez et al., 2002; Roitman and Shadlen, 2002; Uchida and Mainen, 2003; Uka and DeAngelis, 2003, 2006; Heekeren et al., 2004; Romo et al., 2004; Kepecs et al., 2006; Uchida et al., 2006). Recently Hayden and colleagues unveiled in ACC a novel implementation of the integrate-to-bound circuit over longer timescales for strategic decisions (Hayden et al., 2011). Monkeys participated in a simulated foraging task, deciding when to leave a steadily decreasing reward source to forage at another, with leave decisions penalized by a timeout, simulating travel to a new rewarding location. As monkeys neared a decision to leave, neurons in the dorsal and ventral banks of the ACCs exhibited a pattern of successively higher peaks of activation, with this activity thresholding on leave decisions (Hayden et al., 2011). This activation pattern, observed in the past for sequences of movements (Shidara and Richmond, 2002), is highly suggestive of an exponential signal transformation by the integrate-to-bound dynamics in ACCs neurons.
The regularity of the activation function of neurons in this area has implications for the role of ACC in neuropsychiatric dysfunction, as illustrated by the case of OCD. OCD has a well-characterized clinical pathology, affecting up to 3% of the population and resulting in anxiogenic intrusive thoughts (obsessions) and repetitive aversive actions (compulsions) (Graybiel and Rauch, 2000; Maia et al., 2008; Menzies et al., 2008; Nenadic, 2008; Greenberg et al., 2010). The aberrant neurobiological circuitry in OCD patients includes the head of the caudate (Guehl et al., 2008; Maia et al., 2008) and orbitofrontal cortices (Maia et al., 2008; Menzies et al., 2008), as well as the anterior cingulate (Saxena et al., 1998; Cosgrove and Rauch, 2003; Maia et al., 2008). All three areas show hyperactivity in functional neuroimaging at rest (Szeszko et al., 2008), increased activation with OCD symptom provocation (Saxena et al., 1998), and resolution of resting state hyperactivity with successful therapy (Maia et al., 2008). The ACC specifically shows elevated levels of baseline activity in OCD (Rauch et al., 1994, 2001; Adler et al., 2000) and hyperactivation during cognitive activity such as during the processing of errors (Fitzgerald et al., 2005) or during incongruent trials in a conflict task (Fitzgerald et al., 2005, 2010; Maltby et al., 2005; Page et al., 2009). Cingulotomy, which resects both banks of the ACCs and the ACC gyrus (ACCg), is effective as treatment for refractory OCD (Graybiel and Rauch, 2000; Cosgrove and Rauch, 2003; Kim et al., 2003; Greenberg et al., 2010; Dougherty and Greenberg, 2011).
What role in the dysfunctional signal processing in OCD does the ACC play? ACC multiplexes information about rewards and actions (Hayden and Platt, 2010), and lesions in monkeys to the ACCs result in difficulty in reward-guided changes in behavior (Kennerley et al., 2006). Removal of both ACCs and ACCg results in higher error rates in a reward harvesting task (Rushworth et al., 2003). In humans, single neuron activity in ACCs in OCD patients has been shown to signal trials where different possible responses interfere as well as elevated activity following these interference trials, and the concomitant behavioral slowing following an interference trial was abolished post-ACC resection (Sheth et al., 2012). But the mechanism approach reveals deeper insight into the signal transformations that are central to the function of the ACC.
As the ACCs signals changes in behavioral strategy or sequence, a deviant signal transform in the form of persistent transient activation that thresholds abnormally may result in both an inability to change an action plan—compulsions—as well as the hypermetabolism observed in the ACC in OCD patients. The dysfunction in ACCs can be helpfully analyzed using dynamical systems theory. In dynamical systems theory, a system is conceptualized as inhabiting a point in its state space, the space of all possible states of the system. As the system evolves over time, it occupies a succession of such states in its state space, tracing out a trajectory of such states. Some states in the state space will attract the system; these are known as attractors, and the states around the attractor that typically lead to the system occupying that state are known as the basin of attraction for that attractor. OCD symptoms could reflect an inability of the circuit to leave a basin of attraction resulting in a repeated pattern of activation that does not threshold as normal. This hypothesis is supported by modeling of OCD with dynamical systems, which suggests that attractor basins in the network are abnormally deep, compelling the system to stay in a particular basin, possibly due to either excitatory glutamatergic hyperactivity (Rolls et al., 2008) or decreased inhibition (Maia and McClelland, 2012). As the system's signal transforms become trapped in a pattern of repeated, non-increasing transient activations, the behavioral output likewise becomes trapped in a pattern of repeated actions, the compulsions that are a hallmark of OCD.
Knowledge of the neural dynamics in a particular brain region connects metabolic evidence with the computations being executed in a region for tailored interventions. Granted knowledge of the dynamics implemented by an anatomical circuit, its hypo- or hyper-activity can be correlated with aspects of the signal transformation being performed by the circuit that might be malfunctioning in a particular disorder. The circuit mechanism approach allows us to characterize the ways that local circuits transform signals such that intervention might be tailored to suit the malfunctioning transform (Tass, 2003). Treatments such as deep brain stimulation promise to be more effective if they can be targeted to the specific dysfunction in the signal transformation carried out by the local malfunctioning circuit (Nenadic, 2008). Understanding the local signal transformations executed by neuronal mechanisms also allows tailored resection for therapeutic intervention in refractory psychopathology; for example, instead of removing the whole ACCs and ACCg, as has been done in the past (Graybiel and Rauch, 2000; Sheth et al., 2012), focal resection of the ACCs may be sufficient. Likewise, tailored deep brain stimulation could be designed to boost the system out of a local basin of attraction by injecting current at precise times. Understanding what signals are transformed, how they are transformed, and where they are transformed allows for both tailored interventions and bespoke resections.
Other encoding processes in ACC provide insight into the signal transformations relevant to disorders of social cognition. Reference frame encoding and coordinate transformations are fundamental computational functions for executing cognitive functions (Pouget and Snyder, 2000; Andersen and Buneo, 2002; Cohen and Andersen, 2002). In reference frame encoding, neural populations encode behaviorally relevant variables in a reference frame, a coordinate system oriented along some dimension, such as an egocentric dimension like eye position or arm position, or an allocentric dimension, like the position of the target in the world. Each neuron in a population exhibits a preference for a specific value of the relevant variable, and the population's response encodes the variable's value (Glimcher and Sparks, 1992). In the sensorimotor transform from sensation to action, signals encoded in one or more sensory dimensions must be transformed via synaptic computations and efferent signal transmission into the effector-appropriate motor dimensions. This process of reference frame encoding, signal transformation and transmission is a basic organizational feature of information processing in the brain (Poggio, 1990). The reference frame transformation mechanism is just one of the types of computations implemented by neural circuit dynamics to execute cognitive functions, and dysfunction in ACC in certain disorders can be interpreted as disorders of reference frame encoding.
Extending the reference frame concept to reward processing, we propose that deficits of social cognition can result from deficits in reward reference frame encoding. Reward reference frames are different for different prefrontal areas, as revealed by a recent study investigating reward encoding in rhesus monkeys choosing whether or not to donate juice rewards to other monkeys (Chang et al., 2013). In this study, reward was delivered to the actor subject, to another non-actor subject in the room with the actor, or to neither. Recordings from OFC, ACCs, and ACCg revealed that OFC cells preferentially encoded received rewards, ACCs cells preferentially encoded foregone rewards, and ACCg neurons were mixed, with neurons showing preference for received rewards, donated rewards, and for both donated and received rewards, indicating a mixed egocentric/allocentric reference frame encoding. This mixed encoding is a hallmark of areas using intermediate level transformations, those part way in transforming sensory signals into motor ones, in the sensorimotor mapping necessary for adaptive action (Pouget and Snyder, 2000; Chang, 2013).
The reference frame framework provides a number of new hypotheses about the origin of social deficits in atypical cognition. Social cognitive functions are a species of cognitive function and, like other cognitive computational processes, are executed using the basic computational building blocks of dynamic signal transformations. The ACCg has been implicated in deficits in following social gaze cues (Vecera and Rizzo, 2004, 2006), a fundamental social capacity of primates (Shepherd, 2010), and lesions in rhesus macaques have demonstrated that the ACCg is central to social cognition (Rudebeck et al., 2006). Mechanistic malfunction in executing social cognitive functions such as occurs in autism may occur in the encoding reference frame itself, such as problems in tuning or in the trajectory traversed through the state space of the population (Amit, 1992). It may also occur in the coordinate transformations necessary for adaptive social cognition, such as problems in the intermediate layer's implementation of functions necessary for coordinate transformations (Chang, 2013). In any case, failures of social competence may result from failures to implement the appropriate processing, the reference frames, and coordinate transformations requisite for social cognition.
Conclusion
As illustrated in the foregoing, neuropsychiatric evaluation often focuses on deficits evident in particular tasks or on characterization of anatomical insult (Damasio and Damasio, 1989). But research in cognitive neuroscience has unveiled two levels, the model and the mechanism, and neuropsychiatric illness can manifest as dysfunction at either of these levels. Model dysfunction results from failures to execute the right information processing model for adaptive behavior at a mechanism level, and multiple such functions may be disrupted on a given task, calling for care in the design and interpretation of behavioral assays for mental illness. Mechanism dysfunction results from failures to implement the right signal transformations at a neurophysiological level, resulting in maladaptive behavior and psychiatric illness. Models and mechanisms are tightly wound together, as the execution of a model requires the implementation of the right mechanisms.
We have elsewhere urged scientists and clinicians to note that neural circuits malfunction as a result of state-shifted or variance-shifted processing (Chang et al., 2012). The addition of noise into a circuit yields variance-shifted dysfunctions, resulting in suboptimal and noisy processing, while shorting or destroying a circuit yields state-shifted dysfunctions, resulting in ablated or radically atypical behavior (Chang et al., 2012). Applying this distinction in types of malfunction to models and mechanisms, cognitive dysfunction could result from a state-shifted or variance-shifted model or from a state-shifted or variance-shifted mechanism. A state-shifted model is simply the execution of the wrong or incorrect model for a particular behavior. A variance-shifted model is the execution of the correct model, but with the model variables being encoded in a noisier-than-typical fashion. Likewise, a state-shifted mechanism is one whose dynamics are no longer qualitatively identical to those prior to insult, and a variance-shifted mechanism is one whose dynamics are qualitatively identical but with increased variability. When considering this cognitive function space as a whole, each disorder will carve out some dysfunction subspace.
While every executed model requires a suite of mechanisms, models and mechanisms can fail independently. The failure of a mechanism need not result in a failure to execute a model due to redundancy. And just like death by a thousand cuts, aggregation of variance-shifted mechanisms can result in a state-shifted model. Furthermore, executing a computational model requires the joint operation of multiple mechanisms. If this joint operation is disrupted, such as by severing the connections between mechanisms, then despite the preserved functioning of the component mechanisms, the model may still fail to be executed properly, whether ablated altogether (as in a state-shifted dysfunction) or executed in a noisy fashion (variance-shifted dysfunction).
Cognitive neuroscience increasingly invokes models of information and signal processing to explain cognitive phenomena. This neurocomputational approach to psychiatry agrees well with other, recent proposals for understanding the computational basis of psychiatric dysfunction, such as defining new computational and cognitive phenotypes for classifying individuals (Maia and Frank, 2011; Montague et al., 2012; Robbins et al., 2012). By defining the dynamic space of cognitive neural activity, classes of individuals may travel through this space in distinct fashions that correspond to disorders or symptoms, but that may also yield novel classifications orthogonal to preexisting analyses of mental illness. We urge practitioners to take note of this possibly revolutionary transformation in the way that neuroscientists are explaining neurocognitive function, as it provides a framework for the analysis, interpretation and treatment of psychiatric dysfunction.
And as for Vladimir, who exhibited such maladaptive behavior? His persistent rule following may have been the result of an inability to properly follow directions, or of an inability to properly assess the execution of a rule and transition to a new behavior (Goldberg, 2001). Note, though, that he was not completely incapable of following directions, only of executing certain sorts of control over his behavior, such as preventing an old instruction from informing current behavior or inhibiting an action plan once initiated, redolent of the types of rule following deficits observed on the WCST or of the sorts of compulsions seen in OCD patients. Due to the extreme damage he suffered, the absence of control structures based on foraging models, dysfunctional reinforcement learning or belief updating, or other types of damaged information processing may better account for his dysfunctional behavior than appeals to classic, qualitatively described functions such as rule following, rule assessment, or rule transitions.
Author Contributions
All authors listed have made substantial, direct and intellectual contribution to the work and approved it for publication.
Conflict of Interest Statement
The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
References
Adams, G. K., Watson, K. K., Pearson, J., and Platt, M. L. (2012). Neuroethology of decision-making. Curr. Opin. Neurobiol. 22, 982–989. doi: 10.1016/j.conb.2012.07.009
Adler, C. M., McDonough-Ryan, P., Sax, K. W., Holland, S. K., Arndt, S., and Strakowski, S. M. (2000). fMRI of neuronal activation with symptom provocation in unmedicated patients with obsessive compulsive disorder. J. Psychiatr. Res. 34, 317–324. doi: 10.1016/S0022-3956(00)00022-4
Amit, D. J. (1992). Modeling Brain Function: The World of Attractor Neural Networks. Cambridge, UK: Cambridge University Press.
Amodio, D. M., and Frith, C. D. (2006). Meeting of minds: the medial frontal cortex and social cognition. Nat. Rev. Neurosci. 7, 268–277. doi: 10.1038/nrn1884
Andersen, P. H. (1989). The dopamine inhibitor GBR12909: selectivity and molecular mechanism of action. Eur. J. Pharmacol. 166, 493–504. doi: 10.1016/0014-2999(89)90363-4
Andersen, R. A., and Buneo, C. A. (2002). Intentional maps in posterior parietal cortex. Annu. Rev. Neurosci. 25, 189–220. doi: 10.1146/annurev.neuro.25.112701.142922
Anderson, S. W., Bechara, A., Damasio, H., Tranel, D., and Damasio, A. R. (1999). Impairment of social and moral behavior related to early damage in human prefrontal cortex. Nat. Neurosci. 2, 1032–1037. doi: 10.1038/12194
Barceló, F., and Knight, R. T. (2002). Both random and perseverative errors underlie WCST deficits in prefrontal patients. Neuropsychologia 40, 349–356. doi: 10.1016/S0028-3932(01)00110-5
Barceló, F., Sanz, M., Molina, V., and Rubia, F. J. (1997). The Wisconsin Card Sorting Test and the assessment of frontal function: a validation study with event-related potentials. Neuropsychologia 35, 399–408. doi: 10.1016/S0028-3932(96)00096-6
Bechara, A. (2003). Risky business: emotion, decision-making, and addiction. J. Gambl. Stud. 19, 23–51. doi: 10.1023/A:1021223113233
Bechara, A. (2007). Iowa Gambling Task Professional Manual. Lutz: Psychological Assessment Resources.
Bechara, A., and Damasio, H. (2002). Decision-making and addiction (part I): impaired activation of somatic states in substance dependent individuals when pondering decisions with negative future consequences. Neuropsychologia 40, 1675–1689. doi: 10.1016/S0028-3932(02)00015-5
Bechara, A., Damasio, A. R., Damasio, H., and Anderson, S. W. (1994). Insensitivity to future consequences following damage to human prefrontal cortex. Cognition 50, 7–15. doi: 10.1016/0010-0277(94)90018-3
Bechara, A., Damasio, H., Damasio, A. R., and Lee, G. P. (1999). Different contributions of the human amygdala and ventromedial prefrontal cortex to decision-making. J. Neurosci. 19, 5473–5481.
Bechara, A., Damasio, H., Tranel, D., and Anderson, S. W. (1998). Dissociation of working memory from decision making within the human prefrontal cortex. J. Neurosci. 18, 428–437.
Bechara, A., Tranel, D., Damasio, H., and Damasio, A. R. (1996). Failure to respond autonomically to anticipated future outcomes following damage to prefrontal cortex. Cereb. Cortex 6, 215–225. doi: 10.1093/cercor/6.2.215
Berman, K. F., Ostrem, J. L., Randolph, C., Gold, J., Goldberg, T. E., Coppola, R., et al. (1995). Physiological activation of a cortical network during performance of the Wisconsin Card Sorting Test: a positron emission tomography study. Neuropsychologia 33, 1027–1046. doi: 10.1016/0028-3932(95)00035-2
Bernoulli, D. (1738). Specimen theoriae novae de mensura sortis (Exposition of a new theory on the measurement of risk). Comentarii Acad Scient Petropolis 5, 23–36.
Björklund, A., and Dunnett, S. B. (2007). Dopamine neuron systems in the brain: an update. Trends Neurosci. 30, 194–202. doi: 10.1016/j.tins.2007.03.006
Bolla, K. I., Eldreth, D. A., London, E. D., Kiehl, K. A., Mouratidis, M., Contoreggi, C., et al. (2003). Orbitofrontal cortex dysfunction in abstinent cocaine abusers performing a decision-making task. Neuroimage 19, 1085–1094. doi: 10.1016/S1053-8119(03)00113-7
Brand, M., Grabenhorst, F., Starcke, K., Vandekerckhove, M. M. P., and Markowitsch, H. J. (2007a). Role of the amygdala in decisions under ambiguity and decisions under risk: evidence from patients with Urbach-Wiethe disease. Neuropsychologia 45, 1305–1317. doi: 10.1016/j.neuropsychologia.2006.09.021
Brand, M., Recknor, E. C., Grabenhorst, F., and Bechara, A. (2007b). Decisions under ambiguity and decisions under risk: correlations with executive functions and comparisons of two different gambling tasks with implicit and explicit rules. J. Clin. Exp. Neuropsychol. 29, 86–99. doi: 10.1080/13803390500507196
Braver, T. S., Ruge, H., Cabeza, R., and Kingstone, A. (2006). Functional neuroimaging of executive functions, in Handbook of Functional Neuroimaging of Cognition, Vol. 2, eds R. Cabeza and A. Kingstone (Cambridge, MA: MIT Press), 307–348.
Buckner, R. L., Andrews-Hanna, J. R., and Schacter, D. L. (2008). The brain's default network: anatomy, function, and relevance to disease. Ann. N.Y. Acad. Sci. 1124:1–38. doi: 10.1196/annals.1440.011
Buelow, M. T., and Suhr, J. A. (2009). Construct validity of the Iowa gambling task. Neuropsychol. Rev. 19, 102–114. doi: 10.1007/s11065-009-9083-4
Carandini, M., and Heeger, D. J. (2012). Normalization as a canonical neural computation. Nat. Rev. Neurosci. 13, 51–62. doi: 10.1038/nrn3136
Chang, S. W. C. (2013). Coordinate transformation approach to social interactions. Front. Neurosci. 7:147. doi: 10.3389/fnins.2013.00147
Chang, S. W. C., Barack, D. L., and Platt, M. L. (2012). Mechanistic classification of neural circuit dysfunctions: insights from neuroeconomics research in animals. Biol. Psychiatry 72, 101–106. doi: 10.1016/j.biopsych.2012.02.017
Chang, S. W. C., Gariépy, J.-F., and Platt, M. L. (2013). Neuronal reference frames for social decisions in primate frontal cortex. Nat. Neurosci. 16, 243–250. doi: 10.1038/nn.3287
Charnov, E. L. (1976). Optimal foraging, the marginal value theorem. Theor. Popul. Biol. 9, 129–136. doi: 10.1016/0040-5809(76)90040-X
Clark, L., Manes, F., Antoun, N., Sahakian, B. J., and Robbins, T. W. (2003). The contributions of lesion laterality and lesion volume to decision-making impairment following frontal lobe damage. Neuropsychologia 41, 1474–1483. doi: 10.1016/S0028-3932(03)00081-2
Cohen, Y. E., and Andersen, R. A. (2002). A common reference frame for movement plans in the posterior parietal cortex. Nat. Rev. Neurosci. 3, 553–562. doi: 10.1038/nrn873
Corcoran, R., and Upton, D. (1993). A role for the hippocampus in card sorting? Cortex 29, 293–304. doi: 10.1016/S0010-9452(13)80182-7
Cosgrove, G. R., and Rauch, S. L. (2003). Stereotactic cingulotomy. Neurosurg. Clin. N. Am. 14, 225–235. doi: 10.1016/S1042-3680(02)00115-8
Damasio, H., and Damasio, A. R. (1989). Lesion Analysis in Neuropsychology. Cambridge, UK: Oxford University Press.
Dougherty, D. D., and Greenberg, B. D. (2011). Neurobiology and Neurocircuitry of Obsessive-Compulsive Disorder and Relevance to Its Surgical Treatment. New York, NY: Cambridge University Press.
Ernst, M., Bolla, K., Mouratidis, M., Contoreggi, C., Matochik, J. A., Kurian, V., et al. (2002). Decision-making in a risk-taking task: a PET study. Neuropsychopharmacology 26, 682–691. doi: 10.1016/S0893-133X(01)00414-6
Etkin, A., Egner, T., and Kalisch, R. (2011). Emotional processing in anterior cingulate and medial prefrontal cortex. Trends Cogn. Sci. 15, 85–93. doi: 10.1016/j.tics.2010.11.004
Fellows, L. K. (2004). The cognitive neuroscience of human decision making: a review and conceptual framework. Behav. Cogn. Neurosci. Rev. 3, 159–172. doi: 10.1177/1534582304273251
Fellows, L. K., and Farah, M. J. (2005). Different underlying impairments in decision-making following ventromedial and dorsolateral frontal lobe damage in humans. Cereb. Cortex 15, 58–63. doi: 10.1093/cercor/bhh108
Fitzgerald, K. D., Stern, E. R., Angstadt, M., Nicholson-Muth, K. C., Maynor, M. R., Welsh, R. C., et al. (2010). Altered function and connectivity of the medial frontal cortex in pediatric obsessive-compulsive disorder. Biol. Psychiatry 68, 1039–1047. doi: 10.1016/j.biopsych.2010.08.018
Fitzgerald, K. D., Welsh, R. C., Gehring, W. J., Abelson, J. L., Himle, J. A., Liberzon, I., et al. (2005). Error-related hyperactivity of the anterior cingulate cortex in obsessive-compulsive disorder. Biol. Psychiatry 57, 287–294. doi: 10.1016/j.biopsych.2004.10.038
Gansler, D. A., Jerram, M. W., Vannorsdall, T. D., and Schretlen, D. J. (2011a). Comparing alternative metrics to assess performance on the Iowa Gambling Task. J. Clin. Exp. Neuropsychol. 33, 1040–1048. doi: 10.1080/13803395.2011.596820
Gansler, D. A., Jerram, M. W., Vannorsdall, T. D., and Schretlen, D. J. (2011b). Does the iowa gambling task measure executive function? Arch. Clin. Neuropsychol. 26, 706–717. doi: 10.1093/arclin/acr082
Giovagnoli, A. R. (2001). Relation of sorting impairment to hippocampal damage in temporal lobe epilepsy. Neuropsychologia 39, 140–150. doi: 10.1016/S0028-3932(00)00104-4
Glimcher, P. W., and Sparks, D. L. (1992). Movement selection in advance of action in the superior colliculus. Nature 355, 542–545. doi: 10.1038/355542a0
Gold, J. I., and Shadlen, M. N. (2001). Neural computations that underlie decisions about sensory stimuli. Trends Cogn. Sci. 5, 10–16. doi: 10.1016/S1364-6613(00)01567-9
Gold, J. I., and Shadlen, M. N. (2007). The neural basis of decision making. Annu. Rev. Neurosci. 30, 535–574. doi: 10.1146/annurev.neuro.29.051605.113038
Goldberg, E. (2001). The Executive Brain: Frontal Lobes and the Civilized Mind. New York, NY: Oxford University Press.
González-Hernández, J. A., Pita-Alcorta, C., Cedeno, I., Bosch-Bayard, J., Galán-Garcia, L., Scherbaum, W. A., et al. (2002). Wisconsin Card Sorting Test synchronizes the prefrontal, temporal and posterior association cortex in different frequency ranges and extensions. Hum. Brain Mapp. 17, 37–47. doi: 10.1002/hbm.10051
Grant, D. A., and Berg, E. (1948). A behavioral analysis of degree of reinforcement and ease of shifting to new responses in a Weigl-type card-sorting problem. J. Exp. Psychol. 38, 404. doi: 10.1037/h0059831
Graybiel, A. M., and Rauch, S. L. (2000). Toward a neurobiology of obsessive-compulsive disorder. Neuron 28, 343–347. doi: 10.1016/S0896-6273(00)00113-6
Greenberg, B. D., Rauch, S. L., and Haber, S. N. (2010). Invasive circuitry-based neurotherapeutics: stereotactic ablation and deep brain stimulation for OCD. Neuropsychopharmacology 35, 317–336. doi: 10.1038/npp.2009.128
Guehl, D., Benazzouz, A., Aouizerate, B., Cuny, E., Rotgé, J.-Y., Rougier, A., et al. (2008). Neuronal correlates of obsessions in the caudate nucleus. Biol. Psychiatry 63, 557–562. doi: 10.1016/j.biopsych.2007.06.023
Hayden, B. Y., and Platt, M. L. (2010). Neurons in anterior cingulate cortex multiplex information about reward and action. J. Neurosci. 30, 3339–3346. doi: 10.1523/JNEUROSCI.4874-09.2010
Hayden, B. Y., Pearson, J. M., and Platt, M. L. (2011). Neuronal basis of sequential foraging decisions in a patchy environment. Nat. Neurosci. 14, 933–939. doi: 10.1038/nn.2856
Heaton, R. K., Chelune, G. J., Talley, J. L., Kay, G. G., and Curtis, G. (1993). Wisconsin Card Sorting Test (WCST). Manual revised and expanded. Odessa, FL: Psychological Assessment Resources Inc.
Heekeren, H. R., Marrett, S., Bandettini, P. A., and Ungerleider, L. G. (2004). A general mechanism for perceptual decision-making in the human brain. Nature 431, 859–862. doi: 10.1038/nature02966
Hermann, B. P., Wyler, A. R., and Richey, E. T. (1988). Wisconsin Card Sorting Test performance in patients with complex partial seizures of temporal-lobe origin. J. Clin. Exp. Neuropsychol. 10, 467–476. doi: 10.1080/01688638808408253
Hernandez, A., Zainos, A., and Romo, R. (2002). Temporal evolution of a decision-making process in medial premotor cortex. Neuron 33, 959–972. doi: 10.1016/S0896-6273(02)00613-X
Herz, A. V. M., Gollisch, T., Machens, C. K., and Jaeger, D. (2006). Modeling single-neuron dynamics and computations: a balance of detail and abstraction. Science 314, 80–85. doi: 10.1126/science.1127240
Hills, T. T., Todd, P. M., and Goldstone, R. L. (2008). Search in external and internal spaces evidence for generalized cognitive search processes. Psychol. Sci. 19, 802–808. doi: 10.1111/j.1467-9280.2008.02160.x
Horner, M. D., Flashman, L. A., Freides, D., Epstein, C. M., and Bakay, R. A. E. (1996). Temporal lobe epilepsy and performance on the Wisconsin Card Sorting Test. J. Clin. Exp. Neuropsychol. 18, 310–313. doi: 10.1080/01688639608408285
Igarashi, K., Oguni, H., Osawa, M., Awaya, Y., Kato, M., Mimura, M., et al. (2002). Wisconsin card sorting test in children with temporal lobe epilepsy. Brain Dev. 24, 174–178. doi: 10.1016/S0387-7604(02)00024-4
Kawasaki, Y., Maeda, Y., Suzuki, M., Urata, K., Higashima, M., Kiba, K., et al. (1993). SPECT analysis of regional cerebral blood flow changes in patients with schizophrenia during the Wisconsin Card Sorting Test. Schizophr. Res. 10, 109–116. doi: 10.1016/0920-9964(93)90045-K
Kennerley, S. W., Walton, M. E., Behrens, T. E., Buckley, M. J., and Rushworth, M. F. (2006). Optimal decision making and the anterior cingulate cortex. Nat. Neurosci. 9, 940–947. doi: 10.1038/nn1724
Kepecs, A., Uchida, N., and Mainen, Z. F. (2006). The sniff as a unit of olfactory processing. Chem. Senses 31, 167–179. doi: 10.1093/chemse/bjj016
Kim, C. H., Chang, J. W., Koo, M. S., Kim, J. W., Suh, H. S., Park, I. H., et al. (2003). Anterior cingulotomy for refractory obsessive-compulsive disorder. Acta Psychiatr. Scand. 107, 283–290. doi: 10.1034/j.1600-0447.2003.00087.x
Lie, C.-H., Specht, K., Marshall, J. C., and Fink, G. R. (2006). Using fMRI to decompose the neural processes underlying the wisconsin card sorting Test. Neuroimage 30, 1038–1049. doi: 10.1016/j.neuroimage.2005.10.031
Lombardi, W. J., Andreason, P. J., Sirocco, K. Y., Rio, D. E., Gross, R. E., Umhau, J. C., et al. (1999). Wisconsin Card Sorting Test performance following head injury: Dorsolateral fronto-striatal circuit activity predicts perseveration. J. Clin. Exp. Neuropsychol. 21, 2–16. doi: 10.1076/jcen.21.1.2.940
Louie, K., Grattan, L. E., and Glimcher, P. W. (2011). Reward value-based gain control: divisive normalization in parietal cortex. J. Neurosci. 31, 10627–10639. doi: 10.1523/JNEUROSCI.1237-11.2011
Maia, T. V., Cooney, R. E., and Peterson, B. S. (2008). The neural bases of obsessive–compulsive disorder in children and adults. Dev. Psychopathol. 20, 1251–1283. doi: 10.1017/S0954579408000606
Maia, T. V., and Frank, M. J. (2011). From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 14, 154–162. doi: 10.1038/nn.2723
Maia, T. V., and McClelland, J. L. (2012). A neurocomputational approach to obsessive-compulsive disorder. Trends Cogn. Sci. 16, 14–15. doi: 10.1016/j.tics.2011.11.011
Maltby, N., Tolin, D. F., Worhunsky, P., O'Keefe, T. M., and Kiehl, K. A. (2005). Dysfunctional action monitoring hyperactivates frontal–striatal circuits in obsessive–compulsive disorder: an event-related fMRI study. Neuroimage 24, 495–503. doi: 10.1016/j.neuroimage.2004.08.041
Manes, F., Sahakian, B., Clark, L., Rogers, R., Antoun, N., Aitken, M., et al. (2002). Decision-making processes following damage to the prefrontal cortex. Brain 125, 624–639. doi: 10.1093/brain/awf049
Marenco, S., Coppola, R., Daniel, D. G., Zigun, J. R., and Weinberger, D. R. (1993). Regional cerebral blood flow during the Wisconsin Card Sorting Test in normal subjects studied by Xenon-133 Dynamic SPECT: comparison of absolute values, percent distribution values and covariance analysis. Psychiatry Res. 50, 177–192. doi: 10.1016/0925-4927(93)90029-H
Marr, D. (1982). Vision: A Computational Investigation into The Human Representation and Processing of Visual Information. New York, NY: Henry Holt and Co Inc.
McCoy, A. N., and Platt, M. L. (2005). Risk-sensitive neurons in macaque posterior cingulate cortex. Nat. Neurosci. 8, 1220–1227. doi: 10.1038/nn1523
Mentzel, H.-J., Gaser, C., Volz, H.-P., Rzanny, R., Häger, F., Sauer, H., et al. (1998). Cognitive stimulation with the Wisconsin Card Sorting Test: functional MR imaging at 1.5 T. Radiology 207, 399–404. doi: 10.1148/radiology.207.2.9577487
Menzies, L., Chamberlain, S. R., Laird, A. R., Thelen, S. M., Sahakian, B. J., and Bullmore, E. T. (2008). Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci. Biobehav. Rev. 32, 525–549. doi: 10.1016/j.neubiorev.2007.09.005
Milner, B. (1963). Effects of different brain lesions on card sorting: The role of the frontal lobes. Arch. Neurol. 9, 90–100. doi: 10.1001/archneur.1963.00460070100010
Monchi, O., Petrides, M., Petre, V., Worsley, K., and Dagher, A. (2001). Wisconsin Card Sorting revisited: distinct neural circuits participating in different stages of the task identified by event-related functional magnetic resonance imaging. J. Neurosci. 21, 7733–7741.
Montague, P. R., Dolan, R. J., Friston, K. J., and Dayan, P. (2012). Computational psychiatry. Trends Cogn. Sci. 16, 72–80. doi: 10.1016/j.tics.2011.11.018
Mukhopadhyay, P., Dutt, A., Das, S. K., Basu, A., Hazra, A., Dhibar, T., et al. (2007). Identification of neuroanatomical substrates of set-shifting ability: evidence from patients with focal brain lesions. Prog. Brain Res. 168, 95–104. doi: 10.1016/S0079-6123(07)68008-X
Nagahama, Y., Fukuyama, H., Yamauchi, H., Matsuzaki, S., Konishi, J., Shibasaki, H., et al. (1996). Cerebral activation during performance of a card sorting test. Brain 119, 1667–1676. doi: 10.1093/brain/119.5.1667
Nagahama, Y., Fukuyama, H., Yamauchi, H., Katsumi, Y., Magata, Y., Shibasaki, H., et al. (1997). Age-related changes in cerebral blood flow activation during a Card Sorting Test. Exp. Brain Res. 114, 571–577. doi: 10.1007/PL00005665
Nagahama, Y., Sadato, N., Yamauchi, H., Katsumi, Y., Hayashi, T., Fukuyama, H., et al. (1998). Neural activity during attention shifts between object features. Neuroreport 9, 2633–2638. doi: 10.1097/00001756-199808030-00038
Nenadic, I. (2008). Targeting brain regions and symptoms: neuronal single-unit recordings and deep brain stimulation in obsessive-compulsive disorder. Biol. Psychiatry 63, 542–543. doi: 10.1016/j.biopsych.2008.01.014
Noonan, M. P., Walton, M. E., Behrens, T. E. J., Sallet, J., Buckley, M. J., and Rushworth, M. F. S. (2010). Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex. Proc. Natl. Acad. Sci. U.S.A. 107, 20547–20552. doi: 10.1073/pnas.1012246107
Nyhus, E., and Barceló, F. (2009). The Wisconsin Card Sorting Test and the cognitive assessment of prefrontal executive functions: a critical update. Brain Cogn. 71, 437–451. doi: 10.1016/j.bandc.2009.03.005
Ohshiro, T., Angelaki, D. E., and DeAngelis, G. C. (2011). A normalization model of multisensory integration. Nat. Neurosci. 14, 775–782. doi: 10.1038/nn.2815
Padoa-Schioppa, C., and Assad, J. A. (2006). Neurons in the orbitofrontal cortex encode economic value. Nature 441, 223–226. doi: 10.1038/nature04676
Page, L. A., Rubia, K., Deeley, Q., Daly, E., Toal, F., Mataix-Cols, D., et al. (2009). A functional magnetic resonance imaging study of inhibitory control in obsessive-compulsive disorder. Psychiatry Res. 174, 202–209. doi: 10.1016/j.pscychresns.2009.05.002
Platt, M. L., and Glimcher, P. W. (1999). Neural correlates of decision variables in parietal cortex. Nature 400, 233–238. doi: 10.1038/22268
Poggio, T. (1990). A theory of how the brain might work. Cold Spring Harb. Symp. Quant. Biol. 55, 899–910.
Pouget, A., and Snyder, L. H. (2000). Computational approaches to sensorimotor transformations. Nat. Neurosci. 3, 1192–1198. doi: 10.1038/81469
Ragland, J. D., Gur, R. C., Glahn, D. C., Censits, D. M., Smith, R. J., Lazarev, M. G., et al. (1998). Frontotemporal cerebral blood flow change during executive and declarative memory tasks in schizophrenia: a positron emission tomography study. Neuropsychology 12, 399. doi: 10.1037/0894-4105.12.3.399
Rauch, S. L., Dougherty, D. D., Cosgrove, G. R., Cassem, E. H., Alpert, N. M., Price, B. H., et al. (2001). Cerebral metabolic correlates as potential predictors of response to anterior cingulotomy for obsessive compulsive disorder. Biol. Psychiatry 50, 659–667. doi: 10.1016/S0006-3223(01)01188-X
Rauch, S. L., Jenike, M. A., Alpert, N. M., Baer, L., Breiter, H. C., Savage, C. R., et al. (1994). Regional cerebral blood flow measured during symptom provocation in obsessive-compulsive disorder using oxygen 15—labeled carbon dioxide and positron emission tomography. Arch. Gen. Psychiatry 51, 62–70. doi: 10.1001/archpsyc.1994.03950010062008
Reynolds, J. H., and Heeger, D. J. (2009). The normalization model of attention. Neuron 61, 168–185. doi: 10.1016/j.neuron.2009.01.002
Ridderinkhof, K. R., Ullsperger, M., Crone, E. A., and Nieuwenhuis, S. (2004). The role of the medial frontal cortex in cognitive control. Science 306, 443–447. doi: 10.1126/science.1100301
Robbins, T. W., Gillan, C. M., Smith, D. G., de Wit, S., and Ersche, K. D. (2012). Neurocognitive endophenotypes of impulsivity and compulsivity: towards dimensional psychiatry. Trends Cogn. Sci. 16, 81–91. doi: 10.1016/j.tics.2011.11.009
Rogers, P. (1998). The cognitive psychology of lottery gambling: a theoretical review. J. Gambl. Stud. 14, 111–134. doi: 10.1023/A:1023042708217
Rogers, R. L., Andrews, T. K., Grasby, P. M., Brooks, D. J., and Robbins, T. W. (2000). Contrasting cortical and subcortical activations produced by attentional-set shifting and reversal learning in humans. J. Cogn. Neurosci. 12, 142–162. doi: 10.1162/089892900561931
Roitman, J. D., and Shadlen, M. N. (2002). Response of neurons in the lateral intraparietal area during a combined visual discrimination reaction time task. J. Neurosci. 22, 9475–9489.
Rolls, E. T., Loh, M., and Deco, G. (2008). An attractor hypothesis of obsessive–compulsive disorder. Eur. J. Neurosci. 28, 782–793. doi: 10.1111/j.1460-9568.2008.06379.x
Romo, R., Hernandez, A., and Zainos, A. (2004). Neuronal correlates of a perceptual decision in ventral premotor cortex. Neuron 41, 165–173. doi: 10.1016/S0896-6273(03)00817-1
Rubinstein, J. S., Meyer, D. E., and Evans, J. E. (2001). Executive control of cognitive processes in task switching. J. Exp. Psychol. 27, 763. doi: 10.1037/0096-1523.27.4.763
Rudebeck, P. H., Buckley, M. J., Walton, M. E., and Rushworth, M. F. (2006). A role for the macaque anterior cingulate gyrus in social valuation. Science 313, 1310–1312. doi: 10.1126/science.1128197
Rushworth, M. F., Hadland, K. A., Gaffan, D., and Passingham, R. E. (2003). The effect of cingulate cortex lesions on task switching and working memory. J. Cogn. Neurosci. 15, 338–353. doi: 10.1162/089892903321593072
Rutledge, R. B., Lazzaro, S. C., Lau, B., Myers, C. E., Gluck, M. A., and Glimcher, P. W. (2009). Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task. J. Neurosci. 29, 15104–15114. doi: 10.1523/JNEUROSCI.3524-09.2009
Saxena, S., Brody, A. L., Schwartz, J. M., and Baxter, L. R. (1998). Neuroimaging and frontal-subcortical circuitry in obsessive-compulsive disorder. Br. J. Psychiatry Suppl. 173, 26–37.
Schlund, M. W. (2002). The effects of brain injury on choice and sensitivity to remote consequences: deficits in discriminating response-consequence relations. Brain Injury 16, 347–357. doi: 10.1080/02699050110103977
Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. doi: 10.1126/science.275.5306.1593
Schultz, W., Tremblay, L., and Hollerman, J. R. (1998). Reward prediction in primate basal ganglia and frontal cortex. Neuropharmacology 37, 421–429. doi: 10.1016/S0028-3908(98)00071-9
Seung, H. S. (1996). How the brain keeps the eyes still. Proc. Natl. Acad. Sci. U.S.A. 93, 13339–13344. doi: 10.1073/pnas.93.23.13339
Seung, H. S. (2003). Amplification, attenuation, and integration, in The Handbook of Brain Theory and Neural Networks, Vol. 2, ed M. A. Arbib (Cambridge, MA: MIT Press), 94–97.
Shallice, T. (2006). Contrasting domains in the control of action: the routine and the non-routine, in Attention and Performance XXI: Processes of Change in Brain and Cognitive Development, eds M. H. Johnson and Y. Munakata (Cambridge, UK: Oxford University Press), 3–29.
Shepherd, S. V. (2010). Following gaze: gaze-following behavior as a window into social cognition. Front. Integr. Neurosci. 4:5. doi: 10.3389/fnint.2010.00005
Sheth, S. A., Mian, M. K., Patel, S. R., Asaad, W. F., Williams, Z. M., Dougherty, D. D., et al. (2012). Human dorsal anterior cingulate cortex neurons mediate ongoing behavioural adaptation. Nature 488, 218–221. doi: 10.1038/nature11239
Shidara, M., and Richmond, B. J. (2002). Anterior cingulate: single neuronal signals related to degree of reward expectancy. Science 296, 1709–1711. doi: 10.1126/science.1069504
Stephens, D. W., and Krebs, J. R. (1986). Foraging Theory. Princeton, NJ: Princeton University Press.
Strauss, E., Hunter, M., and Wada, J. (1993). Wisconsin Card Sorting Performance: Effects of age of onset of damage and laterality of dysfunction. J. Clin. Exp. Neuropsychol. 15, 896–902. doi: 10.1080/01688639308402606
Szeszko, P. R., Christian, C., MacMaster, F., Lencz, T., Mirza, Y., Taormina, S. P., et al. (2008). Gray matter structural alterations in psychotropic drug-naive pediatric obsessive-compulsive disorder: an optimized voxel-based morphometry study. Am. J. Psychiatry 165, 1299–1307. doi: 10.1176/appi.ajp.2008.08010033
Tass, P. A. (2003). A model of desynchronizing deep brain stimulation with a demand-controlled coordinated reset of neural subpopulations. Biol. Cybern. 89, 81–88. doi: 10.1007/s00422-003-0425-7
Tranel, D., Bechara, A., and Denburg, N. L. (2002). Asymmetric functional roles of right and left ventromedial prefrontal cortices in social conduct, decision-making, and emotional processing. Cortex 38, 589–612. doi: 10.1016/S0010-9452(08)70024-8
Tucker, K. A., Potenza, M. N., Beauvais, J. E., Browndyke, J. N., Gottschalk, P. C., and Kosten, T. R. (2004). Perfusion abnormalities and decision making in cocaine dependence. Biol. Psychiatry 56, 527–530. doi: 10.1016/j.biopsych.2004.06.031
Uchida, N., Kepecs, A., and Mainen, Z. F. (2006). Seeing at a glance, smelling in a whiff: rapid forms of perceptual decision making. Nat. Rev. Neurosci. 7, 485–491. doi: 10.1038/nrn1933
Uchida, N., and Mainen, Z. F. (2003). Speed and accuracy of olfactory discrimination in the rat. Nat. Neurosci. 6, 1224–1229. doi: 10.1038/nn1142
Uka, T., and DeAngelis, G. C. (2003). Contribution of middle temporal area to coarse depth discrimination: comparison of neuronal and psychophysical sensitivity. J. Neurosci. 23, 3515–3530.
Uka, T., and DeAngelis, G. C. (2006). Linking neural representation to function in stereoscopic depth perception: roles of the middle temporal area in coarse versus fine disparity discrimination. J. Neurosci. 26, 6791–6802. doi: 10.1523/JNEUROSCI.5435-05.2006
Usher, M., and McClelland, J. L. (2001). The time course of perceptual choice: the leaky, competing accumulator model. Psychol. Rev. 108:550. doi: 10.1037/0033-295X.108.3.550
Vecera, S. P., and Rizzo, M. (2004). What are you looking at: impaired ‘social attention'following frontal-lobe damage. Neuropsychologia 42, 1657–1665. doi: 10.1016/j.neuropsychologia.2004.04.009
Vecera, S. P., and Rizzo, M. (2006). Eye gaze does not produce reflexive shifts of attention: Evidence from frontal-lobe damage. Neuropsychologia 44, 150–159. doi: 10.1177/0301006615594936
Volz, H.-P., Gaser, C., Häger, F., Rzanny, R., Mentzel, H.-J., Kreitschmann-Andermahr, I., et al. (1997). Brain activation during cognitive stimulation with the Wisconsin Card Sorting Test—a functional MRI study on healthy volunteers and schizophrenics. Psychiatry Res. 75, 145–157. doi: 10.1016/S0925-4927(97)00053-X
Walton, M. E., Behrens, T. E. J., Buckley, M. J., Rudebeck, P. H., and Rushworth, M. F. S. (2010). Separable learning systems in the macaque brain and the role of orbitofrontal cortex in contingent learning. Neuron 65, 927–939. doi: 10.1016/j.neuron.2010.02.027
Wang, L., Kakigi, R., and Hoshiyama, M. (2001). Neural activities during Wisconsin Card Sorting Test—MEG observation. Cogn. Brain Res. 12, 19–31. doi: 10.1016/S0926-6410(01)00022-2
Wang, X. J. (2002). Probabilistic decision making by slow reverberation in cortical circuits. Neuron 36, 955–968. doi: 10.1016/S0896-6273(02)01092-9
Watson, K. K., and Platt, M. L. (2012). Social signals in primate orbitofrontal cortex. Curr. Biol. 22, 2268–2273. doi: 10.1016/j.cub.2012.10.016
Weber, E. U., Shafir, S., and Blais, A. R. (2004). Predicting risk sensitivity in humans and lower animals: risk as variance or coefficient of variation. Psychol. Rev. 111, 430–445. doi: 10.1016/S0022-3549(15)00173-2
Williams, S. M., and Goldman-Rakic, P. S. (1993). Characterization of the dopaminergic innervation of the primate frontal cortex using a dopamine-specific antibody. Cereb. Cortex 3, 199–222. doi: 10.1093/cercor/3.3.199
Keywords: decision-making, computational psychiatry, neuropsychology, executive function, wisconsin card sorting test, Iowa Gambling Task, medial prefrontal cortex (mPFC)
Citation: Barack DL and Platt ML (2016) Neurocomputational Nosology: Malfunctions of Models and Mechanisms. Front. Psychol. 7:602. doi: 10.3389/fpsyg.2016.00602
Received: 22 December 2015; Accepted: 11 April 2016;
Published: 03 May 2016.
Edited by:
Alexandre Heeren, Harvard University, USAReviewed by:
Henryk Bukowski, Université Catholique de Louvain, BelgiumPatrick De Zeeuw, Utrecht University, Netherlands
Copyright © 2016 Barack and Platt. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Correspondence: David L. Barack, dbarack@gmail.com