AUTHOR=Friston Karl , Schwartenbeck Philipp , Fitzgerald Thomas , Moutoussis Michael , Behrens Tim , Dolan Raymond J.

TITLE=The anatomy of choice: active inference and agency

JOURNAL=Frontiers in Human Neuroscience

VOLUME=Volume 7 - 2013

YEAR=2013

URL=https://www.frontiersin.org/journals/human-neuroscience/articles/10.3389/fnhum.2013.00598

DOI=10.3389/fnhum.2013.00598

ISSN=1662-5161

ABSTRACT=This paper considers agency in the setting of embodied or active inference. In brief, we associate a sense of agency with prior beliefs about action and ask what sorts of beliefs underlie optimal behaviour. In particular, we consider prior beliefs that action minimises the Kullback-Leibler divergence between desired states and attainable states in the future. This allows one to formulate bounded rationality as approximate Bayesian inference that optimises a free energy bound on model evidence. We show that constructs like expected utility, exploration bonuses, softmax choice rules and optimism bias emerge as natural consequences of this formulation. Previous accounts of active inference have focused on predictive coding and Bayesian filtering schemes for minimising free energy. Here, we consider variational Bayes as an alternative scheme that provides formal constraints on the computational anatomy of inference and action – constraints that are remarkably consistent with neuroanatomy. Furthermore, this scheme contextualises optimal decision theory and economic (utilitarian) formulations as pure inference problems. For example, expected utility theory emerges as a special case of free energy minimisation, where the sensitivity or inverse temperature (of softmax functions and quantal response equilibria) has a unique and Bayes-optimal solution – that minimises free energy. This sensitivity corresponds to the precision of beliefs about behaviour, such that attainable goals are afforded a higher precision or confidence. In turn, this means that optimal behaviour entails a representation of confidence about outcomes that are under an agent's control.