Modulators of decision making

被引:425
作者
Doya, Kenji [1 ,2 ]
机构
[1] Okinawa Inst Sci & Technol, Neural Computat Unit, Okinawa 9042234, Japan
[2] Computat Neurosci Labs, ATR, Kyoto 6190288, Japan
关键词
D O I
10.1038/nn2077
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Human and animal decisions are modulated by a variety of environmental and intrinsic contexts. Here I consider computational factors that can affect decision making and review anatomical structures and neurochemical systems that are related to contextual modulation of decision making. Expectation of a high reward can motivate a subject to go for an action despite a large cost, a decision that is influenced by dopamine in the anterior cingulate cortex. Uncertainty of action outcomes can promote risk taking and exploratory choices, in which norepinephrine and the orbitofrontal cortex appear to be involved. Predictable environments should facilitate consideration of longer-delayed rewards, which depends on serotonin in the dorsal striatum and dorsal prefrontal cortex. This article aims to sort out factors that affect the process of decision making from the viewpoint of reinforcement learning theory and to bridge between such computational needs and their neurophysiological substrates.
引用
收藏
页码:410 / 416
页数:7
相关论文
共 88 条
[1]   An integrative theory of locus coeruleus-norepinephrine function: Adaptive gain and optimal performance [J].
Aston-Jones, G ;
Cohen, JD .
ANNUAL REVIEW OF NEUROSCIENCE, 2005, 28 :403-450
[2]   The role of the dorsal striatum in reward and decision-making [J].
Balleine, Bernard W. ;
Delgado, Mauricio R. ;
Hikosaka, Okihide .
JOURNAL OF NEUROSCIENCE, 2007, 27 (31) :8161-8165
[3]   Parallel incentive processing: an integrated view of amygdala function [J].
Balleine, BW ;
Killcross, S .
TRENDS IN NEUROSCIENCES, 2006, 29 (05) :272-279
[4]   Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits [J].
Balleine, BW .
PHYSIOLOGY & BEHAVIOR, 2005, 86 (05) :717-730
[6]   Learning the value of information in an uncertain world [J].
Behrens, Timothy E. J. ;
Woolrich, Mark W. ;
Walton, Mark E. ;
Rushworth, Matthew F. S. .
NATURE NEUROSCIENCE, 2007, 10 (09) :1214-1221
[7]   Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala [J].
Belova, Marina A. ;
Paton, Joseph J. ;
Morrison, Sara E. ;
Salzman, C. Daniel .
NEURON, 2007, 55 (06) :970-984
[8]   Intertemporal choice - toward an integrative framework [J].
Berns, Gregory S. ;
Laibson, David ;
Loewenstein, George .
TRENDS IN COGNITIVE SCIENCES, 2007, 11 (11) :482-488
[9]   Network reset: a simplified overarching theory of locus coeruleus noradrenaline function [J].
Bouret, S ;
Sara, SJ .
TRENDS IN NEUROSCIENCES, 2005, 28 (11) :574-582
[10]   Effects of lesions of the nucleus accumbens core on choice between small certain rewards and large uncertain rewards in rats [J].
Cardinal, RN ;
Howes, NJ .
BMC NEUROSCIENCE, 2005, 6 (1)