Role of Striatum in Updating Values of Chosen Actions

被引:155
作者
Kim, Hoseok [1 ]
Sul, Jung Hoon [1 ]
Huh, Namjung [1 ]
Lee, Daeyeol [2 ]
Jung, Min Whan [1 ]
机构
[1] Ajou Univ, Sch Med, Inst Med Sci, Neurosci Lab, Suwon 443721, South Korea
[2] Yale Univ, Sch Med, Dept Neurobiol, New Haven, CT 06510 USA
关键词
MIXED-STRATEGY GAME; NUCLEUS-ACCUMBENS NEURONS; BASAL GANGLIA; PREFRONTAL CORTEX; VENTRAL STRIATUM; DECISION-MAKING; DOPAMINE NEURONS; DORSAL STRIATUM; MATCHING BEHAVIOR; MIDBRAIN DOPAMINE;
D O I
10.1523/JNEUROSCI.2728-09.2009
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The striatum is thought to play a crucial role in value-based decision making. Although a large body of evidence suggests its involvement in action selection as well as action evaluation, underlying neural processes for these functions of the striatum are largely unknown. To obtain insights on this matter, we simultaneously recorded neuronal activity in the dorsal and ventral striatum of rats performing a dynamic two-armed bandit task, and examined temporal profiles of neural signals related to animal's choice, its outcome, and action value. Whereas significant neural signals for action value were found in both structures before animal's choice of action, signals related to the upcoming choice were relatively weak and began to emerge only in the dorsal striatum similar to 200 ms before the behavioral manifestation of the animal's choice. In contrast, once the animal revealed its choice, signals related to choice and its value increased steeply and persisted until the outcome of animal's choice was revealed, so that some neurons in both structures concurrently conveyed signals related to animal's choice, its outcome, and the value of chosen action. Thus, all the components necessary for updating values of chosen actions were available in the striatum. These results suggest that the striatum not only represents values associated with potential choices before animal's choice of action, but might also update the value of chosen action once its outcome is revealed. In contrast, action selection might take place elsewhere or in the dorsal striatum only immediately before its behavioral manifestation.
引用
收藏
页码:14701 / 14712
页数:12
相关论文
共 63 条
[1]   THE FUNCTIONAL-ANATOMY OF BASAL GANGLIA DISORDERS [J].
ALBIN, RL ;
YOUNG, AB ;
PENNEY, JB .
TRENDS IN NEUROSCIENCES, 1989, 12 (10) :366-375
[2]   PREPARATION FOR MOVEMENT - NEURAL REPRESENTATIONS OF INTENDED DIRECTION IN 3 MOTOR AREAS OF THE MONKEY [J].
ALEXANDER, GE ;
CRUTCHER, MD .
JOURNAL OF NEUROPHYSIOLOGY, 1990, 64 (01) :133-150
[3]   FUNCTIONAL ARCHITECTURE OF BASAL GANGLIA CIRCUITS - NEURAL SUBSTRATES OF PARALLEL PROCESSING [J].
ALEXANDER, GE ;
CRUTCHER, MD .
TRENDS IN NEUROSCIENCES, 1990, 13 (07) :266-271
[4]   NEURONAL-ACTIVITY IN MONKEY STRIATUM RELATED TO THE EXPECTATION OF PREDICTABLE ENVIRONMENTAL EVENTS [J].
APICELLA, P ;
SCARNATI, E ;
LJUNGBERG, T ;
SCHULTZ, W .
JOURNAL OF NEUROPHYSIOLOGY, 1992, 68 (03) :945-960
[5]   Separate neural substrates for skill learning and performance in the ventral and dorsal striatum [J].
Atallah, Hisham E. ;
Lopez-Paniagua, Dan ;
Rudy, Jerry W. ;
O'Reilly, Randall C. .
NATURE NEUROSCIENCE, 2007, 10 (01) :126-131
[6]   Fast spiking and regular spiking neural correlates of fear conditioning in the medial prefrontal cortex of the rat [J].
Baeg, EH ;
Kim, YB ;
Jang, J ;
Kim, HT ;
Mook-Jung, I ;
Jung, MW .
CEREBRAL CORTEX, 2001, 11 (05) :441-451
[7]   Dynamics of population code for working memory in the prefrontal cortex [J].
Baeg, EH ;
Kim, YB ;
Huh, K ;
Mook-Jung, I ;
Kim, HT ;
Jung, MW .
NEURON, 2003, 40 (01) :177-188
[8]   Learning-induced enduring changes in functional connectivity among prefrontal cortical neurons [J].
Baeg, Eun H. ;
Kim, Yun B. ;
Kim, Jieun ;
Ghim, Jeong-Wook ;
Kim, Jeansok J. ;
Jung, Min W. .
JOURNAL OF NEUROSCIENCE, 2007, 27 (04) :909-918
[9]   The role of the dorsal striatum in reward and decision-making [J].
Balleine, Bernard W. ;
Delgado, Mauricio R. ;
Hikosaka, Okihide .
JOURNAL OF NEUROSCIENCE, 2007, 27 (31) :8161-8165
[10]   Prefrontal cortex and decision making in a mixed-strategy game [J].
Barraclough, DJ ;
Conroy, ML ;
Lee, D .
NATURE NEUROSCIENCE, 2004, 7 (04) :404-410