The Role of Striatal Tonically Active Neurons in Reward Prediction Error Signaling during Instrumental Task Performance

被引:50
作者
Apicella, Paul [1 ]
Ravel, Sabrina [1 ]
Deffains, Marc [1 ]
Legallet, Eric [1 ]
机构
[1] Univ Aix Marseille 1, CNRS, Lab Neurobiol Cognit, F-13331 Marseille 3, France
关键词
CM-PF COMPLEX; CHOLINERGIC INTERNEURONS; MONKEY STRIATUM; PRIMATES STRIATUM; CAUDATE-NUCLEUS; DORSAL STRIATUM; HUMAN BRAIN; RESPONSES; DOPAMINE; MODULATION;
D O I
10.1523/JNEUROSCI.4880-10.2011
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
The detection of differences between predictions and actual outcomes is important for associative learning and for selecting actions according to their potential future reward. There are reports that tonically active neurons (TANs) in the primate striatum may carry information about errors in the prediction of rewards. However, this property seems to be expressed in classical conditioning tasks but not during performance of an instrumental task. To address this issue, we recorded the activity of TANs in the putamen of two monkeys performing an instrumental task in which probabilistic rewarding outcomes were contingent on an action in block-design experiments. Behavioral evidence suggests that animals adjusted their performance according to the level of probability for reward on each trial block. We found that the TAN response to reward was stronger as the reward probability decreased; this effect was especially prominent on the late component of the pause-rebound pattern of typical response seen in these neurons. The responsiveness to reward omission was also increased with increasing reward probability, whereas there were no detectable effects on responses to the stimulus that triggered the movement. Overall, the modulation of TAN responses by reward probability appeared relatively weak compared with that observed previously in a probabilistic classical conditioning task using the same block design. These data indicate that instrumental conditioning was less effective at demonstrating prediction error signaling in TANs. We conclude that the sensitivity of the TAN system to reward probability depends on the specific learning situation in which animals experienced the stimulus-reward associations.
引用
收藏
页码:1507 / 1515
页数:9
相关论文
共 42 条
[1]   TEMPORAL AND SPATIAL CHARACTERISTICS OF TONICALLY ACTIVE NEURONS OF THE PRIMATES STRIATUM [J].
AOSAKI, T ;
KIMURA, M ;
GRAYBIEL, AM .
JOURNAL OF NEUROPHYSIOLOGY, 1995, 73 (03) :1234-1252
[2]  
AOSAKI T, 1994, J NEUROSCI, V14, P3969
[3]   Responses of tonically discharging neurons in the monkey striatum to primary rewards delivered during different behavioral states [J].
Apicella, P ;
Legallet, E ;
Trouche, E .
EXPERIMENTAL BRAIN RESEARCH, 1997, 116 (03) :456-466
[4]   Leading tonically active neurons of the striatum from reward detection to context recognition [J].
Apicella, Paul .
TRENDS IN NEUROSCIENCES, 2007, 30 (06) :299-306
[5]   Tonically active neurons in the striatum differentiate between delivery and omission of expected reward in a probabilistic task context [J].
Apicella, Paul ;
Deffains, Marc ;
Ravel, Sabrina ;
Legallet, Eric .
EUROPEAN JOURNAL OF NEUROSCIENCE, 2009, 30 (03) :515-526
[6]  
Bennett BD, 1998, J NEUROSCI, V18, P8539
[7]   Anticipating instrumentally obtained and passively-received rewards: A factorial fMRI investigation [J].
Bjork, James M. ;
Hommer, Daniel W. .
BEHAVIOURAL BRAIN RESEARCH, 2007, 177 (01) :165-170
[8]   The computational neurobiology of learning and reward [J].
Daw, ND ;
Doya, K .
CURRENT OPINION IN NEUROBIOLOGY, 2006, 16 (02) :199-204
[9]   Reward, motivation, and reinforcement learning [J].
Dayan, P ;
Balleine, BW .
NEURON, 2002, 36 (02) :285-298
[10]   Involvement of Ih in dopamine modulation of tonic firing in striatal cholinergic interneurons [J].
Deng, Ping ;
Zhang, Yuchun ;
Xu, Zao C. .
JOURNAL OF NEUROSCIENCE, 2007, 27 (12) :3148-3156