Influence of reward expectation on behavior-related neuronal activity in primate striatum

被引:288
作者
Hollerman, JR [1 ]
Tremblay, L [1 ]
Schultz, W [1 ]
机构
[1] Univ Fribourg, Inst Physiol, CH-1700 Fribourg, Switzerland
关键词
D O I
10.1152/jn.1998.80.2.947
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Rewards constitute important goals for voluntary behavior. This study aimed to investigate how expected rewards influence behavior-related neuronal activity in the anterior striatum. In a delayed go-nogo task, monkeys executed or withheld a reaching movement and obtained liquid or sound as reinforcement. An initial instruction picture indicated the behavioral reaction to be performed and the reinforcer to be obtained after a subsequent trigger stimulus. Movements varied according to the reinforcers predicted by the instructions, suggesting that animals differentially expected the two outcomes. bout 250 of nearly 1,500 neurons in anterior parts of caudate nucleus, putamen, and ventral striatum showed typical task-related activations that reflected the expectation of instructions and trigger, and the preparation, initiation, and execution of behavioral reactions. Strikingly, most task-related activations occurred only when liquid reward was delivered at trial end, rather than the reinforcing sound. Activations close to the time of reward showed similar preferences for Liquid reward over the reinforcing sound, suggesting a relationship to the expectation or detection of the motivational outcome of the trial rather than to a "correct" or ''end-of-trial'' signal. By contrast, relatively few activations in the present task occurred irrespective of the type of reinforcement. In conclusion, many of the behavior-related neurons investigated in the anterior striatum were influenced by an upcoming primary liquid reward and did not appear to code behavioral acts in a motivationally neutral manner. Rather, these neurons incorporated information about the expected outcome into their behavior-related activity. The activations influenced by reward several seconds before its occurrence may constitute a neuronal basis for the retrograde effects of rewards on behavioral reactions.
引用
收藏
页码:947 / 963
页数:17
相关论文
共 63 条
[1]   THE ROLE OF THE BASAL GANGLIA IN CONTROLLING A MOVEMENT INITIATED BY A VISUALLY PRESENTED CUE [J].
ALDRIDGE, JW ;
ANDERSON, RJ ;
MURPHY, JT .
BRAIN RESEARCH, 1980, 192 (01) :3-16
[2]   PREPARATION FOR MOVEMENT - NEURAL REPRESENTATIONS OF INTENDED DIRECTION IN 3 MOTOR AREAS OF THE MONKEY [J].
ALEXANDER, GE ;
CRUTCHER, MD .
JOURNAL OF NEUROPHYSIOLOGY, 1990, 64 (01) :133-150
[3]   PARALLEL ORGANIZATION OF FUNCTIONALLY SEGREGATED CIRCUITS LINKING BASAL GANGLIA AND CORTEX [J].
ALEXANDER, GE ;
DELONG, MR ;
STRICK, PL .
ANNUAL REVIEW OF NEUROSCIENCE, 1986, 9 :357-381
[4]   NEURONAL-ACTIVITY IN MONKEY STRIATUM RELATED TO THE EXPECTATION OF PREDICTABLE ENVIRONMENTAL EVENTS [J].
APICELLA, P ;
SCARNATI, E ;
LJUNGBERG, T ;
SCHULTZ, W .
JOURNAL OF NEUROPHYSIOLOGY, 1992, 68 (03) :945-960
[5]  
APICELLA P, 1991, EXP BRAIN RES, V85, P491
[6]   THE ORGANIZATION OF PREFRONTOCAUDATE PROJECTIONS AND THEIR LAMINAR ORIGIN IN THE MACAQUE MONKEY - A RETROGRADE STUDY USING HRP-GEL [J].
ARIKUNI, T ;
KUBOTA, K .
JOURNAL OF COMPARATIVE NEUROLOGY, 1986, 244 (04) :492-510
[7]   THE ROLE OF DOPAMINE IN LOCOMOTOR-ACTIVITY AND LEARNING [J].
BENINGER, RJ .
BRAIN RESEARCH REVIEWS, 1983, 6 (02) :173-196
[8]   RESPONSES OF CELLS IN THE TAIL OF THE CAUDATE-NUCLEUS DURING VISUAL-DISCRIMINATION LEARNING [J].
BROWN, VJ ;
DESIMONE, R ;
MISHKIN, M .
JOURNAL OF NEUROPHYSIOLOGY, 1995, 74 (03) :1083-1094
[9]   SINGLE CELL STUDIES OF THE PRIMATE PUTAMEN .2. RELATIONS TO DIRECTION OF MOVEMENT AND PATTERN OF MUSCULAR-ACTIVITY [J].
CRUTCHER, MD ;
DELONG, MR .
EXPERIMENTAL BRAIN RESEARCH, 1984, 53 (02) :244-258
[10]   MOTIVATIONAL CONTROL OF GOAL-DIRECTED ACTION [J].
DICKINSON, A ;
BALLEINE, B .
ANIMAL LEARNING & BEHAVIOR, 1994, 22 (01) :1-18