Goal-directed instrumental action: contingency and incentive learning and their cortical substrates

被引:1067
作者
Balleine, BW
Dickinson, A
机构
[1] Univ Cambridge, Dept Expt Psychol, Cambridge CB2 3EB, England
[2] Univ Calif Los Angeles, Dept Psychol, Los Angeles, CA 90095 USA
关键词
cortex; instrumental conditioning; reinforcement; reward; rats;
D O I
10.1016/S0028-3908(98)00033-1
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
Instrumental behaviour is controlled by two systems: a stimulus-response habit mechanism and a goal-directed process that involves two forms of learning. The first is learning about the instrumental contingency between the response and reward, whereas the second consists of the acquisition of incentive value by the reward. Evidence for contingency learning comes from studies of reward devaluation and from demonstrations that instrumental performance is sensitive not only the probability of contiguous reward but also to the probability of unpaired rewards. The process of incentive learning is evident in the acquisition of control over performance by primary motivational states. Preliminary lesion studies of the rat suggest that the prelimibic area of prefrontal cortex plays a role in the contingency learning, whereas the incentive learning for food rewards involves the insular cortex. (C) 1998 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:407 / 419
页数:13
相关论文
共 50 条
[1]   INSTRUMENTAL RESPONDING FOLLOWING REINFORCER DEVALUATION [J].
ADAMS, CD ;
DICKINSON, A .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1981, 33 (MAY) :109-121
[2]   VARIATIONS IN THE SENSITIVITY OF INSTRUMENTAL RESPONDING TO REINFORCER DEVALUATION [J].
ADAMS, CD .
QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY SECTION B-COMPARATIVE AND PHYSIOLOGICAL PSYCHOLOGY, 1982, 34 (MAY) :77-98
[3]   INSTRUMENTAL PERFORMANCE FOLLOWING A SHIFT IN PRIMARY MOTIVATION DEPENDS ON INCENTIVE LEARNING [J].
BALLEINE, B .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1992, 18 (03) :236-250
[4]   The role of incentive learning in instrumental outcome revaluation by sensory-specific satiety [J].
Balleine, BW ;
Dickinson, A .
ANIMAL LEARNING & BEHAVIOR, 1998, 26 (01) :46-59
[5]  
BRAUN JJ, 1982, PHYSIOL PSYCHOL, V10, P13
[6]  
BRAUN JJ, 1990, CEREBRAL CORTEX RAT, P407
[7]   MOTONEURON PLASTICITY UNDERLYING OPERANTLY CONDITIONED DECREASE IN PRIMATE H-REFLEX [J].
CARP, JS ;
WOLPAW, JR .
JOURNAL OF NEUROPHYSIOLOGY, 1994, 72 (01) :431-442
[8]   OPERANT-CONDITIONING OF H-REFLEX IN FREELY MOVING RATS [J].
CHEN, XY ;
WOLPAW, JR .
JOURNAL OF NEUROPHYSIOLOGY, 1995, 73 (01) :411-415
[9]   INSTRUMENTAL RESPONDING REMAINS SENSITIVE TO REINFORCER DEVALUATION AFTER EXTENSIVE TRAINING [J].
COLWILL, RM ;
RESCORLA, RA .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1985, 11 (04) :520-536
[10]   THE ROLE OF RESPONSE-REINFORCER ASSOCIATIONS INCREASES THROUGHOUT EXTENDED INSTRUMENTAL TRAINING [J].
COLWILL, RM ;
RESCORLA, RA .
ANIMAL LEARNING & BEHAVIOR, 1988, 16 (01) :105-111