Serotonin and the evaluation of future rewards - Theory, experiments, and possible neural mechanisms

被引:40
作者
Schweighofer, Nicolas [1 ]
Tanaka, Saori C. [1 ]
Doya, Kenji [1 ]
机构
[1] Univ So Calif, Dept Biokinesiol & Phys Therapy, Los Angeles, CA 90089 USA
来源
REWARD AND DECISION MAKING IN CORTICOBASAL GANGLIA NETWORKS | 2007年 / 1104卷
关键词
discounting; impulsivity; reinforcement learning; discount rate; basal ganglia;
D O I
10.1196/annals.1390.011
中图分类号
O [数理科学和化学]; P [天文学、地球科学]; Q [生物科学]; N [自然科学总论];
学科分类号
07 ; 0710 ; 09 ;
摘要
The ability to select an action by considering both delays and amount of reward outcome is critical for survival and well-being of animals and humans. Previous animal experiments suggest a role of serotonin in action choice by modulating the evaluation of delayed rewards. It remains unclear, however, through which neural circuits, and through what receptors and intracellular mechanisms, serotonin affects the evaluation of delayed rewards. Here, we review experimental studies and computational theory of decisions under delayed rewards, and propose that serotonin controls the timescale of reward prediction by regulating neural activity in the basal ganglia.
引用
收藏
页码:289 / 300
页数:12
相关论文
共 74 条
[1]   Precis of breakdown of will [J].
Ainslie, G .
BEHAVIORAL AND BRAIN SCIENCES, 2005, 28 (05) :635-+
[2]   SPECIOUS REWARD - BEHAVIORAL THEORY OF IMPULSIVENESS AND IMPULSE CONTROL [J].
AINSLIE, G .
PSYCHOLOGICAL BULLETIN, 1975, 82 (04) :463-496
[3]   The hyperbolic consumption model: Calibration, simulation, and empirical evaluation [J].
Angeletos, GM ;
Laibson, D ;
Repetto, A ;
Tobacman, J ;
Weinberg, S .
JOURNAL OF ECONOMIC PERSPECTIVES, 2001, 15 (03) :47-68
[4]   Rate currencies and the foraging starling: The fallacy of the averages revisited [J].
Bateson, M ;
Kacelnik, A .
BEHAVIORAL ECOLOGY, 1996, 7 (03) :341-352
[5]   Emotion, decision making and the orbitofrontal cortex [J].
Bechara, A ;
Damasio, H ;
Damasio, AR .
CEREBRAL CORTEX, 2000, 10 (03) :295-307
[6]   A computational model of how the basal ganglia produce sequences [J].
Berns, GS ;
Sejnowski, TJ .
JOURNAL OF COGNITIVE NEUROSCIENCE, 1998, 10 (01) :108-121
[7]   Impulsivity and cigarette smoking: delay discounting in current, never, and ex-smokers [J].
Bickel, WK ;
Odum, AL ;
Madden, GJ .
PSYCHOPHARMACOLOGY, 1999, 146 (04) :447-454
[8]   Serotonin and tolerance to delay of reward in rats [J].
Bizot, JC ;
Le Bihan, C ;
Puech, AJ ;
Hamon, M ;
Thiébot, MH .
PSYCHOPHARMACOLOGY, 1999, 146 (04) :400-412
[9]   Serotonin receptors in cognitive behaviors [J].
Buhot, MC .
CURRENT OPINION IN NEUROBIOLOGY, 1997, 7 (02) :243-254
[10]   Impulsive choice induced in rats by lesions of the nucleus accumbens core [J].
Cardinal, RN ;
Pennicott, DR ;
Sugathapala, CL ;
Robbins, TW ;
Everitt, BJ .
SCIENCE, 2001, 292 (5526) :2499-2501