Context, Learning, and Extinction

被引:243
作者
Gershman, Samuel J. [1 ,2 ]
Blei, David M. [3 ]
Niv, Yael [1 ,2 ]
机构
[1] Princeton Univ, Dept Psychol, Princeton, NJ 08540 USA
[2] Princeton Univ, Inst Neurosci, Princeton, NJ 08540 USA
[3] Princeton Univ, Dept Comp Sci, Princeton, NJ 08540 USA
关键词
classical conditioning; renewal; latent inhibition; Bayesian; hippocampus; LATENT INHIBITION; HIPPOCAMPAL-LESIONS; MEMORY; RETRIEVAL; FEAR; RENEWAL; MODELS; RAT; INFORMATION; MECHANISMS;
D O I
10.1037/a0017808
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
A. Redish et al. (2007) proposed a reinforcement learning model of context-dependent learning and extinction in conditioning experiments, using the idea of "state classification" to categorize new observations into states. In the current article, the authors propose an interpretation of this idea in terms of normative statistical inference. They focus on renewal and latent inhibition, 2 conditioning paradigms in which contextual manipulations have been studied extensively, and show that online Bayesian inference within a model that assumes an unbounded number of latent causes can characterize a diverse set of behavioral results from such manipulations, some of which pose problems for the model of Redish et al. Moreover, in both paradigms, context dependence is absent in younger animals, or if hippocampal lesions are made prior to training. The authors suggest an explanation in terms of a restricted capacity to infer new causes.
引用
收藏
页码:197 / 209
页数:13
相关论文
共 74 条
[31]   The effects of neurotoxic hippocampal lesions on two effects of context after fear extinction [J].
Frohardt, RJ ;
Guarraci, FA ;
Bouton, ME .
BEHAVIORAL NEUROSCIENCE, 2000, 114 (02) :227-240
[32]   Context learning in the rodent hippocampus [J].
Fuhs, Mark C. ;
Touretzky, David S. .
NEURAL COMPUTATION, 2007, 19 (12) :3173-3215
[33]   HIPPOCAMPAL MEDIATION OF STIMULUS REPRESENTATION - A COMPUTATIONAL THEORY [J].
GLUCK, MA ;
MYERS, CE .
HIPPOCAMPUS, 1993, 3 (04) :491-516
[34]   ADAPTIVE PATTERN-CLASSIFICATION AND UNIVERSAL RECODING .1. PARALLEL DEVELOPMENT AND CODING OF NEURAL FEATURE DETECTORS [J].
GROSSBERG, S .
BIOLOGICAL CYBERNETICS, 1976, 23 (03) :121-134
[35]   CONTEXTUAL EFFECTS IN CONDITIONING, LATENT INHIBITION, AND HABITUATION - ASSOCIATIVE AND RETRIEVAL FUNCTIONS OF CONTEXTUAL CUES [J].
HALL, G ;
HONEY, RC .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIORAL PROCESSES, 1989, 15 (03) :232-241
[36]   A proposed function for hippocampal theta rhythm:: Separate phases of encoding and retrieval enhance reversal of prior learning [J].
Hasselmo, ME ;
Bodelón, C ;
Wyble, BP .
NEURAL COMPUTATION, 2002, 14 (04) :793-817
[37]   Hippocampal mechanisms for the context-dependent retrieval of episodes [J].
Hasselmo, ME ;
Eichenbaum, H .
NEURAL NETWORKS, 2005, 18 (09) :1172-1190
[38]  
Hertz J., 1991, Introduction to the theory of neural computation
[39]   HIPPOCAMPUS AND CONTEXTUAL RETRIEVAL OF INFORMATION FROM MEMORY - THEORY [J].
HIRSH, R .
BEHAVIORAL BIOLOGY, 1974, 12 (04) :421-444
[40]   EXCITATION AND INHIBITION IN UNBLOCKING [J].
HOLLAND, PC .
JOURNAL OF EXPERIMENTAL PSYCHOLOGY-ANIMAL BEHAVIOR PROCESSES, 1988, 14 (03) :261-279