Integrated Bayesian models of learning and decision making for saccadic eye movements

被引:31
作者
Brodersen, Kay H. [1 ,2 ]
Penny, Will D. [1 ]
Harrison, Lee M. [1 ]
Daunizeau, Jean [1 ]
Ruff, Christian C. [4 ]
Duzel, Emrah [4 ]
Friston, Karl J. [1 ]
Stephan, Klaas E. [1 ,3 ]
机构
[1] UCL, Inst Neurol, Wellcome Trust Ctr Neuroimaging, London WC1N 3BG, England
[2] Univ Oxford, John Radcliffe Hosp, Ctr Funct Magnet Resonance Imaging Brain FMRIB, Oxford OX3 9DU, England
[3] Univ Zurich, Inst Empir Res Econ, Branco Weiss Lab, CH-8006 Zurich, Switzerland
[4] UCL, Inst Cognit Neurosci, London WC1N 3AR, England
基金
英国惠康基金;
关键词
Saccades; Decision making; Reaction time; Bayesian learning; Model comparison;
D O I
10.1016/j.neunet.2008.08.007
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
The neurophysiology of eye movements has been studied extensively, and several computational models have been proposed for decision-making processes that underlie the generation of eye movements towards a Visual stimulus in a Situation of uncertainty. One class of models, known as linear rise-to-threshold models, provides an economical, yet broadly applicable, explanation for the observed variability in the latency between the onset of a peripheral Visual target and the saccade towards it. So far, however, these models do not account for the dynamics of learning across a Sequence of stimuli, and they do not apply to situations in which Ssbjects are exposed to events with conditional probabilities. In this methodological paper, we extend the class of linear rise-to-threshold models to address these limitations. Specifically, we reformulate previous models in terms of a generative, hierarchical model. by combining two separate sub-models that account for the interplay between learning of target locations across trials and the decision-making process within trials. We derive a maximum-likelihood scheme for parameter estimation as well as model comparison on the basis of log likelihood ratios. The utility Of the integrated model is demonstrated by applying it to empirical saccade data acquired from three healthy subjects. Model comparison is used (i) to show that eye movements do not only reflect marginal but also conditional probabilities of target locations, and (ii) to reveal subject-specific learning profiles over trials. These individual learning profiles are Sufficiently distinct that test samples can be Successfully mapped onto the correct subject by a naive Bayes classifier. Altogether, our approach extends the class of linear rise-to-threshold models of saccadic decision making, overcomes some of their previous limitations, and enables statistical inference both about learning of target locations across trials and the decision-making process within trials. (C) 2008 Elsevier Ltd. All rights reserved.
引用
收藏
页码:1247 / 1260
页数:14
相关论文
共 84 条
[51]   Neural correlates of decision variables in parietal cortex [J].
Platt, ML ;
Glimcher, PW .
NATURE, 1999, 400 (6741) :233-238
[52]   Neural correlates of decisions [J].
Platt, ML .
CURRENT OPINION IN NEUROBIOLOGY, 2002, 12 (02) :141-148
[53]   Bayesian computation in recurrent neural circuits [J].
Rao, RPN .
NEURAL COMPUTATION, 2004, 16 (01) :1-38
[54]   A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions [J].
Ratcliff, R ;
Cherian, A ;
Segraves, M .
JOURNAL OF NEUROPHYSIOLOGY, 2003, 90 (03) :1392-1407
[55]   Connectionist and diffusion models of reaction time [J].
Ratcliff, R ;
Van Zandt, T ;
McKoon, G .
PSYCHOLOGICAL REVIEW, 1999, 106 (02) :261-300
[56]   A comparison of sequential sampling models for two-choice reaction time [J].
Ratcliff, R ;
Smith, PL .
PSYCHOLOGICAL REVIEW, 2004, 111 (02) :333-367
[57]   Modeling response times for two-choice decisions [J].
Ratcliff, R ;
Rouder, JN .
PSYCHOLOGICAL SCIENCE, 1998, 9 (05) :347-356
[58]   THEORY OF MEMORY RETRIEVAL [J].
RATCLIFF, R .
PSYCHOLOGICAL REVIEW, 1978, 85 (02) :59-108
[59]   Accuracy, information, and response time in a saccadic decision task [J].
Reddi, BAJ ;
Asrress, KN ;
Carpenter, RHS .
JOURNAL OF NEUROPHYSIOLOGY, 2003, 90 (05) :3538-3546
[60]   The influence of urgency on decision time [J].
Reddi, BAJ ;
Carpenter, RHS .
NATURE NEUROSCIENCE, 2000, 3 (08) :827-830