MARKOV MODEL DESCRIPTION OF CHANGEOVER PROBABILITIES ON CONCURRENT VARIABLE-INTERVAL SCHEDULES

被引:87
作者
HEYMAN, GM [1 ]
机构
[1] HARVARD UNIV, CAMBRIDGE, MA 02138 USA
关键词
changeover delay; changeover probability; concurrent variable‐interval schedules; key peck; matching; molar analysis; molecular analysis; pigeons;
D O I
10.1901/jeab.1979.31-41
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
The primary data were peck‐by‐peck sequential records of four pigeons responding on several different concurrent variable‐interval schedules. According to the hypothesis that the subject chooses the alternative with the highest probability of reinforcement at the moment, response‐by‐response performance in concurrent schedules should show sequential dependencies. However, such dependencies were not found, and it was possible to describe molecular‐level performance with simple Markov chain models. The Markov model description implies that the momentary changeover probabilities were proportional to the overall relative reinforcement frequencies, and that changeover probabilities did not change as a function of previous responding. A second finding was that although a changeover‐delay procedure was omitted, relative response frequencies closely approximated relative reinforcement frequencies. 1979 Society for the Experimental Analysis of Behavior
引用
收藏
页码:41 / 51
页数:11
相关论文
共 25 条
[11]   PREFERENCE AND SWITCHING UNDER CONCURRENT SCHEDULING [J].
FINDLEY, JD .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1958, 1 (01) :123-144
[12]   A PROGRESSION FOR GENERATING VARIABLE-INTERVAL SCHEDULES [J].
FLESHLER, M ;
HOFFMAN, HS .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1962, 5 (04) :529-&
[13]   QUANTITATIVE HEDONISM [J].
HERRNSTEIN, RJ .
JOURNAL OF PSYCHIATRIC RESEARCH, 1971, 8 (3-4) :399-+
[14]   ON THE LAW OF EFFECT [J].
Herrnstein, RJ .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1970, 13 (02) :243-266
[16]  
HEYMAN GM, 1977, THESIS HARVARD U
[17]  
MACKINTOSH N, 1974, PSYCHOLOGY ANIMAL LE
[18]  
MOSTELLER F, 1970, PROBABILITY STATISTI
[19]   INTERVAL REINFORCEMENT OF CHOICE BEHAVIOR IN DISCRETE TRIALS [J].
NEVIN, JA .
JOURNAL OF THE EXPERIMENTAL ANALYSIS OF BEHAVIOR, 1969, 12 (06) :875-+
[20]   OPTIMAL BEHAVIOR ON FREE-OPERANT EXPERIMENTS [J].
SHIMP, CP .
PSYCHOLOGICAL REVIEW, 1969, 76 (02) :97-+