Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs

被引:239
作者
Fisher, WW
Kelley, ME
Lomas, JE
机构
[1] Kennedy Krieger Inst, Baltimore, MD USA
[2] Johns Hopkins Univ, Sch Med, Baltimore, MD 21218 USA
[3] Louisiana State Univ, Baton Rouge, LA 70803 USA
关键词
assessment; behavior analysis; data analysis; interrater agreement; visual inspection;
D O I
10.1901/jaba.2003.36-387
中图分类号
B849 [应用心理学];
学科分类号
040203 [应用心理学];
摘要
Because behavior analysis is a data-driven process, a critical skill for behavior analysts is accurate visual inspection and interpretation of single-case data. Study 1 was a basic study in which we increased the accuracy of visual inspection methods for A-B designs through two refinements of the split-middle (SM) method called the dual-criteria (DC) and conservative dual-criteria (CDC) methods. The accuracy of these visual inspection methods was compared with one another and with two statistical methods (Allison & Gorman, 1993: Gottman, 1981) using a computer-simulated Monte Carlo study. Results indicated that the DC and CDC methods controlled Type I error rates much better than the SM method and had considerably higher power (to detect real treatment effects) than the two statistical methods. In Study 2, brief verbal and written instructions with modeling were used to train 5 staff members to use the DC method, and in Study 3, these training methods were incorporated into a slide presentation and were used to rapidly (i.e., 15 min) train a large group of individuals (N = 87). Interpretation accuracy increased from a baseline mean of 55% to a treatment mean of 94% in Study 2 and from a baseline mean of 71% to a treatment mean of 95% in Study 3. Thus, Study 1 answered basic questions about the accuracy of several methods of interpreting A-B designs; Study 2 showed how that information could be used to increase the accuracy of human visual inspectors; and Study 3 showed how the training procedures from Study 2 could be modified into a format that would facilitate rapid training of large groups of individuals to interpret single-case designs.
引用
收藏
页码:387 / 406
页数:20
相关论文
共 29 条
[1]
POWCOR - A POWER ANALYSIS AND SAMPLE-SIZE PROGRAM FOR TESTING DIFFERENCES BETWEEN DEPENDENT AND INDEPENDENT CORRELATIONS [J].
ALLISON, DB ;
GORMAN, BS .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 1993, 53 (01) :133-137
[2]
[Anonymous], 1995, J BEHAV EDUC, DOI DOI 10.1007/BF02110316
[5]
THE EFFECTS OF INSTRUCTIONS AND CALCULATION PROCEDURES ON OBSERVERS ACCURACY, AGREEMENT, AND CALCULATION CORRECTNESS [J].
BOYKIN, RA ;
NELSON, RO .
JOURNAL OF APPLIED BEHAVIOR ANALYSIS, 1981, 14 (04) :479-489
[6]
A METHODOLOGY FOR THE QUANTITATIVE SYNTHESIS OF INTRA-SUBJECT DESIGN RESEARCH [J].
CENTER, BA ;
SKIBA, RJ ;
CASEY, A .
JOURNAL OF SPECIAL EDUCATION, 1985, 19 (04) :387-400
[7]
CROSBIE J, 1987, BEHAV ASSESS, V9, P141
[8]
INCONSISTENT VISUAL ANALYSES OF INTRASUBJECT DATA [J].
DEPROSPERO, A ;
COHEN, S .
JOURNAL OF APPLIED BEHAVIOR ANALYSIS, 1979, 12 (04) :573-579
[9]
ANALYZING SINGLE-CASE DATA - THE POWER OF RANDOMIZATION TESTS [J].
FERRON, J ;
WARE, W .
JOURNAL OF EXPERIMENTAL EDUCATION, 1995, 63 (02) :167-178
[10]
Franklin R. D., 1996, DESIGN ANAL SINGLE C, P119