Evaluation methods for social intervention

被引:121
作者
Lipsey, MW [1 ]
Cordray, DS [1 ]
机构
[1] Vanderbilt Univ, Dept Psychol & Human Dev, Nashville, TN 37203 USA
关键词
program evaluation; treatment effectiveness; outcomes; field experiments; quasi-experiments; analysis of change;
D O I
10.1146/annurev.psych.51.1.345
中图分类号
B84 [心理学];
学科分类号
04 ; 0402 ;
摘要
Experimental design is the method of choice for establishing whether social interventions have the intended effects on the populations they are presumed to benefit. Experience with field experiments, however, has revealed significant limitations relating chiefly to (a) practical problems implementing random assignment, (b) important uncontrolled sources of variability occuring after assignment, and (c) a low yield of information for explaining why certain effects were or were not found. In response, it is increasingly common for outcome evaluation to draw on some form of program theory and extend data collection to include descriptive information about program implementation, client characteristics, and patterns of change. These supplements often cannot be readily incorporated into standard experimental design, especially statistical analysis. An important advance in outcome evaluation is the recent development of statistical models that are able to represent individual-level change, correlates of change, and program effects in an integrated and informative manner.
引用
收藏
页码:345 / 375
页数:31
相关论文
共 124 条
[41]   ANALYSIS OF CHANGE - MODELING INDIVIDUAL GROWTH [J].
FRANCIS, DJ ;
FLETCHER, JM ;
STUEBING, KK ;
DAVIDSON, KC ;
THOMPSON, NM .
JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY, 1991, 59 (01) :27-37
[43]  
HATRY HP, 1997, NEW DIRECTIONS EVALU, V75, P31
[44]   SAMPLE SELECTION BIAS AS A SPECIFICATION ERROR [J].
HECKMAN, JJ .
ECONOMETRICA, 1979, 47 (01) :153-161
[45]   A multilevel thresholds of change model for analysis of stages of change data [J].
Hedeker, D ;
Mermelstein, RJ .
MULTIVARIATE BEHAVIORAL RESEARCH, 1998, 33 (04) :427-455
[46]   Assignment methods in experimentation: When do nonrandomized experiments approximate answers from randomized experiments? [J].
Heinsman, DT ;
Shadish, WR .
PSYCHOLOGICAL METHODS, 1996, 1 (02) :154-169
[47]  
HENRY GT, 1998, NEW DIRECTIONS EVALU, V78
[48]  
Holtzman J, 1998, J AM GERIATR SOC, V46, P629
[49]   Addressing self-selection effects in evaluations of mutual help groups and professional mental health services: An introduction to two-stage sample selection models [J].
Humphreys, K ;
Phibbs, CS ;
Moos, RH .
EVALUATION AND PROGRAM PLANNING, 1996, 19 (04) :301-308
[50]   CLINICAL-SIGNIFICANCE - A STATISTICAL APPROACH TO DEFINING MEANINGFUL CHANGE IN PSYCHOTHERAPY-RESEARCH [J].
JACOBSON, NS ;
TRUAX, P .
JOURNAL OF CONSULTING AND CLINICAL PSYCHOLOGY, 1991, 59 (01) :12-19