Assessing the Correspondence between Experimental Results Obtained in the Lab and Field: A Review of Recent Social Science Research

被引:31
作者
Coppock, Alexander [1 ]
Green, Donald P. [1 ]
机构
[1] Columbia Univ, Dept Polit Sci, 420 West 118th St,Suite 710, New York, NY 10025 USA
关键词
D O I
10.1017/psrm.2014.10
中图分类号
D0 [政治学、政治理论];
学科分类号
0302 ; 030201 ;
摘要
A small but growing social science literature examines the correspondence between experimental results obtained in lab and field settings. This article reviews this literature and reanalyzes a set of recent experiments carried out in parallel in both the lab and field. Using a standardized format that calls attention to both the experimental estimates and the statistical uncertainty surrounding them, the study analyzes the overall pattern of lab-field correspondence, which is found to be quite strong (Spearman's r50.73). Recognizing that this correlation may be distorted by the ad hoc manner in which lab-field comparisons are constructed (as well as the selective manner in which results are reported and published), the article concludes by suggesting directions for future research, stressing in particular the need for more systematic investigation of treatment effect heterogeneity.
引用
收藏
页码:113 / 131
页数:19
相关论文
共 58 条
[31]  
Habyarimana James., 2009, COETHNICITY DIVERSIT
[32]   Propensity Score Techniques and the Assessment of Measured Covariate Balance to Test Causal Associations in Psychological Research [J].
Harder, Valerie S. ;
Stuart, Elizabeth A. ;
Anthony, James C. .
PSYCHOLOGICAL METHODS, 2010, 15 (03) :234-249
[33]   Naturally occurring markets and exogenous laboratory experiments: A case study of the winner's curse [J].
Harrison, Glenn W. ;
List, John A. .
ECONOMIC JOURNAL, 2008, 118 (528) :822-843
[34]   Field experiments [J].
Harrison, GW ;
List, JA .
JOURNAL OF ECONOMIC LITERATURE, 2004, 42 (04) :1009-1055
[35]   In search of Homo economicus: Behavioral experiments in 15 small-scale societies [J].
Henrich, J ;
Boyd, R ;
Bowles, S ;
Camerer, C ;
Fehr, E ;
Gintis, H ;
McElreath, R .
AMERICAN ECONOMIC REVIEW, 2001, 91 (02) :73-78
[36]   The weirdest people in the world? [J].
Henrich, Joseph ;
Heine, Steven J. ;
Norenzayan, Ara .
BEHAVIORAL AND BRAIN SCIENCES, 2010, 33 (2-3) :61-+
[37]   Predicting the efficacy of future training programs using past experiences at other locations [J].
Hotz, VJ ;
Imbens, GW ;
Mortimer, JH .
JOURNAL OF ECONOMETRICS, 2005, 125 (1-2) :241-270
[38]  
Humphreys M., 2010, POLICING POLITICIANS
[39]   Fishing, Commitment, and Communication: A Proposal for Comprehensive Nonbinding Research Registration [J].
Humphreys, Macartan ;
de la Sierra, Raul Sanchez ;
van der Windt, Peter .
POLITICAL ANALYSIS, 2013, 21 (01) :1-20
[40]   COMPARING CONTEMPORANEOUS LABORATORY AND FIELD EXPERIMENTS ON MEDIA EFFECTS [J].
Jerit, Jennifer ;
Barabas, Jason ;
Clifford, Scott .
PUBLIC OPINION QUARTERLY, 2013, 77 (01) :256-282