Single-Paper Meta-Analysis: Benefits for Study Summary, Theory Testing, and Replicability

被引:353
作者
McShane, Blakeley B. [1 ]
Bockenholt, Ulf [1 ]
机构
[1] Northwestern Univ, Mkt, Kellogg Sch Management, Evanston, IL 60208 USA
关键词
meta-analysis; between-study variation; heterogeneity; hierarchical; multilevel; random effects; REPLICATION; POWER;
D O I
10.1093/jcr/ucw085
中图分类号
F [经济];
学科分类号
02 ;
摘要
A typical behavioral research paper features multiple studies of a common phenomenon that are analyzed solely in isolation. Because the studies are of a common phenomenon, this practice is inefficient and forgoes important benefits that can be obtained only by analyzing them jointly in a single-paper meta-analysis (SPM). To facilitate SPM, we introduce meta-analytic methodology that is userfriendly, widely applicable, and specially tailored to the SPM of the set of studies that appear in a typical behavioral research paper. Our SPM methodology provides important benefits for study summary, theory testing, and replicability that we illustrate via three case studies that include papers recently published in the Journal of Consumer Research and the Journal of Marketing Research. We advocate that authors of typical behavioral research papers use it to supplement the single-study analyses that independently examine the multiple studies in the body of their papers as well as the " qualitative meta-analysis" that verbally synthesizes the studies in the general discussion of their papers. When used as such, this requires only a minor modification of current practice. We provide an easy-to-use website that implements our SPM methodology.
引用
收藏
页码:1048 / 1063
页数:16
相关论文
共 41 条
[1]  
[Anonymous], 1991, Replication Research in the Social Sciences
[2]  
[Anonymous], 2014, METHODS METAANALYSIS
[3]  
Borenstein M., 2021, Introduction to Meta-Analysis, V2nd
[4]   The Replication Recipe: What makes for a convincing replication? [J].
Brandt, Mark J. ;
IJzerman, Hans ;
Dijksterhuis, Ap ;
Farach, Frank J. ;
Geller, Jason ;
Giner-Sorolla, Roger ;
Grange, James A. ;
Perugini, Marco ;
Spies, Jeffrey R. ;
van 't Veer, Anna .
JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2014, 50 :217-224
[5]   A Duty to Describe: Better the Devil You Know Than the Devil You Don't [J].
Brown, Sacha D. ;
Furrow, David ;
Hill, Daniel F. ;
Gable, Jonathon C. ;
Porter, Liam P. ;
Jacobs, W. Jake .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2014, 9 (06) :626-640
[6]   A Nondegenerate Penalized Likelihood Estimator for Variance Parameters in Multilevel Models [J].
Chung, Yeojin ;
Rabe-Hesketh, Sophia ;
Dorie, Vincent ;
Gelman, Andrew ;
Liu, Jingchen .
PSYCHOMETRIKA, 2013, 78 (04) :685-709
[7]   THINGS I HAVE LEARNED (SO FAR) [J].
COHEN, J .
AMERICAN PSYCHOLOGIST, 1990, 45 (12) :1304-1312
[8]   A POWER PRIMER [J].
COHEN, J .
PSYCHOLOGICAL BULLETIN, 1992, 112 (01) :155-159
[9]  
Cooper H, 2019, HANDBOOK OF RESEARCH SYNTHESIS AND META-ANALYSIS, 3RD EDITION, P3
[10]   The Relative Benefits of Meta-Analysis Conducted With Individual Participant Data Versus Aggregated Data [J].
Cooper, Harris ;
Patall, Erika A. .
PSYCHOLOGICAL METHODS, 2009, 14 (02) :165-176