Single-Paper Meta-Analysis: Benefits for Study Summary, Theory Testing, and Replicability

被引:353
作者
McShane, Blakeley B. [1 ]
Bockenholt, Ulf [1 ]
机构
[1] Northwestern Univ, Mkt, Kellogg Sch Management, Evanston, IL 60208 USA
关键词
meta-analysis; between-study variation; heterogeneity; hierarchical; multilevel; random effects; REPLICATION; POWER;
D O I
10.1093/jcr/ucw085
中图分类号
F [经济];
学科分类号
02 ;
摘要
A typical behavioral research paper features multiple studies of a common phenomenon that are analyzed solely in isolation. Because the studies are of a common phenomenon, this practice is inefficient and forgoes important benefits that can be obtained only by analyzing them jointly in a single-paper meta-analysis (SPM). To facilitate SPM, we introduce meta-analytic methodology that is userfriendly, widely applicable, and specially tailored to the SPM of the set of studies that appear in a typical behavioral research paper. Our SPM methodology provides important benefits for study summary, theory testing, and replicability that we illustrate via three case studies that include papers recently published in the Journal of Consumer Research and the Journal of Marketing Research. We advocate that authors of typical behavioral research papers use it to supplement the single-study analyses that independently examine the multiple studies in the body of their papers as well as the " qualitative meta-analysis" that verbally synthesizes the studies in the general discussion of their papers. When used as such, this requires only a minor modification of current practice. We provide an easy-to-use website that implements our SPM methodology.
引用
收藏
页码:1048 / 1063
页数:16
相关论文
共 41 条
[11]   ON THE ORIGINS OF THE .05 LEVEL OF STATISTICAL SIGNIFICANCE [J].
COWLES, M ;
DAVIS, C .
AMERICAN PSYCHOLOGIST, 1982, 37 (05) :553-558
[12]   Business Not as Usual [J].
Eich, Eric .
PSYCHOLOGICAL SCIENCE, 2014, 25 (01) :3-6
[13]   Conceptualizing and evaluating the replication of research results [J].
Fabrigar, Leandre R. ;
Wegener, Duane T. .
JOURNAL OF EXPERIMENTAL SOCIAL PSYCHOLOGY, 2016, 66 :68-80
[14]  
Fisher FMaRA, 1948, AM STAT, V2, P30, DOI DOI 10.2307/2681650
[15]  
Fisher R. A., 1946, Statistical methods for research workers.
[16]  
Freedman D., 2007, Statistics
[17]   Beyond Power Calculations: Assessing Type S (Sign) and Type M (Magnitude) Errors [J].
Gelman, Andrew ;
Carlin, John .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2014, 9 (06) :641-651
[18]   Of Beauty, Sex and Power [J].
Gelman, Andrew ;
Weakliem, David .
AMERICAN SCIENTIST, 2009, 97 (04) :310-316
[19]  
Haidich AB, 2010, HIPPOKRATIA, V14, P29
[20]  
Hedges L, 1985, STAT METHODS METAANA, DOI [DOI 10.1016/C2009-0-03396-0, 10.2307/1164953]