Single-Paper Meta-Analysis: Benefits for Study Summary, Theory Testing, and Replicability

被引:353
作者
McShane, Blakeley B. [1 ]
Bockenholt, Ulf [1 ]
机构
[1] Northwestern Univ, Mkt, Kellogg Sch Management, Evanston, IL 60208 USA
关键词
meta-analysis; between-study variation; heterogeneity; hierarchical; multilevel; random effects; REPLICATION; POWER;
D O I
10.1093/jcr/ucw085
中图分类号
F [经济];
学科分类号
02 ;
摘要
A typical behavioral research paper features multiple studies of a common phenomenon that are analyzed solely in isolation. Because the studies are of a common phenomenon, this practice is inefficient and forgoes important benefits that can be obtained only by analyzing them jointly in a single-paper meta-analysis (SPM). To facilitate SPM, we introduce meta-analytic methodology that is userfriendly, widely applicable, and specially tailored to the SPM of the set of studies that appear in a typical behavioral research paper. Our SPM methodology provides important benefits for study summary, theory testing, and replicability that we illustrate via three case studies that include papers recently published in the Journal of Consumer Research and the Journal of Marketing Research. We advocate that authors of typical behavioral research papers use it to supplement the single-study analyses that independently examine the multiple studies in the body of their papers as well as the " qualitative meta-analysis" that verbally synthesizes the studies in the general discussion of their papers. When used as such, this requires only a minor modification of current practice. We provide an easy-to-use website that implements our SPM methodology.
引用
收藏
页码:1048 / 1063
页数:16
相关论文
共 41 条
[31]  
Mosteller F., 1954, HDB SOCIAL PSYCHOL, VI
[32]  
Pigott T., 2012, Advances in MetaAnalysis
[33]   COMBINING RESULTS OF INDEPENDENT STUDIES [J].
ROSENTHAL, R .
PSYCHOLOGICAL BULLETIN, 1978, 85 (01) :185-193
[34]   STATISTICAL PROCEDURES AND THE JUSTIFICATION OF KNOWLEDGE IN PSYCHOLOGICAL SCIENCE [J].
ROSNOW, RL ;
ROSENTHAL, R .
AMERICAN PSYCHOLOGIST, 1989, 44 (10) :1276-1284
[35]  
Rothstein H, 2005, PUBLICATION BIAS IN META-ANALYSIS: PREVENTION, ASSESSMENT AND ADJUSTMENTS, pIX
[36]   Surcharges Plus Unhealthy Labels Reduce Demand for Unhealthy Menu Items [J].
Shah, Avni M. ;
Bettman, James R. ;
Ubel, Peter A. ;
Keller, Punam Anand ;
Edell, Julie A. .
JOURNAL OF MARKETING RESEARCH, 2014, 51 (06) :773-789
[37]   Meta-analysis of individual patient data from randomized trials: a review of methods used in practice [J].
Simmonds, MC ;
Higgins, JPT ;
Stewart, LA ;
Tierney, JF ;
Clarke, MJ ;
Thompson, SG .
CLINICAL TRIALS, 2005, 2 (03) :209-217
[38]   To IPD or not to IPD? Advantages and disadvantages of systematic reviews using individual patient data [J].
Stewart, LA ;
Tierney, JF .
EVALUATION & THE HEALTH PROFESSIONS, 2002, 25 (01) :76-97
[39]   The Alleged Crisis and the Illusion of Exact Replication [J].
Stroebe, Wolfgang ;
Strack, Fritz .
PERSPECTIVES ON PSYCHOLOGICAL SCIENCE, 2014, 9 (01) :59-71
[40]   Replication and theory development in organizational science: A critical realist perspective [J].
Tsang, EWK ;
Kwan, KM .
ACADEMY OF MANAGEMENT REVIEW, 1999, 24 (04) :759-780