WHAT YOU SEE IS WHAT YOU GET? ENHANCING METHODOLOGICAL TRANSPARENCY IN MANAGEMENT RESEARCH

被引:295
作者
Aguinis, Herman [1 ]
Ramani, Ravi S. [2 ]
Alabduljader, Nawaf [2 ]
机构
[1] George Washington Univ, Sch Business, Management, Washington, DC 20052 USA
[2] George Washington Univ, Sch Business, Dept Management, Washington, DC 20052 USA
关键词
QUESTIONABLE RESEARCH PRACTICES; BEST-PRACTICE RECOMMENDATIONS; STRATEGIC MANAGEMENT; INTERNATIONAL-BUSINESS; APPLIED-PSYCHOLOGY; EFFECT SIZES; ORGANIZATIONAL-PSYCHOLOGY; CONSTRUCT MEASUREMENT; QUALITATIVE RESEARCH; MULTIPLE-REGRESSION;
D O I
10.5465/annals.2016.0011
中图分类号
F [经济];
学科分类号
02 ;
摘要
We review the literature on evidence-based best practices on how to enhance methodological transparency, which is the degree of detail and disclosure about the specific steps, decisions, and judgment calls made during a scientific study. We conceptualize lack of transparency as a "research performance problem" because it masks fraudulent acts, serious errors, and questionable research practices, and therefore precludes inferential and results reproducibility. Our recommendations for authors provide guidance on how to increase transparency at each stage of the research process: (1) theory, (2) design, (3) measurement, (4) analysis, and (5) reporting of results. We also offer recommendations for journal editors, reviewers, and publishers on how to motivate authors to be more transparent. We group these recommendations into the following categories: (1) manuscript submission forms requiring authors to certify they have taken actions to enhance transparency, (2) manuscript evaluation forms including additional items to encourage reviewers to assess the degree of transparency, and (3) review process improvements to enhance transparency. Taken together, our recommendations provide a resource for doctoral education and training; researchers conducting empirical studies; journal editors and reviewers evaluating submissions; and journals, publishers, and professional organizations interested in enhancing the credibility and trustworthiness of research.
引用
收藏
页码:83 / 110
页数:28
相关论文
共 172 条
[1]   Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30-year review [J].
Aguinis, H ;
Beaty, JC ;
Boik, RJ ;
Pierce, CA .
JOURNAL OF APPLIED PSYCHOLOGY, 2005, 90 (01) :94-107
[2]  
Aguinis H., 2013, Performance management, V2nd
[3]   Science's reproducibility and replicability crisis: International business is not immune [J].
Aguinis, Herman ;
Cascio, Wayne F. ;
Ramani, Ravi S. .
JOURNAL OF INTERNATIONAL BUSINESS STUDIES, 2017, 48 (06) :653-663
[4]   Cumulative Advantage: Conductors and Insulators of Heavy-Tailed Productivity Distributions and Productivity Stars [J].
Aguinis, Herman ;
O'Boyle, Ernest, Jr. ;
Gonzalez-Mule, Erik ;
Joo, Harry .
PERSONNEL PSYCHOLOGY, 2016, 69 (01) :3-66
[5]   Scholarly Impact: A Pluralist Conceptualization [J].
Aguinis, Herman ;
Shapiro, Debra L. ;
Antonacopoulou, Elena P. ;
Cummings, Thomas G. .
ACADEMY OF MANAGEMENT LEARNING & EDUCATION, 2014, 13 (04) :623-639
[6]   An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection [J].
Aguinis, Herman ;
Vandenberg, Robert J. .
ANNUAL REVIEW OF ORGANIZATIONAL PSYCHOLOGY AND ORGANIZATIONAL BEHAVIOR, VOL 1, 2014, 1 :569-595
[7]   STAR PERFORMERS IN TWENTY-FIRST CENTURY ORGANIZATIONS [J].
Aguinis, Herman ;
O'Boyle, Ernest, Jr. .
PERSONNEL PSYCHOLOGY, 2014, 67 (02) :313-350
[8]   Methodological Wishes for the Next Decade and How to Make Wishes Come True [J].
Aguinis, Herman ;
Edwards, Jeffrey R. .
JOURNAL OF MANAGEMENT STUDIES, 2014, 51 (01) :143-174
[9]   Best-Practice Recommendations for Defining, Identifying, and Handling Outliers [J].
Aguinis, Herman ;
Gottfredson, Ryan K. ;
Joo, Harry .
ORGANIZATIONAL RESEARCH METHODS, 2013, 16 (02) :270-301
[10]   Best-practice recommendations for estimating interaction effects using meta-analysis [J].
Aguinis, Herman ;
Gottfredson, Ryan K. ;
Wright, Thomas A. .
JOURNAL OF ORGANIZATIONAL BEHAVIOR, 2011, 32 (08) :1033-1043