An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection

被引:189
作者
Aguinis, Herman [1 ]
Vandenberg, Robert J. [2 ]
机构
[1] Indiana Univ, Kelley Sch Business, Dept Management & Entrepreneurship, Bloomington, IN 47405 USA
[2] Univ Georgia, Terry Coll Business, Dept Management, Athens, GA 30602 USA
来源
ANNUAL REVIEW OF ORGANIZATIONAL PSYCHOLOGY AND ORGANIZATIONAL BEHAVIOR, VOL 1 | 2014年 / 1卷
关键词
theory development; theory testing; research design; measurement; methodology; research quality; validity; causality; CONSTRUCT-VALIDATION; MANAGEMENT RESEARCH; STATISTICAL CONTROL; ORGANIZATIONAL-PSYCHOLOGY; PHD PROGRAMS; SCIENCE; POWER; METHODOLOGY; VARIABLES; RELEVANCE;
D O I
10.1146/annurev-orgpsych-031413-091231
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
We rely on classic as well as recently published sources to offer a review of theory, research design, and measurement issues that should be considered prior to conducting any empirical study. First, we examine theory-related issues that should be addressed before research design and measurement considerations. Specifically, we discuss how to make meaningful theoretical progress including the use of inductive and deductive approaches, address an important issue, and conduct research with a practical end in mind. Second, we offer recommendations regarding research design, including how to address the low statistical power challenge, design studies that strengthen inferences about causal relationships, and use control variables appropriately. Finally, we address measurement issues. Specifically, we discuss how to improve the link between underlying constructs and their observable indicators. Our review offers a checklist for use by researchers to improve research quality prior to data collection and by journal editors and reviewers to evaluate the quality of submitted manuscripts.
引用
收藏
页码:569 / 595
页数:27
相关论文
共 115 条
[1]  
Acad. Manag, 2008, QUEST WE ASK AN CAL
[2]   Effect size and power in assessing moderating effects of categorical variables using multiple regression: A 30-year review [J].
Aguinis, H ;
Beaty, JC ;
Boik, RJ ;
Pierce, CA .
JOURNAL OF APPLIED PSYCHOLOGY, 2005, 90 (01) :94-107
[3]   Social-role versus structural models of gender and influence use in organizations - A strong inference approach [J].
Aguinis, H ;
Adams, SKR .
GROUP & ORGANIZATION MANAGEMENT, 1998, 23 (04) :414-446
[4]  
Aguinis H., 2013, Performance management, V2nd
[5]  
Aguinis H., 2004, Regression analysis for categorical moderators
[6]   Using Market Basket Analysis in Management Research [J].
Aguinis, Herman ;
Forcum, Lura E. ;
Joo, Harry .
JOURNAL OF MANAGEMENT, 2013, 39 (07) :1799-1824
[7]   Best-Practice Recommendations for Estimating Cross-Level Interaction Effects Using Multilevel Modeling [J].
Aguinis, Herman ;
Gottfredson, Ryan K. ;
Culpepper, Steven Andrew .
JOURNAL OF MANAGEMENT, 2013, 39 (06) :1490-1528
[8]   Meta-Analytic Choices and Judgment Calls: Implications for Theory Building and Testing, Obtained Effect Sizes, and Scholarly Impact [J].
Aguinis, Herman ;
Dalton, Dan R. ;
Bosco, Frank A. ;
Pierce, Charles A. ;
Dalton, Catherine M. .
JOURNAL OF MANAGEMENT, 2011, 37 (01) :5-38
[9]   Revival of Test Bias Research in Preemployment Testing [J].
Aguinis, Herman ;
Culpepper, Steven A. ;
Pierce, Charles A. .
JOURNAL OF APPLIED PSYCHOLOGY, 2010, 95 (04) :648-680
[10]   Customer-Centric Science: Reporting Significant Research Results With Rigor, Relevance, and Practical Impact in Mind [J].
Aguinis, Herman ;
Werner, Steve ;
Abbott, JeAnna Lanza ;
Angert, Cory ;
Park, Joon Hyung ;
Kohlhausen, Donna .
ORGANIZATIONAL RESEARCH METHODS, 2010, 13 (03) :515-539