An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection

被引:195
作者
Aguinis, Herman [1 ]
Vandenberg, Robert J. [2 ]
机构
[1] Indiana Univ, Kelley Sch Business, Dept Management & Entrepreneurship, Bloomington, IN 47405 USA
[2] Univ Georgia, Terry Coll Business, Dept Management, Athens, GA 30602 USA
来源
ANNUAL REVIEW OF ORGANIZATIONAL PSYCHOLOGY AND ORGANIZATIONAL BEHAVIOR, VOL 1 | 2014年 / 1卷
关键词
theory development; theory testing; research design; measurement; methodology; research quality; validity; causality; CONSTRUCT-VALIDATION; MANAGEMENT RESEARCH; STATISTICAL CONTROL; ORGANIZATIONAL-PSYCHOLOGY; PHD PROGRAMS; SCIENCE; POWER; METHODOLOGY; VARIABLES; RELEVANCE;
D O I
10.1146/annurev-orgpsych-031413-091231
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
We rely on classic as well as recently published sources to offer a review of theory, research design, and measurement issues that should be considered prior to conducting any empirical study. First, we examine theory-related issues that should be addressed before research design and measurement considerations. Specifically, we discuss how to make meaningful theoretical progress including the use of inductive and deductive approaches, address an important issue, and conduct research with a practical end in mind. Second, we offer recommendations regarding research design, including how to address the low statistical power challenge, design studies that strengthen inferences about causal relationships, and use control variables appropriately. Finally, we address measurement issues. Specifically, we discuss how to improve the link between underlying constructs and their observable indicators. Our review offers a checklist for use by researchers to improve research quality prior to data collection and by journal editors and reviewers to evaluate the quality of submitted manuscripts.
引用
收藏
页码:569 / 595
页数:27
相关论文
共 115 条
[11]   First Decade of Organizational Research Methods Trends in Design, Measurement, and Data-Analysis Topics [J].
Aguinis, Herman ;
Pierce, Charles A. ;
Bosco, Frank A. ;
Muslin, Ivan S. .
ORGANIZATIONAL RESEARCH METHODS, 2009, 12 (01) :69-112
[12]   Doctoral training in statistics, measurement, and methodology in psychology - Replication and extension of Aiken, West, Sechrest, and Reno's (1990) survey of PhD programs in North America [J].
Aiken, Leona S. ;
West, Stephen G. ;
Millsap, Roger E. .
AMERICAN PSYCHOLOGIST, 2008, 63 (01) :32-50
[13]   GRADUATE TRAINING IN STATISTICS, METHODOLOGY, AND MEASUREMENT IN PSYCHOLOGY - A SURVEY OF PHD PROGRAMS IN NORTH-AMERICA [J].
AIKEN, LS ;
WEST, SG ;
SECHREST, L ;
RENO, RR ;
ROEDIGER, HL ;
SCARR, S ;
KAZDIN, AE ;
SHERMAN, SJ .
AMERICAN PSYCHOLOGIST, 1990, 45 (06) :721-734
[14]   The practitioner-researcher divide revisited: Strategic-level bridges and the roles of IWO psychologists [J].
Anderson, Neil .
JOURNAL OF OCCUPATIONAL AND ORGANIZATIONAL PSYCHOLOGY, 2007, 80 :175-183
[15]  
[Anonymous], 2010, ACAD MANAG LEARN EDU
[16]   A General Approach for Representing Constructs in Organizational Research [J].
Bagozzi, Richard P. ;
Edwards, Jeffrey R. .
ORGANIZATIONAL RESEARCH METHODS, 1998, 1 (01) :45-87
[17]   ASSESSING CONSTRUCT-VALIDITY IN ORGANIZATIONAL RESEARCH [J].
BAGOZZI, RP ;
LI, YJ ;
PHILLIPS, LW .
ADMINISTRATIVE SCIENCE QUARTERLY, 1991, 36 (03) :421-458
[19]  
Bartunek JM, 2006, ACAD MANAGE J, V49, P9
[20]   Potential problems in the statistical control of variables in organizational research: A qualitative analysis with recommendations [J].
Becker, TE .
ORGANIZATIONAL RESEARCH METHODS, 2005, 8 (03) :274-289