An Ounce of Prevention Is Worth a Pound of Cure: Improving Research Quality Before Data Collection

被引:195
作者
Aguinis, Herman [1 ]
Vandenberg, Robert J. [2 ]
机构
[1] Indiana Univ, Kelley Sch Business, Dept Management & Entrepreneurship, Bloomington, IN 47405 USA
[2] Univ Georgia, Terry Coll Business, Dept Management, Athens, GA 30602 USA
来源
ANNUAL REVIEW OF ORGANIZATIONAL PSYCHOLOGY AND ORGANIZATIONAL BEHAVIOR, VOL 1 | 2014年 / 1卷
关键词
theory development; theory testing; research design; measurement; methodology; research quality; validity; causality; CONSTRUCT-VALIDATION; MANAGEMENT RESEARCH; STATISTICAL CONTROL; ORGANIZATIONAL-PSYCHOLOGY; PHD PROGRAMS; SCIENCE; POWER; METHODOLOGY; VARIABLES; RELEVANCE;
D O I
10.1146/annurev-orgpsych-031413-091231
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
We rely on classic as well as recently published sources to offer a review of theory, research design, and measurement issues that should be considered prior to conducting any empirical study. First, we examine theory-related issues that should be addressed before research design and measurement considerations. Specifically, we discuss how to make meaningful theoretical progress including the use of inductive and deductive approaches, address an important issue, and conduct research with a practical end in mind. Second, we offer recommendations regarding research design, including how to address the low statistical power challenge, design studies that strengthen inferences about causal relationships, and use control variables appropriately. Finally, we address measurement issues. Specifically, we discuss how to improve the link between underlying constructs and their observable indicators. Our review offers a checklist for use by researchers to improve research quality prior to data collection and by journal editors and reviewers to evaluate the quality of submitted manuscripts.
引用
收藏
页码:569 / 595
页数:27
相关论文
共 115 条
[71]   The persistence of underpowered studies in psychological research: Causes, consequences, and remedies [J].
Maxwell, SE .
PSYCHOLOGICAL METHODS, 2004, 9 (02) :147-163
[72]   Using Computer-Aided Text Analysis to Elevate Constructs: An Illustration Using Psychological Capital [J].
McKenny, Aaron F. ;
Short, Jeremy C. ;
Payne, G. Tyge .
ORGANIZATIONAL RESEARCH METHODS, 2013, 16 (01) :152-184
[74]   HIGH SCHOOL YEARBOOKS - REPLY [J].
MEEHL, PE .
JOURNAL OF ABNORMAL PSYCHOLOGY, 1971, 77 (02) :143-&
[75]   A person-centered approach to the study of commitment [J].
Meyer, John P. ;
Stanley, Laura J. ;
Vandenberg, Robert J. .
HUMAN RESOURCE MANAGEMENT REVIEW, 2013, 23 (02) :190-202
[76]   The perceptions and usage of statistical power in applied psychology and management research [J].
Mone, MA ;
Mueller, GC ;
Mauland, W .
PERSONNEL PSYCHOLOGY, 1996, 49 (01) :103-120
[77]  
Murphy K.R., 1998, Statistical power analysis: A simple and general model for traditional and modern hypothesis tests
[78]  
Nunnally J.C., 1994, Psychometric theory, V3, P248, DOI DOI 10.2307/1161962
[79]   How Can Significance Tests Be Deinstitutionalized? [J].
Orlitzky, Marc .
ORGANIZATIONAL RESEARCH METHODS, 2012, 15 (02) :199-228