Customer-Centric Science: Reporting Significant Research Results With Rigor, Relevance, and Practical Impact in Mind

被引:169
作者
Aguinis, Herman [1 ]
Werner, Steve [2 ]
Abbott, JeAnna Lanza [3 ]
Angert, Cory [2 ]
Park, Joon Hyung [2 ]
Kohlhausen, Donna
机构
[1] Indiana Univ, Dept Management & Entrepreneurship, Kelley Sch Business, Bloomington, IN 47405 USA
[2] Univ Houston, CT Bauer Coll Business, Downtown, TX USA
[3] Univ Houston, Conrad N Hilton Coll Hotel & Restaurant Managemen, Downtown, TX USA
关键词
statistical significance; practical significance; hypothesis testing; STATISTICAL SIGNIFICANCE TESTS; EFFECT SIZE; CONFIDENCE-INTERVALS; QUALITATIVE RESEARCH; ORGANIZATIONAL-PSYCHOLOGY; MULTIPLE-REGRESSION; EDITORIAL POLICIES; POWER; MANAGEMENT; KNOWLEDGE;
D O I
10.1177/1094428109333339
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
In response to the ongoing concern regarding a science-practice gap, we propose a customer-centric approach to reporting significant research results that involves a sequence of three interdependent steps. The first step involves setting an alpha level (i.e., a priori Type I error rate) that considers the relative seriousness of falsely rejecting a null hypothesis of no effect or relationship (i.e., Type I error) relative to not detecting an existing effect or relationship (i.e., Type II error) and reporting the actual observed p value (i.e., probability that the data would be obtained if the null hypothesis is true). The second step involves reporting estimates of the size of the effect or relationship, which indicate the extent to which an outcome is explained or predicted. The third step includes reporting results of a qualitative study to gather evidence regarding the practical significance of the effect or relationship. Our proposal to report research results with rigor, relevance, and practical impact involves important changes in how we report research results with the goal to bridge the science-practice gap.
引用
收藏
页码:515 / 539
页数:25
相关论文
共 112 条
  • [31] A POWER PRIMER
    COHEN, J
    [J]. PSYCHOLOGICAL BULLETIN, 1992, 112 (01) : 155 - 159
  • [32] Cohen J., 1988, Statistical power analysis for the behavioral sciences, VSecond
  • [33] Connelly FM, 2006, HANDBOOK OF COMPLEMENTARY METHODS IN EDUCATION RESEARCH, P477
  • [34] Cortina JM, 2009, STATISTICAL AND METHODOLOGICAL MYTHS AND URBAN LEGENDS: DOCTRINE, VERITY AND FABLE IN THE ORGANIZATIONAL AND SOCIAL SCIENCES, P287
  • [35] When Is It Acceptable to Accept a Null Hypothesis: No Way, Jose?
    Cortina, Jose M.
    Folger, Robert G.
    [J]. ORGANIZATIONAL RESEARCH METHODS, 1998, 1 (03) : 334 - 350
  • [36] Cumming G, 2001, EDUC PSYCHOL MEAS, V61, P532, DOI 10.1177/00131640121971374
  • [37] Cummings TG, 2007, ACAD MANAGE REV, V32, P355
  • [38] A content analysis of the content analysis literature in organization studies - Research themes, data sources, and methodological refinements
    Duriau, Vincent J.
    Reger, Rhonda K.
    Pfarrer, Michael D.
    [J]. ORGANIZATIONAL RESEARCH METHODS, 2007, 10 (01) : 5 - 34
  • [39] Working with pluralism-determining quality in qualitative research
    Easterby-Smith, Mark
    Golden-Biddle, Karen
    Locke, Karen
    [J]. ORGANIZATIONAL RESEARCH METHODS, 2008, 11 (03) : 419 - 429
  • [40] Statistical significance and effect size in education research: Two sides of a coin
    Fan, XT
    [J]. JOURNAL OF EDUCATIONAL RESEARCH, 2001, 94 (05) : 275 - 282