How Can Significance Tests Be Deinstitutionalized?

被引:54
作者
Orlitzky, Marc [1 ]
机构
[1] Penn State Univ, Altoona, PA 16601 USA
关键词
philosophy of science; quantitative research; historical social science; meta-analysis; structural equation modeling; NULL-HYPOTHESIS; STATISTICAL SIGNIFICANCE; CONFIDENCE-INTERVALS; ORGANIZATIONAL SCIENCE; CUMULATIVE KNOWLEDGE; SOCIAL PERFORMANCE; APPLIED-PSYCHOLOGY; MANAGEMENT; METAANALYSIS; JOURNALS;
D O I
10.1177/1094428111428356
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The purpose of this article is to propose possible solutions to the methodological problem of null hypothesis significance testing (NHST), which is framed as deeply embedded in the institutional structure of the social and organizational sciences. The core argument is that, for the deinstitutionalization of statistical significance tests, minor methodological changes within an unreformed epistemology will be as unhelpful as emotive exaggerations of the ill effects of NHST. Instead, several institutional-epistemological reforms affecting cultural-cognitive, normative, and regulative processes and structures in the social sciences are necessary and proposed in this article. In the conclusion, the suggested research reforms, ranging from greater emphasis on inductive and abductive reasoning to statistical modeling and Bayesian epistemology, are classified according to their practical importance and the time horizon expected for their implementation. Individual-level change in researchers' use of NHST is unlikely if it is not facilitated by these broader epistemological changes.
引用
收藏
页码:199 / 228
页数:30
相关论文
共 248 条
[1]  
Abelson R., 1997, MULTIVAR APPL SER, P117
[2]  
Abelson RP., 1995, Statistics as principled argument
[3]   Management fashion [J].
Abrahamson, E .
ACADEMY OF MANAGEMENT REVIEW, 1996, 21 (01) :254-285
[4]   VALIDITY GENERALIZATION - SOME CRITICAL REMARKS ON THE SCHMIDT-HUNTER PROCEDURE [J].
ALGERA, JA ;
JANSEN, PGW ;
ROE, RA ;
VIJN, P .
JOURNAL OF OCCUPATIONAL PSYCHOLOGY, 1984, 57 (03) :197-210
[5]  
American Psychological Association, 2010, Publication manual of the American Psychological Association, V6th
[6]   Null hypothesis testing: Problems, prevalence, and an alternative [J].
Anderson, DR ;
Burnham, KP ;
Thompson, WL .
JOURNAL OF WILDLIFE MANAGEMENT, 2000, 64 (04) :912-923
[7]  
[Anonymous], APPL MULTIVARIATE ST
[8]  
[Anonymous], 1965, HDB CLIN PSYCHOL
[9]  
[Anonymous], 1997, MULTIVAR APPL SER
[10]  
[Anonymous], 1981, STAT BRITAIN 1865 19