How Can Significance Tests Be Deinstitutionalized?

被引:54
作者
Orlitzky, Marc [1 ]
机构
[1] Penn State Univ, Altoona, PA 16601 USA
关键词
philosophy of science; quantitative research; historical social science; meta-analysis; structural equation modeling; NULL-HYPOTHESIS; STATISTICAL SIGNIFICANCE; CONFIDENCE-INTERVALS; ORGANIZATIONAL SCIENCE; CUMULATIVE KNOWLEDGE; SOCIAL PERFORMANCE; APPLIED-PSYCHOLOGY; MANAGEMENT; METAANALYSIS; JOURNALS;
D O I
10.1177/1094428111428356
中图分类号
B849 [应用心理学];
学科分类号
040203 ;
摘要
The purpose of this article is to propose possible solutions to the methodological problem of null hypothesis significance testing (NHST), which is framed as deeply embedded in the institutional structure of the social and organizational sciences. The core argument is that, for the deinstitutionalization of statistical significance tests, minor methodological changes within an unreformed epistemology will be as unhelpful as emotive exaggerations of the ill effects of NHST. Instead, several institutional-epistemological reforms affecting cultural-cognitive, normative, and regulative processes and structures in the social sciences are necessary and proposed in this article. In the conclusion, the suggested research reforms, ranging from greater emphasis on inductive and abductive reasoning to statistical modeling and Bayesian epistemology, are classified according to their practical importance and the time horizon expected for their implementation. Individual-level change in researchers' use of NHST is unlikely if it is not facilitated by these broader epistemological changes.
引用
收藏
页码:199 / 228
页数:30
相关论文
共 248 条
[81]   BUILDING THEORIES FROM CASE-STUDY RESEARCH [J].
EISENHARDT, KM .
ACADEMY OF MANAGEMENT REVIEW, 1989, 14 (04) :532-550
[82]   SIGNIFICANCE TESTS DIE HARD - THE AMAZING PERSISTENCE OF A PROBABILISTIC MISCONCEPTION [J].
FALK, R ;
GREENBAUM, CW .
THEORY & PSYCHOLOGY, 1995, 5 (01) :75-98
[83]   Editors can lead researchers to confidence intervals, but can't make them think - Statistical reform lessons from medicine [J].
Fidler, F ;
Thomason, N ;
Cumming, G ;
Finch, S ;
Leeman, J .
PSYCHOLOGICAL SCIENCE, 2004, 15 (02) :119-126
[84]   The fifth edition of the APA Publication Manual:: Why its statistics recommendations are so controversial [J].
Fidler, F .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2002, 62 (05) :749-770
[85]  
Fidler F., 2004, Journal of Socio-Economics, V33, P615, DOI DOI 10.1016/J.SOCEC.2004.09.035
[86]   Past and future American Psychological Association guidelines for statistical practice [J].
Finch, S ;
Thomason, N ;
Cumming, G .
THEORY & PSYCHOLOGY, 2002, 12 (06) :825-853
[87]   Reporting of statistical inference in the Journal of Applied Psychology:: Little evidence of reform [J].
Finch, S ;
Cumming, G ;
Thomason, N .
EDUCATIONAL AND PSYCHOLOGICAL MEASUREMENT, 2001, 61 (02) :181-210
[88]  
Friedman M., 1953, ESSAYS POSITIVE EC
[89]  
Fuchs S., 2001, Handbook of sociological theory, P21
[90]   HOW ARE THE MIGHTY FALLEN - REJECTED CLASSIC ARTICLES BY LEADING ECONOMISTS [J].
GANS, JS ;
SHEPHERD, GB .
JOURNAL OF ECONOMIC PERSPECTIVES, 1994, 8 (01) :165-179