When should potentially false research findings be considered acceptable?

被引:47
作者
Djulbegovic, Benjamin [1 ]
Hozo, Iztok
机构
[1] Univ S Florida, H Lee Moffit Canc Ctr & Res Inst, Dept Interdisciplinary Oncol, Tampa, FL USA
[2] Indiana Univ NW, Dept Math, Gary, IN USA
关键词
MEDICAL STATISTICS; DECISION-MAKING; CLINICAL-TRIALS; REGRET; BENEFIT; RISK;
D O I
10.1371/journal.pmed.0040026
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Ioannidis estimated that most published research findings are false [1], but he did not indicate when, if at all, potentially false research results may be considered as acceptable to society. We combined our two previously published models [2,3] to calculate the probability above which research findings may become acceptable. A new model indicates that the probability above which research results should be accepted depends on the expected payback from the research (the benefits) and the inadvertent consequences (the harms). This probability may dramatically change depending on our willingness to tolerate error in accepting false research findings. Our acceptance of research findings changes as a function of what we call "acceptable regret," i.e., our tolerance of making a wrong decision in accepting the research hypothesis. We illustrate our findings by providing a new framework for early stopping rules in clinical research (i.e., when should we accept early findings from a clinical trial indicating the benefits as true?). Obtaining absolute "truth" in research is impossible, and so society has to decide when less-than-perfect results may become acceptable. © 2007 Djulbegovic and Hozo.
引用
收藏
页码:211 / 217
页数:7
相关论文
共 27 条
[21]   Better reporting of harms in randomized trials: An extension of the CONSORT statement [J].
Ioannidis, JPA ;
Evans, SJW ;
Gotzsche, PC ;
O'Neill, RT ;
Altman, DG ;
Schulz, K ;
Moher, D .
ANNALS OF INTERNAL MEDICINE, 2004, 141 (10) :781-788
[22]   REGRET THEORY - AN ALTERNATIVE THEORY OF RATIONAL CHOICE UNDER UNCERTAINTY [J].
LOOMES, G ;
SUGDEN, R .
ECONOMIC JOURNAL, 1982, 92 (368) :805-824
[23]   CLINICAL-TRIALS AS DIAGNOSTIC-TESTS [J].
PATER, JL ;
WILLAN, AR .
CONTROLLED CLINICAL TRIALS, 1984, 5 (02) :107-113
[24]   THERAPEUTIC DECISION-MAKING - COST-BENEFIT ANALYSIS [J].
PAUKER, SG ;
KASSIRER, JP .
NEW ENGLAND JOURNAL OF MEDICINE, 1975, 293 (05) :229-234
[25]   When (not) to stop a clinical trial for benefit [J].
Pocock, SJ .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 2005, 294 (17) :2228-2230
[26]  
WACHOLODER S, 2004, JNCI-J NATL CANCER I, V96, P432
[27]   Presumed benefit: lessons from the American experience with marrow transplantation for breast cancer [J].
Welch, HG ;
Mogielnicki, J .
BMJ-BRITISH MEDICAL JOURNAL, 2002, 324 (7345) :1088-1092