When should potentially false research findings be considered acceptable?

被引:47
作者
Djulbegovic, Benjamin [1 ]
Hozo, Iztok
机构
[1] Univ S Florida, H Lee Moffit Canc Ctr & Res Inst, Dept Interdisciplinary Oncol, Tampa, FL USA
[2] Indiana Univ NW, Dept Math, Gary, IN USA
关键词
MEDICAL STATISTICS; DECISION-MAKING; CLINICAL-TRIALS; REGRET; BENEFIT; RISK;
D O I
10.1371/journal.pmed.0040026
中图分类号
R5 [内科学];
学科分类号
1002 ; 100201 ;
摘要
Ioannidis estimated that most published research findings are false [1], but he did not indicate when, if at all, potentially false research results may be considered as acceptable to society. We combined our two previously published models [2,3] to calculate the probability above which research findings may become acceptable. A new model indicates that the probability above which research results should be accepted depends on the expected payback from the research (the benefits) and the inadvertent consequences (the harms). This probability may dramatically change depending on our willingness to tolerate error in accepting false research findings. Our acceptance of research findings changes as a function of what we call "acceptable regret," i.e., our tolerance of making a wrong decision in accepting the research hypothesis. We illustrate our findings by providing a new framework for early stopping rules in clinical research (i.e., when should we accept early findings from a clinical trial indicating the benefits as true?). Obtaining absolute "truth" in research is impossible, and so society has to decide when less-than-perfect results may become acceptable. © 2007 Djulbegovic and Hozo.
引用
收藏
页码:211 / 217
页数:7
相关论文
共 27 条
[2]   Equipoise, knowledge and ethics in clinical research and practice [J].
Ashcroft, R .
BIOETHICS, 1999, 13 (3-4) :314-326
[3]   Randomized, controlled intervention trial of male circumcision for reduction of HIV infection risk: The ANRS 1265 trial [J].
Auvert, B ;
Taljaard, D ;
Lagarde, E ;
Sobngwi-Tambekou, J ;
Sitta, M ;
Puren, A .
PLOS MEDICINE, 2005, 2 (11) :1112-1122
[4]  
Bell D.E., 1988, DECISION MAKING DESC, DOI DOI 10.1017/CBO9780511598951.003
[5]   REGRET IN DECISION-MAKING UNDER UNCERTAINTY [J].
BELL, DE .
OPERATIONS RESEARCH, 1982, 30 (05) :961-981
[6]   ARE ALL SIGNIFICANT P-VALUES CREATED EQUAL - THE ANALOGY BETWEEN DIAGNOSTIC-TESTS AND CLINICAL RESEARCH [J].
BROWNER, WS ;
NEWMAN, TB .
JAMA-JOURNAL OF THE AMERICAN MEDICAL ASSOCIATION, 1987, 257 (18) :2459-2463
[7]   NULL RESULTS IN CLINICAL-TRIALS - THE NEED FOR A DECISION-THEORY APPROACH [J].
CIAMPI, A ;
TILL, JE .
BRITISH JOURNAL OF CANCER, 1980, 41 (04) :618-629
[8]  
DJLUBEGOVIC B, 2000, MEDGENMED, V2, pE6
[9]   Acceptable regret in medical decision making [J].
Djulbegovic, B ;
Hozo, I ;
Schwartz, A ;
McMasters, KM .
MEDICAL HYPOTHESES, 1999, 53 (03) :253-259
[10]   Equation and nomogram for calculation of testing and treatment thresholds [J].
Djulbegovic, B ;
Desoky, AH .
MEDICAL DECISION MAKING, 1996, 16 (02) :198-199