Standardizing diagnostic markers to evaluate and compare their performance

被引:52
作者
Pepe, MS
Longton, G
机构
[1] Univ Washington, Dept Biostat, Seattle, WA 98195 USA
[2] Fred Hutchinson Canc Res Ctr, Div Publ Hlth Sci, Seattle, WA 98104 USA
关键词
D O I
10.1097/01.ede.0000173041.03470.8b
中图分类号
R1 [预防医学、卫生学];
学科分类号
1004 ; 120402 ;
摘要
Background: Markers that purport to distinguish subjects with a condition from those without a condition must be evaluated rigorously for their classification accuracy. A single approach for statistical evaluation and comparison of markers is not yet established. Methods: We suggest a standardization that uses the marker distribution in unaffected subjects as a reference. For an affected subject with marker value Y, the standardized placement value is the proportion of unaffected subjects with marker values that exceed Y. Results: We applied the standardization to 2 illustrative datasets. As a marker for pancreatic cancer, the CA-19-9 marker had smaller placement values than the CA-125 marker, indicating that CA-19-9 was the better marker. For detecting hearing impairment, the placement values for the test output (the marker) were smaller when the input sound stimulus was of lower intensity, which indicates that the test better distinguishes hearing-impaired from unimpaired ears when a lower intensity sound stimulus is used. Explicit connections are drawn between the distribution of standardized marker values and the receiver operating characteristic curve, one established statistical technique for evaluating classifiers. Conclusion: The standardization is an intuitive procedure for evaluating markers. It facilitates direct and meaningful comparisons between markers. It also provides a new view of receiver operating characteristic analysis that may render it more accessible to those as yet unfamiliar with it. The general approach provides a statistical tool to address important questions that are typically not addressed in current marker research, such as quantifying and controlling for covariate effects.
引用
收藏
页码:598 / 603
页数:6
相关论文
共 19 条
  • [1] [Anonymous], 1999, NAT GENET S, V21, P1
  • [2] The central role of receiver operating characteristic (ROC) curves in evaluating tests for the early detection of cancer
    Baker, SG
    [J]. JOURNAL OF THE NATIONAL CANCER INSTITUTE, 2003, 95 (07) : 511 - 515
  • [3] ADVANCES IN STATISTICAL METHODOLOGY FOR DIAGNOSTIC MEDICINE IN THE 1980S
    BEGG, CB
    [J]. STATISTICS IN MEDICINE, 1991, 10 (12) : 1887 - 1895
  • [4] Semi-parametric ROC regression analysis with placement values
    Cai, TX
    [J]. BIOSTATISTICS, 2004, 5 (01) : 45 - 60
  • [5] Efron B., 1994, INTRO BOOTSTRAP, DOI DOI 10.1201/9780429246593
  • [6] The case for early detection
    Etzioni, R
    Urban, N
    Ramsey, S
    McIntosh, M
    Schwartz, S
    Reid, B
    Radich, J
    Anderson, G
    Hartwell, L
    [J]. NATURE REVIEWS CANCER, 2003, 3 (04) : 243 - 252
  • [7] FRISCHANCHO AR, 1990, ANTHROPOMETRIC STAND
  • [8] Sampling variability of nonparametric estimates of the areas under receiver operating characteristic curves: An update
    Hanley, JA
    HajianTilaki, KO
    [J]. ACADEMIC RADIOLOGY, 1997, 4 (01) : 49 - 58
  • [9] HANLEY JA, 1989, CRIT REV DIAGN IMAG, V29, P307
  • [10] Written in blood
    Liotta, LA
    Ferrari, M
    Petricoin, E
    [J]. NATURE, 2003, 425 (6961) : 905 - 905