Increasing the reliability of reliability diagrams

被引:219
作者
Brocker, Jochen [1 ]
Smith, Leonard A.
机构
[1] London Sch Econ, Ctr Anal Time Series, London WC2A 2AE, England
[2] Univ Oxford, Pembroke Coll, Oxford, England
关键词
D O I
10.1175/WAF993.1
中图分类号
P4 [大气科学(气象学)];
学科分类号
0706 ; 070601 ;
摘要
The reliability diagram is a common diagnostic graph used to summarize and evaluate probabilistic forecasts. Its strengths lie in the ease with which it is produced and the transparency of its definition. While visually appealing, major long-noted shortcomings lie in the difficulty of interpreting the graph visually; for the most part, ambiguities arise from variations in the distributions of forecast probabilities and from various binning procedures. A resampling method for assigning consistency bars to the observed frequencies is introduced that allows for immediate visual evaluation as to just how likely the observed relative frequencies are under the assumption that the predicted probabilities are reliable. Further, an alternative presentation of the same information on probability paper eases quantitative evaluation and comparison. Both presentations can easily be employed for any method of binning.
引用
收藏
页码:651 / 661
页数:11
相关论文
共 13 条
  • [1] [Anonymous], APPLIED STATISTICS
  • [2] [Anonymous], 1995, STAT METHODS ATMOSPH
  • [3] Estimation of the reliability of ensemble-based probabilistic forecasts
    Atger, F
    [J]. QUARTERLY JOURNAL OF THE ROYAL METEOROLOGICAL SOCIETY, 2004, 130 (597) : 627 - 646
  • [4] Atger F, 2003, MON WEATHER REV, V131, P1509, DOI 10.1175//1520-0493(2003)131<1509:SAIVOT>2.0.CO
  • [5] 2
  • [6] Bonferroni C., 1936, PUBBLICAZIONI R I SU, V8, P3, DOI DOI 10.4135/9781412961288.N455
  • [7] Efron B., 1993, INTRO BOOTSTRAP MONO, DOI DOI 10.1201/9780429246593
  • [8] The rationale behind the success of multi-model ensembles in seasonal forecasting - I. Basic concept
    Hagedorn, R
    Doblas-Reyes, FJ
    Palmer, TN
    [J]. TELLUS SERIES A-DYNAMIC METEOROLOGY AND OCEANOGRAPHY, 2005, 57 (03) : 219 - 233
  • [9] Jolliffe IT, 2003, FORECAST VERIFICATIO
  • [10] MURPHY AH, 1987, MON WEATHER REV, V115, P1330, DOI 10.1175/1520-0493(1987)115<1330:AGFFFV>2.0.CO