Refinements of MDL and MML coding

被引:17
作者
Wallace, CS [1 ]
Dowe, DL [1 ]
机构
[1] Monash Univ, Clayton, Vic 3168, Australia
关键词
D O I
10.1093/comjnl/42.4.330
中图分类号
TP3 [计算技术、计算机技术];
学科分类号
0812 ;
摘要
We discuss Rissanen's scheme of 'complete coding' in which a two-part data code is Further shortened by conditioning the second part not only on the estimates, but also on the fact that these estimates were preferred to any others. We show that the scheme does not lead to improved estimates of parameters. The resulting message lengths may validly be employed to select among competing model classes in a global hypothesis space, but not to select a single member of the chosen class. A related coding scheme is introduced in which the message commences by encoding an ancillary statistic, and then states parameter estimates using a code conditioned on this statistic. The use of Jeffreys priors in MDL codes is questioned and the resulting normalization difficulties and violations of the likelihood principle are discussed, We argue that the MDL objective of avoiding Bayesian Driers mag; be better pursued by other means.
引用
收藏
页码:330 / 337
页数:8
相关论文
共 12 条
  • [1] [Anonymous], P 14 INT C UNC AI
  • [2] BAXTER RA, 1996, INFORMATION STAT IND, P292
  • [3] BAXTER RA, 1995, 207 MDL MML TR MON U
  • [4] Bernardo J.M., 2009, Bayesian Theory, V405
  • [5] DOM BE, 1996, 1003090526 RJ IBM
  • [6] DOWE DL, 1996, LECT NOTES ARTIF INT, V1160, P213
  • [7] LINDLEY DV, 1972, BAYESIAN STAT REV, P71
  • [8] Hypothesis selection and testing by the MDL principle
    Rissanen, J
    [J]. COMPUTER JOURNAL, 1999, 42 (04) : 260 - 269
  • [9] RISSANEN J, 1987, J ROY STAT SOC B MET, V49, P223
  • [10] Rissanen J., 1989, STOCHASTIC COMPLEXIT