Universal prediction

被引:280
作者
Merhav, N [1 ]
Feder, M
机构
[1] Technion Israel Inst Technol, Dept Elect Engn, IL-32000 Haifa, Israel
[2] Tel Aviv Univ, Dept Elect Engn Syst, IL-69978 Tel Aviv, Israel
基金
以色列科学基金会;
关键词
Bayes envelope; entropy; finite-state machine; linear prediction; loss function; probability assignment; redundancy-capacity; stochastic complexity; universal coding; universal prediction;
D O I
10.1109/18.720534
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper consists of an overview on universal prediction from an information-theoretic perspective. Special attention is given to the notion of probability assignment under the self-information loss function, which is directly related to the theory of universal data compression. Both the probabilistic setting and the deterministic setting of the universal prediction problem are described with emphasis on the analog and the differences between results in the two settings.
引用
收藏
页码:2124 / 2147
页数:24
相关论文
共 128 条
[1]   ASYMPTOTICALLY EFFICIENT ADAPTIVE ALLOCATION SCHEMES FOR CONTROLLED IID PROCESSES - FINITE PARAMETER SPACE [J].
AGRAWAL, R ;
TENEKETZIS, D ;
ANANTHARAM, V .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1989, 34 (03) :258-267
[2]   ASYMPTOTICALLY EFFICIENT ADAPTIVE ALLOCATION SCHEMES FOR CONTROLLED MARKOV-CHAINS - FINITE PARAMETER SPACE [J].
AGRAWAL, R ;
TENEKETZIS, D ;
ANANTHARAM, V .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1989, 34 (12) :1249-1259
[3]   UNIVERSAL SCHEMES FOR PREDICTION, GAMBLING AND PORTFOLIO SELECTION [J].
ALGOET, P .
ANNALS OF PROBABILITY, 1992, 20 (02) :901-941
[4]   ASYMPTOTIC OPTIMALITY AND ASYMPTOTIC EQUIPARTITION PROPERTIES OF LOG-OPTIMUM INVESTMENT [J].
ALGOET, PH ;
COVER, TM .
ANNALS OF PROBABILITY, 1988, 16 (02) :876-898
[5]   THE STRONG LAW OF LARGE NUMBERS FOR SEQUENTIAL DECISIONS UNDER UNCERTAINTY [J].
ALGOET, PH .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1994, 40 (03) :609-633
[6]  
[Anonymous], MCGRAWHILL SERIES EL
[7]  
[Anonymous], MEMOIRES ACAD ROYALE
[8]  
Bailey D. H., 1976, THESIS STANFORD U ST
[9]  
BERNARDO JM, 1979, J R STAT SOC B, V41, P113
[10]  
Blackwell D., 1956, PAC J MATH, V6, P1, DOI [DOI 10.2140/PJM.1956.6.1, 10.2140/pjm.1956.6.1]