Field theories for learning probability distributions

被引:82
作者
Bialek, W [1 ]
Callan, CG [1 ]
Strong, SP [1 ]
机构
[1] PRINCETON UNIV, DEPT PHYS, PRINCETON, NJ 08544 USA
关键词
D O I
10.1103/PhysRevLett.77.4693
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
Imagine being shown N samples of random variables drawn independently from the same distribution. What can you say about the distribution? In general, of course, the answer is nothing, unless you have some prior notions about what to expect. From a Bayesian point of view one needs an a priori distribution on the space of possible probability distributions, which defines st scalar field theory. In one dimension, free field theory with a normalization constraint provides a tractable formulation of the problem, and we discuss generalizations to higher dimensions.
引用
收藏
页码:4693 / 4697
页数:5
相关论文
共 11 条
[1]  
BALASUBRAMANIAN V, IN PRESS NEURAL COMP
[2]   MINIMUM COMPLEXITY DENSITY-ESTIMATION [J].
BARRON, AR ;
COVER, TM .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1991, 37 (04) :1034-1054
[3]   APPROXIMATION OF DENSITY-FUNCTIONS BY SEQUENCES OF EXPONENTIAL-FAMILIES [J].
BARRON, AR ;
SHEU, CH .
ANNALS OF STATISTICS, 1991, 19 (03) :1347-1369
[4]  
COLEMAN S, 1975, ASPECTS SYMMETRY
[5]  
Earman J., 1992, BAYES BUST CRITICAL
[6]  
Li M., 1993, An introduction to Kolmogorov complexity and its applications
[7]  
MACKAY DJC, 1992, NEURAL COMPUT, V4, P415, DOI [10.1162/neco.1992.4.3.415, 10.1162/neco.1992.4.3.448]
[8]   UNIVERSAL CODING, INFORMATION, PREDICTION, AND ESTIMATION [J].
RISSANEN, J .
IEEE TRANSACTIONS ON INFORMATION THEORY, 1984, 30 (04) :629-636
[9]   STOCHASTIC COMPLEXITY AND MODELING [J].
RISSANEN, J .
ANNALS OF STATISTICS, 1986, 14 (03) :1080-1100
[10]  
Rissanen J., 1989, STOCHASTIC COMPLEXIT