Explaining Variational Approximations

被引：237

作者：

Ormerod, J. T. ^{[1
]}

Wand, M. P. ^{[2
]}

机构：

[1] Univ Sydney, Sch Math & Stat, Sydney, NSW 2006, Australia

[2] Univ Wollongong, Ctr Stat & Survey Methodol, Sch Math & Appl Stat, Wollongong, NSW 2522, Australia

来源：

AMERICAN STATISTICIAN | 2010年 / 64卷 / 02期

基金：

澳大利亚研究理事会;

关键词：

Bayesian inference; Bayesian networks; Directed acyclic graphs; Generalized linear mixed models; Kullback-Leibler divergence; Linear mixed models; BAYESIAN MODEL SELECTION; INFERENCE;

D O I：

10.1198/tast.2010.09058

中图分类号：

O21 [概率论与数理统计]; C8 [统计学];

学科分类号：

020208 ; 070103 ; 0714 ;

摘要：

Variational approximations facilitate approximate inference for the parameters in complex statistical models and provide fast, deterministic alternatives to Monte Carlo methods. However, much of the contemporary literature on variational approximations is in Computer Science rather than Statistics, and uses terminology, notation, and examples from the former field. In this article we explain variational approximation in statistical terms. In particular, we illustrate the ideas of variational approximation using examples that are familiar to statisticians.

引用

页码：140 / 153

页数：14

共 36 条

[21]

McLachlan G., 1997, The EM Algorithm and Extensions

[22]

Minka T., 2009, INFER NET 2 3

[23]

Parisi G., 1988, STAT FIELD THEORY, DOI DOI 10.1063/1.2811677

[24]

Pearl Judea, 1988, Probabilistic Reasoning in Intelligent Systems: Networks of Plausible Inference, DOI DOI 10.1016/C2009-0-27609-4

[25]

Pinheiro JC, 2000, MIXED EFFECTS MODELS, DOI DOI 10.1007/B98882

[26] S-convexity revisited (fuzzy): long version [J].

Pinheiro, M. R. .

OPTIMIZATION LETTERS, 2009, 3 (01) :1-6

[27]

Pournelle G. H., 1953, Journal of Mammalogy, V34, P133, DOI 10.1890/0012-9658(2002)083[1421:SDEOLC]2.0.CO

[28]

[29]

Rockafellar R. T., 1970, Convex Analysis

[30]

Seeger M, 2000, ADV NEUR IN, V12, P603

← 1 2 3 4 →