Fastest mixing Markov chain on a graph

被引:106
作者
Boyd, S [1 ]
Diaconis, P
Xiao, L
机构
[1] Stanford Univ, Dept Elect Engn, Informat Syst Lab, Stanford, CA 94305 USA
[2] Stanford Univ, Dept Stat, Stanford, CA 94305 USA
[3] Stanford Univ, Dept Math, Stanford, CA 94305 USA
关键词
Markov chains; second largest eigenvalue modulus; fast mixing; semidefinite programming; subgradient method;
D O I
10.1137/s0036144503423264
中图分类号
O29 [应用数学];
学科分类号
070104 ;
摘要
We consider a symmetric random walk on a connected graph, where each edge is labeled with the probability of transition between the two adjacent vertices. The associated Markov chain has a uniform equilibrium distribution; the rate of convergence to this distribution, i.e., the mixing rate of the Markov chain, is determined by the second largest eigenvalue modulus (SLEM) of the transition probability matrix. In this paper we address the problem of assigning probabilities to the edges of the graph in such a way as to minimize the SLEM, i.e., the problem of finding the fastest mixing Markov chain on the graph. We show that this problem can be formulated as a convex optimization problem, which can in turn be expressed as a semidefinite program (SDP). This allows us to easily compute the (globally) fastest mixing Markov chain for any graph with a modest number of edges (say, 1000) using standard numerical methods for SDPs. Larger problems can be solved by exploiting various types of symmetry and structure in the problem, and far larger problems (say, 100,000 edges) can be solved using a subgradient method we describe. We compare the fastest mixing Markov chain to those obtained using two commonly used heuristics: the maximum-degree method, and the Metropolis-Hastings algorithm. For many of the examples considered, the fastest mixing Markov chain is substantially faster than those obtained using these heuristic methods. We derive the Lagrange dual of the fastest mixing Markov chain problem, which gives a sophisticated method for obtaining (arbitrarily good) bounds on the optimal mixing rate, as well as the optimality conditions. Finally, we describe various extensions of the method, including a solution of the problem of finding the fastest mixing reversible Markov chain, on a fixed graph, with a given equilibrium distribution.
引用
收藏
页码:667 / 689
页数:23
相关论文
共 56 条
[1]  
ALDOUS D, 1983, LECT NOTES MATH, V986, P243
[2]   INTERIOR-POINT METHODS IN SEMIDEFINITE PROGRAMMING WITH APPLICATIONS TO COMBINATORIAL OPTIMIZATION [J].
ALIZADEH, F .
SIAM JOURNAL ON OPTIMIZATION, 1995, 5 (01) :13-51
[3]  
ALIZADEH F, 1997, SDPPACK PACKAGE SEMI
[4]  
[Anonymous], 1994, SIAM STUD APPL MATH
[5]  
[Anonymous], 2000, INTRO MARKOV CHAINS, DOI DOI 10.1007/978-1-4612-1590-5_8
[6]  
[Anonymous], 2013, Markov chains: Gibbs fields, Monte Carlo simulation, and queues
[7]  
[Anonymous], 2001, SPRINGER SER STAT
[8]  
[Anonymous], SDPSOL PARSER SOLVER
[9]   Solving large-scale sparse semidefinite programs for combinatorial optimization [J].
Benson, SJ ;
Ye, YY ;
Zhang, X .
SIAM JOURNAL ON OPTIMIZATION, 2000, 10 (02) :443-461
[10]  
BENTAL A, 2001, MPS SIAM SER OPTIM, V2