Descent methods for optimization on homogeneous manifolds

被引:12
作者
Celledoni, Elena [1 ]
Fiori, Simone [2 ]
机构
[1] Norwegian Univ Sci & Technol, Dept Math Sci, Fac Informat Technol Math & Elect Engn, NO-7491 Trondheim, Norway
[2] Univ Politecn Marche, Fac Ingn, Dipartimento Elettron Intelligenza Artificiale, I-60131 Ancona, Italy
关键词
Optimization on manifolds; Lie group actions; Eigen-problems; Independent component analysis; Signal processing;
D O I
10.1016/j.matcom.2008.03.013
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
In this article we present a framework for line search methods for optimization on smooth homogeneous manifolds, with particular emphasis to the Lie group of real orthogonal matrices. We propose strategies of univariate descent (UVD), methods. The main advantage of this approach is that the optimization problem is broken down into one-dimensional optimization problems, so that each optimization step involves little computation effort. In order to assess its numerical performance, we apply the devised method to eigen-problems as well as to independent component analysis in signal processing. (C) 2008 IMACS. Published by Elsevier B.V. All rights reserved.
引用
收藏
页码:1298 / 1323
页数:26
相关论文
共 38 条
[1]  
ABSIL PA, 2007, J FOCM, V7
[2]   Newton's method on Riemannian manifolds and a geometric model for the human spine [J].
Adler, RL ;
Dedieu, JP ;
Margulies, JY ;
Martens, M ;
Shub, M .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2002, 22 (03) :359-390
[3]   DYNAMIC-SYSTEMS THAT SORT LISTS, DIAGONALIZE MATRICES, AND SOLVE LINEAR-PROGRAMMING PROBLEMS [J].
BROCKETT, RW .
LINEAR ALGEBRA AND ITS APPLICATIONS, 1991, 146 :79-91
[4]   Approximating the exponential from a Lie algebra to a Lie group [J].
Celledoni, E ;
Iserles, A .
MATHEMATICS OF COMPUTATION, 2000, 69 (232) :1457-1480
[5]   Neural learning by geometric integration of reduced 'rigid-body' equations [J].
Celledoni, E ;
Fiori, S .
JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS, 2004, 172 (02) :247-269
[6]   On the implementation of Lie group methods on the Stiefel manifold [J].
Celledoni, E ;
Owren, B .
NUMERICAL ALGORITHMS, 2003, 32 (2-4) :163-183
[7]   Methods for the approximation of the matrix exponential in a Lie-algebraic setting [J].
Celledoni, E ;
Iserles, A .
IMA JOURNAL OF NUMERICAL ANALYSIS, 2001, 21 (02) :463-488
[8]   THE PROJECTED GRADIENT-METHOD FOR LEAST-SQUARES MATRIX APPROXIMATIONS WITH SPECTRAL CONSTRAINTS [J].
CHU, MT ;
DRIESSEL, KR .
SIAM JOURNAL ON NUMERICAL ANALYSIS, 1990, 27 (04) :1050-1060
[9]   INDEPENDENT COMPONENT ANALYSIS, A NEW CONCEPT [J].
COMON, P .
SIGNAL PROCESSING, 1994, 36 (03) :287-314
[10]   Image compression using principal component neural networks [J].
Costa, S ;
Fiori, S .
IMAGE AND VISION COMPUTING, 2001, 19 (9-10) :649-668