ACCELERATION OF STOCHASTIC-APPROXIMATION BY AVERAGING

被引：1033

作者：

POLYAK, BT ^{[1
]}

JUDITSKY, AB ^{[1
]}

机构：

[1] INST RECH INFORMAT & SYST ALEATOIRES,F-35042 RENNES,FRANCE

来源：

SIAM JOURNAL ON CONTROL AND OPTIMIZATION | 1992年 / 30卷 / 04期

关键词：

STOCHASTIC APPROXIMATION; RECURSIVE ESTIMATION; STOCHASTIC OPTIMIZATION; OPTIMAL ALGORITHMS;

D O I：

10.1137/0330046

中图分类号：

TP [自动化技术、计算机技术];

学科分类号：

0812 ;

摘要：

A new recursive algorithm of stochastic approximation type with the averaging of trajectories is investigated. Convergence with probability one is proved for a variety of classical optimization and identification problems. It is also demonstrated for these problems that the proposed algorithm achieves the highest possible rate of convergence.

引用

页码：838 / 855

页数：18

共 40 条

[1] Aizerman M. A., 1970, METHOD POTENTIAL FUN
[2] [Anonymous], 1973, STOCHASTIC APPROXIMA
[3] [Anonymous], 1988, EFFICIENT ESTIMATION
[4] [Anonymous], 1990, AUTOMAT REM CONTR+
[5] [Anonymous], 1978, STOCHASTIC APPROXIMA
[6] BENDERSKIJ AM, 1982, PROBLEMS INFORM TRAN, V17, P423
[7] CONVERGENCE ANALYSIS OF SMOOTHED STOCHASTIC GRADIENT-TYPE ALGORITHM
BERMAN, N
FEUER, A
WAHNON, E
[J]. INTERNATIONAL JOURNAL OF SYSTEMS SCIENCE, 1987, 18 (06) : 1061 - 1078
[8] ASYMPTOTICALLY EFFICIENT STOCHASTIC APPROXIMATION - RM CASE
FABIAN, V
[J]. ANNALS OF STATISTICS, 1973, 1 (03) : 486 - 495
[9] ASYMPTOTICALLY EFFICIENT RECURSIVE ESTIMATION
FABIAN, V
[J]. ANNALS OF STATISTICS, 1978, 6 (04) : 854 - 866
[10] FOMIN VN, 1984, RECURSIVE ESTIMATION

← 1 2 3 4 →