THE LIMITING BEHAVIOR OF LMS

被引:28
作者
SOLO, V
机构
[1] Johns Hopkins Univ, Dep of Electr, & Comput Eng, Baltimore, MD, USA
来源
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING | 1989年 / 37卷 / 12期
基金
美国国家科学基金会;
关键词
Mathematical Techniques--Least Squares Approximations - Probability--Random Processes - Signal Filtering and Prediction;
D O I
10.1109/29.45537
中图分类号
O42 [声学];
学科分类号
070206 ; 082403 ;
摘要
A realization-oriented analysis is given of the gradient noise misadjustment and lag misadjustment performance of the LMS (least-mean-square) algorithm. New formulas are given for both of these components of excess mean-square error. It is shown that the traditional formula for lag misadjustment needs to be modified by adding further terms due to gradient noise and noise variance. To perform the analysis, it is necessary to study the convergence (with probability one) of the noise-free, fixed-parameter LMS algorithm. Convergence is found under simple conditions that improve on those previously obtained.
引用
收藏
页码:1909 / 1922
页数:14
相关论文
共 15 条
[1]  
A Benveniste, 1987, INT J ADAPT CONTROL, P3
[2]   A MEASURE OF THE TRACKING CAPABILITY OF RECURSIVE STOCHASTIC ALGORITHMS WITH CONSTANT GAINS [J].
BENVENISTE, A ;
RUGET, G .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1982, 27 (03) :639-649
[3]  
Billingsley P, 1968, CONVERGENCE PROBABIL
[4]   LYAPUNOV TECHNIQUES FOR THE EXPONENTIAL STABILITY OF LINEAR DIFFERENCE-EQUATIONS WITH RANDOM-COEFFICIENTS [J].
BITMEAD, RR ;
ANDERSON, BDO .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1980, 25 (04) :782-787
[5]   CONVERGENCE IN DISTRIBUTION OF LMS-TYPE ADAPTIVE PARAMETER ESTIMATES [J].
BITMEAD, RR .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1983, 28 (01) :54-60
[6]   PERFORMANCE OF ADAPTIVE ESTIMATION ALGORITHMS IN DEPENDENT RANDOM-ENVIRONMENTS [J].
BITMEAD, RR ;
ANDERSON, BDO .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1980, 25 (04) :788-794
[7]  
BITMEAD RR, 1981, 20TH P IEEE C DEC CO, P607
[8]   CONVERGENCE ANALYSIS OF LMS FILTERS WITH UNCORRELATED GAUSSIAN DATA [J].
FEUER, A ;
WEINSTEIN, E .
IEEE TRANSACTIONS ON ACOUSTICS SPEECH AND SIGNAL PROCESSING, 1985, 33 (01) :222-230
[9]  
Kushner H. J., 1984, APPROXIMATION WEAK C
[10]   2ND-ORDER CONVERGENCE ANALYSIS OF STOCHASTIC ADAPTIVE LINEAR-FILTERING [J].
MACCHI, O ;
EWEDA, E .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 1983, 28 (01) :76-85