Worst case analysis of weight inaccuracy effects in multilayer perceptrons

被引：14

作者：

Anguita, D ^{[1
]}

Ridella, S ^{[1
]}

Rovetta, S ^{[1
]}

机构：

[1] Univ Genoa, Dept Biophys & Elect Engn, I-16126 Genoa, Italy

来源：

IEEE TRANSACTIONS ON NEURAL NETWORKS | 1999年 / 10卷 / 02期

关键词：

interval arithmetic; multilayer perceptron; quantization; robustness;

D O I：

10.1109/72.750571

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

We derive here a new method for the analysis of weight quantization effects in multilayer perceptrons based on the application of interval arithmetic, Differently from previous results, we find worst case bounds on the errors due to weight quantization, that are valid for every distribution of the input or weight values. Given a trained network, our method allows to easily compute the minimum number of bits needed to encode its weights.

引用

页码：415 / 418

页数：4

共 14 条

[1]

Alefeld G., 1986, INTRO INTERVAL COMPU

[2] INCORPORATING A-PRIORI KNOWLEDGE INTO NEURAL NETWORKS [J].

ANGUITA, D ;

RIDELLA, S ;

ROVETTA, S ;

ZUNINO, R .

ELECTRONICS LETTERS, 1995, 31 (22) :1930-1931

[3]

ANGUITA D, 1996, P IEEE INT C NEUR NE, P414

[4] THE EFFECTS OF QUANTIZATION ON MULTILAYER NEURAL NETWORKS [J].

DUNDAR, G ;

ROSE, K .

IEEE TRANSACTIONS ON NEURAL NETWORKS, 1995, 6 (06) :1446-1451

[5] LEARNING WITH LIMITED NUMERICAL PRECISION USING THE CASCADE-CORRELATION ALGORITHM [J].

HOEHFELD, M ;

FAHLMAN, SE .

IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (04) :602-611

[6] AN ARCHITECTURE OF NEURAL NETWORKS WITH INTERVAL WEIGHTS AND ITS APPLICATION TO FUZZY REGRESSION-ANALYSIS [J].

ISHIBUCHI, H ;

TANAKA, H ;

OKADA, H .

FUZZY SETS AND SYSTEMS, 1993, 57 (01) :27-39

[7]

Ishibuchi H., 1991, P INT JCNN 91, V2, P1588

[8]

ISHIBUCHI H, 1994, P IEEE INT C NEUR NE, V5, P2907

[9] SENSITIVITY ANALYSIS OF MULTILAYER PERCEPTRON WITH DIFFERENTIABLE ACTIVATION FUNCTIONS [J].

JIN, YC ;

CHOI, CH .

IEEE TRANSACTIONS ON NEURAL NETWORKS, 1992, 3 (01) :101-107

[10] ALGORITHM-737 - INTLIB - A PORTABLE FORTRAN-77 INTERVAL STANDARD-FUNCTION LIBRARY [J].

KEARFOTT, RB ;

DAWANDE, M ;

DU, K ;

HU, C .

ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE, 1994, 20 (04) :447-459

← 1 2 →