STORAGE CAPACITY OF A MULTILAYER NEURAL NETWORK WITH BINARY WEIGHTS

被引：32

作者：

BARKAI, E

KANTER, I

机构：

[1] Department of Physics, Bar-Ilan University, Ramat Gan

来源：

EUROPHYSICS LETTERS | 1991年 / 14卷 / 02期

关键词：

D O I：

10.1209/0295-5075/14/2/003

中图分类号：

O4 [物理学];

学科分类号：

0702 ;

摘要：

Statistical mechanics is applied to estimate the maximal capacity per weight (alpha-c) of a two-layer feed-forward network with binary weights, functioning as a parity machine of the hidden units. For K greater-than-or-equal-to 2 hidden units, the maximal theoretical capacity is achieved, alpha-c = 1, and the average overlap between different solutions is zero. These results agree with the simulations. At finite temperature one-step replica symmetry breaking solution is found, which appears to be exact.

引用

页码：107 / 112

页数：6

共 14 条

[1]

BARKAI E, 1990, PREPRINT

[2] GEOMETRICAL AND STATISTICAL PROPERTIES OF SYSTEMS OF LINEAR INEQUALITIES WITH APPLICATIONS IN PATTERN RECOGNITION [J].

COVER, TM .

IEEE TRANSACTIONS ON ELECTRONIC COMPUTERS, 1965, EC14 (03) :326-&

[3] RANDOM-ENERGY MODEL - AN EXACTLY SOLVABLE MODEL OF DISORDERED-SYSTEMS [J].

DERRIDA, B .

PHYSICAL REVIEW B, 1981, 24 (05) :2613-2626

[4] OPTIMAL STORAGE PROPERTIES OF NEURAL NETWORK MODELS [J].

GARDNER, E ;

DERRIDA, B .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :271-284

[5] THE SPACE OF INTERACTIONS IN NEURAL NETWORK MODELS [J].

GARDNER, E .

JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1988, 21 (01) :257-270

[6]

GARDNER E, 1989, J PHYS A, V22

[7] THE SIMPLEST SPIN-GLASS [J].

GROSS, DJ ;

MEZARD, M .

NUCLEAR PHYSICS B, 1984, 240 (04) :431-452

[8] MEAN-FIELD THEORY OF THE POTTS GLASS [J].

GROSS, DJ ;

KANTER, I ;

SOMPOLINSKY, H .

PHYSICAL REVIEW LETTERS, 1985, 55 (03) :304-307

[9] THE EQUIVALENCE BETWEEN DISCRETE-SPIN HAMILTONIANS AND ISING HAMILTONIANS WITH MULTI-SPIN INTERACTIONS [J].

KANTER, I .

JOURNAL OF PHYSICS C-SOLID STATE PHYSICS, 1987, 20 (13) :L257-L262

[10] STORAGE CAPACITY OF MEMORY NETWORKS WITH BINARY COUPLINGS [J].

KRAUTH, W ;

MEZARD, M .

JOURNAL DE PHYSIQUE, 1989, 50 (20) :3057-3066

← 1 2 →