Statistical mechanics of error-correcting codes

被引:94
作者
Kabashima, Y [1 ]
Saad, D
机构
[1] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 226, Japan
[2] Aston Univ, Neural Comp Res Grp, Birmingham B4 7ET, W Midlands, England
来源
EUROPHYSICS LETTERS | 1999年 / 45卷 / 01期
关键词
D O I
10.1209/epl/i1999-00137-2
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We investigate the performance of error-correcting codes, where the code word comprises products of K bits selected from the original message and decoding is carried out utilizing a connectivity tensor with C connections per index. Shannon's bound for the channel capacity is recovered for large K and zero temperature when the code rate K/C is finite. Close to optimal error-correcting capability is obtained for finite K and C. We examine the finite-temperature case to assess the use of simulated annealing for decoding and extend the analysis to accommodate other types of noisy channels.
引用
收藏
页码:97 / 103
页数:7
相关论文
共 15 条
[1]   REPLICA SYMMETRY-BREAKING IN WEAK CONNECTIVITY SYSTEMS [J].
DEDOMINICIS, C ;
MOTTISHAW, P .
JOURNAL OF PHYSICS A-MATHEMATICAL AND GENERAL, 1987, 20 (18) :L1267-L1273
[2]   RANDOM-ENERGY MODEL - AN EXACTLY SOLVABLE MODEL OF DISORDERED-SYSTEMS [J].
DERRIDA, B .
PHYSICAL REVIEW B, 1981, 24 (05) :2613-2626
[3]   LOW-DENSITY PARITY-CHECK CODES [J].
GALLAGER, RG .
IRE TRANSACTIONS ON INFORMATION THEORY, 1962, 8 (01) :21-&
[4]   THE SIMPLEST SPIN-GLASS [J].
GROSS, DJ ;
MEZARD, M .
NUCLEAR PHYSICS B, 1984, 240 (04) :431-452
[5]  
KABASHIMA Y, 1998, IN PRESS EUROPHYS LE
[6]   Near Shannon limit performance of low density parity check codes [J].
MacKay, DJC ;
Neal, RM .
ELECTRONICS LETTERS, 1997, 33 (06) :457-458
[7]   EXACT RESULTS AND CRITICAL PROPERTIES OF THE ISING-MODEL WITH COMPETING INTERACTIONS [J].
NISHIMORI, H .
JOURNAL OF PHYSICS C-SOLID STATE PHYSICS, 1980, 13 (21) :4071-4076
[8]   OPTIMUM DECODING TEMPERATURE FOR ERROR-CORRECTING CODES [J].
NISHIMORI, H .
JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN, 1993, 62 (09) :2973-2975
[9]   FINITE-TEMPERATURE ERROR-CORRECTING CODES [J].
RUJAN, P .
PHYSICAL REVIEW LETTERS, 1993, 70 (19) :2968-2971
[10]   A MATHEMATICAL THEORY OF COMMUNICATION [J].
SHANNON, CE .
BELL SYSTEM TECHNICAL JOURNAL, 1948, 27 (03) :379-423