Belief propagation vs. TAP for decoding corrupted messages

被引:93
作者
Kabashima, Y [1 ]
Saad, D
机构
[1] Tokyo Inst Technol, Dept Computat Intelligence & Syst Sci, Yokohama, Kanagawa 2268502, Japan
[2] Aston Univ, Neural Comp Res Grp, Birmingham B4 7ET, W Midlands, England
来源
EUROPHYSICS LETTERS | 1998年 / 44卷 / 05期
关键词
D O I
10.1209/epl/i1998-00524-7
中图分类号
O4 [物理学];
学科分类号
0702 ;
摘要
We employ two different methods, based on belief propagation and TAP, for decoding corrupted messages encoded by employing Sourlas's method, where the code word comprises products of K bits selected randomly from the original message. We show that the equations obtained by the two approaches are similar and provide the same solution as the one obtained by the replica approach in some cases (K = 2). However, we also show that for K greater than or equal to 3 and unbiased messages the iterative solution is sensitive to the initial conditions and is likely to provide erroneous solutions; and that it is generally beneficial to use Nishimori's temperature, especially in the case of biased messages.
引用
收藏
页码:668 / 674
页数:7
相关论文
共 16 条
[1]  
[Anonymous], GRAPHICAL MODELS MAC
[2]  
BETHE H, 1935, P ROY SOC LOND A MAT, V151, P540
[3]   RANDOM-ENERGY MODEL - AN EXACTLY SOLVABLE MODEL OF DISORDERED-SYSTEMS [J].
DERRIDA, B .
PHYSICAL REVIEW B, 1981, 24 (05) :2613-2626
[4]  
KABASHIMA Y, 1997, PREPRINT
[5]   Near Shannon limit performance of low density parity check codes [J].
MacKay, DJC ;
Neal, RM .
ELECTRONICS LETTERS, 1997, 33 (06) :457-458
[6]   EXACT RESULTS AND CRITICAL PROPERTIES OF THE ISING-MODEL WITH COMPETING INTERACTIONS [J].
NISHIMORI, H .
JOURNAL OF PHYSICS C-SOLID STATE PHYSICS, 1980, 13 (21) :4071-4076
[7]  
NISHIMORI H, 1993, J PHYS SOC JPN, V62, P1169
[8]  
Pearl J., 1988, PROBABILISTIC REASON, DOI [DOI 10.1016/C2009-0-27609-4, 10.1016/c2009-0-27609-4]
[9]   FINITE-TEMPERATURE ERROR-CORRECTING CODES [J].
RUJAN, P .
PHYSICAL REVIEW LETTERS, 1993, 70 (19) :2968-2971
[10]   Diluted generalized random energy model [J].
Saakian, DB .
JETP LETTERS, 1998, 67 (06) :440-444