A multi-layer sparse coding network learns contour coding from natural images

被引:106
作者
Hoyer, PO [1 ]
Hyvärinen, A [1 ]
机构
[1] Aalto Univ, Neural Networks Res Ctr, FIN-02015 Helsinki, Finland
基金
芬兰科学院;
关键词
natural images; neural networks; contours; cortex; independent component analysis;
D O I
10.1016/S0042-6989(02)00017-2
中图分类号
Q189 [神经科学];
学科分类号
071006 ;
摘要
An important approach in visual neuroscience considers how the function of the early visual system relates to the statistics of its natural input. Previous studies have shown how many basic properties of the primary visual cortex, such as the receptive fields of simple and complex cells and the spatial organization (topography) of the cells, can be understood as efficient coding of natural images. Here we extend the framework by considering how the responses of complex cells could be sparsely represented by a higher-order neural layer. This leads to contour coding and end-stopped receptive fields. In addition, contour integration could be interpreted as top-down inference in the presented model. (C) 2002 Elsevier Science Ltd. All rights reserved.
引用
收藏
页码:1593 / 1605
页数:13
相关论文
共 67 条
[21]   RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE OF MONKEY STRIATE CORTEX [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF PHYSIOLOGY-LONDON, 1968, 195 (01) :215-&
[22]  
HUBEL DH, 1987, J NEUROSCI, V7, P3378
[23]   RECEPTIVE FIELDS, BINOCULAR INTERACTION AND FUNCTIONAL ARCHITECTURE IN CATS VISUAL CORTEX [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF PHYSIOLOGY-LONDON, 1962, 160 (01) :106-&
[24]   RECEPTIVE FIELDS AND FUNCTIONAL ARCHICHITECTURE IN 2 NONSTRIATE VISUAL AREAS (18 AND 19) OF CAT [J].
HUBEL, DH ;
WIESEL, TN .
JOURNAL OF NEUROPHYSIOLOGY, 1965, 28 (02) :229-+
[25]   Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons [J].
Hupé, JM ;
James, AC ;
Payne, BR ;
Lomber, SG ;
Girard, P ;
Bullier, J .
NATURE, 1998, 394 (6695) :784-787
[26]   Sparse code shrinkage:: Denoising of nongaussian data by maximum likelihood estimation [J].
Hyvärinen, A .
NEURAL COMPUTATION, 1999, 11 (07) :1739-1768
[27]   Emergence of phase- and shift-invariant features by decomposition of natural images into independent feature subspaces [J].
Hyvärinen, A ;
Hoyer, P .
NEURAL COMPUTATION, 2000, 12 (07) :1705-1720
[28]   Fast and robust fixed-point algorithms for independent component analysis [J].
Hyvärinen, A .
IEEE TRANSACTIONS ON NEURAL NETWORKS, 1999, 10 (03) :626-634
[29]  
Hyvärinen A, 2001, INDEPENDENT COMPONENT ANALYSIS: PRINCIPLES AND PRACTICE, P71
[30]   Topographic independent component analysis [J].
Hyvärinen, A ;
Hoyer, PO ;
Inki, M .
NEURAL COMPUTATION, 2001, 13 (07) :1527-1558