Deep Fusion of Remote Sensing Data for Accurate Classification

被引:204
作者
Chen, Yushi [1 ]
Li, Chunyang [1 ]
Ghamisi, Pedram [2 ,3 ]
Jia, Xiuping [4 ]
Gu, Yanfeng [1 ]
机构
[1] Harbin Inst Technol, Sch Elect & Informat Engn, Harbin 150001, Heilongjiang, Peoples R China
[2] German Aerosp Ctr DLR, Remote Sensing Technol Inst IMF, D-82234 Wessling, Germany
[3] Tech Univ Munich, Signal Proc Earth Observat, D-80333 Munich, Germany
[4] Univ New South Wales, Sch Engn & Informat Technol, Canberra, ACT 2600, Australia
基金
美国国家科学基金会;
关键词
Convolutional neural network (CNN); data fusion; deep neural network (DNN); feature extraction (FE); hyperspectral image (HSI); light detection and ranging (LiDAR); multispectral image (MSI);
D O I
10.1109/LGRS.2017.2704625
中图分类号
P3 [地球物理学]; P59 [地球化学];
学科分类号
0708 ; 070902 ;
摘要
The multisensory fusion of remote sensing data has obtained a great attention in recent years. In this letter, we propose a new feature fusion framework based on deep neural networks (DNNs). The proposed framework employs deep convolutional neural networks (CNNs) to effectively extract features of multi-/hyperspectral and light detection and ranging data. Then, a fully connected DNN is designed to fuse the heterogeneous features obtained by the previous CNNs. Through the aforementioned deep networks, one can extract the discriminant and invariant features of remote sensing data, which are useful for further processing. At last, logistic regression is used to produce the final classification results. Dropout and batch normalization strategies are adopted in the deep fusion framework to further improve classification accuracy. The obtained results reveal that the proposed deep fusion model provides competitive results in terms of classification accuracy. Furthermore, the proposed deep learning idea opens a new window for future remote sensing data fusion.
引用
收藏
页码:1253 / 1257
页数:5
相关论文
共 15 条
[1]  
Benediktsson JA, 2015, ARTECH HSE REMOTE SE, P1
[2]   Representation Learning: A Review and New Perspectives [J].
Bengio, Yoshua ;
Courville, Aaron ;
Vincent, Pascal .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2013, 35 (08) :1798-1828
[3]   Deep Feature Extraction and Classification of Hyperspectral Images Based on Convolutional Neural Networks [J].
Chen, Yushi ;
Jiang, Hanlu ;
Li, Chunyang ;
Jia, Xiuping ;
Ghamisi, Pedram .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2016, 54 (10) :6232-6251
[4]   Extended profiles with morphological attribute filters for the analysis of hyperspectral data [J].
Dalla Mura, Mauro ;
Benediktsson, Jon Atli ;
Waske, Bjoern ;
Bruzzone, Lorenzo .
INTERNATIONAL JOURNAL OF REMOTE SENSING, 2010, 31 (22) :5975-5991
[5]   Fusion of hyperspectral and LIDAR remote sensing data for classification of complex forest areas [J].
Dalponte, Michele ;
Bruzzone, Lorenzo ;
Gianelle, Damiano .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2008, 46 (05) :1416-1427
[6]   Thematic map comparison: Evaluating the statistical significance of differences in classification accuracy [J].
Foody, GM .
PHOTOGRAMMETRIC ENGINEERING AND REMOTE SENSING, 2004, 70 (05) :627-633
[7]  
Ghamisi P., IEEE J SEL TOPICS AP
[8]   A Novel MKL Model of Integrating LiDAR Data and MSI for Urban Area Classification [J].
Gu, Yanfeng ;
Wang, Qingwang ;
Jia, Xiuping ;
Benediktsson, Jon Atli .
IEEE TRANSACTIONS ON GEOSCIENCE AND REMOTE SENSING, 2015, 53 (10) :5312-5326
[9]  
Ioffe Sergey, 2015, PROC INT C MACH LEAR, V37, P448, DOI DOI 10.48550/ARXIV.1502.03167
[10]   ImageNet Classification with Deep Convolutional Neural Networks [J].
Krizhevsky, Alex ;
Sutskever, Ilya ;
Hinton, Geoffrey E. .
COMMUNICATIONS OF THE ACM, 2017, 60 (06) :84-90