A Hybrid Mobile Visual Search System With Compact Global Signatures

被引:14
作者
Chen, David M. [1 ]
Girod, Bernd [1 ]
机构
[1] Stanford Univ, Dept Elect Engn, Stanford, CA 94305 USA
关键词
Compact signatures; image retrieval; interframe compression; mobile visual search; FISHER CODES; FEATURES; SIFT;
D O I
10.1109/TMM.2015.2427744
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Mobile visual search systems typically compare a query image against a database of annotated images for accurate object recognition. On-server database matching can search a large database hosted in the cloud, but the query latency could suffer with slow network transmissions or server congestion. On-device database matching can ensure fast recognition responses regardless of network or server conditions, but a small amount of memory on the mobile device can severely limit the number of images that can be stored in an on-device database. This paper presents a new hybrid system that combines the advantages of on-device and on-server database matching. At the core of this system, we first develop a compact and discriminative global signature to characterize each image. Our global signature uses an optimized local feature count that is derived from a statistical analysis of the retrieval performance. We additionally create two extensions that exploit color information within images and relationships between similar database images to improve retrieval accuracy. Then, we propose methods for efficient interframe coding of a sequence of global signatures which are extracted from the viewfinder frames on the mobile device. A low bitrate stream of global signatures can be sent to the server at an uplink bitrate of less than 2 kbps to broaden the search range of the current query and to update the on-device database to help future queries.
引用
收藏
页码:1019 / 1030
页数:12
相关论文
共 52 条
[1]  
Alahi A, 2012, PROC CVPR IEEE, P510, DOI 10.1109/CVPR.2012.6247715
[2]  
[Anonymous], 2009, P 5 INT C MOB MULT C
[3]  
[Anonymous], IEEE T MULT IN PRESS
[4]  
[Anonymous], 2012, P 20 ACM MULTIMEDIA
[5]  
[Anonymous], 2010, P 18 ACM INT C MULT
[6]  
[Anonymous], N14095 JTCISC29WG11
[7]  
[Anonymous], P SPIE
[8]  
[Anonymous], IEEE T PATTERN ANAL
[9]  
[Anonymous], N12202 ISOIEC JTCISC
[10]  
[Anonymous], P IEEE DAT COMPR C M