Automatic text detection and removal in video sequences

被引:53
作者
Lee, CW
Jung, K
Kim, HJ
机构
[1] Kyungpook Natl Univ, Dept Comp Engn, Taegu 702701, South Korea
[2] Soongsil Univ, Coll Informat Sci, Sch Media, Seoul, South Korea
关键词
text detection; text removal; motion estimation; spatiotemporal restoration; support vector machines;
D O I
10.1016/S0167-8655(03)00105-3
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
This paper proposes an approach for automatic text detection and removal in video sequences based on support vector machines (SVMs) and spatiotemporal restoration. Given two consecutive frames, first, text regions in the current frame are detected by an SVM-based texture classifier. Second, two stages are performed for the restoration of the regions occluded by the detected text regions: temporal restoration in consecutive frames and spatial restoration in the current frame. Utilizing text motion and background difference, an input video sequence is classified and a different temporal restoration scheme is applied to the sequence. Such a combination of temporal restoration and spatial restoration shows great potential for automatic detection and removal of objects of interest in various kinds of video sequences, and is applicable to many applications such as translation of captions and replacement of indirect advertisements in videos. (C) 2003 Elsevier B.V. All rights reserved.
引用
收藏
页码:2607 / 2623
页数:17
相关论文
共 30 条
[1]   Image inpainting [J].
Bertalmio, M ;
Sapiro, G ;
Caselles, V ;
Ballester, C .
SIGGRAPH 2000 CONFERENCE PROCEEDINGS, 2000, :417-424
[2]  
Bovik AC., 2000, HDB IMAGE VIDEO PROC
[3]  
CHAN T, 2001, SPEC SESS INV PROBL
[4]  
CHUN BT, 2001, INT WORKSH CONT BAS
[5]   GEOMETRICAL AND STATISTICAL PROPERTIES OF SYSTEMS OF LINEAR INEQUALITIES WITH APPLICATIONS IN PATTERN RECOGNITION [J].
COVER, TM .
IEEE TRANSACTIONS ON ELECTRONIC COMPUTERS, 1965, EC14 (03) :326-&
[6]   Automatic thresholding for change detection in digital video [J].
Habili, N ;
Moini, A ;
Burgess, N .
VISUAL COMMUNICATIONS AND IMAGE PROCESSING 2000, PTS 1-3, 2000, 4067 :133-142
[7]   Morphological text extraction from images [J].
Hasan, YMY ;
Karam, LJ .
IEEE TRANSACTIONS ON IMAGE PROCESSING, 2000, 9 (11) :1978-1983
[8]  
Hastie T, 2008, The elements of statistical learning, Vsecond, DOI DOI 10.1007/978-0-387-21606-5
[9]  
Haykin S., 1999, NEURAL NETWORK COMPR
[10]  
Irani M., 1993, Journal of Visual Communication and Image Representation, V4, P324, DOI 10.1006/jvci.1993.1030