Fast Video Shot Boundary Detection Based on SVD and Pattern Matching

被引:96
作者
Lu, Zhe-Ming [1 ]
Shi, Yong [1 ]
机构
[1] Zhejiang Univ, Sch Aeronaut & Astronaut, Hangzhou 310027, Zhejiang, Peoples R China
关键词
Fast shot boundary detection; adaptive thresholds; dimensionality reduction; cut transition detection; gradual transition detection; pattern matching; SEGMENTATION;
D O I
10.1109/TIP.2013.2282081
中图分类号
TP18 [人工智能理论];
学科分类号
140502 [人工智能];
摘要
Video shot boundary detection (SBD) is the first and essential step for content-based video management and structural analysis. Great efforts have been paid to develop SBD algorithms for years. However, the high computational cost in the SBD becomes a block for further applications such as video indexing, browsing, retrieval, and representation. Motivated by the requirement of the real-time interactive applications, a unified fast SBD scheme is proposed in this paper. We adopted a candidate segment selection and singular value decomposition (SVD) to speed up the SBD. Initially, the positions of the shot boundaries and lengths of gradual transitions are predicted using adaptive thresholds and most non-boundary frames are discarded at the same time. Only the candidate segments that may contain the shot boundaries are preserved for further detection. Then, for all frames in each candidate segment, their color histograms in the hue-saturation-value) space are extracted, forming a frame-feature matrix. The SVD is then performed on the framefeature matrices of all candidate segments to reduce the feature dimension. The refined feature vector of each frame in the candidate segments is obtained as a new metric for boundary detection. Finally, cut and gradual transitions are identified using our pattern matching method based on a new similarity measurement. Experiments on TRECVID 2001 test data and other video materials show that the proposed scheme can achieve a high detection speed and excellent accuracy compared with recent SBD schemes.
引用
收藏
页码:5136 / 5145
页数:10
相关论文
共 28 条
[1]
Adaptive Edge-Oriented Shot Boundary Detection [J].
Adjeroh, Don ;
Lee, M. C. ;
Banda, N. ;
Kandaswamy, Uma .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2009,
[2]
[Anonymous], 2001, TREC VIDEO RETRIEVAL
[3]
[Anonymous], INT C INF COMM SIGN
[4]
A unified model for techniques on video-shot transition detection [J].
Bescós, J ;
Cisneros, G ;
Martínez, JM ;
Menéndez, JM ;
Cabrera, J .
IEEE TRANSACTIONS ON MULTIMEDIA, 2005, 7 (02) :293-307
[5]
A unified shot boundary detection method based on linear prediction with Bayesian cost functions [J].
Cai, C ;
Lam, KM ;
Tan, Z .
PROCEEDINGS OF 2005 IEEE INTERNATIONAL WORKSHOP ON VLSI DESIGN AND VIDEO TECHNOLOGY, 2005, :101-104
[6]
Information theory-based shot cut/fade detection and video summarization [J].
Cerneková, Z ;
Pitas, I ;
Nikou, C .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (01) :82-91
[7]
Video shot-boundary detection using singular-value decomposition and statistical tests [J].
Cernekova, Zuzana ;
Kotropoulos, Constantine ;
Pitas, Ioannis .
JOURNAL OF ELECTRONIC IMAGING, 2007, 16 (04)
[8]
Video shot detection and condensed representation [J].
Cotsaces, C ;
Nikolaidis, N ;
Pitas, I .
IEEE SIGNAL PROCESSING MAGAZINE, 2006, 23 (02) :28-37
[9]
Comparison of automatic video segmentation algorithms [J].
Dailianas, A ;
Allen, RB ;
England, P .
INTEGRATION ISSUES IN LARGE COMMERCIAL MEDIA DELIVERY SYSTEMS, 1996, 2615 :2-16
[10]
Applications of video-content analysis and retrieval [J].
Dimitrova, N ;
Zhang, HJ ;
Shahraray, B ;
Sezan, I ;
Huang, T ;
Zakhor, A .
IEEE MULTIMEDIA, 2002, 9 (03) :42-55