A divide-and-rule scheme for shot boundary detection based on SIFT

被引:7
作者
Li J. [1 ]
Ding Y. [1 ]
Shi Y. [1 ]
Li W. [2 ]
机构
[1] School of Computer Engineering and Science, Shanghai University, Shanghai
[2] School of Communication and Information Engineering, Shanghai University, Shanghai
关键词
Scale invariant feature transform (SIFT); Shot boundary detection; Support vector machine (SVM); Video retrieval;
D O I
10.4156/jdcta.vol4.issue3.20
中图分类号
学科分类号
摘要
Shot boundary detection is an important fundamental process toward automatic video indexing, retrieval, editing, etc. After a critical review of most approaches seeking to solve this problem, we propose a novel shot boundary detection. To improve the performance of the algorithm and reduce the computational cost, frames that are clearly not shot boundaries are first removed from the original video. After that, a novel SIFT keypoint matching algorithm based on SVM is proposed, which is used to capture the changing statistics of different kinds of shot transitions so as to identify, not only abrupt transitions, but also gradual transitions(fade, dissolve, wipe) accordingly. At last, our system use different algorithms for different kinds of shot transitions to help us to get a better solution for shot boundary detection problem. Numerical experiments in the evaluation of TRECVID and a variety of film videos demonstrate that our method is capable of accurately detecting shot transitions, and could greatly reduce the computational cost.
引用
收藏
页码:202 / 214
相关论文
共 28 条
[11]
Chasanis V., Likas A., Galatsanos N., Simultaneous detection of abrupt cuts and dissolves in videos using support vector machines, Journal of LSEVIER Pattern Recognition Letters, 30, pp. 55-65, (2009)
[12]
Kawai Y., Sumiyoshi H., Yagi N., Shot Boundary Detection at TRECVID, TRECVID, (2007)
[13]
Zong Z.P., Liu K., Peng J.H., Shot Boundary Detection Based on Histogram of Mismatching-Pixel Count of FMB, In Proceedings of ICIEA, pp. 24-26, (2006)
[14]
Zhao H., Li X.H., Shot Boundary Detection Based on Mutual Information and Canny Edge Detector, In Proceedings of the International Conference On Computer Science and Software, pp. 1124-1128, (2008)
[15]
Park M.H., Park R.H., Lee S.W., Efficient Shot Boundary Detection for Action Movies Using Blockwise Motion-Based Features, In Proceedings of LNCS Advances In Visual Computing, pp. 478-489, (2005)
[16]
Lu T., An Accumulation Algorithm for Video Shot Boundary Detection, Journal of Multimedia Tools and Applications, 22, pp. 89-106, (2004)
[17]
Dai X.W., Cai Z.P., An Algorithm of Video Shot Detection Based on Partition in Image Wavelet Entropy, Journal of ACTA PHOTONICA SINICA, 37, 7, pp. 1492-1496, (2008)
[18]
Feng H., Fang W., Liu S., Fang Y., A new general framework for shot boundary detection and key-frame extraction
[19]
In Proceedings of 7th ACM SIGMM, Int.Workshop Multimedia Inf. Retrieval, pp. 121-126, (2005)
[20]
Cao J.R., Cai A.N., A robust shot transition detection method based on support vector machine in compressed domain, Journal of LSEVIER Pattern Recognition Letters, 28, pp. 1534-1540, (2007)