Walsh-Hadamard Transform Kernel-Based Feature Vector for Shot Boundary Detection

被引:88
作者
Priya, Lakshmi G. G. [1 ]
Domnic, S. [2 ]
机构
[1] VIT Univ, Sch Informat Technol & Engn, Vellore 632014, Tamil Nadu, India
[2] Natl Inst Technol Tiruchirappalli, Dept Comp Applicat, Tiruchirappalli 620015, Tamil Nadu, India
关键词
Shot boundary detection; Walsh Hadamard transform kernel; basis vectors; feature vector; probabilistic classifier with feature weights; procedure based identification; INFORMATION-THEORY; VIDEO; SEGMENTATION;
D O I
10.1109/TIP.2014.2362652
中图分类号
TP18 [人工智能理论];
学科分类号
140502 [人工智能];
摘要
Video shot boundary detection (SBD) is the first step of video analysis, summarization, indexing, and retrieval. In SBD process, videos are segmented into basic units called shots. In this paper, a new SBD method is proposed using color, edge, texture, and motion strength as vector of features (feature vector). Features are extracted by projecting the frames on selected basis vectors of Walsh-Hadamard transform (WHT) kernel and WHT matrix. After extracting the features, based on the significance of the features, weights are calculated. The weighted features are combined to form a single continuity signal, used as input for Procedure Based shot transition Identification process (PBI). Using the procedure, shot transitions are classified into abrupt and gradual transitions. Experimental results are examined using large-scale test sets provided by the TRECVID 2007, which has evaluated hard cut and gradual transition detection. To evaluate the robustness of the proposed method, the system evaluation is performed. The proposed method yields F1-Score of 97.4% for cut, 78% for gradual, and 96.1% for overall transitions. We have also evaluated the proposed feature vector with support vector machine classifier. The results show that WHT-based features can perform well than the other existing methods. In addition to this, few more video sequences are taken from the Openvideo project and the performance of the proposed method is compared with the recent existing SBD method.
引用
收藏
页码:5187 / 5197
页数:11
相关论文
共 32 条
[1]
Adaptive Edge-Oriented Shot Boundary Detection [J].
Adjeroh, Don ;
Lee, M. C. ;
Banda, N. ;
Kandaswamy, Uma .
EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING, 2009,
[2]
[Anonymous], 2008, INFORMATIKTAGE
[3]
[Anonymous], 2011, Pei. data mining concepts and techniques
[4]
[Anonymous], 1993, Multimedia Systems, DOI DOI 10.1007/BF01210504
[5]
Barjatya A., 2004, IEEE T EVOLUTION COM, V8, P225, DOI DOI 10.1109/TEVC.2004.826069
[6]
A tutorial on Support Vector Machines for pattern recognition [J].
Burges, CJC .
DATA MINING AND KNOWLEDGE DISCOVERY, 1998, 2 (02) :121-167
[7]
Information theory-based shot cut/fade detection and video summarization [J].
Cerneková, Z ;
Pitas, I ;
Nikou, C .
IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 2006, 16 (01) :82-91
[8]
LIBSVM: A Library for Support Vector Machines [J].
Chang, Chih-Chung ;
Lin, Chih-Jen .
ACM TRANSACTIONS ON INTELLIGENT SYSTEMS AND TECHNOLOGY, 2011, 2 (03)
[9]
Video segmentation via temporal pattern classification [J].
Cooper, Matthew ;
Liu, Ting ;
Rieffel, Eleanor .
IEEE TRANSACTIONS ON MULTIMEDIA, 2007, 9 (03) :610-618
[10]
Video shot detection and condensed representation [J].
Cotsaces, C ;
Nikolaidis, N ;
Pitas, I .
IEEE SIGNAL PROCESSING MAGAZINE, 2006, 23 (02) :28-37