An integrated semantic-based approach in concept based video retrieval

被引:14
作者
Memar, Sara [1 ]
Affendey, Lilly Suriani [1 ]
Mustapha, Norwati [1 ]
Doraisamy, Shyamala C. [1 ]
Ektefa, Mohammadreza [1 ]
机构
[1] Univ Putra Malaysia, Dept Comp Sci, Serdang 43400, Selangor, Malaysia
关键词
Video retrieval; Semantic knowledge; Content-based analysis; Similarity; Search; IMAGE; WEB;
D O I
10.1007/s11042-011-0848-4
中图分类号
TP [自动化技术、计算机技术];
学科分类号
080201 [机械制造及其自动化];
摘要
Multimedia content has been growing quickly and video retrieval is regarded as one of the most famous issues in multimedia research. In order to retrieve a desirable video, users express their needs in terms of queries. Queries can be on object, motion, texture, color, audio, etc. Low-level representations of video are different from the higher level concepts which a user associates with video. Therefore, query based on semantics is more realistic and tangible for end user. Comprehending the semantics of query has opened a new insight in video retrieval and bridging the semantic gap. However, the problem is that the video needs to be manually annotated in order to support queries expressed in terms of semantic concepts. Annotating semantic concepts which appear in video shots is a challenging and time-consuming task. Moreover, it is not possible to provide annotation for every concept in the real world. In this study, an integrated semantic-based approach for similarity computation is proposed with respect to enhance the retrieval effectiveness in concept-based video retrieval. The proposed method is based on the integration of knowledge-based and corpus-based semantic word similarity measures in order to retrieve video shots for concepts whose annotations are not available for the system. The TRECVID 2005 dataset is used for evaluation purpose, and the results of applying proposed method are then compared against the individual knowledge-based and corpus-based semantic word similarity measures which were utilized in previous studies in the same domain. The superiority of integrated similarity method is shown and evaluated in terms of Mean Average Precision (MAP).
引用
收藏
页码:77 / 95
页数:19
相关论文
共 42 条
[1]
[Anonymous], P ACM INT C IM VID R
[2]
[Anonymous], 2005, GUIDELINES TRECVID 2
[3]
[Anonymous], 2003, P 2003 C N AM CHAPT
[4]
[Anonymous], 2007, P 6 ACM INT C IMAGE
[5]
[Anonymous], P INT C IM VID RETR
[6]
[Anonymous], 2007, COLUMBIA U BASELINE
[7]
Aytar Y., 2008, IEEE C COMP VIS PATT
[8]
The Virage image search engine: An open framework for image management [J].
Bach, JR ;
Fuller, C ;
Gupta, A ;
Hampapur, A ;
Horowitz, B ;
Humphrey, R ;
Jain, R ;
Shu, CF .
STORAGE AND RETRIEVAL FOR STILL IMAGE AND VIDEO DATABASES IV, 1996, 2670 :76-87
[9]
INFORMATION-RETRIEVAL - VANRIJS']JSBERGEN,CJ [J].
BLAIR, DC .
JOURNAL OF THE AMERICAN SOCIETY FOR INFORMATION SCIENCE, 1979, 30 (06) :374-375
[10]
Campbell M, 2006, TRECVID WORKSH