Surveillance Video Parsing with Single Frame Supervision

被引：35

作者：

Liu, Si ^{[1
]}

Wang, Changhu ^{[2
]}

Qian, Ruihe ^{[1
]}

Yu, Han ^{[1
]}

Bao, Renda ^{[1
]}

Sun, Yao ^{[1
]}

机构：

[1] Chinese Acad Sci, Inst Informat Engn, State Key Lab Informat Secur, Beijing 100093, Peoples R China

[2] Toutiao AI Lab, Beijing, Peoples R China

来源：

30TH IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2017) | 2017年

基金：

中国国家自然科学基金;

关键词：

D O I：

10.1109/CVPR.2017.114

中图分类号：

TP18 [人工智能理论];

学科分类号：

081104 ; 0812 ; 0835 ; 1405 ;

摘要：

Surveillance video parsing, which segments the video frames into several labels, e.g., face, pants, left-leg, has wide applications [41, 8]. However, pixel-wisely annotating all frames is tedious and inefficient. In this paper, we develop a Single frame Video Parsing (SVP) method which requires only one labeled frame per video in training stage. To parse one particular frame, the video segment preceding the frame is jointly considered. SVP (i) roughly parses the frames within the video segment, (ii) estimates the optical flow between frames and (iii) fuses the rough parsing results warped by optical flow to produce the refined parsing result. The three components of SVP, namely frame parsing, optical flow estimation and temporal fusion are integrated in an end-to-end manner. Experimental results on two surveillance video datasets show the superiority of SVP over state-of-the-arts. The collected video parsing datasets can be downloaded via http:// liusi-group. com/ projects/SVP for the further studies.

引用

页码：1013 / 1021

页数：9

共 40 条

[31] Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks [J].

Ren, Shaoqing ;

He, Kaiming ;

Girshick, Ross ;

Sun, Jian .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (06) :1137-1149

[32]

Revaud J, 2015, PROC CVPR IEEE, P1164, DOI 10.1109/CVPR.2015.7298720

[33]

Simonyan K, 2015, Arxiv, DOI arXiv:1409.1556

[34] Joint Object and Part Segmentation using Deep Learned Potentials [J].

Wang, Peng ;

Shen, Xiaohui ;

Lin, Zhe ;

Cohen, Scott ;

Price, Brian ;

Yuille, Alan .

2015 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION (ICCV), 2015, :1573-1581

[35] STC: A Simple to Complex Framework for Weakly-Supervised Semantic Segmentation [J].

Wei, Yunchao ;

Liang, Xiaodan ;

Chen, Yunpeng ;

Shen, Xiaohui ;

Cheng, Ming-Ming ;

Feng, Jiashi ;

Zhao, Yao ;

Yan, Shuicheng .

IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2017, 39 (11) :2314-2320

[36]

Xu J, 2015, PROC CVPR IEEE, P3781, DOI 10.1109/CVPR.2015.7299002

[37]

Yamaguchi K., 2013, ICCV

[38]

Zhang T., 2012, ROBUST VISUAL TRACKI

[39]

Zhang T., 2012, Low-rank sparse learning for robust visual tracking

[40] Learning Mid-level Filters for Person Re-identification [J].

Zhao, Rui ;

Ouyang, Wanli ;

Wang, Xiaogang .

2014 IEEE CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2014, :144-151

← 1 2 3 4 →