Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video

被引:65
作者
Matsuyama, T [1 ]
Wu, X [1 ]
Takai, T [1 ]
Nobuhara, S [1 ]
机构
[1] Kyoto Univ, Grad Sch Informat, Kyoto 6068501, Japan
关键词
dynamic 3D shape reconstruction; real-time processing; PC cluster; multi-viewpoint video; deformable mesh model; video texture mapping;
D O I
10.1016/j.cviu.2004.03.012
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
3D video [IEEE Multimedia (1997) 18] is the ultimate image media recording dynamic visual events in the real world as is; it records time varying 3D object shape with high fidelity surface properties (i.e., color and texture). Its applications cover wide varieties of personal and social human activities: entertainment (e.g., 3D game and 3D TV), education (e.g., 3D animal picture books), sports (e.g., sport performance analysis), medicine (e.g., 3D surgery monitoring), culture (e.g., 3D archive of traditional dances), and so on. In this paper, we propose: (1) a PC cluster system for real-time reconstruction of dynamic 3D object action from multiview video images, (2) a deformable 3D mesh model for reconstructing the accurate dynamic 3D object shape, and (3) an algorithm of rendering natural-looking texture on the 3D object surface from the multi-view video images. Experimental results with quantitative performance evaluations demonstrate the effectiveness of these methods in generating high fidelity 3D video from multi-view video images. (C) 2004 Elsevier Inc. All rights reserved.
引用
收藏
页码:393 / 434
页数:42
相关论文
共 38 条
[1]  
[Anonymous], P EGWR
[2]  
[Anonymous], P ICIP
[3]  
Baker H, 1977, P 5 INT JOINT C ART, P649
[4]  
Baraff D., 1998, Computer Graphics. Proceedings. SIGGRAPH 98 Conference Proceedings, P43, DOI 10.1145/280814.280821
[5]  
BAUMGART BG, AIM249 STANF U ART I
[6]  
Borovikov E, 2000, 5TH INTERNATIONAL WORKSHOP ON COMPUTER ARCHITECTURES FOR MACHINE PERCEPTION, PROCEEDINGS, P183, DOI 10.1109/CAMP.2000.875976
[7]  
Briceno H. M., 2003, ACM SIGGRAPH/Eurographics Symposium on Computer Animation, P136
[8]  
BURR DJ, 1981, COMPUT VISION GRAPH, V15, P102, DOI 10.1016/0146-664X(81)90072-1
[9]  
CARRANZA J, ACM T COMPUTER GRAPH, V22
[10]  
Cheung GKM, 2003, PROC CVPR IEEE, P375