Mixing synthetic and video images of an outdoor urban environment

被引:15
作者
Berger, MO
Wrobel-Dautcourt, B
Petitjean, S
Simon, G
机构
[1] CNRS, LORIA, F-54506 Vandoeuvre Les Nancy, France
[2] INRA Lorraine, F-54506 Vandoeuvre Les Nancy, France
关键词
augmented reality; enriched image sequence; viewpoint determination; tracking;
D O I
10.1007/s001380050098
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Mixing video and computer-generated images is a new and promising area of research for enhancing reality. It can be used in all the situations when a complete simulation would not be easy to implement. Past work on the subject has relied for a large part on human intervention at key moments of the composition. In this paper, we show that if enough geometric information about the environment is available, then efficient tools developed in the computer vision literature can be used to build a highly automated augmented reality loop. We focus on outdoor urban environments and present an application for the visual assessment of a new lighting project of the bridges of Paris. We present a fully augmented 300-image sequence of a specific bridge, the Pont Neuf Emphasis is put on the robust calculation of the camera position. We also detail the techniques used for matching 2D and 3D primitives and for tracking features over the sequence. Our system overcomes two major difficulties. First, it is capable of handling poor-quality images, resulting from the fact that images were shot at night since the goal was to simulate a new lighting system. Second, it can deal with important changes in viewpoint position and in appearance along the sequence. Throughout the paper, many results are shown to illustrate the different steps and difficulties encountered.
引用
收藏
页码:145 / 159
页数:15
相关论文
共 28 条
[1]  
[Anonymous], COMP GRAPH
[2]  
[Anonymous], SERIES PROBABILITY M
[3]   Merging virtual objects with the real world: seeing ultrasound imagery within the patient [J].
Bajura, Michael ;
Fuchs, Henry ;
Ohbuchi, Ryutarou .
Computer Graphics (ACM), 1992, 26 (02) :203-210
[4]   Resolving occlusion in augmented reality: a contour based approach without 3D reconstruction [J].
Berger, MO .
1997 IEEE COMPUTER SOCIETY CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION, PROCEEDINGS, 1997, :91-96
[5]  
BERGER MO, 1994, P 12 INT C PATT REC, V1, P32
[6]  
BERGER MO, 1996, P 13 ICPR INT C PATT, V1, P90
[7]  
Caudell T.P., 1992, P IEEE HAW INT C SYS, V2, P659, DOI [10.1109/HICSS.1992, DOI 10.1109/HICSS.1992]
[8]  
Cazier D., 1994, Proceedings of the Second Pacific Conference on Computer Graphics and Applications, Pacific Graphics '94. Fundamentals of Computer Graphics, P113
[9]  
CHEVRIER C, 1995, P CGI 95 COMP GRAPH, P115
[10]   MODEL-BASED OBJECT POSE IN 25 LINES OF CODE [J].
DEMENTHON, DF ;
DAVIS, LS .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1995, 15 (1-2) :123-141