Performance relighting and reflectance transformation with time-multiplexed illumination

被引：161

作者：

Wenger, A ^{[1
]}

Gardner, A ^{[1
]}

Tchou, C ^{[1
]}

Unger, J ^{[1
]}

Hawkins, T ^{[1
]}

Debevec, P ^{[1
]}

机构：

[1] Univ So Calif, Inst Creat Technol, Marina Del Rey, CA 90292 USA

来源：

ACM TRANSACTIONS ON GRAPHICS | 2005年 / 24卷 / 03期

关键词：

relighting; compositing; environmental illumination; image-based rendering; reflectance models;

D O I：

10.1145/1073204.1073258

中图分类号：

TP31 [计算机软件];

学科分类号：

081202 ; 0835 ;

摘要：

We present a technique for capturing an actor's live-action performance in such a way that the lighting and reflectance of the actor can be designed and modified in postproduction. Our approach is to illuminate the subject with a sequence of time-multiplexed basis lighting conditions, and to record these conditions with a highspeed video camera so that many conditions are recorded in the span of the desired output frame interval. We investigate several lighting bases for representing the sphere of incident illumination using a set of discrete LED light sources, and we estimate and compensate for subject motion using optical flow and image warping based on a set of tracking frames inserted into the lighting basis. To composite the illuminated performance into a new background, we include a time-multiplexed matte within the basis. We also show that the acquired data enables time-varying surface normals, albedo, and ambient occlusion to be estimated, which can be used to transform the actor's reflectance to produce both subtle and stylistic effects.

引用

页码：756 / 764

页数：9

共 42 条

[1]

[Anonymous], 1998, COMBINATORIAL THEORY

[2]

[Anonymous], 1992, Synthetic lighting for photography

[3]

Black M. J., 1993, [1993] Proceedings Fourth International Conference on Computer Vision, P231, DOI 10.1109/ICCV.1993.378214

[4]

Brostow GJ, 2001, COMP GRAPH, P561, DOI 10.1145/383259.383325

[5]

CALAHAN S, 2000, ADV RENDERMAN CREATI, P337

[6]

Debevec P, 2002, ACM T GRAPHIC, V21, P547

[7]

Debevec P, 2000, COMP GRAPH, P145, DOI 10.1145/344779.344855

[8]

Fielding R., 1985, TECHNIQUE SPECIAL EF

[9]

Georghiades A. S., 2003, Eurographics Symposium on Rendering. 14th Eurographics Workshop on Rendering, P230

[10] Illumination-based image synthesis: Creating novel images of human faces under differing pose and lighting [J].

Georghiades, AS ;

Belhumeur, PN ;

Kriegman, DJ .

IEEE WORKSHOP ON MULTI-VIEW MODELING & ANALYSIS OF VISUAL SCENES (MVIEW'99). PROCEEDINGS, 1999, :47-54

← 1 2 3 4 5 →