Separating reflection components of textured surfaces using a single image

被引:243
作者
Tan, RT [1 ]
Ikeuchi, K [1 ]
机构
[1] Univ Tokyo, Inst Ind Sci, Dept 3, Ikeuchi Lab,Meguro Ku, Tokyo 1538505, Japan
关键词
reflection components separation; specular reflection; diffuse reflection; dichromatic reflection model; chromaticity; specular-to-diffuse mechanism; specular-free image;
D O I
10.1109/TPAMI.2005.36
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
In inhomogeneous objects, highlights are linear combinations of diffuse and specular reflection components. A number of methods have been proposed to separate or decompose these two components. To our knowledge, all methods that use a single input image require explicit color segmentation to deal with multicolored surfaces. Unfortunately, for complex textured images, current color segmentation algorithms are still problematic to segment correctly. Consequently, a method without explicit color segmentation becomes indispensable and this paper presents such a method. The method is based solely on colors, particularly chromaticity, without requiring any geometrical information. One of the basic ideas is to iteratively compare the intensity logarithmic differentiation of an input image and its specular-free image. A specular-free image is an image that has exactly the same geometrical profile as the diffuse component of the input image and that can be generated by shifting each pixel's intensity and maximum chromaticity nonlinearly. Unlike existing methods using a single image, all processes in the proposed method are done locally, involving a maximum of only two neighboring pixels. This local operation is useful for handling textured objects with complex multicolored scenes. Evaluations by comparison with the results of polarizing filters demonstrate the effectiveness of the proposed method.
引用
收藏
页码:178 / 193
页数:16
相关论文
共 32 条
[1]  
BAJSCY R, 1996, INT J COMPUT VISION, V17, P249
[2]  
Beckmann P., 1963, SCATTERING ELECTROMA
[3]  
Born M., 1999, PRINCIPLES OPTICS
[4]  
Criminisi A, 2002, MSRTR200219
[5]   MECHANISMS OF COLOR CONSTANCY [J].
DZMURA, M ;
LENNIE, P .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1986, 3 (10) :1662-1672
[6]  
FUNT BV, 1992, LECT NOTES COMPUT SC, V588, P124
[7]   AMBIENT ILLUMINATION AND THE DETERMINATION OF MATERIAL CHANGES [J].
GERSHON, R ;
JEPSON, AD ;
TSOTSOS, JK .
JOURNAL OF THE OPTICAL SOCIETY OF AMERICA A-OPTICS IMAGE SCIENCE AND VISION, 1986, 3 (10) :1700-1707
[8]  
Gonzales R.C., 1993, DIGITAL IMAGE PROCES
[9]   RADIOMETRIC CCD CAMERA CALIBRATION AND NOISE ESTIMATION [J].
HEALEY, GE ;
KONDEPUDY, R .
IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 1994, 16 (03) :267-276
[10]   A PHYSICAL APPROACH TO COLOR IMAGE UNDERSTANDING [J].
KLINKER, GJ ;
SHAFER, SA ;
KANADE, T .
INTERNATIONAL JOURNAL OF COMPUTER VISION, 1990, 4 (01) :7-38