DYNAMIC 3-D SCENE ANALYSIS THROUGH SYNTHESIS FEEDBACK-CONTROL

The analysis of 3-D scenes consisting of nonrigid moving objects from 2-D image sequences is discussed. A parametric description of dynamic objects is extracted, and the time-variant scene parameters are estimated throughout the sequence by employing an analysis-by-synthesis approach. Images are synthesized from the parametric scene description and compared with the original input images of the camera. Frame differences between both images are evaluated to estimate a scene parameter update. The analysis system is applied to video phone scenes as a data compression algorithm where the scene parameters are transmitted, and the output sequence is synthesized at the receiver.