Remote walkthrough over mobile networks using 3-D image warping and streaming

A mobile walkthrough environment based on 3-D superview warping and view compensation streaming is presented. In this environment, 3-D views are rendered on the remote clients using 3-D oversized reference views and compensated on a view-on-demand basis by the graphically rendered views from the server. The view compensations (hole residuals and the depth map) are coded using a layered joint source-channel coding with unequal error corrections to protect the significant packets on noisy and erasure mobile channels. The new compensated view will then serve as a reference view for the subsequent rendering on the clients. This environment enables numerous mobile virtual applications, such as remote m-gaming, remote m-design, in-learning, m-CAD/CAM, etc., scalable to different network capabilities.