Motion segmentation and pose recognition with motion history gradients

This paper presents a fast and simple method using a timed motion history image (tMHI) for representing motion from the gradients in successively layered silhouettes. This representation can be used to (a) determine the current pose of the object and (b) segment and measure the motions induced by the object in a video scene. These segmented regions are not "motion blobs", but instead are motion regions that are naturally connected to parts of the moving object. This method may be used as a very general gesture recognition "toolbox". We demonstrate the approach with recognition of waving and overhead clapping motions to control a music synthesis program.