Multi-rate fusion with vision and inertial sensors

This paper presents a multi-rate fusion model which exploits the complimentary properties of visual and inertial sensors for egomotion estimation in applications such as robot navigation and augmented reality. The sampling of these two sensors is described with size-varying input and output equations without assumed synchronicity and periodicity of measurements. Data fusion is performed with two different multi-rate (MR) filter models, an Extended (EKF) and an Unscented Kalman filter (UKF). A complete dynamic model for the 6D-tracking task is given together with a method to calculate the dependencies of the covariance matrices. It is further shown that a centripetal acceleration model and the precise description of quaternion prediction for a constant velocity model highly improve the estimation error for rotary motions. The comparison demonstrates that the MR-UKF provides better estimation results at higher computational costs.