The key technological challenge to creating an augmented reality lies in maintaining accurate registration between real and computer-generated objects. As augmented reality users move their viewpoints, the graphic virtual elements must remain aligned with the observed positions and orientations of real objects. A hybrid approach to orientation tracking is developed which integrates inertial and vision-based sensing. Analysis and experimental results demonstrates the effectiveness of this approach.