Evaluating the Effectiveness of Interactive Map Interface Designs: A Case Study Integrating Usability Metrics with Eye-Movement Analysis

This paper proposes combining traditional usability methods with the analysis of eye movement recordings to evaluate interactive map interfaces, and presents a case study in support of this approach. The case Study evaluates two informationally equivalent, but differently designed online interactive map interfaces presented to novice users. In a mixed factorial experiment, thirty participants were asked to solve three typical map-use tasks using one of the two interfaces; we then measured user satisfaction, efficiency (completion time) and effectiveness (accuracy) with standard SEE usability metrics. While traditional (bottom line) usability metrics call reveal a range of usability problems, they may he enhanced by additional procedural measures such as eye movement recordings. Eye movements have been shown to help reveal the amount of cognitive processing a display requires and,where these cognitive resources are required. Therefore, we call establish how a display may or may not facilitate task completion by analyzing eye movement recordings. User satisfaction information related to tested Stimuli (i.e., collected through standardized questionnaires) call also be linked to eye tracking data for further analysis. We hope that the presented methodology and case study will help cartographers and map interface designers to better identify, design issues in their products, and that these insights will eventually lead to more effective and efficient online map interfaces.