A Visual Interaction Cue Framework from Video Game Environments for Augmented Reality

Abstract

Based on an analysis of 49 popular contemporary video games, I develop a descriptive framework of visual interaction cues in video games. These cues are used to inform players what can be interacted with, where to look, and where to go within the game world. These cues vary along three dimensions: the purpose of the cue, the visual design of the cue, and the circumstances under which the cue is shown. I demonstrate that this framework can also be used to describe interaction cues for augmented reality applications. Beyond this, I show how the framework can be used to generatively derive new design ideas for visual interaction cues in augmented reality experiences and use the framework as a guide to create three novel AR prototypes. Finally, I suggest design considerations for the creation of visual interaction cues for augmented reality and examine how the framework might be employed in future work.