VXSlate: Combining Head Movement and Mobile Touch for Large Virtual Display Interaction

Abstract: Virtual Reality (VR) headsets can open opportunities for users to accomplish complex tasks on large virtual displays, using compact setups. However, interacting with large virtual displays using existing interaction techniques might cause fatigue, especially for precise manipulations, due to the lack of physical surfaces. We designed VXSlate, an interaction technique that uses a large virtual display, as an expansion of a tablet. VXSlate combines a user's headmovement, as tracked by the VR headset, and touch interaction on the tablet. The user's headmovement position both a virtual representation of the tablet and of the user's hand on the large virtual display. The user's multi-touch interactions perform finely-tuned content manipulations.