An Interactive Virtual Reality System with a Wireless Head-Mounted Display

Abstract

Virtual reality (VR) with head-mounted display (HMD) device provides an immersive experience for novel multimedia applications. This paper develops an interactive virtual reality system with a wireless HMD to enable a natural VR operation interface. In a server, the system utilizes the Kinect as a motion detection device to estimate VR user's location and gesture information in real time. Through a WiFi network, the user's information is transferred to the HMD as a client, where the user controls an avatar following his motion. The controlled avatar interacts with the virtual environment in real time. The proposed system is implemented using a Samsung Gear VR, Kinect 2.0 and Unity3D environment. This system is compatible with serious games, virtual and physical collaboration, natural user interfaces, and other multimedia applications.