XR Framework for Collaborating Remote Heterogeneous Devices

Abstract

With the advent of high-speed 5G networks, establishing a remote space-sharing XR environment that supports real-time interaction based on the latest VR/AR/MR technology is receiving attention as a promising new research topic. With that aim, we have developed a framework that allows users with different types of devices, in different physical spaces, to effectively build a virtual world where collaborative work can be performed. By using this technology, new types of content can be effectively produced that can interact in real time with various commercial VR/MR head-mounted displays, smart mobile devices, and even beam projectors. In this paper, we demonstrate the effectiveness and potential of this framework through the example of game content development where MR and VR head-mounted display users interact in virtual space.