An Edge Cloud Based Coordination Platform for Multi-user AR Applications

Sonkoly, Balázs and Nagy, Bálint György and Dóka, János and Kecskés-Solymosi, Zsófia and Czentye, János Emánuel and Formanek, Bence and Jocha, Dávid and Gerő, Balázs Péter (2024) An Edge Cloud Based Coordination Platform for Multi-user AR Applications. JOURNAL OF NETWORK AND SYSTEMS MANAGEMENT, 32 (2). pp. 32-40. ISSN 1064-7570

Preview

Text s10922-024-09809-9.pdf - Published Version Available under License Creative Commons Attribution. Download (1MB) | Preview

Abstract

Augmented Reality (AR) applications can reshape our society enabling novel ways of interactions and immersive experiences in many fields. However, multi-user and collaborative AR applications pose several challenges. The expected user experience requires accurate position and orientation information for each device and precise synchronization of the respective coordinate systems in real-time. Unlike mobile phones or AR glasses running on battery with constrained resource capacity, cloud and edge platforms can provide the computing power for the core functions under the hood. In this paper, we propose a novel edge cloud based platform for multi-user AR applications realizing an essential coordination service among the users. The latency critical, computation intensive Simultaneous Localization And Mapping (SLAM) function is offloaded from the device to the edge cloud infrastructure. Our solution is built on open-source SLAM libraries and the Robot Operating System (ROS). Our contribution is threefold. First, we propose an extensible, edge cloud based AR architecture. Second, we develop a proof-of-concept prototype supporting multiple devices and building on an AI-based SLAM selection component. Third, a dedicated measurement methodology is described, including energy consumption aspects as well, and the overall performance of the system is evaluated via real experiments.

Actions (login required)

Edit Item