Remote Rendering for Virtual Reality: performance comparison of multimedia frameworks and protocols
By: Daniel Mejías , Inhar Yeregui , Roberto Viola and more
Potential Business Impact:
Makes virtual worlds run smoothly on any device.
The increasing complexity of Extended Reality (XR) applications demands substantial processing power and high bandwidth communications, often unavailable on lightweight devices. Remote rendering consists of offloading processing tasks to a remote node with a powerful GPU, delivering the rendered content to the end device. The delivery is usually performed through popular streaming protocols such as Web Real-Time Communications (WebRTC), offering a data channel for interactions, or Dynamic Adaptive Streaming over HTTP (DASH), better suitable for scalability. Moreover, new streaming protocols based on QUIC are emerging as potential replacements for WebRTC and DASH and offer benefits like connection migration, stream multiplexing and multipath delivery. This work describes the integration of the two most popular multimedia frameworks, GStreamer and FFmpeg, with a rendering engine acting as a Remote Renderer, and analyzes their performance when offering different protocols for delivering the rendered content to the end device over WIFI or 5G. This solution constitutes a beyond state-of-the-art testbed to conduct cutting-edge research in the XR field.
Similar Papers
Streaming Remote rendering services: Comparison of QUIC-based and WebRTC Protocols
Networking and Internet Architecture
Makes virtual meetings feel more real.
Energy consumption assessment of a Virtual Reality Remote Rendering application over 5G networks
Networking and Internet Architecture
Makes VR games work on simple phones.
Immersive Multimedia Communication: State-of-the-Art on eXtended Reality Streaming
Multimedia
Makes virtual worlds look and feel real.