XARP Tools: An Extended Reality Platform for Humans and AI Agents
By: Arthur Caetano, Misha Sra
Potential Business Impact:
Lets people and robots control virtual worlds together.
This technical report presents XARP Tools, an extended reality (XR) framework designed for human and AI developers alike. XARP comprises a server-side Python library and platform-specific XR clients. The library offers high-level APIs and communicates with clients via a JSON-based protocol over WebSockets. XR clients encapsulate device and runtime specifics, providing responsive, low-latency user interaction. XARP can be utilized in three ways: (i) as a library that abstracts XR development for humans; (ii) as a set of callable tools that allow AI agents to drive on-the-fly interactions with users; and (iii) as a Model Context Protocol server that plugs XR devices into AI ecosystems. XARP code and working examples are released openly at https://github.com/HAL-UCSB/xarp.
Similar Papers
XARP Tools: An Extended Reality Platform for Humans and AI Agents
Human-Computer Interaction
Build
XR Blocks: Accelerating Human-centered AI + XR Innovation
Human-Computer Interaction
Builds AI virtual worlds faster.
Evaluating Social Acceptance of eXtended Reality (XR) Agent Technology: A User Study (Extended Version)
Human-Computer Interaction
Teaches journalists safely using virtual people.