Score: 0

Tell-XR: Conversational End-User Development of XR Automations

Published: April 12, 2025 | arXiv ID: 2504.09104v1

By: Alessandro Carcangiu , Marco Manca , Jacopo Mereu and more

Potential Business Impact:

Lets anyone build virtual worlds with just talking.

Business Areas:
Augmented Reality Hardware, Software

The availability of extended reality (XR) devices has widened their adoption, yet authoring interactive experiences remains complex for non-programmers. We introduce Tell-XR, an intelligent agent leveraging large language models (LLMs) to guide end-users in defining the interaction in XR settings using automations described as Event-Condition-Action (ECA) rules. Through a formative study, we identified the key conversation stages to define and refine automations, which informed the design of the system architecture. The evaluation study in two scenarios (a VR museum and an AR smart home) demonstrates the effectiveness of Tell-XR across different XR interaction settings.

Country of Origin
🇮🇹 Italy

Page Count
23 pages

Category
Computer Science:
Human-Computer Interaction