From SERPs to Agents: A Platform for Comparative Studies of Information Interaction
By: Saber Zerhoudi, Michael Granitzer
The diversification of information access systems, from RAG to autonomous agents, creates a critical need for comparative user studies. However, the technical overhead to deploy and manage these distinct systems is a major barrier. We present UXLab, an open-source system for web-based user studies that addresses this challenge. Its core is a web-based dashboard enabling the complete, no-code configuration of complex experimental designs. Researchers can visually manage the full study, from recruitment to comparing backends like traditional search, vector databases, and LLMs. We demonstrate UXLab's value via a micro case study comparing user behavior with RAG versus an autonomous agent. UXLab allows researchers to focus on experimental design and analysis, supporting future multi-modal interaction research.
Similar Papers
UXAgent: A System for Simulating Usability Testing of Web Design with LLM Agents
Computation and Language
Tests website designs with fake users before launch.
UXAgent: An LLM Agent-Based Usability Testing Framework for Web Design
Human-Computer Interaction
Tests websites with fake people before real ones.
Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies
Human-Computer Interaction
Tests helper robots without real people.