Through the Lens of Human-Human Collaboration: A Configurable Research Platform for Exploring Human-Agent Collaboration
By: Bingsheng Yao , Jiaju Chen , Chaoran Chen and more
Potential Business Impact:
Helps people work better with smart computer helpers.
Intelligent systems have traditionally been designed as tools rather than collaborators, often lacking critical characteristics that collaboration partnerships require. Recent advances in large language model (LLM) agents open new opportunities for human-LLM-agent collaboration by enabling natural communication and various social and cognitive behaviors. Yet it remains unclear whether principles of computer-mediated collaboration established in HCI and CSCW persist, change, or fail when humans collaborate with LLM agents. To support systematic investigations of these questions, we introduce an open and configurable research platform for HCI researchers. The platform's modular design allows seamless adaptation of classic CSCW experiments and manipulation of theory-grounded interaction controls. We demonstrate the platform's effectiveness and usability through two case studies: (1) re-implementing the classic human-human-collaboration task Shape Factory as a between-subject human-agent-collaboration experiment with 16 participants, and (2) a participatory cognitive walkthrough with five HCI researchers to refine workflows and interfaces for experiment setup and analysis.
Similar Papers
LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey
Computation and Language
Humans and AI work together for better results.
A Call for Collaborative Intelligence: Why Human-Agent Systems Should Precede AI Autonomy
Artificial Intelligence
AI helps people do jobs better, not alone.
Design and Evaluation of Generative Agent-based Platform for Human-Assistant Interaction Research: A Tale of 10 User Studies
Human-Computer Interaction
Tests helper robots without real people.