Score: 0

Enhancing Software Development with Context-Aware Conversational Agents: A User Study on Developer Interactions with Chatbots

Published: May 13, 2025 | arXiv ID: 2505.08648v1

By: Glaucia Melo, Paulo Alencar, Donald Cowan

Potential Business Impact:

Helps coders build programs faster with smart helpers.

Business Areas:
Natural Language Processing Artificial Intelligence, Data and Analytics, Software

Software development is a cognitively intensive process requiring multitasking, adherence to evolving workflows, and continuous learning. With the rise of large language model (LLM)-based tools, such as conversational agents (CAs), there is growing interest in supporting developers through natural language interaction. However, little is known about the specific features developers seek in these systems. We conducted a user study with 29 developers using a prototype text-based chatbot to investigate preferred functionalities. Our findings reveal strong interest in task automation, version control support, and contextual adaptability, especially the need to tailor assistance for both novice and experienced users. We highlight the importance of deep contextual understanding, historical interaction awareness, and personalized support in CA design. This study contributes to the development of context-aware chatbots that enhance productivity and satisfaction, and it outlines opportunities for future research on human-AI collaboration in software engineering.

Country of Origin
🇨🇦 Canada

Page Count
11 pages

Category
Computer Science:
Software Engineering