LLM-Driven Cost-Effective Requirements Change Impact Analysis
By: Romina Etezadi , Sallam Abualhaija , Chetan Arora and more
Potential Business Impact:
Finds how changing one idea affects others.
Requirements are inherently subject to changes throughout the software development lifecycle. Within the limited budget available to requirements engineers, manually identifying the impact of such changes on other requirements is both error-prone and effort-intensive. That might lead to overlooked impacted requirements, which, if not properly managed, can cause serious issues in the downstream tasks. Inspired by the growing potential of large language models (LLMs) across diverse domains, we propose ProReFiCIA, an LLM-driven approach for automatically identifying the impacted requirements when changes occur. We conduct an extensive evaluation of ProReFiCIA using several LLMs and prompts variants tailored to this task. Using the best combination of an LLM and a prompt variant, ProReFiCIA achieves a recall of 93.3% on a benchmark dataset and 95.8% on a newly created industry dataset, demonstrating its strong effectiveness in identifying impacted requirements. Further, the cost of applying ProReFiCIA remains small, as the engineer only needs to review the generated results, which represent between 2.1% and 8.5% of the entire set of requirements.
Similar Papers
Can LLMs Generate User Stories and Assess Their Quality?
Software Engineering
Helps write computer instructions clearly and faster.
Analysis of LLMs vs Human Experts in Requirements Engineering
Software Engineering
Helps computers understand what people want.
Classification or Prompting: A Case Study on Legal Requirements Traceability
Software Engineering
Automates checking if software follows laws.