Score: 1

Technique to Baseline QE Artefact Generation Aligned to Quality Metrics

Published: November 18, 2025 | arXiv ID: 2511.15733v1

By: Eitan Farchi , Kiran Nayak , Papia Ghosh Majumdar and more

BigTech Affiliations: IBM

Potential Business Impact:

Checks computer-made plans for quality.

Business Areas:
Quality Assurance Professional Services

Large Language Models (LLMs) are transforming Quality Engineering (QE) by automating the generation of artefacts such as requirements, test cases, and Behavior Driven Development (BDD) scenarios. However, ensuring the quality of these outputs remains a challenge. This paper presents a systematic technique to baseline and evaluate QE artefacts using quantifiable metrics. The approach combines LLM-driven generation, reverse generation , and iterative refinement guided by rubrics technique for clarity, completeness, consistency, and testability. Experimental results across 12 projects show that reverse-generated artefacts can outperform low-quality inputs and maintain high standards when inputs are strong. The framework enables scalable, reliable QE artefact validation, bridging automation with accountability.

Country of Origin
🇺🇸 United States

Page Count
14 pages

Category
Computer Science:
Software Engineering