Towards Automated Safety Requirements Derivation Using Agent-based RAG
By: Balahari Vignesh Balu , Florian Geissler , Francesco Carella and more
Potential Business Impact:
Helps self-driving cars make safer decisions.
We study the automated derivation of safety requirements in a self-driving vehicle use case, leveraging LLMs in combination with agent-based retrieval-augmented generation. Conventional approaches that utilise pre-trained LLMs to assist in safety analyses typically lack domain-specific knowledge. Existing RAG approaches address this issue, yet their performance deteriorates when handling complex queries and it becomes increasingly harder to retrieve the most relevant information. This is particularly relevant for safety-relevant applications. In this paper, we propose the use of agent-based RAG to derive safety requirements and show that the retrieved information is more relevant to the queries. We implement an agent-based approach on a document pool of automotive standards and the Apollo case study, as a representative example of an automated driving perception system. Our solution is tested on a data set of safety requirement questions and answers, extracted from the Apollo data. Evaluating a set of selected RAG metrics, we present and discuss advantages of a agent-based approach compared to default RAG methods.
Similar Papers
SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generation
Artificial Intelligence
Makes self-driving cars safer by teaching them rules.
RAG LLMs are Not Safer: A Safety Analysis of Retrieval-Augmented Generation for Large Language Models
Computation and Language
Makes AI that uses outside info less safe.
Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG
Artificial Intelligence
AI agents help computers answer questions with new info.