TAAF: A Trace Abstraction and Analysis Framework Synergizing Knowledge Graphs and LLMs
By: Alireza Ezaz , Ghazal Khodabandeh , Majid Babaei and more
Potential Business Impact:
Lets computers understand messy software logs easily.
Execution traces are a critical source of information for understanding, debugging, and optimizing complex software systems. However, traces from OS kernels or large-scale applications like Chrome or MySQL are massive and difficult to analyze. Existing tools rely on predefined analyses, and custom insights often require writing domain-specific scripts, which is an error-prone and time-consuming task. This paper introduces TAAF (Trace Abstraction and Analysis Framework), a novel approach that combines time-indexing, knowledge graphs (KGs), and large language models (LLMs) to transform raw trace data into actionable insights. TAAF constructs a time-indexed KG from trace events to capture relationships among entities such as threads, CPUs, and system resources. An LLM then interprets query-specific subgraphs to answer natural-language questions, reducing the need for manual inspection and deep system expertise. To evaluate TAAF, we introduce TraceQA-100, a benchmark of 100 questions grounded in real kernel traces. Experiments across three LLMs and multiple temporal settings show that TAAF improves answer accuracy by up to 31.2%, particularly in multi-hop and causal reasoning tasks. We further analyze where graph-grounded reasoning helps and where limitations remain, offering a foundation for next-generation trace analysis tools.
Similar Papers
A Training-Free Large Reasoning Model-based Knowledge Tracing Framework for Unified Prediction and Prescription
Computation and Language
Helps computers teach students better, faster, and with feedback.
TALE: A Tool-Augmented Framework for Reference-Free Evaluation of Large Language Models
Computation and Language
Tests AI answers using the real internet.
STAF: Leveraging LLMs for Automated Attack Tree-Based Security Test Generation
Cryptography and Security
Automates car security tests from attack plans.