Open Source
Evaluating AST-Derived Knowledge Graph Retrieval for AIOps Incident Diagnosis in Apache Kafka
arXiv cs.SE0 views
arXiv:2611.21625v1 Announce Type: new Abstract: Incident diagnosis requires retrieving source-linked operational evidence from large codebases. We evaluate graph-augmented retrieval for Apache Kafka using an abstract-syntax-tree (AST)-derived ownership graph over 1,600 source-linked log records and an audited benchmark of 315 incident-style queries covering 103 unique targets. Vector-only retrieval is a strong baseline at Recall@20 of 0.956, and neither static nor confidence-guided staged AST expansion significantly improves Recall@20 over it. As an external control we evaluate HippoRAG, a published text-derived graph-retrieval system, against its own ColBERTv2 retrieval backbone. Against ColBERTv2-only (Recall@20 0.803), HippoRAG attained 0.308; a post-hoc document-ensemble sensitivity raised Recall@20 to 0.648 but did not eliminate the deficit. Relative to static expansion, staging reduces cross-encoder pair workload and measured reranking time by about 52%. A manually evaluated 100-query downstream study finds no significant root-cause-correctness advantage for AST-derived structural evidence.
Source:https://arxiv.org/abs/2611.21625PreviousTrustworthy AI Teammates for Software Engineering: A Research Agenda for Lifecycle Context, Explainability, and Agentic CollaborationNextX-LocVul: An Evidence-Propagation Audit of Cascaded C/C++ Vulnerability Detection, Localization, and Explanation
Related posts
Turn a folder of MP4s into an editable publishing CSV with Python
0dev.to Python
Oriko CLI – Create your CV in the terminal with builtin Agent support
0Hacker News New
From 181 bytes: nixpkgs' full-source bootstrap
0Hacker News New
Show HN: Fufu – an opinionated Git client inspired by Jujutsu
0Hacker News New
Show HN: Pbc – a CLI for any PocketBase instance
0Hacker News Show

A Link You Can Just Open
0dev.to