AI & ML
More Agents, More Reliable? System-Level Reliability of Multi-Agent LLMs under Operational-Profile Uncertainty
arXiv cs.MA0 views
arXiv:2611.07140v1 Announce Type: new Abstract: Teams increasingly build software from cooperating large language model (LLM) agents, often assuming more agents mean more reliability. Yet the usual evidence, average benchmark accuracy, ignores the input mix a deployed system meets and the rule merging the agents' answers. Building on HIP-LLM, a hierarchical imprecise-probability assessment of single LLMs, we propose a framework combining it with a Bayesian network of the system's failure logic for multi-agent systems. Agent failure-probability intervals propagate through this network, where the combining rule can itself fail, into a reliability envelope showing which evidence limits it. In a pipeline extracting regulated chemical-hazard statements, majority voting over three models protected against the weakest but did not clearly exceed the best, and a voter failing on 5\% of demands would largely erase its advantage over the middle model. More agents yield a more defensible reliability claim, not automatically a more reliable system.
Source:https://arxiv.org/abs/2611.07140PreviousAuthorization Propagation in Agent2Agent Systems: An Experimental Security Evaluation of Multi-Hop DelegationNextDesign of Multi-UAV Cooperative Deep Semantic Autoencoders for Communication Networks
Related posts
Free Chinese AI Models Are Getting Scary Good at Hacking
0Wired

Meta’s Muse AI can create custom ‘spaces’ for the version of the app you need right now
0The Verge
Meta introduces Spaces, a new way to collaborate with your Muse agent
0TechCrunch
GPU-Accelerated Weight Teleportation
0Hacker News
AI spend flatlined at +1.5% as Anthropic's $2T IPO shrinks
0dev.to Discuss

osFoundry का Maestro क्या करता है, एक AI चैट जो अपना हर कदम दिखाती है
0dev.to Productivity