AI & ML
Evolution Under Fire: Evolving Agent Safety Harnesses with Adaptive Injection Stressors
arXiv cs.CR0 views
arXiv:2611.22583v1 Announce Type: new Abstract: Tool-using language-model agents must act on information from untrusted emails, webpages, and documents. This creates a central security challenge: malicious instructions and legitimate task directives can arrive through the same interaction channel. Existing defenses are largely hand-designed and static, making further improvements dependent on repeated manual redesign. We introduce Evolution Under Fire, a staged framework that couples safety-harness evolution with adaptive stressor evolution. Utility-constrained, Pareto-scheduled tree search evolves complete executable safety harnesses from execution evidence while keeping the task model, benchmark, tools, and evaluator fixed. Adaptive stressor evolution then discovers utility-preserving attacks that guide a subsequent stage of harness evolution. On AgentDyn with GPT-4o-mini, an evolved harness reduces attack success from 50.4% to 3.0%, improves clean and attacked utility over the initial harness, and offers a stronger security-utility trade-off than reproduced defenses. On Agent-SafetyBench with Qwen2.5-7B-Instruct, harness evolution reduces attack success from 82.6% to 62.0% while retaining helpfulness and runtime validity. Evolved harnesses also transfer without further evolution to Qwen3.5-35B-A3B, reducing attack success from 32.1% to 0.9% while improving attacked-task utility.
Source:https://arxiv.org/abs/2611.22583PreviousHow Well Is My Artwork Protected? Predicting and Tailoring Protection against Style Mimicry by PersonalizationNextAdaptive LLM-Driven Honeypots vs. LLM-Driven Attackers: Does Narrative Coherence Improve Deception?
Related posts
Cambridge Dictionary chooses 'human' as word of the year in response to AI fears
0Phys.org Tech
After a 13-year wait, 'Grand Theft Auto VI' arrives with enormous hype and expectations
0Phys.org Tech
Anthropic set to price IPO in key test for AI boom
0Phys.org Tech
AI-Powered Sashiko Introduces Experimental Patch Series Design Assessment
0Phoronix

Preparing for a post-quantum future
0TechRadar

75+ best Black Friday deals 2026 in the UK — GTA 6, Kindles, Switch 2, Shark vacuums, LG OLED TVs, and more
0TechRadar