AI & ML
JailBound: FOL-Guided Jailbreak Evaluation for Exploring LLM Behavioral Boundaries
arXiv cs.CR0 views
arXiv:2611.07530v1 Announce Type: new Abstract: As large language models (LLMs) are increasingly deployed as general-purpose conversational assistants, they must handle diverse user requests while reliably refusing harmful ones. Jailbreak attacks craft adversarial instructions or conversational contexts to elicit unsafe responses despite these safeguards. However, existing jailbreak benchmarks often rely on manually designed or collected prompts, making it difficult to systematically extend coverage to new threat conditions. Moreover, existing attack search methods typically optimize for attack success rate (ASR), providing limited insight into how model behavior changes locally between safe refusal and unsafe response. To address these limitations, we present JailBound, a unified jailbreak evaluation framework that combines automated benchmark construction with first-order loss (FOL)-guided dual-branch search. JailBound organizes threats by risk category, application domain, and attack type. Conditioned on this taxonomy, a fine-tuned meta-attack generator synthesizes evaluation prompts across diverse threat conditions. FOL serves as a local sensitivity signal for exploring high-value attack states and behavior-sensitive states. We evaluate JailBound across 46 LLMs from 13 model families under a unified experimental protocol. Under matched settings, the High-Value Branch improves average ASR over a ZOL-only baseline by 5.1 and 4.9 percentage points across the two evaluation settings. Under local perturbations, states from the Safety-Sensitivity Branch exhibit higher behavioral flip rates than those from the High-Value Branch across all tested radii for JailBound and S-Eval, indicating greater local sensitivity of judge-assigned safety labels. Warning: this paper includes examples that may be offensive or harmful.
Source:https://arxiv.org/abs/2611.07530PreviousAMORT-V1: Checkpointed Post-Quantum Attestation for Industrial ControllersNextA Gingerbread House for LLM Agents: Source-Planned Honeypots That Lure Autonomous Attackers into an Isolated Shadow
Related posts
Stop running everything through LLMs: How I fixed my research agent
0Hacker News New
Lessons from Building a Deep Research System
0Hacker News New
Decomp of David Horner's Drain Storm (1997)
0Hacker News New
How Sustainable Is a Solar Powered Website? (2020)
0Hacker News New
Now indexed by Vuink,500K+ words. 742 turns.135 Knowledge domains – UKA-135
0Hacker News New
IDE extension that keeps me in control of AI-written code
0Hacker News New