AI & ML
Decision Models as Retrieval Gates Against Injection and Pollution
arXiv cs.IR0 views
arXiv:2611.08325v1 Announce Type: cross Abstract: Retrieved web text can carry instructions aimed at the language model, or synthetic pages written to mislead. We test whether released open-weight decision models, which answer typed questions about a text without generating tokens, can screen retrieved passages against both threats. On a benchmark of 1,000 questions over forum-style web pages with hidden injected instructions, a Kev-4B gate reads each passage's HTML. Attack success, measured automatically, falls from 27.9% with no defence to 13.6% with the published mitigations (sanitisation, normalisation and citation prompting) and to 5.7% with the gate added. The gate takes 76 ms per passage and wrongly flags 4 of 186 benign pages with instructions for human readers. Responsiveness on clean queries stays within a point (85.6% to 86.2%). On a 200-query pollution testbed where two thirds of the candidate pages are fake, filtering the pool before the top ten are chosen keeps fake pages out of the answer (0.5% exposure) and holds accuracy at 83%, against 28% with no filter. Filtering only the top ten leaves the generator too few pages to answer. Large LLMs used as judges rank attacks better (AUROC 0.99 against 0.94) but cost ten times more. Gates catch more attacks when they read the page's HTML than when they read its plain text. Every model is open-weight.
Source:https://arxiv.org/abs/2611.08325PreviousArcadeDB in Python: An In-Process Multi-Model DatabaseNextFloodSQL-Bench: A Retrieval-Augmented Benchmark for Geospatially-Grounded Text-to-SQL
Related posts

How I Switched: a human-approved change desk for AI agents
0dev.to
Your favourite name is taken. Do not ruin it trying to save it
0dev.to
Writing HTCondor DAG Files: Job Dependencies, Variables, and Concurrency Limits
0dev.to
YuGPT backs up ChatGPT and Codex chats locally and offers flexible search across them. It's quietly finding buyers. Thank you to everyone who bought it. I'm working on improvements and plan to release
0dev.to
GEO 的第一步,不是多發幾篇文章
0dev.to AI
Sol's Take: Saturday — November 07, 2026
0dev.to AI