AI & ML
Prompt-Based Abstention Fails Under Misleading Context: A Controlled Study of Small Frozen RAG Models
arXiv cs.IR0 views
arXiv:2608.22228v2 Announce Type: replace Abstract: Missing and misleading evidence are not the same problem in retrieval-augmented generation (RAG), but prompt-based abstention treats them alike. Small frozen models abstain when context is absent, not when it is misleading. We introduce GRAB-RAG (Graded Abstention Benchmark for Retrieval-Augmented Generation), a paired benchmark that tests the same questions across four context conditions (supportive, degraded, missing, and misleading) in Natural Questions and HotpotQA. In the misleading condition, we edit a gold passage to support a wrong answer and place it among other retrieved passages. We test five abstention policies on three small frozen models (3.8B-8B) across two English QA benchmarks. Models abstain reliably when evidence is missing, but under explicit abstention prompting still answer 41.6% of misleading questions, with 63% of those answers echoing the planted wrong entity. Chain-of-thought provides little additional benefit. A generator-side conflict check cuts the rate to 13.3% but discards many correct answers, while a natural language inference (NLI) verifier recovers that coverage but fails when parametric memory and the misleading passage agree on the same wrong answer. Prompt-based abstention asks whether context is sufficient, not whether it is correct. The two-pass checks are diagnostic baselines, not deployable mitigations.
Source:https://arxiv.org/abs/2608.22228PreviousFederated User Behavior Modeling for Privacy-Preserving LLM RecommendationNextLEGIT: Live Eligibility Gating over Identifier Tries for Constrained Decoding of Heterogeneous Pages
Related posts

SBOM ที่ทำแล้วไม่มีใครเปิด: เปลี่ยนมันเป็น re-scan รายวันที่จับ CVE ใหม่ได้ โดยไม่ต้อง rebuild image
0dev.to Kubernetes

Add ChatGPT-style AI chat to your Expo app in 5 minutes
0dev.to OpenSource
sheet_route: نوافذ bottom sheet في Flutter كـ routes حقيقية مع snap points و go_router
0dev.to OpenSource
Every family WhatsApp group in India has the same problem
0dev.to OpenSource

How to Use Git Stash Step by Step
0dev.to Git
GenTUS: Table Union Search via Constrained Generation of Semantic Table Identifiers
0arXiv cs.DB