AI & ML
Measuring Bounded Autonomy for an LLM Decomposition Planner on a Live 5G-Core Testbed
arXiv cs.NI0 views
arXiv:2611.08707v1 Announce Type: new Abstract: Large language models (LLMs) are entering network-management control loops, yet their plans can fall outside the executable action space. Whether hard deterministic bounds around such a planner have real effect, or merely restate a definition, is an empirical question. We measure it on a live 5G-core testbed, where an LLM planner decides when to decompose control-plane procedures into stateless handlers inside a bounded loop: a JSON schema constrains the output, a projection-repair validator re-checks it, a deterministic fallback guarantees liveness, and every decision is persisted. Three measurements anchor the paper. First, the two tested models, run unbounded with the allowed action sets stated in the prompt, still violated intent-handler rules in 13 of 44 standard calls. Every violation broke an intent-handler combination rule that the deployed flat schema cannot encode (schema enforcement as deployed caught 0/13); a union schema encoding the rule removes the class by construction. Second, with the bounds in place, all 33 decoded live plans were feasible without repair, and a matched-condition probe put the in-distribution unbounded rate at one violation in 20 windows. Third, exploratory: on the design set the planner matched an author-specified selection reference that a threshold policy and three a priori codings each missed. Transfer to held-out scenarios remained partial (5-6 of 10), and the planner's two-clause distillate could replace the runtime planner itself. Together, the results suggest elicitation and distillation, not runtime control, as the LLM's role.
Source:https://arxiv.org/abs/2611.08707PreviousREAL-2MIX: Evaluating Identity Faithfulness in Audio-Visual Target Speaker ExtractionNextStochastic AI Model Placement for AI-and-RAN Coexistence in 6G Networks
Related posts

Agents draft. People decide.
0dev.to UX

โค้ดเพิ่ม 400% แต่คุณไม่ได้เร็วขึ้น 400%: GitHub ชี้คอขวดใหม่อยู่ที่การรีวิว
0dev.to GitHub

Drago: Your GitHub Dragon
0dev.to GitHub
Case Study: Automating Tableau to Power BI Migration with Up to 90% Accuracy.
0dev.to Data
Vom Bluttest ins Molekül: Warum die Alamar/Nightingale-Studie räumliches Denken braucht...
0dev.to Data
10x Genomics가 Anthropic의 Claude AI를 Chromium 플랫폼에 통합한 'Sentira'를 발표했습니다. 단일세포 데이터 분석을 가...
0dev.to Data