AI & ML
Worst-Case Discovery and Runtime Protection for RL-Based Network Controllers
arXiv eess.SY0 views
arXiv:2605.04373v2 Announce Type: replace-cross Abstract: RL-based controllers achieve strong average-case performance in networking tasks such as congestion control and adaptive bitrate streaming. Yet their performance can degrade severely under network conditions where strong performance is still achievable. Identifying such conditions and quantifying the resulting performance gap is intractable by enumeration, while the sequential and closed-loop nature of RL controllers makes formal verification methods impractical. We present ReGuard, a framework that discovers worst-case scenarios for a given RL controller and protects it against them at inference time without retraining. ReGuard formulates scenario discovery as a bilevel regret-maximization problem, certifying a lower bound on the controller's worst-case performance gap. ReGuard then analyzes the discovered counterfactual trajectories and compiles them into lightweight logic rules that intervene only when a risky state is detected, leaving the controller's behavior unchanged otherwise. We evaluate ReGuard across three RL-based network controllers: Pensieve, Sage, and Park. ReGuard discovers scenarios in which each controller suffers a 43-64% performance loss relative to what is achievable under the same conditions. ReGuard exposes performance gaps 57% to 6 times larger than those found by the strongest baselines and shrinks those gaps by 79-85% in its first iteration via lightweight rule-based protection, iteratively driving the remaining gap toward nominal levels. ReGuard's protection extends beyond the scenarios it discovers, improving performance across a wide range of network conditions.
Source:https://arxiv.org/abs/2605.04373PreviousDirection-Dependent Path Loss Modeling in Olive Orchards for Precision AgricultureNextThermoLLM: LLM-Based Multi-Zone HVAC Control with a Spatiotemporal Context
Related posts

Shure’s popular podcasting and streaming mic is almost $50 off
0The Verge

BoopFace: an MIT-licensed SVG robot avatar Web Component for AI agents
0dev.to

Written, translated into eleven languages, and seen by nobody
0dev.to
40C3 halfnarp – Submit talk preferences to aid scheduling
0Hacker News
Firecracker VM Escape: PwnEscape Part 2
0Hacker News
AI agents are getting more complex. Developers shouldn’t have to babysit them.
0The New Stack