AI & ML
Worst-Case Discovery and Runtime Protection for RL-Based Network Controllers
arXiv eess.SY0 views
arXiv:2605.04373v2 Announce Type: replace-cross Abstract: RL-based controllers achieve strong average-case performance in networking tasks such as congestion control and adaptive bitrate streaming. Yet their performance can degrade severely under network conditions where strong performance is still achievable. Identifying such conditions and quantifying the resulting performance gap is intractable by enumeration, while the sequential and closed-loop nature of RL controllers makes formal verification methods impractical. We present ReGuard, a framework that discovers worst-case scenarios for a given RL controller and protects it against them at inference time without retraining. ReGuard formulates scenario discovery as a bilevel regret-maximization problem, certifying a lower bound on the controller's worst-case performance gap. ReGuard then analyzes the discovered counterfactual trajectories and compiles them into lightweight logic rules that intervene only when a risky state is detected, leaving the controller's behavior unchanged otherwise. We evaluate ReGuard across three RL-based network controllers: Pensieve, Sage, and Park. ReGuard discovers scenarios in which each controller suffers a 43-64% performance loss relative to what is achievable under the same conditions. ReGuard exposes performance gaps 57% to 6 times larger than those found by the strongest baselines and shrinks those gaps by 79-85% in its first iteration via lightweight rule-based protection, iteratively driving the remaining gap toward nominal levels. ReGuard's protection extends beyond the scenarios it discovers, improving performance across a wide range of network conditions.
Source:https://arxiv.org/abs/2605.04373PreviousDirection-Dependent Path Loss Modeling in Olive Orchards for Precision AgricultureNextThermoLLM: LLM-Based Multi-Zone HVAC Control with a Spatiotemporal Context
Related posts
Slickdeals.net Is Compromised
0Hacker News Ask
Show HN: Makoda: reuse your Codex or Claude subscriptions as API
0Hacker News Show
There’s a New Way to Shop With AI. Text Alexa
0CNET News

13 waterproof jacket deals to save you from the November drizzle — up to 40% off leading brands
0TechRadar
In Vivo CRISPR Base Editing of <i>ANGPTL3</i> for Durable Lipid Lowering
0Nature News

Shure’s popular podcasting and streaming mic is almost $50 off
0The Verge