AI & ML
Optimal Learning in Games with Arbitrary Delays: Best-of-Both-Worlds for Self-Play and Adversarial Opponents
arXiv stat.ML0 views
arXiv:2611.07773v1 Announce Type: cross Abstract: We study learning in zero-sum games with delayed feedback. We introduce Multi-Anchor Optimistic Online Mirror Descent (MAO-OMD), a single algorithm which obtains optimal fast rates in self-play on smooth games, while simultaneously maintaining minimax optimal guarantees against arbitrary opponents. In particular, in smooth zero-sum games with arbitrary and unknown feedback delays, MAO-OMD obtains $O(\sigma_{\max}+1)$ social and individual regrets when used by both players, where $\sigma_{\max}$ denotes the maximum number of outstanding gradients, while also guaranteeing minimax optimal $O(\sqrt{T+d_{\mathrm{tot}}})$ individual regret against arbitrary opponents, where $d_{\mathrm{tot}}$ is the total delay. Moreover, we show that these optimal rates cannot be obtained simultaneously using the standard black-box reduction to the undelayed setting. We also extend our results to multi-player games, and to games with player-dependent delay sequences.
Source:https://arxiv.org/abs/2611.07773PreviousIdentification and Bounding of Joint Expectation over Potential OutcomesNextDoubly-robust causal inference for multi-valued treatment regimes with recurrent neural networks
Related posts

Save 26% on this 142-piece toolkit for your PC repairs and hobbyist projects, now under $28
0Tom's Hardware
‘Mathematics is more than a mechanical process’ — why I think the field will survive OpenAI’s disruption
0Nature News
Preprint platform offers to pay researchers to review papers, but questions remain
0Nature News

I’ve reviewed almost every Android foldable this year — here’s how the iPhone Duo compares
0The Verge
Physicl raises $10M to make the digital world real enough for robots
0TechCrunch

Kubernetes, mark II? Why Google’s giving away gVisor, a code sandbox used by Anthropic and OpenAI
0The New Stack