AI & ML
Nonparametric Bandits with Single-Index Rewards: Optimality and Adaptivity
arXiv stat.TH0 views
arXiv:2512.24669v2 Announce Type: replace Abstract: Contextual bandits are a central framework for sequential decision-making, with applications ranging from recommendation systems to clinical trials. While nonparametric methods can flexibly model complex reward structures, they suffer from the curse of dimensionality. We address this challenge using a single-index model, which projects high-dimensional covariates onto a one-dimensional subspace while preserving nonparametric flexibility. We first develop a nonasymptotic theory for offline single-index regression for each arm, combining maximum rank correlation for index estimation with local polynomial regression. Building on this foundation, we propose a single-index bandit algorithm and establish its convergence rate. We further derive a matching lower bound, showing that the algorithm achieves minimax-optimal regret independent of the ambient dimension $d$, thereby overcoming the curse of dimensionality. We also establish an impossibility result for adaptation: without additional assumptions, no policy can adapt to unknown smoothness levels. Under a standard self-similarity condition, however, we construct a policy that remains minimax-optimal while automatically adapting to the unknown smoothness. Finally, as the dimension $d$ increases, our algorithm continues to achieve minimax-optimal regret, revealing a phase transition that characterizes the fundamental limits of single-index bandit learning.
Source:https://arxiv.org/abs/2512.24669PreviousSpectral Thresholds in Correlated Spiked Models and Fundamental Limits of Partial Least SquaresNextSecond-order PACF asymptotics and discrimination between fractional Gaussian noise and $\FARIMA(0,d,0)$
Related posts

The Ninja Crispi DualZone air fryer earns its price tag with clever design, great features, and excellent cooking
0TechRadar
Language models generate maximally activating examples for any residual direction
0dev.to

9 Timeouts in Claude Code, Codex and Gemini CLI That Cut Long Test Runs Short
0dev.to
Where JLPT learners lose points: 36,263 first answers by section
0dev.to
Stripe Billing or Chargebee: The Renewal Decides
0dev.to
Layer Rename & Cleanup: batch rename and delete empty layers in Aseprite (free Lite)
0dev.to