Backend
MIST: Reliable Streaming Decision Trees for Online Class-Incremental Learning via McDiarmid Bound
arXiv stat.TH0 views
arXiv:2605.11617v3 Announce Type: replace-cross Abstract: Streaming decision trees are natural candidates for open-world continual learning, as they perform local updates, enjoy bounded memory, and static decision boundaries. Despite these, they still fail in online class-incremental learning due to two coupled miscalibrations: (i) their split criterion grows unreliable as the class count K expands, and (ii) the absence of knowledge transfer at split time. Both failures share a common root: the range of Information Gain intrinsically scales with log2 K. Consequently, any Hoeffding-style confidence radius derived from it must inevitably grow with the class count, making a K-independent split criterion structurally impossible, taking away the potential benefits of applying streaming decision trees to continual learning. To fix this issue, we present MIST (McDiarmid Incremental Streaming Tree), which resolves both failures through three integrated components: (i) a tight, K-independent McDiarmid confidence radius for Gini splitting that acts as a structural regulariser; (ii) a Bayesian inheritance protocol that projects parent statistics to child nodes via truncated-Gaussian moments, with variance reduction guarantees strongest precisely when splitting is most conservative; and (iii) per-leaf KLL quantile sketches that support both continuous threshold evaluation and geometry-adaptive leaf prediction from a single data structure. On standard and stress-test tabular streams, MIST is competitive with global parametric methods on near-Gaussian benchmarks and uniquely robust on non-Gaussian geometry where SOTA benchmarks collapse.
Source:https://arxiv.org/abs/2605.11617PreviousInduced replication and the assessment of modelsNextInference for conditional Fr\'echet means via Riemannian Robust Bias Correction
Related posts

Introducing Tool Retrieval in the Gemini API
0Google AI Blog
How to Scrape Websites in Python with Olostep
0freeCodeCamp

How I Built a 100% Local PDF RAG Assistant on CPU Using Python and Ollama
0dev.to
A 302 From Your Upstream Can Delist Your Service
0dev.to
Calling C from KingCobra: a hands-on FFI tutorial
0dev.to
Private Object Storage for SaaS Documents: Presigned Links, Isolation, and Recovery
0dev.to