AI & ML
Neural Memory Orchestration
arXiv cs.DC0 views
arXiv:2611.23857v1 Announce Type: new Abstract: Modern HPC workloads increasingly stall on the memory hierarchy rather than on compute, and page faults from mmap'd files, swap, and tiered memory are a growing fraction of wall time. Heuristic prefetchers in the kernel handle stride-like and temporally clustered patterns well but degrade sharply on the irregular, data-dependent access streams typical of these workloads. Learned prefetchers have been shown to capture such patterns in simulation but have not been taken to a deployed pipeline running against live workloads on real hardware. We present Overseer, an end-to-end learned page-prefetching system. An eBPF collector observes page faults on the target host, a transformer predictor (OverNet) runs on network-attached inference hardware and emits future page addresses, and a kernel-resident enforcer materializes those pages into the target's address space before they are demanded. OverNet encodes fault sequences through per-instance ordinal ranks over deltas, which lets a single trained model serve any target process without retraining. On two page-fault-heavy workloads, Overseer reduces runtime by roughly 35% on Hilbert-curve traversal and by roughly an order of magnitude on dense matrix multiplication, with corresponding reductions in major-fault counts.
Source:https://arxiv.org/abs/2611.23857PreviousA Fast, Programmable GPU-to-CPU Invocation Layer for GPU-Initiated CommunicationNextLocality-Aware Scheduling for Stream Processing Applications in Serverless Environments
Related posts

With the biggest IPO of all time, Anthropic’s ‘good guy’ reputation is on the line
0The Verge
Read the Hints First, Then Guess: A Better Way to Play a Music Daily
0dev.to

Did the attack really work?
0dev.to
Synergizing Evidence Retrieval and Utilization for Self-Improving Multimodal Scientific Document Reasoning
0dev.to
How to build a favicon set from a logo you already have
0dev.to
Understanding AI Computing — Part 4
0dev.to