AI & ML
Stochastic AI Model Placement for AI-and-RAN Coexistence in 6G Networks
arXiv cs.NI0 views
arXiv:2611.08739v1 Announce Type: new Abstract: This paper considers AI-service placement over geographically distributed RAN sites equipped with GPU resources partitioned into fixed, isolated multi-instance GPU (MIG) profiles. We propose C$^2$AIR, a chance-constrained optimization model that maximizes expected AI requests served while protecting uncertain RAN workloads and enforcing probabilistic capacity reliability requirements for admitted AI services. C$^2$AIR allows a service to run at multiple sites and accounts for discrete profile, memory, and GPU-slice constraints. We evaluate C$^2$AIR on a four-site deployment calibrated from NVIDIA Aerial RAN capacity figures and MLPerf Inference results, and on seven larger scenarios with up to 15 sites and 40 AI services, computing every violation and overload probability exactly from the demand distributions. C$^2$AIR keeps the RAN violation probability within its target at every hour of the day, whereas reserving for the mean RAN demand violates it in 24\% to 47\% of the intervals. The reliability condition prevents placing AI models that would be overloaded in 85\% of the intervals at an event hour, and multi-site replication serves 2.7 times more AI requests than single-site deployment. The evaluation also shows that coarse MIG instances and a heavy demand tail can make strict RAN protection expensive.
Source:https://arxiv.org/abs/2611.08739PreviousMeasuring Bounded Autonomy for an LLM Decomposition Planner on a Live 5G-Core TestbedNextStarLoc: A Practical Approach to Encoding Geographic Locators in IPv6 for Starlink
Related posts

Agents draft. People decide.
0dev.to UX

โค้ดเพิ่ม 400% แต่คุณไม่ได้เร็วขึ้น 400%: GitHub ชี้คอขวดใหม่อยู่ที่การรีวิว
0dev.to GitHub

Drago: Your GitHub Dragon
0dev.to GitHub
Case Study: Automating Tableau to Power BI Migration with Up to 90% Accuracy.
0dev.to Data
Vom Bluttest ins Molekül: Warum die Alamar/Nightingale-Studie räumliches Denken braucht...
0dev.to Data
10x Genomics가 Anthropic의 Claude AI를 Chromium 플랫폼에 통합한 'Sentira'를 발표했습니다. 단일세포 데이터 분석을 가...
0dev.to Data