Backend
Energy-Proportional Serverless Computing on SBC Clusters
arXiv cs.DC0 views
arXiv:2611.14026v1 Announce Type: new Abstract: Serverless computing promises to run code only on demand, yet the servers beneath it draw most of their power while idle, so energy consumption does not scale to zero with the workload. We show that the statelessness of serverless functions makes it possible to extend scale-to-zero from function instances to physical nodes, enabling energy proportionality. Our platform, built on tinyFaaS for clusters of single-board computers, treats node power state as part of worker selection, powering workers off when idle and back on under load. On a physical cluster, our approach reduces mean power draw by 39.6 % on a bursty, trace-based workload and by 46.7 % on a sparse one, without a detectable change in median latency on the bursty workload. The cost lands in the tail, where invocations that arrive while all workers are off wait about a minute for a node to boot. Under continuous load, the platform behaves like an always-on cluster.
Source:https://arxiv.org/abs/2611.14026PreviousScaling Shapley Energy Attribution to Large LLM BatchesNextCan KV Cache Be Reused Across Model Updates? A DeepSeek-V4-Flash Case Study
Related posts

Run Gemma 4 31B-it Uncensored on a 12GB GPU: Complete Local Vision & 256K Context Guide with llama.cpp, DeepSeek Harness & Hermes Agent
0dev.to
Transactions & Basic Indexing in PostgreSQL: COMMIT, ROLLBACK, EXPLAIN & SQLAlchemy ⚛️
0dev.to
The hard part of paraphrasing is preserving meaning, not swapping synonyms
0dev.to
TypeScript for AI Engineers: The Language of AI Web Apps
0dev.to
Your Static Site Build Shouldn't DDoS Your Own API
0dev.to
Human Handoff for Website AI Chatbots: A Spec You Can Actually Build From
0dev.to