AI & ML
Prediction with Foundation Models under Deployment Budgets
arXiv stat.ML0 views
arXiv:2611.12466v2 Announce Type: replace Abstract: Foundation models can supply predictions for a downstream task that draw on knowledge from extensive pretraining, but they differ in task-specific accuracy and query cost. We develop a framework that improves prediction for the task under a budget on the average query cost per input, using training data to learn which models to query and how to combine their outputs with features available without querying. The first method queries the same models for every input; the second lets them vary across inputs and uses Q-learning to decide which model to query next and when to stop. For the first method, we show that several individually inaccurate outputs can jointly outperform the best single one. It attains the minimax rate when the regression function depends on the outputs only through models within the budget. Otherwise, any method within the budget can be forced to a slower rate, which the first method attains. For the second method, we show when varying the queried models across inputs strictly improves on querying the same models for every input, and bound its prediction risk and average cost in finite samples. In simulations and a multimodal laptop price application, both methods outperform existing methods.
Source:https://arxiv.org/abs/2611.12466PreviousAgnostic Smoothed Online Regression with Adversarial ResponsesNextActive Learning For Contextual Linear Optimization: A Margin-Based Approach
Related posts
내 PDF 문서를 로컬 LLM에게 검색시키기 — RAG 실전 구축
0dev.to
How we tell parents what a teen's AI chat was about, without showing them the chat
0dev.to
GitHub Actions GITHUB_TOKEN: 11 Tags Pushed, 0 Release Workflows Ran
0dev.to

I can't believe the podcast I learned to code with is back!
0dev.to
Practice unaided and AI-assisted coding as two different skills
0dev.to
Best Semrush AI Visibility Toolkit Alternatives in 2026 (prices checked)
0dev.to