Open Source
DRIFT: Detachable Reasoning for Runtime-Flexible and Efficient End-to-End Driving
arXiv cs.RO0 views
arXiv:2611.24719v1 Announce Type: cross Abstract: The integration of vision-language models (VLMs) into end-to-end (E2E) autonomous driving has demonstrated strong potential by providing scene description and reasoning capabilities. However, VLMs are computationally expensive, and switching language reasoning on and off at runtime without hurting closed-loop performance has not been demonstrated, which hinders practical adoption. To address these issues, we propose DRIFT, an E2E autonomous driving framework that integrates a lightweight language model (LM) for visual question answering and action commentary. By efficiently projecting intermediate driving representations into the language embedding space, we demonstrate that a compact LM (<150M parameters) can achieve strong scene description and action commentary. Furthermore, we introduce a runtime-flexible planning module that is trained on surrogate reasoning features distilled from the LM and can be conditioned on either the LM or the surrogate reasoning features at inference. This design enables bypassing the LM entirely when required by deployment constraints, without sacrificing driving performance. With only 255M parameters, DRIFT reaches up to a Driving Score (DS) of 97.03 and a Success Rate of 89.39% (mean over three runs) on Bench2Drive by interleaving its LM and surrogate reasoning at a chosen reasoning rate. This is on par with the strongest non-language models while being far more compact than existing VLM-based models. DRIFT further achieves competitive results on the real-world NAVSIM and AlpaSim benchmarks at significantly lower computational cost than existing VLM-based approaches. Project page: https://drift-e2e.github.io/
Source:https://arxiv.org/abs/2611.24719PreviousALIVE: Bring Foundation Features to Life with EventsNextDoes the Action Matter? Probing Action-Conditioned Semantic Forecasting as a World Model for Autonomous Driving
Related posts
GTA VI — Rockstar made the game. ClipForge makes the clips.
0dev.to
I built Cornhole News. A Hacker News inspired site for news across the Midwest
0Hacker News
Launch HN: Onlook (YC W25) – An open-source developer tool for designers
0Hacker News
Gemini 4 Neon brings complex agent workflows to Copilot and Google's AI tools
0dev.to Machine Learning
December 24 Is the Newest Week on the WARN Layoff Calendar — 2,528 Workers Scheduled
0dev.to Career

2567. Minimum Score by Changing Two Elements
0dev.to PHP