AI & ML
SACQ: Structure-Aware Codebook Quantization for Ultra-Low-Bit Vision-Language-Action Models
arXiv cs.RO0 views
arXiv:2610.41408v1 Announce Type: cross Abstract: Vision-Language-Action (VLA) models enable capable robot behavior, but their large memory footprint limits deployment on resource-constrained robotic platforms. Weight quantization is a natural remedy, yet post-training quantization (PTQ) recipes inherited from large language models degrade when applied to VLAs at ultra-low precision. Existing low-bit PTQ methods often fail to explicitly account for the structure of downstream operations and allocate precision without considering its effect on the policy actions. We introduce SACQ, an ultra- low-bit weight-only vector-codebook quantization framework for VLAs. SACQ combines (1) structure-aware codebook fitting with role-specific quadratic metrics that reflect input statistics and downstream sensitivity; (2) action-aware mixed-bit allocation based on the increase in final-action error as individual layers are compressed; and (3) two-stage post-quantization refinement that reassigns codeword indices with second-order error compensation and calibrates codebooks and row-group scales against the decoded action. Using GR00T N1.7, SACQ achieves 93.85% average success across four LIBERO suites at 1.5 bits per language/action weight while reducing model memory by 4.83x. With INT8 activation quantization and low-precision attention, it retains 93.55% success while running 1.51x faster than BF16. On SimplER, SACQ further achieves 63.76% and 52.27% success under Visual Matching and Variant Aggregation at 2 bits per language/action weight, compared to 58.90% and 53.45% for BF16, respectively.
Source:https://arxiv.org/abs/2610.41408PreviousMotorSense: A Video-EMG Dataset of Motoric Representations for Action UnderstandingNextFOCUS: First-Order Control Using Optimal Transport Supervision for Imitation from Observations
Related posts
5 Shopify Product Page Fixes That Help Small Stores Sell More
0dev.to UX
How to Monitor Internet Usage on Windows: Real-Time Network Speed and Data Consumption Tracking
0dev.to Productivity
‘A Court of Thorns and Roses’ Book 6 Breaks Sarah J. Maas’ Release Day Record With 1.7 Million Copies Sold (EXCLUSIVE)
0dev.to Productivity

Qwen weight editing: how Astra reduced thinking loops
0dev.to Machine Learning

GPU Kernels, Part 2: Teaching a 27B Model to Write Triton Kernels with SFT and a GPU Gym
0dev.to Machine Learning
NVIDIA Maps the AI-Defined Fab as Chip Simulation Speeds Jump 10x to 35x
0dev.to Machine Learning