AI & ML
Robustness of Text-Only Adapted Speech LLMs for Spoken Semantic Parsing
arXiv cs.HC0 views
arXiv:2606.21453v2 Announce Type: replace Abstract: Large language models (LLMs) are increasingly used to generate structured outputs from natural language instructions, including semantic frames and function calls. When the input is speech, this task becomes spoken semantic parsing, which can be performed using either Speech LLMs or ASR-LLM cascades. Although both approaches can be adapted with text-only task supervision, their relative robustness to acoustic degradation remains unclear. We compare these approaches under matched text-form supervision using 3B and 7B models across three datasets, evaluated on clean speech and babble noise at five SNR levels. Results show that Speech LLMs generally achieve better performance in command understanding, intent prediction, and function calling, particularly under severe noise, while improvements in fine-grained entity prediction are less consistent. An additional evaluation shows that Speech LLMs achieve lower average inference time per sample than ASR-LLM cascades at both model scales.
Source:https://arxiv.org/abs/2606.21453PreviousLLM-Assisted Reranking to Operationalize Nuanced Objectives in Recommender SystemsNextFrom Tasks to Turns: Measuring Human Labor Contributions in Human-Agent Joint Production
Related posts
My Wallet Introduces 1:1 Cross-Chain Stablecoin Swaps After Being Listed First on WalletConnect
0HackerNoon
Jensen Huang Chinese Revenue, Affairs, Resignation, and Case for CEO Reinstatement Timeline
0HackerNoon
International Men’s Day: Anthropic IPOs, Trump Meets Putin and Xi, and GTA 6 Is Released
0HackerNoon

What Happens When AI Makes So Many Decisions That We Forget How?
0HackerNoon
Elon Musk says SpaceX has a plan to eliminate cell phone dead zones
0TechCrunch
Freezing a model that caught 2% of real errors: OCR error detection for prewar Japanese print
0dev.to