AI & ML
Beyond Intelligibility: Fine-Grained Perceptual Assessment of Dysarthric Speech with Auditory Large Language Models
arXiv cs.SD0 views
arXiv:2611.23768v1 Announce Type: cross Abstract: Accurate assessment of dysarthric speech is vital for clinical diagnosis and rehabilitation, yet existing automated methods rely heavily on isolated, single-task models or generic speech quality metrics that fail to disentangle heterogeneous neuromotor deficits. This work presents the first systematic investigation into adapting auditory large language models (ALLMs) for multi-dimensional dysarthric speech assessment under a unified, prompt-conditioned framework. Four representative ALLMs are benchmarked across five clinical perceptual dimensions from the Speech Accessibility Project (SAP): naturalness, monopitch, intelligibility, imprecise consonants, and inappropriate silences. To bridge generic perceptual quality and clinical evaluation, a two-stage training paradigm is explored, leveraging out-of-domain pre-training followed by in-domain clinical adaptation. Experimental results demonstrate that leading ALLMs reliably capture fine-grained pathological variations, exhibiting distinct and complementary strengths across prosodic and articulatory attributes. These findings establish ALLMs as a scalable foundation for clinical speech evaluation and provide practical insights into model selection and multi-task transfer potential.
Source:https://arxiv.org/abs/2611.23768PreviousLabel-Free Role-Aware Segmentation of Classroom Recordings: Recovering the Teacher from Transferable StructureNext21Codec: Decoder-side Speaker Control for Text-to-Speech
Related posts
Multimodal Masked Diffusion Autoencoder for Modeling Impaired Driving
0arXiv cs.RO
CoNav-UAV: Cooperative Dual-Altitude Aerial Navigation via Stackelberg Learning
0arXiv cs.RO
Meta-RL with Bayesian Linear Task Models
0arXiv cs.RO
RFW-S: Everyday Deformable Objects with Independent Simulation Verification
0arXiv cs.RO
Heave-Ho: Decentralized Long-Horizon Multi-Humanoid Collaboration
0arXiv cs.RO
CriticHack: Evaluating Visual Rewards Under Robot Policy Optimization
0arXiv cs.RO