AI & ML
Label-Free Role-Aware Segmentation of Classroom Recordings: Recovering the Teacher from Transferable Structure
arXiv cs.SD0 views
arXiv:2611.23609v1 Announce Type: cross Abstract: How much the teacher talks and when are among the most informative and costly-to-measure signals of teaching. Yet, classroom audio is among the most sensitive data an AI system can process: recordings capture minors and fall under GDPR, preventing raw audio from leaving the recording device. We present a teacher-student segmentation pipeline designed to meet exactly this constraint: label-free at inference, running on a recording device, and requiring no per-session calibration. The pipeline chains a lightweight voice activity detector, compactly pretrained speaker embeddings, agglomerative clustering, and a small logistic regression that assigns the teacher role based on session-relative structure rather than voice identity. We show that our structural cue transfers across classrooms, languages, and acoustic conditions. In leave-one-teacher-out cross-validation on 292 recordings from 63 teachers across English and German corpora, our pipeline achieves teacher F1 of 0.81 and 0.87, respectively, outperforming both enrollment-based baselines and a 30-second supervised enrollment ceiling. On a commodity smartphone, its performance matches pyannote, a strong neural diarization tool, while running 4.8x faster at comparable peak memory at a real-time factor of ~0.18. We also find that transcribing filtered audio only marginally increases teacher's word error rate from $0.26$ to 0.28. Residual failures concentrate where teacher and student voices are not acoustically separable. However, we show how to flag these sessions label-free at inference so that they can be routed to human review, enabling selective, privacy-preserving deployment.
Source:https://arxiv.org/abs/2611.23609PreviousExploring Speaker-Aware Engagement Modeling for Children with Autism Spectrum DisorderNextBeyond Intelligibility: Fine-Grained Perceptual Assessment of Dysarthric Speech with Auditory Large Language Models
Related posts
How to Make the Ink Used to Write Hamlet and the Declaration of Independence
0Hacker News
Why AI Wants to Be Local – With Pete Warden (Creator of Moonshine Voice)
0Hacker News
A Voice License Must Fit the Product It Authorizes
0dev.to Machine Learning

How I Made a 90-Second AI Short Film With One Consistent Character (and Fixed Its Glitches With ffmpeg)
0dev.to Tutorial
How to Change Text in an Image Without Photoshop
0dev.to Tutorial
Removing Objects From Photos With AI Inpainting: A Practical Guide
0dev.to Tutorial