AI & ML
Unsupervised Evaluation of Deep Audio Embeddings for Music Structure Analysis
arXiv cs.SD0 views
arXiv:2603.27218v3 Announce Type: replace Abstract: Music Structure Analysis (MSA) aims to uncover the high-level organization of musical pieces. State-of-the-art methods are often based on supervised deep learning, but these methods are bottlenecked by the need for heavily annotated data and inherent structural ambiguities. In this paper, we propose an unsupervised evaluation of nine open-source, generic pre-trained deep audio models, on MSA. For each model, we extract barwise embeddings and segment them using three unsupervised segmentation algorithms (Foote's checkerboard kernels, spectral clustering, and Correlation Block-Matching (CBM)), focusing exclusively on boundary retrieval. Our results demonstrate that modern, generic deep embeddings generally outperform traditional spectrogram-based baselines, but not systematically. Furthermore, our unsupervised boundary estimation methodology generally yields stronger performance than recent linear probing baselines. Among the evaluated techniques, the CBM algorithm consistently emerges as the most effective downstream segmentation method. Finally, we highlight the artificial inflation of standard evaluation metrics and advocate for the systematic adoption of ``trimming'', or even ``double trimming'' annotations to establish more rigorous MSA evaluation standards.
Source:https://arxiv.org/abs/2603.27218PreviousEncoding of musical structures in hidden units of restricted Boltzmann machinesNextTOMORI: A Tool-Orchestrated Mixing Operator for REAPER Interaction
Related posts

Teens and parents can expect Instagram notifications about AI age estimation
09to5Mac
W-2 vs 1099 Calculator: A Worked Offer Comparison for 2026
0dev.to

I tested ChatGPT's PDF Content Credentials: what survives a re-save, a print and an edit
0dev.to
I Built ResearchLens AI to Make Data Exploration and ML Benchmarking Easier
0dev.to
Fold Epic Paper Airplanes
0Hacker News
The Midterms Were a Pretty Good Sign for the Right-to-Repair Movement
0Wired