Open Source
Emilia2: A Large-Scale Dataset for Controllable Long-Form Speech Generation
arXiv cs.SD0 views
arXiv:2611.13614v1 Announce Type: cross Abstract: Generating long-form speech requires models to keep content, speaker identity, turn-taking, and expressive style consistent over time. Yet most open training corpora contain examples lasting only tens of seconds and open long-form benchmarks cover at most two speakers per recording. We introduce Emilia2, a 229K-hour multilingual dataset for controllable long-form speech generation. From in-the-wild data, Emilia2 constructs short utterances, single-speaker long-form speech, and multi-speaker dialogues, preserving transcripts, speaker identities, pauses, and acoustic transitions. Examples longer than five minutes account for 50.0% of single-speaker long-form hours and 66.8% of dialogue hours. To support expressive control, Emilia2 provides natural language instructions for 4.77M examples and nonverbal-vocalization tags for 933K examples. We also introduce Emilia2-testset, 23 hours of bilingual recordings of up to 30 minutes and four speakers, each speaker paired with reference audio. We train autoregressive (AR) and non-autoregressive (NAR) models on Emilia2. Our 0.6B-backbone NAR model achieves the lowest Chinese CER and English WER on TTSD-Eval (5.27%/9.93%) among compared systems, while our AR model is on par with Qwen3-TTS-12Hz-VD on InstructTTSEval (zh/en: 76.2/78.3 vs. 77.1/77.9). These results validate Emilia2 as a comprehensive data foundation for long-form speech generation and minute-scale expressive control. Demo: https://charlesnii.github.io/Emilia2-demo/.
Source:https://arxiv.org/abs/2611.13614PreviousOff-target posterior mass: A training-free diagnostic for fine-tuning spoken language diarization probesNextAntalia-2 Mini: A 7.6-million-parameter Turkish text-to-speech model trained entirely on synthetic speech
Related posts

Reverse Engineering Tools: A Free Starter Kit for Your First Binary
0dev.to
Software Refactoring Research with Large Language Models: A Systematic Literature Review
0arXiv cs.SE
Antalia-2 Mini: A 7.6-million-parameter Turkish text-to-speech model trained entirely on synthetic speech
0arXiv cs.SD
Asymptotically good codes from Siegel modular varieties
0arXiv math.IT
On the Concavity of R\'enyi Entropy and R\'enyi Entropy Power along Heat Flows on Manifolds
0arXiv math.IT
Multimodal Judges Flag, Humans Decide: A Review-and-Edit Framework for AI-Generated Product Video Ads
0arXiv cs.HC