AI & ML
High-Fidelity Binarized Neural Vocoder
arXiv cs.SD0 views
arXiv:2611.22593v1 Announce Type: new Abstract: Neural vocoders have achieved remarkable progress in high-fidelity waveform generation in recent years, but most existing methods still rely on full-precision operators, leading to non-negligible storage and computational costs during inference. Binary neural networks (BNNs) provide an alternative direction by quantizing weights and activations to 1 bit. However, directly applying binarization to neural vocoders is rather challenging as it inherently incurs severe information loss. To this end, we propose BiVoC, a BNN-oriented time-frequency neural vocoder for high-fidelity waveform generation. Building on our previous full-precision RNDVoC framework, BiVoC adapts the inverse-problem formulation, range-null decomposition, and fineto-coarse non-uniform subband modeling to the 1-bit setting. Specifically, we develop a simple binarized convolutional unit to provide stable time-frequency feature modeling under binary representations. Furthermore, we analyze the quality-complexity sensitivity of different modules and propose a mixed-precision design to retain quality-sensitive components in full precision while binarizing computation-dominant parts. Extensive experiments are conducted on LibriTTS and multiple out-of-distribution benchmarks. Both objective and subjective results demonstrate that BiVoC substantially outperforms BNN variants obtained by directly binarizing existing vocoders, while achieving competitive performance against several mainstream full-precision vocoder baselines under much lower theoretical computational cost. These results demonstrate the promising potential of BNNs in the audio generation field. Codes and pre-trained weights are available at https://github.com/Andong-Li-speech/BiVoC.
Source:https://arxiv.org/abs/2611.22593PreviousEvaluating the Evaluation of Music Generation Models with Generative PsychometricsNextBeyond Mimicry: Constrained Exploration with GRPO for Joint Multi-Talker ASR and Diarization under Unknown Speaker Counts
Related posts
Nvidia Earnings; Office Convergence; OS Wars, AI Edition
0Stratechery
France Is Blaming Iran for the Fridge Cyberattack
0Schneier on Security
Apple iPhone Duo Gets a New Facial Unlock Option With iOS 27.3 Update
0FOSS Bytes
CMM. The cursed language that never really took off.
0dev.to Watercooler

I built a GitHub Action that scores pull requests and never auto-closes them
0dev.to GitHub
I built a Windows app to track Instagram follower and profile changes over time
0dev.to GitHub