AI & ML
FoleyForge: Free-form, Controllable, Rectified-flow Editing of Sound Effects
arXiv cs.SD0 views
arXiv:2611.08695v1 Announce Type: new Abstract: We present FoleyForge, a generative model for instruction-based editing of sound effects. Given an input clip and a free-form instruction describing the desired change, it applies the edit while preserving the input's identity. A single model handles semantic, stylistic, and DSP-like changes. We introduce a data pipeline that guides an audio language model to author both DSP-based acoustic edits and similarity-preserving semantic edits, thus addressing the lack of publicly available audio editing data. Such data is then used to fine-tune a rectified-flow audio generation model, which we extend to expose attribute controls for loudness change, edit strength, and an input-derived contour envelope, each tunable via classifier-free guidance, yielding a more expressive editing model. FoleyForge achieves state-of-the-art instruction adherence at competitive audio quality and source faithfulness.
Source:https://arxiv.org/abs/2611.08695PreviousInstance-Optimal Estimation with Multiple LLM Judges on a BudgetNextAircraftWitness: How Often Aircraft Can Locate Recordings
Related posts
Why can't my AI agent use mobile apps?
0dev.to AI
24 KI-Agenten für einen Film – und was das über das Sehenlernen verrät
0dev.to AI
How AI Agent Memory Architectures Split Working Memory from Episodic Storage
0dev.to AI
Your Page Listened for Messages From the Checkout Frame and Took Them From Any Window
0dev.to Security
Field report: 20359 real pull requests scanned, 6.5% flagged, 46 of our own mistakes fixed in public
0dev.to DevOps
Evaluating API Portals for Autonomous Agents: Schemas, Perks, and Registry Data
0dev.to DevOps