RFWave: Multi-band Rectified Flow for Audio Waveform Reconstruction
arxiv(2024)
摘要
Recent advancements in generative modeling have led to significant progress
in audio waveform reconstruction from diverse representations. Although
diffusion models have been used for reconstructing audio waveforms, they tend
to exhibit latency issues because they operate at the level of individual
sample points and require a relatively large number of sampling steps. In this
study, we introduce RFWave, a novel multi-band Rectified Flow approach that
reconstructs high-fidelity audio waveforms from Mel-spectrograms. RFWave is
distinctive for generating complex spectrograms and operating at the frame
level, processing all subbands concurrently to enhance efficiency. Thanks to
Rectified Flow, which aims for a flat transport trajectory, RFWave requires
only 10 sampling steps. Empirical evaluations demonstrate that RFWave achieves
exceptional reconstruction quality and superior computational efficiency,
capable of generating audio at a speed 90 times faster than real-time.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要