Iso-Diffusion: Improving Diffusion Probabilistic Models Using the Isotropy of the Additive Gaussian Noise
CoRR(2024)
摘要
Denoising Diffusion Probabilistic Models (DDPMs) have accomplished much in
the realm of generative AI. Despite their high performance, there is room for
improvement, especially in terms of sample fidelity by utilizing statistical
properties that impose structural integrity, such as isotropy. Minimizing the
mean squared error between the additive and predicted noise alone does not
impose constraints on the predicted noise to be isotropic. Thus, we were
motivated to utilize the isotropy of the additive noise as a constraint on the
objective function to enhance the fidelity of DDPMs. Our approach is simple and
can be applied to any DDPM variant. We validate our approach by presenting
experiments conducted on four synthetic 2D datasets as well as on unconditional
image generation. As demonstrated by the results, the incorporation of this
constraint improves the fidelity metrics, Precision and Density for the 2D
datasets as well as for the unconditional image generation.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要