ObjBlur: A Curriculum Learning Approach With Progressive Object-Level Blurring for Improved Layout-to-Image Generation
arxiv(2024)
摘要
We present ObjBlur, a novel curriculum learning approach to improve
layout-to-image generation models, where the task is to produce realistic
images from layouts composed of boxes and labels. Our method is based on
progressive object-level blurring, which effectively stabilizes training and
enhances the quality of generated images. This curriculum learning strategy
systematically applies varying degrees of blurring to individual objects or the
background during training, starting from strong blurring to progressively
cleaner images. Our findings reveal that this approach yields significant
performance improvements, stabilized training, smoother convergence, and
reduced variance between multiple runs. Moreover, our technique demonstrates
its versatility by being compatible with generative adversarial networks and
diffusion models, underlining its applicability across various generative
modeling paradigms. With ObjBlur, we reach new state-of-the-art results on the
complex COCO and Visual Genome datasets.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要