Generalizing to unseen domains via PatchMix

Juncheng Yang,Zuchao Li,Chao Li, Shuai Xie,Wei Yu,Shijun Li

Multimedia Systems(2024)

引用 0|浏览6
暂无评分
摘要
Domain generalization (DG) aims to transfer knowledge learned from multiple source domains to unseen domains. One of the primary challenges hinders DG is the insufficient diversity of source domains, which hampers the model’s ability to learn to generalize. Traditional data augmentation methods, which fuse content, style, labels, etc., unable to effectively learn the global features from the source domains. In this paper, we present an innovative approach to domain generalization learning technique, called PatchMix, by stitching the patches of different source domains together to build domain-mixup samples. This approach helps the model to learn the common features of different source domains. Meanwhile, a domain discriminator is introduced to preserve the model’s ability to distinguish the source domains, which is proved to be helpful for the model to generalize to unseen domains. To our best knowledge, we are the first to unveil the equation that elucidates the correlation between the number of patches and the number of source domains. Our method, PatchMix, outperforms the current state-of-the-art (SOTA) on four benchmark datasets.
更多
查看译文
关键词
Domain generalization,PatchMix,Domain discriminator,Vision transformer,Data augmentation
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络