Contextrast: Contextual Contrastive Learning for Semantic Segmentation
CVPR 2024(2024)
摘要
Despite great improvements in semantic segmentation, challenges persist
because of the lack of local/global contexts and the relationship between them.
In this paper, we propose Contextrast, a contrastive learning-based semantic
segmentation method that allows to capture local/global contexts and comprehend
their relationships. Our proposed method comprises two parts: a) contextual
contrastive learning (CCL) and b) boundary-aware negative (BANE) sampling.
Contextual contrastive learning obtains local/global context from multi-scale
feature aggregation and inter/intra-relationship of features for better
discrimination capabilities. Meanwhile, BANE sampling selects embedding
features along the boundaries of incorrectly predicted regions to employ them
as harder negative samples on our contrastive learning, resolving segmentation
issues along the boundary region by exploiting fine-grained details. We
demonstrate that our Contextrast substantially enhances the performance of
semantic segmentation networks, outperforming state-of-the-art contrastive
learning approaches on diverse public datasets, e.g. Cityscapes, CamVid,
PASCAL-C, COCO-Stuff, and ADE20K, without an increase in computational cost
during inference.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要