SAM-I-Am: Semantic Boosting for Zero-shot Atomic-Scale Electron Micrograph Segmentation
arxiv(2024)
摘要
Image segmentation is a critical enabler for tasks ranging from medical
diagnostics to autonomous driving. However, the correct segmentation semantics
- where are boundaries located? what segments are logically similar? - change
depending on the domain, such that state-of-the-art foundation models can
generate meaningless and incorrect results. Moreover, in certain domains,
fine-tuning and retraining techniques are infeasible: obtaining labels is
costly and time-consuming; domain images (micrographs) can be exponentially
diverse; and data sharing (for third-party retraining) is restricted. To enable
rapid adaptation of the best segmentation technology, we propose the concept of
semantic boosting: given a zero-shot foundation model, guide its segmentation
and adjust results to match domain expectations. We apply semantic boosting to
the Segment Anything Model (SAM) to obtain microstructure segmentation for
transmission electron microscopy. Our booster, SAM-I-Am, extracts geometric and
textural features of various intermediate masks to perform mask removal and
mask merging operations. We demonstrate a zero-shot performance increase of
(absolute) +21.35
drop in mean false positive masks across images of three difficulty classes
over vanilla SAM (ViT-L).
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要