Integrative Graph-Transformer Framework for Histopathology Whole Slide Image Representation and Classification
arxiv(2024)
摘要
In digital pathology, the multiple instance learning (MIL) strategy is widely
used in the weakly supervised histopathology whole slide image (WSI)
classification task where giga-pixel WSIs are only labeled at the slide level.
However, existing attention-based MIL approaches often overlook contextual
information and intrinsic spatial relationships between neighboring tissue
tiles, while graph-based MIL frameworks have limited power to recognize the
long-range dependencies. In this paper, we introduce the integrative
graph-transformer framework that simultaneously captures the context-aware
relational features and global WSI representations through a novel Graph
Transformer Integration (GTI) block. Specifically, each GTI block consists of a
Graph Convolutional Network (GCN) layer modeling neighboring relations at the
local instance level and an efficient global attention model capturing
comprehensive global information from extensive feature embeddings. Extensive
experiments on three publicly available WSI datasets: TCGA-NSCLC, TCGA-RCC and
BRIGHT, demonstrate the superiority of our approach over current
state-of-the-art MIL methods, achieving an improvement of 1.0
accuracy and 0.7
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要