PEACH: Pretrained-embedding Explanation Across Contextual and Hierarchical Structure
arxiv(2024)
摘要
In this work, we propose a novel tree-based explanation technique, PEACH
(Pretrained-embedding Explanation Across Contextual and Hierarchical
Structure), that can explain how text-based documents are classified by using
any pretrained contextual embeddings in a tree-based human-interpretable
manner. Note that PEACH can adopt any contextual embeddings of the PLMs as a
training input for the decision tree. Using the proposed PEACH, we perform a
comprehensive analysis of several contextual embeddings on nine different NLP
text classification benchmarks. This analysis demonstrates the flexibility of
the model by applying several PLM contextual embeddings, its attribute
selections, scaling, and clustering methods. Furthermore, we show the utility
of explanations by visualising the feature selection and important trend of
text classification via human-interpretable word-cloud-based trees, which
clearly identify model mistakes and assist in dataset debugging. Besides
interpretability, PEACH outperforms or is similar to those from pretrained
models.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要