A Picture Is Worth a Graph: Blueprint Debate on Graph for Multimodal Reasoning
arxiv(2024)
摘要
This paper presents a pilot study aimed at introducing multi-agent debate
into multimodal reasoning. The study addresses two key challenges: the
trivialization of opinions resulting from excessive summarization and the
diversion of focus caused by distractor concepts introduced from images. These
challenges stem from the inductive (bottom-up) nature of existing debating
schemes. To address the issue, we propose a deductive (top-down) debating
approach called Blueprint Debate on Graphs (BDoG). In BDoG, debates are
confined to a blueprint graph to prevent opinion trivialization through
world-level summarization. Moreover, by storing evidence in branches within the
graph, BDoG mitigates distractions caused by frequent but irrelevant concepts.
Extensive experiments validate BDoG, achieving state-of-the-art results in
Science QA and MMBench with significant improvements over previous methods.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要