An Empirical Analysis of Diversity in Argument Summarization
Conference of the European Chapter of the Association for Computational Linguistics(2024)
摘要
Presenting high-level arguments is a crucial task for fostering participation
in online societal discussions. Current argument summarization approaches miss
an important facet of this task – capturing diversity – which is important
for accommodating multiple perspectives. We introduce three aspects of
diversity: those of opinions, annotators, and sources. We evaluate approaches
to a popular argument summarization task called Key Point Analysis, which shows
how these approaches struggle to (1) represent arguments shared by few people,
(2) deal with data from various sources, and (3) align with subjectivity in
human-provided annotations. We find that both general-purpose LLMs and
dedicated KPA models exhibit this behavior, but have complementary strengths.
Further, we observe that diversification of training data may ameliorate
generalization. Addressing diversity in argument summarization requires a mix
of strategies to deal with subjectivity.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要