Evaluating Opinion Summarization In Ranking

INFORMATION RETRIEVAL TECHNOLOGY, AIRS 2017(2017)

Cited 0|Views5
No score
Abstract
We discuss the evaluation of rankings of documents that aim to summarize the overall opinion expressed in product reviews. Such a ranking can be used by e-commerce websites to represent a gist of the public opinion about a product. The inability of traditional IR metrics to reward such a representation is argued for. A matrix based labelling procedure serves as the framework for such evaluation. Three alternative metrics are adapted from previous similar works to evaluate opinion representativeness. Similarly, two metrics are adapted for exhaustiveness. Finally, we compare the robustness of these metrics.
More
Translated text
Key words
Opinion, Reviews, Diversity, Proportionality, Summarization
AI Read Science
Must-Reading Tree
Example
Generate MRT to find the research sequence of this paper
Chat Paper
Summary is being generated by the instructions you defined