A convolutional attention model for text classification
Lecture Notes in Artificial Intelligence(2017)
摘要
Neural network models with attention mechanism have shown their efficiencies on various tasks. However, there is little research work on attention mechanism for text classification and existing attention model for text classification lacks of cognitive intuition and mathematical explanation. In this paper, we propose a new architecture of neural network based on the attention model for text classification. In particular, we show that the convolutional neural network (CNN) is a reasonable model for extracting attentions from text sequences in mathematics. We then propose a novel attention model base on CNN and introduce a new network architecture which combines recurrent neural network with our CNN-based attention model. Experimental results on five datasets show that our proposed models can accurately capture the salient parts of sentences to improve the performance of text classification.
更多查看译文
关键词
Text Categorization, Convolutional Neural Network (CNN), Text Sequence, Attention-based Model, Recurrent Neural Networks (RNN)
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络