Review Based on Attention Model

Attention Model is important in deep learning and has been widely used in different fields. Alignment functions and distribution functions, which are commonly used in basic attention model, are reviewed and taxonomy is conducted on basic attention mechanism. In addition, it was discussed whether attention is explanatory to neural networks. Finally, the potential research directions in future are p...