Positional Mask Attention for Video Sequence Modeling

The attention mechanism has been widely developed in different domains. Some recent studies apply position embedding to encode relative positions in the attention mechanism for learning better representations in both natural language processing and computer vision tasks. However, this position embedding method is limited to the “fixed input size” problem and requires large additional memory to sto...