SpanBERT: Improving Pre-training by Representing and Predicting Spans.
Trans. Assoc. Comput. Linguistics(2020)
摘要
We present SpanBERT, a pre-training method that is designed to better represent and predict spans of text. Our approach extends BERT by (1) masking contiguous random spans, rather than random token...
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络