Li Dong(董力)

Senior Researcher

Microsoft Research

Show Academic Trajectory

Ego Network

D-Core

Research Interests

Author Statistics

Experience

Education

Bio

Research Interests
Building a bridge between structured data and text.

Papers48 papers

Sort

By YearBy Citation

UniLMv2: Pseudo-Masked Language Models for Unified Language Model Pre-Training

Bao Hangbo,Dong Li,Wei Furu,Wang Wenhui,Yang Nan,Liu Xiaodong,Wang Yu, Piao Songhao,Gao Jianfeng,Zhou Ming,Hon Hsiao-Wuen

ICML, pp.642-652, (2020)

Cited by4EIBibtex

XLM-T: Scaling up Multilingual Machine Translation with Pretrained Cross-lingual Transformer Encoders

Shuming Ma,Jian Yang, Haoyang Huang, Zewen Chi,Li Dong,Dongdong Zhang, Hany Hassan Awadalla, Alexandre Muzio, Akiko Eriguchi, Saksham Singhal, Xia Song, Arul Menezes

Bibtex

Cross-Lingual Natural Language Generation via Pre-Training

Zewen Chi,Li Dong,Furu Wei,Wenhui Wang,Xian-Ling Mao,Heyan Huang

national conference on artificial intelligence, (2020)

Bibtex

InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training

Zewen Chi,Li Dong,Furu Wei, Nan Yang, Saksham Singhal, Wenhui Wang, Xia Song,Xian-Ling Mao,Heyan Huang,Ming Zhou

Bibtex

Pseudo-Masked Language Models for Unified Language Model Pre-Training

Hangbo Bao,Li Dong,Furu Wei,Wenhui Wang, Nan Yang,Xiaodong Liu, Yu Wang,Jianfeng Gao, Songhao Piao,Ming Zhou,Hsiao-Wuen Hon

international conference on machine learning, (2020)

Bibtex

MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformers

Wang Wenhui,Wei Furu,Dong Li, Bao Hangbo,Yang Nan,Zhou Ming

NeurIPS, (2020)

EIBibtex

MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformers

Wenhui Wang, Hangbo Bao,Shaohan Huang,Li Dong,Furu Wei

Bibtex

Harvesting and Refining Question-Answer Pairs for Unsupervised QA

Li Zhongli,Wang Wenhui,Dong Li,Wei Furu,Xu Ke

ACL, pp.6719-6728, (2020)

EIBibtex

Self-Attention Attribution: Interpreting Information Interactions Inside Transformer

Hao Yaru,Dong Li,Wei Furu,Xu Ke

Bibtex

Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks

Li Xiujun, Yin Xi,Li Chunyuan, Zhang Pengchuan, Hu Xiaowei,Zhang Lei, Wang Lijuan, Hu Houdong,Dong Li,Wei Furu,Choi Yejin,Gao Jianfeng

european conference on computer vision, pp.121-137, (2020)

Cited by4Bibtex

Data-to-text Generation with Entity Modeling

Ratish Puduppully,Li Dong,Mirella Lapata

ACL (1), pp.2023-2035, (2019)

EIBibtex

Learning to Ask Unanswerable Questions for Machine Reading Comprehension

Haichao Zhu,Li Dong,Furu Wei, Wenhui Wang,Bing Qin,Ting Liu

ACL (1), pp.4238-4248, (2019)

EIBibtex

Inspecting Unification of Encoding and Matching with Transformer: A Case Study of Machine Reading Comprehension

Hangbo Bao,Li Dong, Furu Wei,Wenhui Wang,Nan Yang,Lei Cui, Songhao Piao, Ming Zhou

MRQA@EMNLP, pp.14-18, (2019)

Cited by1EIBibtex

Learning natural language interfaces with neural models

Li Dong

(2019)

Bibtex

Can Monolingual Pretrained Models Help Cross-Lingual Classification

Chi Zewen,Dong Li,Wei Furu,Mao Xian-Ling,Huang Heyan

AACL/IJCNLP, pp.12-17, (2019)

EIBibtex

Transforming Wikipedia into Augmented Data for Query-Focused Summarization

Zhu Haichao,Dong Li,Wei Furu,Qin Bing,Liu Ting

Bibtex

Learning to Ask Unanswerable Questions for Machine Reading Comprehension

Haichao Zhu,Li Dong,Furu Wei,Wenhui Wang,Bing Qin,Ting Liu

Meeting of the Association for Computational Linguistics, (2019)

Cited by8EIBibtex

Data-to-text Generation with Entity Modeling

Ratish Puduppully,Li Dong,Mirella Lapata

Meeting of the Association for Computational Linguistics, (2019)

Cited by5EIBibtex

Visualizing and Understanding the Effectiveness of BERT

Yaru Hao,Li Dong,Furu Wei,Ke Xu

EMNLP/IJCNLP (1), pp.4141-4150, (2019)

Cited by16EIBibtex

Unified Language Model Pre-training for Natural Language Understanding and Generation

Li Dong,Nan Yang,Wenhui Wang,Furu Wei,Xiaodong Liu,Yu Wang,Jianfeng Gao,Ming Zhou,Hsiao-Wuen Hon

ADVANCES IN NEURAL INFORMATION PROCESSING SYSTEMS 32 (NIPS 2019), (2019): 13042-13054

Cited by139EIBibtex

View All

Base Info Papers Patents Projects