William Fedus

基本信息

浏览量：41

职业迁徙

个人简介

My research interests span supervised, unsupervised and reinforcement learning -- all with an aim to build robust, reliable algorithms. Along with a growing number of researchers in machine learning, my background is in physics

研究兴趣

论文共 33 篇作者统计合作学者相似作者

按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选

Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts

Sheng Shen,Le Hou,Yanqi Zhou,Nan Du,Shayne Longpre,Jason Wei,Hyung Won Chung,Barret Zoph,William Fedus,Xinyun Chen,Tu Vu,Yuexin Wu,

arxiv（2023）

引用0浏览0引用

Scaling Instruction-Finetuned Language Models

Hyung Won Chung,Le Hou,Shayne Longpre,Barret Zoph,Yi Tay,William Fedus, Yunxuan Li,Xuezhi Wang,Mostafa Dehghani,Siddhartha Brahma, Albert Webson,Shixiang Shane Gu,

ICLR 2023 (2022)

引用194浏览0引用

194

Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling

Yi Tay,Mostafa Dehghani,Samira Abnar, Hyung Won Chung,William Fedus,Jinfeng Rao,Sharan Narang,Vinh Q. Tran,Dani Yogatama,Donald Metzler

arxiv（2022）

引用0浏览0引用

A Review of Sparse Expert Models in Deep Learning

William Fedus,Jeff Dean,Barret Zoph

arxiv（2022）

引用0浏览0引用

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

Nan Du,Yanping Huang,Andrew M. Dai,Simon Tong,Dmitry Lepikhin,Yuanzhong Xu,Maxim Krikun,Yanqi Zhou,Adams Wei Yu,Orhan Firat,Barret Zoph,Liam Fedus,

ICML（2022）

引用93浏览0EI引用

Emergent Abilities of Large Language Models

Jason Wei,Yi Tay,Rishi Bommasani,Colin Raffel,Barret Zoph,Sebastian Borgeaud,Dani Yogatama,Maarten Bosma,Denny Zhou,Donald Metzler,Ed H. Chi,Tatsunori Hashimoto,

arxiv（2022）

引用216浏览0EI引用

216

Scale Efficiently: Insights from Pretraining and Finetuning Transformers

Yi Tay,Mostafa Dehghani,Jinfeng Rao,William Fedus,Samira Abnar,Hyung Won Chung,Sharan Narang,Dani Yogatama,Ashish Vaswani,Donald Metzler

ICLR（2022）

引用0浏览0EI引用

PaLM: Scaling Language Modeling with Pathways

Aakanksha Chowdhery,Sharan Narang,Jacob Devlin,Maarten Bosma,Gaurav Mishra,Adam Roberts,Paul Barham, Hyung Won Chung,Charles Sutton,Sebastian Gehrmann, Parker Schuh,Kensen Shi,

ICLR 2023 (2022)

引用846浏览0引用

846

Beyond The lmitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi,Abhishek Rao, Abu Awal Md Shoeb,Abubakar Abid,Adam Fisch, Adam R. Brown,Adam Santoro , Aditya Gupta, Adrià Garriga-Alonso, Agnieszka Kluska,Aitor Lewkowycz,

user-5f6bfffd92c7f9be21bbcc99（2022）

引用123浏览0引用

123

Designing Effective Sparse Expert Models

Barret Zoph,Irwan Bello, Sameer Kumar,Nan Du,Yanping Huang,Jeff Dean,Noam Shazeer,William Fedus

arxiv（2022）

引用1浏览0引用

加载更多

作者统计

合作学者

合作机构

D-Core

合作者
学生
导师

暂无相似学者，你可以通过学者研究领域进行搜索筛选

数据免责声明

页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果，我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问，可以通过电子邮件方式联系我们：report@aminer.cn

Senior Research Scientist

论文共 33 篇作者统计合作学者相似作者