基本信息
浏览量:49
职业迁徙
个人简介
i specialize in building big systems to crunch through big data and develop big models.
i have previously developed one of the largest reinforcement learning systems at openai for openai five, along with llm training infrastructure at meta ai / fair that created opt-175b.
opt-175b was the first release in the industry to include:
a 175b parameter model for research use
a 114-page logbook detailing the challenges encountered during the 56 days it took to train a 175b llm on new hardware for the first time
the entire training codebase
a full suite of smaller-scale models ranging from 125M to 66B in size for studying scaling laws.
before getting into ai systems, i worked on scaling out data infrastructure and processing pipelines across various cloud providers.
i have previously developed one of the largest reinforcement learning systems at openai for openai five, along with llm training infrastructure at meta ai / fair that created opt-175b.
opt-175b was the first release in the industry to include:
a 175b parameter model for research use
a 114-page logbook detailing the challenges encountered during the 56 days it took to train a 175b llm on new hardware for the first time
the entire training codebase
a full suite of smaller-scale models ranging from 125M to 66B in size for studying scaling laws.
before getting into ai systems, i worked on scaling out data infrastructure and processing pipelines across various cloud providers.
研究兴趣
论文共 10 篇作者统计合作学者相似作者
按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
Igor Molybog, Peter Albert,Moya Chen, Zachary DeVito,David Esiobu,Naman Goyal,Punit Singh Koura,Sharan Narang, Andrew Poulton,Ruan Silva,Binh Tang, Diana Liskovich,
CoRR (2023)
引用11浏览0EI引用
11
0
Berner Christopher, Brockman Greg,Chan Brooke,Cheung Vicki, Dębiak Przemysław,Dennison Christy,Farhi David, Fischer Quirin, Hashme Shariq,Hesse Chris,Józefowicz Rafal,Gray Scott,
arxiv(2019)
引用1680浏览0EI引用
1680
0
arxiv(2019)
引用0浏览0EI引用
0
0
Juan M. Huerta,Susan Zhang,Evan Picard,Alexandra Dango, Ranqi Zhu, Jonathan Lenaghan, Steve Milton,Kevin Brackney,Amol Kapila, Roman Shraga, Rachit Srivastava,Carmem Domingues Khoa Pham,
Proceedings of 20th ACM SIGKDD Conference on Knowledge Discovery and Data Mining - ADKDD'14 (2014)
Juan M. Huerta, Jonathan Lenaghan, Steve Milton,Kevin Brackney,Amol Kapila, Roman Shraga, Rachit Srivastava,Carmem Domingues Khoa Pham, Eliza Chang,Susan Zhang,Evan Picard,Alexandra Dango,
KDD '14: The 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
New York
NY
USA
August, 2014pp.1-9, (2014)
作者统计
合作学者
合作机构
D-Core
- 合作者
- 学生
- 导师
数据免责声明
页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果,我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问,可以通过电子邮件方式联系我们:report@aminer.cn