Fire-Flyer AI-HPC: A Cost-Effective Software-Hardware Co-Design for Deep Learning

Wei An,Xiao Bi,Guanting Chen,Shanhuang Chen,Chengqi Deng,Honghui Ding,Kai Dong, Qiushi Du,Wenjun Gao,Kang Guan,Jianzhong Guo,Yongqiang Guo, Zhe Fu, Ying He,Panpan Huang,Jiashi Li,Wenfeng Liang, Xiaodong Liu, Xin Liu,Yiyuan Liu,Yuxuan Liu,Shanghao Lu, Xuan Lu,Xiaotao Nie,Tian Pei,Junjie Qiu,Hui Qu,Zehui Ren,Zhangli Sha,Xuecheng Su,Xiaowen Sun,Yixuan Tan,Minghui Tang, Shiyu Wang,Yaohui Wang, Yongji Wang,Ziwei Xie,Yiliang Xiong, Yanhong Xu,Shengfeng Ye,Shuiping Yu,Yukun Zha,Liyue Zhang, Haowei Zhang,Mingchuan Zhang, Wentao Zhang,Yichao Zhang,Chenggang Zhao,Yao Zhao,Shangyan Zhou,Shunfeng Zhou,Yuheng Zou

SC24 International Conference for High Performance Computing, Networking, Storage and Analysis（2024）

Cited 0|Views32

Key words

High Performance Computing,Cost-Effective,All-Reduce,Best Practices,Deep Learning,Machine Learning,Large Language Models,Artificial Intelligence Infrastructure

AI Read Science

Must-Reading Tree

Example

Generate MRT to find the research sequence of this paper

Chat Paper

Summary is being generated by the instructions you defined