基本信息
浏览量:67
职业迁徙
个人简介
My current passion revolves around building SCALABLE solutions to AGI, which means the solutions will bring improvement simply with more resources on computation and data. This include:
1. Scaling Model. This include
Scaling Law. Ensuring the growth of language models’ ability is measureable and predictable.
Scalable Supervision for LLM. As we are running out of pretraining data and step into super-human tasks, developing mechanisms for scalable oversight and dynamic evaluation is important.
Scalable and Unified Foundation Models. Unifing modality, unifing training pipeline. Using generative model for everything.
Scale up Model’s Reception. Long context and life long context.
2. Scaling Data. This include
Scaling Data for LLM. Scaling pretraining data, human expert data, synthetic data, etc. Data is all you need for AGI.
Scalable Data for LWM. Large world model will be the next milestone. Have we prepared enough data for them?
1. Scaling Model. This include
Scaling Law. Ensuring the growth of language models’ ability is measureable and predictable.
Scalable Supervision for LLM. As we are running out of pretraining data and step into super-human tasks, developing mechanisms for scalable oversight and dynamic evaluation is important.
Scalable and Unified Foundation Models. Unifing modality, unifing training pipeline. Using generative model for everything.
Scale up Model’s Reception. Long context and life long context.
2. Scaling Data. This include
Scaling Data for LLM. Scaling pretraining data, human expert data, synthetic data, etc. Data is all you need for AGI.
Scalable Data for LWM. Large world model will be the next milestone. Have we prepared enough data for them?
研究兴趣
论文共 28 篇作者统计合作学者相似作者
按年份排序按引用量排序主题筛选期刊级别筛选合作者筛选合作机构筛选
时间
引用量
主题
期刊级别
合作者
合作机构
crossref(2024)
Chaoqun He, Renjie Luo, Yuzhuo Bai,Shengding Hu, Zhen Leng Thai, Junhao Shen,Jinyi Hu,Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi,
CoRR (2024)
引用0浏览0EI引用
0
0
Chaoqun He, Renjie Luo,Shengding Hu, Yuanqian Zhao,Jie Zhou, Hanghao Wu,Jiajie Zhang,Xu Han,Zhiyuan Liu,Maosong Sun
arxiv(2024)
引用0浏览0引用
0
0
Xinrong Zhang,Yingfa Chen,Shengding Hu, Zihang Xu, Junhao Chen, Moo Khai Hao,Xu Han, Zhen Leng Thai,Shuo Wang,Zhiyuan Liu,Maosong Sun
CoRR (2024)
引用0浏览0EI引用
0
0
Shengding Hu, Yuge Tu,Xu Han, Chaoqun He,Ganqu Cui,Xiang Long, Zhi Zheng, Yewei Fang,Yuxiang Huang,Weilin Zhao, Xinrong Zhang, Zheng Leng Thai,
arxiv(2024)
引用0浏览0引用
0
0
Chenyang Song,Xu Han,Zhengyan Zhang,Shengding Hu, Xiyu Shi, Kuai Li,Chen Chen,Zhiyuan Liu,Guangli Li,Tao Yang,Maosong Sun
CoRR (2024)
引用0浏览0EI引用
0
0
EMNLP 2023 (2023): 15062-15078
引用0浏览0EI引用
0
0
Shengding Hu, Xin Liu,Xu Han,Xinrong Zhang, Chaoqun He,Weilin Zhao,Yankai Lin,Ning Ding, Zebin Ou,Guoyang Zeng,Zhiyuan Liu,Maosong Sun
引用0浏览0EI引用
0
0
加载更多
作者统计
合作学者
合作机构
D-Core
- 合作者
- 学生
- 导师
数据免责声明
页面数据均来自互联网公开来源、合作出版商和通过AI技术自动分析结果,我们不对页面数据的有效性、准确性、正确性、可靠性、完整性和及时性做出任何承诺和保证。若有疑问,可以通过电子邮件方式联系我们:report@aminer.cn