MoBA: Mixture of Block Attention for Long-Context LLMs

Enzhe Lu, Zhejun Jiang, Jingyuan Liu,Yulun Du, Tao Jiang, Chao Hong, Shaowei Liu,Weiran He, Enming Yuan, Yuzhi Wang,Zhiqi Huang, Huan Yuan, Suting Xu, Xinran Xu,Guokun Lai, Yanru Chen, Huabin Zheng, Junjie Yan,Jianlin Su,Yuxin Wu, Neo Y. Zhang,Zhilin Yang,Xinyu Zhou,Mingxing Zhang,Jiezhong Qiu

CoRR（2025）

Cited 0|Views146

AI Read Science

Must-Reading Tree

Example

Generate MRT to find the research sequence of this paper

Chat Paper

Summary is being generated by the instructions you defined