谷歌浏览器插件
订阅小程序
在清言上使用

ResDecode: Accelerating Large Language Models Inference Via Residual Decoding Heads

Ziqian Zeng, Jiahong Yu, Qianshi Pang,Zihao Wang,Huiping Zhuang,Fan Yu, Hongen Shao,Xiaofeng Zou

Big Data Mining and Analytics(2025)

引用 0|浏览2
关键词
speculative decoding,efficient inference,Large Language Models (LLMs)
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要