3

SpecGen: Accelerating Agentic Kernel Optimization with Speculative Generation
We present SpecGen, an agentic kernel optimization system that uses speculative generation to fork candidate kernels during LLM reasoning, validating and profiling them in parallel to reduce end-to-end optimization time and improve resource utilization.
Jihu Guo, Sitian Lu, Tenghui Ma, Wei Gao, Zhisheng YE, Xingcheng Zhang, Dahua Lin
Preprint PDF Cite
AMSP: Super-Scaling LLM Training via Advanced Model States Partitioning
Large Language Models (LLMs) have demonstrated impressive performance across various downstream tasks. When training these models, …
Qiaoling Chen, Qinghao Hu, Zhisheng YE, Guoteng Wang, Peng Sun, Yonggang Wen, Tianwei Zhang
Preprint Cite