avatar

Ziheng Jiang

Principal AI Researcher
Meta
ziheng.misc@gmail.com


About Me

Ziheng is an AI Researcher at Meta, focusing on building personalized artificial intelligence. Prior to joining Meta, he was a Principal Research Scientist at ByteDance, serving as a major contributor to the Seed pretraining model.

He was a Ph.D. student advised by Luis Ceze and Tianqi Chen in the Paul G. Allen School of Computer Science & Engineering at the University of Washington. He received his Bachelor’s degree from Fudan University, where he was a member of Fudan NLP Lab, working with Xipeng Qiu, and Zheng Zhang.

Throughout his career, Ziheng is/was heavily involved in prominent systems and machine learning projects, including: MegaScale, Apache TVM, Apache MXNet

Research Interests

Selected Publications

Ziheng's work has been cited more than 5000 times. Here are some selected papers in the field of Machine Learning Systems. See a full-list of publication at Google Scholar.

  1. [NSDI' 24] MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs
    Ziheng Jiang*, Haibin Lin*, Yinmin Zhong*, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu
    21st USENIX Symposium on Networked Systems Design and Implementation (NSDI), 2024.

  2. [SIGCOMM' 25] MegaScale-Infer: Serving Mixture-of-Experts at Scale with Disaggregated Expert Parallelism
    Ruidong Zhu*, Ziheng Jiang*, Chao Jin*, Peng Wu, Cesar A. Stuardo, Dongyang Wang, Xinlei Zhang, Huaping Zhou, Haoran Wei, Yang Cheng, Jianzhe Xiao, Xinyi Zhang, Lingjun Liu, Haibin Lin, Li-Wen Chang, Jianxi Ye, Xiao Yu, Xuanzhe Liu, Xin Jin, Xin Liu
    the ACM Special Interest Group on Data Communication (SIGCOMM), 2025.

  3. [EuroSys' 26] Megascale-MoE: Large-Scale Communication-Efficient Training of Mixture-of-Experts Models in Production
    Chao Jin*, Ziheng Jiang*, Zhihao Bai, Zheng Zhong, Juncai Liu, Xiang Li, Ningxin Zheng, Xi Wang, Cong Xie, Qi Huang, Wen Heng, Yiyuan Ma, Wenlei Bao, Size Zheng, Yanghua Peng, Haibin Lin, Xuanzhe Liu, Xin Jin, Xin Liu
    the European Conference on Computer Systems (EuroSys), 2026.

  4. [TechReport] Seed1.5-Thinking: Advancing Superb Reasoning Models with Reinforcement Learning
    ByteDance Seed with 271 individual authors

  5. [ASPLOS' 26] SwiftSpec: Ultra-Low Latency LLM Decoding by Scaling Asynchronous Speculative Decoding
    Ziyi Zhang*, Ziheng Jiang*, Chengquan Jiang, Menghan Yu, Size Zheng, Haibin Lin, Henry Hoffmann, Xin Liu
    the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2026.

  6. [OSDI' 25] Understanding Stragglers in Large Model Training Using What-if Analysis
    Jinkun Liu, Ziheng Jiang*, Zuquan Song, Sida Zhao, Menghan Yu, Zhanghan Wang, Chenyuan Wang, Zuocheng Shi, Xiang Shi, Wei Jia, Zherui Liu, Shuguang Wang, Haibin Lin, Xin Liu, Aurojit Panda, Jinyang Li
    USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2025

  7. [MLSys' 25] Comet: Fine-grained Computation-communication Overlapping for Mixture-of-Experts
    Shulai Zhang, Ningxin Zheng, Haibin Lin, Ziheng Jiang, Wenlei Bao, Chengquan Jiang, Qi Hou, Weihao Cui, Size Zheng, Li-Wen Chang, Quan Chen, Xin Liu
    the Conference on Machine Learning and Systems (MLSys), 2025.
    Outstanding Paper Honorable Mention

  8. [MLSys' 25] TileLink: Generating Efficient Compute-Communication Overlapping Kernels using Tile-Centric Primitives
    Size Zheng, Jin Fang, Xuegui Zheng, Qi Hou, Wenlei Bao, Ningxin Zheng, Ziheng Jiang, Dongyang Wang, Jianxi Ye, Haibin Lin, Li-Wen Chang, Xin Liu
    the Conference on Machine Learning and Systems (MLSys), 2025.

  9. [Preprint] FLUX: Fast Software-based Communication Overlap On GPUs Through Kernel Fusion
    Li-Wen Chang, Wenlei Bao, Qi Hou, Chengquan Jiang, Ningxin Zheng, Yinmin Zhong, Xuanrun Zhang, Zuquan Song, Ziheng Jiang, Haibin Lin, Xin Jin, Xin Liu
    Preprint, 2024.

  10. [ICML' 21] Characterizing Structural Regularities of Labeled Data in Overparameterized Models
    Ziheng Jiang*, Chiyuan Zhang*, Kunal Talwar, Michael C. Mozer
    International Conference on Machine Learning (ICML), 2021.
    Long Oral (3%)

  11. [NIPS' 18] Learning to optimize tensor programs
    Tianqi Chen, Lianmin Zheng, Eddie Yan, Ziheng Jiang, Thierry Moreau, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy
    the Conference on Neural Information Processing Systems (NIPS), 2018.

  12. [OSDI' 18] TVM: An Automated End-to-End Optimizing Compiler for Deep Learning
    Tianqi Chen, Thierry Moreau, Ziheng Jiang, Lianmin Zheng, Eddie Yan, Haichen Shen, Meghan Cowan, Leyuan Wang, Yuwei Hu, Luis Ceze, Carlos Guestrin, Arvind Krishnamurthy
    USENIX Symposium on Operating Systems Design and Implementation (OSDI), 2018

  13. [MLSys' 18] Efficient Deep Learning Inference on Edge Devices
    Ziheng Jiang, Tianqi Chen, Mu Li
    the Conference on Machine Learning and Systems (MLSys), 2018.