Yinmin Zhong

Yinmin Zhong

Ph.D. Student

Peking University

zhongyinmin [at] pku.edu.cn

About Me

I am a second-year Ph.D. student studying computer science in the Computer Systems Research Group at Peking University where I am advised by Xin Jin. Before that, I received my B.S. in Computer Science from Peking University.

I have a broad interest in building efficient systems for training and serving deep learning models, with a primary focus on large language models (LLMs) currently.

I am also an enthusiastic self-learner and interested in various fields of computer science. I have built a website to share my self-learning experiences and resources.

Interests
  • Machine Learning Systems
  • Distributed Systems
  • Large Language Models
Education

  • Peking University

    Ph.D. in Computer Science, Sep 2022 - Present

  • Peking University

    B.S. in Computer Science, Sep 2018 - June 2022

Experience

  • ByteDance AML Team

    Research Intern, Aug 2023 - Present

  • Alibaba DAMO Academy

    Research Intern, Sep 2021 - Sep 2022

  • AI Innovation Center, Peking University

    Software Engineer Intern, Sep 2020 - Mar 2021

Publications

DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Serving.
Yinmin Zhong, Shengyu Liu, Junda Chen, Jianbo Hu, Yibo Zhu, Xuanzhe Liu, Xin Jin, Hao Zhang

In OSDI 2024. PDF Cite

MegaScale: Scaling Large Language Model Training to More Than 10,000 GPUs.
Ziheng Jiang, Haibin Lin, Yinmin Zhong, Qi Huang, Yangrui Chen, Zhi Zhang, Yanghua Peng, Xiang Li, Cong Xie, Shibiao Nong, Yulu Jia, Sun He, Hongmin Chen, Zhihao Bai, Qi Hou, Shipeng Yan, Ding Zhou, Yiyao Sheng, Zhuo Jiang, Haohan Xu, Haoran Wei, Zhang Zhang, Pengfei Nie, Leqi Zou, Sida Zhao, Liang Xiang, Zherui Liu, Zhe Li, Xiaoying Jia, Jianxi Ye, Xin Jin, Xin Liu

In NSDI 2024. PDF Cite Code

DistMind: Efficient Resource Disaggregation for Deep Learning Workloads.
Xin Jin, Zhihao Bai, Zhen Zhang, Yibo Zhu, Yinmin Zhong, Xuanzhe Liu

In TON 2024. PDF Cite

Fast Distributed Inference Serving for Large Language Models.
Bingyang Wu, Yinmin Zhong, Zili Zhang, Gang Huang, Xuanzhe Liu, Xin Jin

In Preprint. PDF Cite

AlpaServe: Statistical Multiplexing with Model Parallelism for Deep Learning Serving.
Zhuohan Li, Lianmin Zheng, Yinmin Zhong, Vincent Liu, Ying Sheng, Xin Jin, Yanping Huang, Zhifeng Chen, Hao Zhang, Joseph E. Gonzalez, Ion Stoica

In OSDI 2023. PDF Cite Code Video

ElasticFlow: An Elastic Serverless Training Platform for Distributed Deep Learning.
Diandian Gu, Yihao Zhao, Yinmin Zhong, Yifan Xiong, Zhenhua Han, Peng Cheng, Fan Yang, Gang Huang, Xin Jin, Xuanzhe Liu

In ASPLOS 2023. PDF Cite Code Video