Xupeng Miao

Email: xupeng@cmu.edu


Xupeng Miao is currently a Post Doctoral Fellow working with Prof. Zhihao Jia in Catalyst Group at Computer Science Department of Carnegie Mellon University. He is broadly interested in machine learning systems, data management and distributed computing. He is the creator of Hetu, an highly efficient distributed deep learning system, and continuously leading the team development, welcome to join us!

Before that, he received his Ph.D. degree in computer science from Peking University in June 2022, supervised by Prof. Bin Cui. He was a research intern in System Research Group of Microsoft Research Asia (MSRA), supervised by Dr. Jilong Xue. Besides, he has accumulated for more than 5 years industrial internship experience at the Machine Learning & Data Platform Department of Tencent.


Sep 3, 2022 I was awared WAIC 2022 Yunfan Award · Rising Stars! :confetti_ball:
Aug 24, 2022 We won the Best Scalable Data Science Paper Award of VLDB 2022! :trophy:
Aug 1, 2022 I joined CMU to work with Prof. Zhihao Jia as a Post Doctoral Fellow. :smile:
Jun 2, 2022 We provided a presentation on BAAI Conference 2022 to introduce Hetu. :mega:

selected publications

  1. SCIS
    Hetu: A highly efficient automatic parallel distributed deep learning system
    Xupeng Miao, Xiaonan Nie, Hailin Zhang,  Tong Zhao and 1 more author
    Sci. China Inf. Sci. 2022
  2. VLDB
    HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework (Best Scalable Data Science Paper)
    Xupeng Miao, Hailin Zhang, Yining Shi,  Xiaonan Nie and 3 more authors
    Proc. VLDB Endow. 2022
    HET-GMP: A Graph-based System Approach to Scaling Large Embedding Model Training
    Xupeng Miao, Yining Shi, Hailin Zhang,  Xin Zhang and 3 more authors
    In Proceedings of SIGMOD Conference 2022
    Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce
    Xupeng Miao, Xiaonan Nie, Yingxia Shao,  Zhi Yang and 3 more authors
    In Proceedings of SIGMOD Conference 2021