Publications

Publications by categories in reversed chronological order. 1 represents co-first author.

2023

  1. VLDB
    Galvatron: Efficient Transformer Training over Multiple GPUs Using Automatic Parallelism
    Xupeng Miao, Yujie Wang, Youhe Jiang,  Chunan Shi and 3 more authors
    Proc. VLDB Endow. 2023
  2. SIGMOD
    FlexMoE: Scaling Large-scale Sparse Pre-trained Model Training via Dynamic Device Placement
    Xiaonan Nie,  Xupeng Miao, Zilong Wang,  Jilong Xue and 4 more authors
    Proceedings of SIGMOD Conference 2023
  3. AAAI
    CALIP: Zero-Shot Enhancement of CLIP with Parameter-free Attention
    Ziyu Guo, Renrui Zhang, Longtian Qiu,  Xianzheng Ma and 3 more authors
    Proceedings of AAAI Conference 2023

2022

  1. SCIS
    Hetu: A highly efficient automatic parallel distributed deep learning system
    Xupeng Miao, Xiaonan Nie, Hailin Zhang,  Tong Zhao and 1 more author
    Sci. China Inf. Sci. 2022
  2. VLDB
    HET: Scaling out Huge Embedding Model Training via Cache-enabled Distributed Framework (Best Scalable Data Science Paper)
    Xupeng Miao, Hailin Zhang, Yining Shi,  Xiaonan Nie and 3 more authors
    Proc. VLDB Endow. 2022
  3. VLDB
    Towards Communication-efficient Vertical Federated Learning Training via Cache-enabled Local Updates
    Fangcheng Fu,  Xupeng Miao, Jiawei Jiang,  Huanran Xue and 1 more author
    Proc. VLDB Endow. 2022
  4. SIGMOD
    HET-GMP: A Graph-based System Approach to Scaling Large Embedding Model Training
    Xupeng Miao, Yining Shi, Hailin Zhang,  Xin Zhang and 3 more authors
    In Proceedings of SIGMOD Conference 2022
  5. VLDBJ
    P2CG: A Privacy Preserving Collaborative Graph Neural Network Training Framework
    Xupeng Miao, Wentao Zhang, Yuezihan Jiang,  Fangcheng Fu and 5 more authors
    The VLDB Journal 2022
  6. ICDE
    TSPLIT: Fine-grained GPU Memory Management for Efficient DNN Training via Tensor Splitting
    Xiaonan Nie,  Xupeng Miao, Zhi Yang,  and Bin Cui
    In Proceedings of ICDE Conference 2022
  7. ICDE
    HET-KG: Communication-Efficient Knowledge Graph Embedding Training via Hotness-Aware Cache
    Sicong Dong1Xupeng Miao1, Pengkai Liu,  Xin Wang and 2 more authors
    In Proceedings of ICDE Conference 2022
  8. ICDE
    Zoomer: Boosting Retrieval on Web-scale Graphs by Regions of Interest
    Yuezihan Jiang, Yu Cheng, Hanyu Zhao,  Wentao Zhang and 5 more authors
    In Proceedings of ICDE Conference 2022
  9. CIKM
    Scalable Graph Sampling on GPUs with Compressed Graph
    Hongbo Yin, Yingxia Shao,  Xupeng Miao,  Yawen Li and 1 more author
    In Proceedings of CIKM Conference 2022
  10. ICDE Poster
    Lasagne: A Multi-Layer Graph Convolutional Network Framework via Node-aware Deep Architecture (Extended Abstract)
    Xupeng Miao, Wentao Zhang, Yingxia Shao,  Bin Cui and 3 more authors
    In Proceedings of ICDE Conference 2022
  11. 软件学报
    Graph Neural Network Training Acceleration over Multi-GPUs
    Xupeng Miao, Yujie Wang, Jia Shen,  Yingxia Shao and 1 more author
    In Journal of Software (Chinese) 2022
  12. arXiv
    HetuMoE: An Efficient Trillion-scale Mixture-of-Expert Distributed Training System
    Xiaonan Nie, Pinxue Zhao,  Xupeng Miao,  Tong Zhao and 1 more author
    arXiv preprint arXiv:2203.14685 2022
  13. arXiv
    Distributed Graph Neural Network Training: A Survey
    Yingxia Shao, Hongzheng Li, Xizhi Gu,  Hongbo Yin and 5 more authors
    arXiv preprint arXiv:2211.00216 2022
  14. CVPR
    PointCLIP: Point Cloud Understanding by CLIP
    Renrui Zhang, Ziyu Guo, Wei Zhang,  Kunchang Li and 5 more authors
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2022
  15. ICML Workshop
    OSDP: Optimal Sharded Data Parallel for Distributed Deep Learning
    Youhe Jiang,  Xupeng Miao, Xiaonan Nie,  and Bin Cui
    In Proceedings of ICML Hardware Aware Efficient Training (HAET) Workshop 2022

2021

  1. SIGMOD
    Heterogeneity-Aware Distributed Machine Learning Training via Partial Reduce
    Xupeng Miao, Xiaonan Nie, Yingxia Shao,  Zhi Yang and 3 more authors
    In Proceedings of SIGMOD Conference 2021
  2. ICDE Poster
    CuWide: Towards Efficient Flow-based Training for Sparse Wide Models on GPUs (Extended Abstract)
    Xupeng Miao, Lingxiao Ma, Zhi Yang,  Yingxia Shao and 3 more authors
    In Proceedings of ICDE Conference 2021
  3. TKDE
    Lasagne: A multi-layer graph convolutional network framework via node-aware deep architecture
    Xupeng Miao, Wentao Zhang, Yingxia Shao,  Bin Cui and 3 more authors
    IEEE Transactions on Knowledge and Data Engineering 2021
  4. SIGKDD
    DeGNN: Improving Graph Neural Networks with Graph Decomposition
    Xupeng Miao, Nezihe Merve Gürel, Wentao Zhang,  Zhichao Han and 16 more authors
    In Proceedings of SIGKDD Conference 2021
  5. SIGKDD
    ROD: Reception-aware Online Distillation for Sparse Graphs
    Wentao Zhang, Yuezihan Jiang, Yang Li,  Zeang Sheng and 5 more authors
    In Proceedings of SIGKDD Conference 2021
  6. VLDBJ
    Memory-aware framework for fast and scalable second-order random walk over billion-edge natural graphs
    Yingxia Shao, Shiyue Huang, Yawen Li,  Xupeng Miao and 2 more authors
    The VLDB Journal 2021
  7. arXiv
    EvoMoE: An Evolutional Mixture-of-Experts Training Framework via Dense-To-Sparse Gate
    Xiaonan Nie,  Xupeng Miao, Shijie Cao,  Lingxiao Ma and 6 more authors
    arXiv preprint arXiv:2112.14397 2021

2020

  1. TKDE
    Cuwide: Towards efficient flow-based training for sparse wide models on gpus
    Xupeng Miao, Lingxiao Ma, Zhi Yang,  Yingxia Shao and 3 more authors
    IEEE Transactions on Knowledge and Data Engineering 2020
  2. SIGMOD
    Reliable Data Distillation on Graph Convolutional Network
    Wentao Zhang1Xupeng Miao1, Yingxia Shao,  Jiawei Jiang and 3 more authors
    In Proceedings of SIGMOD 2020
  3. SIGMOD
    Memory-Aware Framework for Efficient Second-Order Random Walk on Large Graphs
    Yingxia Shao, Shiyue Huang,  Xupeng Miao,  Bin Cui and 1 more author
    In Proceedings of SIGMOD 2020
  4. ICDE
    PSGraph: How Tencent trains extremely large-scale graphs with Spark?
    Jiawei Jiang, Pin Xiao, Lele Yu,  Xiaosen Li and 4 more authors
    In Proceedings of ICDE Conference 2020

2019

  1. SIGMOD
    PS2: Parameter Server on Spark
    Zhipeng Zhang, Bin Cui, Yingxia Shao,  Lele Yu and 2 more authors
    In Proceedings of SIGMOD 2019