# 分布式训练框架202309/30论文阅读: ZeRO: Memory Optimizations Toward Training Trillion Parameter Models分布式训练框架09/17论文阅读: PyTorch Distributed: Experiences on Accelerating Data Parallel Training分布式训练框架09/17论文阅读: Horovod: fast and easy distributed deep learning in TensorFlow分布式训练框架