# 分布式训练框架202404/06论文阅读: Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models分布式训练框架202311/25论文阅读: ZeRO++: Extremely Eficient Collective Communication for Giant Model Training分布式训练框架10/26论文阅读: ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Scale Deep Learning分布式训练框架10/17论文阅读: ZeRO-Offload: Democratizing Billion-Scale Model Training分布式训练框架09/30论文阅读: ZeRO: Memory Optimizations Toward Training Trillion Parameter Models分布式训练框架09/17论文阅读: PyTorch Distributed: Experiences on Accelerating Data Parallel Training分布式训练框架09/17论文阅读: Horovod: fast and easy distributed deep learning in TensorFlow分布式训练框架
04/06论文阅读: Colossal-Auto: Unified Automation of Parallelization and Activation Checkpoint for Large-scale Models分布式训练框架