Discover the Best Open-Source Data-parallelism Projects Sorted by Stars

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

A state-of-the-art multithreading runtime: message-passing based, fast, scalable, ultra-low overhead

飞桨大模型开发套件，提供大语言模型、跨模态大模型、生物计算大模型等领域的全流程开发工具链。

LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training