Discover the Best Open-Source Pipeline-parallelism Projects Sorted by Stars
Get Insights into Stars Growth, Contributions, Diversity, Bus Factor, and Community Governance. Optimize Your Project's Performance and Collaborate with a Thriving Community.
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
aibig-modeldata-parallelismdeep-learningdistributed-computingfoundation-modelsheterogeneous-traininghpcinferencelarge-scalemodel-parallelismpipeline-parallelism
31,848
microsoft/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
billion-parameterscompressiondata-parallelismdeep-learninggpuinferencemachine-learningmixture-of-expertsmodel-parallelismpipeline-parallelismpytorchtrillion-parameterszero
28,106
bigscience-workshop/petals
🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading
bloomchatbotdeep-learningdistributed-systemsgptguanacolanguage-modelslarge-language-modelsllamallama2machine-learningneural-networksnlppipeline-parallelismpretrained-modelspytorchtensor-parallelismtransformervolunteer-computing
6,917
Oneflow-Inc/libai
LiBai(李白): A Toolbox for Large-Scale Distributed Parallel Training
data-parallelismdeep-learningdistributed-traininglarge-scalemodel-parallelismnlponeflowpipeline-parallelismself-supervised-learningtransformervision-transformer
355
Get updates on the fastest growing repos and cool stats about GitHub right in your inbox
Once per month. No spam.