analyzemyrepo.com
GitHub Repo stars

Discover the Best Open-Source Inference Projects Sorted by Stars

Get Insights into Stars Growth, Contributions, Diversity, Bus Factor, and Community Governance. Optimize Your Project's Performance and Collaborate with a Thriving Community.

Repo Image
microsoft/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

28,106
Repo Image
colinhacks/zod

TypeScript-first schema validation with static type inference

24,863
Repo Image
aws/amazon-sagemaker-examples

Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

8,764
Repo Image
gvergnaud/ts-pattern

🎨 The exhaustive Pattern Matching library for TypeScript, with smart type inference.

8,705
Repo Image
NVIDIA/TensorRT

NVIDIA® TensorRT™, an SDK for high-performance deep learning inference, includes a deep learning inference optimizer and runtime that delivers low latency and high throughput for inference applications.

7,709
Repo Image
Linzaer/Ultra-Light-Fast-Generic-Face-Detector-1MB

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

6,809
Repo Image
gcanti/io-ts

Runtime type system for IO decoding/encoding

6,386
Repo Image
py-why/dowhy

DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.

6,100
Repo Image
vllm-project/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

6,031

Get updates on the fastest growing repos and cool stats about GitHub right in your inbox

I agree to the storage of my email for the purpose of contacting me.

Once per month. No spam.