#pytorch

onnx/onnx

Python

90

health

Open standard for machine learning interoperability

MakazhanAlpamys/Soup

Python

89

health

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

xorbitsai/inference

Python

89

health

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

onnxsim/onnxsim

C++

89

health

Simplify your onnx model

meta-pytorch/torchrec

Python

88

health

Pytorch domain library for recommendation systems

rentruewang/aioway

Python

88

health

AI on the way. An auto deep learning pipe dream. An RDBMS approach to deep learning. Declarative, explainable, scalable, optimizable, easy to deploy, all that good stuff.

NVIDIA/TransformerEngine

Python

88

health

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

microsoft/onnxruntime

C++

88

health

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

pytorch/TensorRT

Python

87

health

PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

pytorch/rl

Python

87

health

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.

flashinfer-ai/flashinfer

Python

87

health

FlashInfer: Kernel Library for LLM Serving

lightly-ai/lightly

Python

87

health

A python library for self-supervised learning on images.

zaina-ml/ml_forge

Python

85

health

A visual-based graph node editor for training computer vision models.

vllm-project/vllm-omni

Python

84

health

A framework for efficient model inference with omni-modality models

pytorch/benchmark

Python

82

health

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

iree-org/iree

C++

80

health

A retargetable MLIR-based machine learning compiler and runtime toolkit.