#llmops

dataelement/bisheng

Python

90

health

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

mlflow/mlflow

Python

89

health

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controlling costs and managing access to models and data.

0xPlaygrounds/rig

Rust

89

health

⚙️🦀 Build modular and scalable LLM Applications in Rust

maximhq/bifrost

Go

86

health

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

traceloop/openllmetry

Python

86

health

Open-source observability for your GenAI or LLM application, based on OpenTelemetry

anthony-chaudhary/fak

Go

73

health

Agentic Runtime

AixleHQ/flow

Ruby

69

health

Aixle Flow — orchestrate coding agents through durable, inspectable workflows.