Open source repositories tagged with #llmops, ranked by health score.
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.
⚙️🦀 Build modular and scalable LLM Applications in Rust
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
The platform for LLM evaluations and AI agent testing
Unified AI Gateway for 30+ LLMs (OpenAI, Anthropic, Bedrock, Azure etc) with Caching, Guardrails, A/B test & cost controls. Go-native Fastest & Scalable AI Gateway LiteLLM & Kong AI Gateway alternative.
Open-source observability for your GenAI or LLM application, based on OpenTelemetry
Create your Agentic AIs.
