#ai-gateway

vllm-project/semantic-router

Go

89

health

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

agentgateway/agentgateway

Rust

88

health

Next Generation Agentic Proxy for AI Agents and MCP servers

katanemo/plano

Rust

88

health

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

ENTERPILOT/GoModel

Go

88

health

AI gateway written in Go. Lightweight unified OpenAI-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama. LiteLLM alternative with observability, guardrails, streaming, costs and usage tracking.

maximhq/bifrost

Go

87

health

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.

higress-group/higress

Go

87

health

🤖 AI Gateway | AI Native API Gateway