← Back to Discover
smg-project

smg-project/smg

RustApache-2.0active
85Health

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

Stars565
Forks183
Open Issues153
Contributors183
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
10
Popularity
25
#anthropic#anthropic-api#chat#claude#gemini#inference-gateway#lightseek#llm#mcp#openai#responses-api#routing#sglang#tensorrtllm#tokenspeed#trtllm#vllm
View on GitHub ↗Issues (153) ↗Pull Requests ↗

Should you contribute to smg-project/smg?

smg-project/smg has a FoundDev health score of 85/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Rust, so prior Rust experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

smg-project
smg-project/smg
RustApache 2.0
85

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

active
★ 565183 contributors153 issues
0d ago

More Rust repos

MystenLabs
MystenLabs/sui
Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language
★ 7.8k97
n42blockchain
n42blockchain/N42-rs
The N42 blockchain, built with Rust, aims to become the world's premier blockchain mainnet provider, empowering a decentralized ecosystem. By exploring the limitless potential of intelligent technologies, N42 seeks to advance human civilization toward greater equality, efficiency, and intelligence.
★ 5194
storytold
storytold/vectorcraft
An open-source, clean-room reimplementation of Adobe Illustrator, built in pure Rust.
★ 5.4k92