← Back to Discover
lightseekorg

lightseekorg/smg

RustApache-2.0active
86Health

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

Stars392
Forks116
Open Issues86
Contributors116
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
11
Popularity
25
#anthropic#anthropic-api#chat#claude#gemini#inference-gateway#lightseek#llm#mcp#openai#responses-api#routing#sglang#tensorrtllm#tokenspeed#trtllm#vllm
View on GitHub ↗Issues (86) ↗Pull Requests ↗

Should you contribute to lightseekorg/smg?

lightseekorg/smg has a FoundDev health score of 86/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Rust, so prior Rust experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

lightseekorg
lightseekorg/smg
RustApache 2.0
86

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

active
392116 contributors86 issues
0d ago

More Rust repos

MystenLabs
MystenLabs/sui
Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language
7.7k97
jito-foundation
jito-foundation/jito-solana
Jito Foundation MEV Solana Client
73693
containerd
containerd/rust-extensions
Rust crates to extend containerd
23692