← Explore
TOPIC

#sglang

Open source repositories tagged with #sglang, ranked by health score.

xorbitsai
xorbitsai/inference
Python
89
health

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

9.5k
kvcache-ai
kvcache-ai/Mooncake
C++
88
health

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

6.3k