Open source repositories tagged with #sglang, ranked by health score.
Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond
A simple and effective post training quantization toolkit for high-accuracy low-bit LLM inference|简洁且高效的后训练量化工具包
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
Open Source Inference Research Platform Standard / 开源推理研究平台
