Open source repositories tagged with #distributed-inference, ranked by health score.
A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
Reproducible Docker/vLLM deployment, tuning, and benchmarks for DeepSeek V4.1 Flash on a switchless three-node DGX Spark fabric.
