Open source repositories tagged with #model-serving, ranked by health score.
Olares: An Open-Source Personal Cloud to Reclaim Your Data
Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2
Community maintained hardware plugin for vLLM on Ascend
