#llm-serving

skypilot-org/skypilot

Python

88

health

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

vllm-project/vllm-ascend

C++

82

health

Community maintained hardware plugin for vLLM on Ascend