Open source repositories tagged with #model-serving, ranked by health score.
Community maintained hardware plugin for vLLM on Huawei Ascend
A framework for efficient model inference with omni-modality models
