Open source repositories tagged with #serving, ranked by health score.
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle
