Open source repositories tagged with #distributed-inference, ranked by health score.
FlashInfer: Kernel Library for LLM Serving