Open source repositories tagged with #fast-inference, ranked by health score.
Fast, Unified, Rust-Native, Axum-Compatible inference Endpoints for Burn models and LLMs