← Explore
TOPIC

#paged-attention

Open source repositories tagged with #paged-attention, ranked by health score.

mudler
mudler/vllm.cpp
C++
76
health

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

★ 441