← Explore
TOPIC

#speculative-decoding

Open source repositories tagged with #speculative-decoding, ranked by health score.

VecSzn
VecSzn/PolyStrata
C++
88
health

Run large AI models on your own PC: Qwen3.8-Flash-Next on Strata's engine, and GLM 5.3 Flash, DeepSeek V4 Flash, LFM2.5, Qwen3.6, Ornith 1.5, Gemma 4, Tiel Coder and MiniCPM-V on a second engine written for PolyStrata. One-click install for Windows and Linux, OpenAI/Anthropic API on localhost.

★ 138