← Back to Discover
intentee

intentee/paddler

RustApache-2.0active
88Health

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

Stars1.6k
Forks90
Open Issues28
Contributors90
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
13
Popularity
25
#ai#llamacpp#llm#llmops#load-balancer
View on GitHub ↗Issues (28) ↗Pull Requests ↗

Should you contribute to intentee/paddler?

intentee/paddler has a FoundDev health score of 88/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Rust, so prior Rust experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

intentee
intentee/paddler
RustApache 2.0
88

Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.

active
1.6k90 contributors28 issues
0d ago

More Rust repos

MystenLabs
MystenLabs/sui
Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language
7.7k97
hoangnb24
hoangnb24/repository-harness
Turn any repo into an agent-ready workspace for Claude Code, Codex, Cursor, and other coding agents.
59293
HarrierOnChain
HarrierOnChain/Prediction-Markets-Trading-Bot-Toolkits
Trading bots on Prediction markets like Polymarket, Kalshi, Limitless etc. it is also available on Predict.fun predictdotfun. predict fun trading bot predict fun trading bot predict fun trading bot
26992