← Back to Discover
pegainfer-project

pegainfer-project/pegainfer

RustApache-2.0activerising
84Health

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Stars634
Forks97
Open Issues148
Contributors97
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
9
Popularity
25
#cuda#cuda-kernels#deepseek#gpu#inference#inference-engine#kimi#kimi-k2#kv-cache#llm#llm-inference#llm-serving#model-serving#moe#openai-api#paged-attention#qwen#qwen3#rust#vllm
View on GitHub ↗Issues (148) ↗Pull Requests ↗Wiki ↗

Should you contribute to pegainfer-project/pegainfer?

pegainfer-project/pegainfer has a FoundDev health score of 84/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Rust, so prior Rust experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

pegainfer-project84

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

activerising
63497 contributors148 issues
0d ago

More Rust repos

MystenLabs
MystenLabs/sui
Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language
7.7k97
tsouth89
tsouth89/toolport
Local-first MCP gateway. One port for every tool and every AI client: lazy discovery (~90% token savings), tool integrity + quarantine, secrets in the OS keychain.
14091
genomoncology
genomoncology/biomcp
BioMCP: Biomedical Model Context Protocol
58490