← Back to Discover
openinfer-project

openinfer-project/openinfer

RustApache-2.0activerising
84Health

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

Stars618
Forks92
Open Issues142
Contributors92
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
9
Popularity
25
#cuda#cuda-kernels#deepseek#gpu#inference#inference-engine#kimi#kimi-k2#kv-cache#llm#llm-inference#llm-serving#model-serving#moe#openai-api#paged-attention#qwen#qwen3#rust#vllm
View on GitHub ↗Issues (142) ↗Pull Requests ↗Wiki ↗

Should you contribute to openinfer-project/openinfer?

openinfer-project/openinfer has a FoundDev health score of 84/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Rust, so prior Rust experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

openinfer-project84

Pure Rust + CUDA LLM inference engine — no PyTorch, OpenAI-compatible, serves Qwen3 to Kimi-K2

activerising
61892 contributors142 issues
0d ago

More Rust repos

MystenLabs
MystenLabs/sui
Sui, a next-generation smart contract platform with high throughput, low latency, and an asset-oriented programming model powered by the Move programming language
7.7k97
ProvableHQ
ProvableHQ/snarkVM
A zkVM for Decentralized Private Computations (DPC)
1.2k95
rpcpool
rpcpool/yellowstone-grpc
Triton's Dragon's Mouth Yellowstone gRPC service for high-performance Solana streaming
99092