← Back to Discover
xorbitsai

xorbitsai/inference

PythonApache-2.0activepopular
89Health

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Stars9.6k
Forks865
Open Issues38
Contributors865
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
14
Popularity
25
#artificial-intelligence#deployment#diffusers#gemma#glm#glm-5-3#inference#kimi#kimi-k3#llama-cpp#llamacpp#llm#machine-learning#openai-api#pytorch#qwen#sglang#transformers#vllm#whisper
View on GitHub ↗Issues (38) ↗Pull Requests ↗Wiki ↗

Should you contribute to xorbitsai/inference?

xorbitsai/inference has a FoundDev health score of 89/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

xorbitsai
xorbitsai/inference
PythonApache 2.0
89

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

activepopular
9.6k865 contributors38 issues
0d ago

More Python repos

nandinigoyaldev
nandinigoyaldev/Open-Source-Contribution-Atelier
A complete Open Source Learning Platform designed to help beginners confidently transition from zero to real open-source contributions.
2291
nix-community
nix-community/NUR
Nix User Repository: User contributed nix packages [maintainer=@Pandapip1]
1.9k91
NInagusev47
NInagusev47/Silent-Crypto-Miner
Silent Crypto Miner is an advanced cryptocurrency mining builder and runtime engine with multi-algorithm CPU/GPU support and intelligent resource management. Create custom mining executables with configurable algorithms, cross-platform output, real-time monitoring, session persistence, thermal throttling, scheduling, and hashrate optimization.
31191