← Back to Discover
xorbitsai

xorbitsai/inference

PythonApache-2.0activepopular
89Health

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

Stars9.5k
Forks851
Open Issues43
Contributors851
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
14
Popularity
25
#artificial-intelligence#chatglm#deployment#flan-t5#gemma#ggml#glm4#inference#llama#llama3#llamacpp#llm#machine-learning#mistral#openai-api#pytorch#qwen#vllm#whisper#wizardlm
View on GitHub ↗Issues (43) ↗Pull Requests ↗Wiki ↗

Should you contribute to xorbitsai/inference?

xorbitsai/inference has a FoundDev health score of 89/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

xorbitsai
xorbitsai/inference
PythonApache 2.0
89

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

activepopular
9.5k851 contributors43 issues
0d ago

More Python repos

miguelgrinberg
miguelgrinberg/python-engineio
Python Engine.IO server and client
25796
OCA
OCA/OpenUpgrade
Open source upgrade path for Odoo/OpenERP
97096
OCA
OCA/l10n-spain
Odoo Spain Localization
54294