← Back to Discover
jundot

jundot/omlx

PythonApache-2.0activepopular
87Health

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Stars21.6k
Forks1.8k
Open Issues1.3k
Contributors1.8k
Last Push2d ago

Health Breakdown

Activity
25
Community
25
Maintenance
12
Popularity
25
#apple-silicon#inference-server#llm#macos#mlx#openai-api
View on GitHub ↗Issues (1.3k) ↗Pull Requests ↗

Should you contribute to jundot/omlx?

jundot/omlx has a FoundDev health score of 87/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 2 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in Python, so prior Python experience will shorten ramp-up.

Licensed under Apache-2.0, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

jundot
jundot/omlx
PythonApache 2.0
87

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

activepopular
21.6k1.8k contributors1.3k issues
2d ago

More Python repos

runpod-workers
runpod-workers/worker-vllm
The Runpod worker template for serving our large language model endpoints. Powered by vLLM.
46697
openstack
openstack/nova
OpenStack Compute (Nova). Mirror of code maintained at opendev.org.
3.2k92
josharsh
josharsh/100LinesOfCode
🚀 100+ mini-projects demonstrating the power of concise code. Perfect for learning, portfolio building, and first-time open source contributors. Under 100 lines each!
84092