← Back to Discover
swellweb

swellweb/reame

C++MITactiverising
86Health

CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures included.

Stars102
Forks9
Open Issues5
Contributors9
Last Push0d ago

Health Breakdown

Activity
25
Community
25
Maintenance
13
Popularity
23
#arm#cpu#edge-ai#gguf#inference#kv-cache#llama-cpp#llm#local-llm#openai-api#prompt-compression#self-hosted#speculative-decoding
View on GitHub ↗Issues (5) ↗Pull Requests ↗

Should you contribute to swellweb/reame?

swellweb/reame has a FoundDev health score of 86/100, which puts it in the active-and-maintained tier. The maintainer team is shipping recently, issues are being closed, and a PR you open this week has a realistic chance of being reviewed.

Last push was 0 days ago — that signals an actively maintained project. New issues are likely to get a maintainer response within days. The project is written primarily in C++, so prior C++ experience will shorten ramp-up.

Licensed under MIT, a standard OSI-approved license — safe to contribute to under normal employer IP policies.

Community

swellweb86

CPU-first LLM inference server on llama.cpp. Runs useful models on free-tier ARM boxes; rewriting the input made it ~6x faster and more accurate than tuning the engine. MIT, benchmarks and failures included.

activerising
1029 contributors5 issues
0d ago

More C++ repos

GlistEngine
GlistEngine/GlistEngine
GlistEngine is a cross platform OpenGL game engine written in C++
386100
MarlinFirmware
MarlinFirmware/Marlin
Marlin is a firmware for RepRap 3D printers optimized for both 8 and 32 bit microcontrollers. Marlin supports all common platforms. Many commercial 3D printers come with Marlin installed. Check with your vendor if you need source code for your specific machine.
17.5k99
mne-tools
mne-tools/mne-cpp
MNE-CPP: The C++ framework for real-time functional brain imaging.
17498