← Explore
TOPIC

#local-inference

Open source repositories tagged with #local-inference, ranked by health score.

ardanlabs
ardanlabs/kronk
Go
89
health

Go With Your Own Intelligence! Use Go for hardware accelerated local inference with llama.cpp, whisper.cpp, and stable-diffusion.cpp directly integrated into your Go applications. Kronk provides a high-level API and production ready model server.

★ 831