โ† Explore
TOPIC

#llama

Open source repositories tagged with #llama, ranked by health score.

superiorlu
superiorlu/AITreasureBox
Ruby
89
health

๐Ÿค– Automatically collected AI repos, tools, websites, papers & tutorials. ๅฎž็”จAI็™พๅฎ็ฎฑ ๐Ÿ’Ž

โ˜… 806
SciSharp
SciSharp/LLamaSharp
C#
89
health

A C#/.NET library to run LLM (๐Ÿฆ™LLaMA/LLaVA) on your local device efficiently.

โ˜… 3.7k
yamadashy
yamadashy/repomix
TypeScript
88
health

๐Ÿ“ฆ Repomix is a powerful tool that packs your entire repository into a single, AI-friendly file. Perfect for when you need to feed your codebase to Large Language Models (LLMs) or other AI tools like Claude, ChatGPT, DeepSeek, Perplexity, Gemini, Gemma, Llama, Grok, and more.

โ˜… 25.5k
ModelTC
ModelTC/LightLLM
Python
88
health

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

โ˜… 4.1k
linkedin
linkedin/Liger-Kernel
Python
88
health

Efficient Triton Kernels for LLM Training

โ˜… 6.4k
mostlygeek
mostlygeek/llama-swap
Go
88
health

Reliable model swapping for any local OpenAI/Anthropic compatible server - llama.cpp, vllm, etc

โ˜… 4.2k
langchain4j
langchain4j/langchain4j
Java
88
health

LangChain4j is an idiomatic, open-source Java library for building LLM-powered applications on the JVM. It offers a unified API over popular LLM providers and vector stores, and makes implementing tool calling (including MCP support), agents and RAG easy. It integrates seamlessly with enterprise Java frameworks like Quarkus and Spring Boot.

โ˜… 12.1k
yoshoku
yoshoku/llama_cpp.rb
C
88
health

llama_cpp.rb provides Ruby bindings for llama.cpp

โ˜… 236
johnbean393
johnbean393/Sidekick
Swift
88
health

A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp.

โ˜… 3.2k
sgl-project
sgl-project/sglang
Python
87
health

SGLang is a high-performance serving framework for large language models and multimodal models.

โ˜… 28.2k
lemonade-sdk
lemonade-sdk/lemonade
C++
87
health

Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk

โ˜… 4.1k
FuJacob
FuJacob/tabby
Swift
85
health

tabby is local AI autocomplete for your entire Mac. Open source. On device. Everywhere you type.

โ˜… 227
ArkaneFans
ArkaneFans/servllama
Dart
81
health

1-Click LLM Server on Your Phone โ€” no Termux needed! ๆ— ้œ€Termux๏ผŒไธ€้”ฎ่ฎฉไฝ ็š„ๆ‰‹ๆœบๅ˜ๆˆLLMๆœๅŠกๅ™จ๏ผ

โ˜… 38
NVIDIA-NeMo
NVIDIA-NeMo/Automodel
Python
79
health

๐Ÿš€ Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

โ˜… 521
tenstorrent
tenstorrent/tt-metal
C++
79
health

:metal: TT-NN operator library, and TT-Metalium low level kernel programming model.

โ˜… 1.5k