AI agent tools for llama
Short answer: Our top pick for llama: AstrBot, with the highest AgentPick Score (89/100) among tools tagged "llama". Runners-up: LocalAI (88) and lemonade (80). Compare what each does, its license and how recently it was updated below.
| # | Tool | What it does | Score | Stars | License | Updated |
|---|---|---|---|---|---|---|
| #1 | AstrBot | AI Agent Assistant & development framework that integrates lots of IM platforms, LLMs, plugins and AI feature, and can be your openclaw alternative. ✨ | 89/100 | ★ 42k | AGPL-3.0 | 14 Oct 2026 |
| #2 | LocalAI | LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | 88/100 | ★ 50k | MIT | 14 Oct 2026 |
| #3 | lemonade | Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg… | 80/100 | ★ 5.9k | Apache-2.0 | 14 Oct 2026 |
| #4 | langroid | Harness LLMs with Multi-Agent Programming | 77/100 | ★ 4.1k | MIT | 14 Oct 2026 |
| #5 | oumi | Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM! | 72/100 | ★ 9.4k | Apache-2.0 | 14 Oct 2026 |
| #6 | tools | A set of tools that gives agents powerful capabilities. | 71/100 | ★ 1.3k | Apache-2.0 | 13 Oct 2026 |
| #7 | bolna | Conversational voice AI agents | 70/100 | ★ 793 | MIT | 14 Oct 2026 |
| #8 | beelzebub | A secure low code deception runtime framework, leveraging AI for System Virtualization. | 69/100 | ★ 2.2k | GPL-3.0 | 14 Oct 2026 |
| #9 | Risuai | Make your own story. User-friendly software for LLM roleplaying | 66/100 | ★ 1.7k | GPL-3.0 | 14 Oct 2026 |
| #10 | claude-code-local | Run Claude Code 100% on-device with local AI on Apple Silicon. MLX-native Anthropic-API server. 6 fighters incl. Muse-Glimmer 30B (now multimodal — re… | 63/100 | ★ 3.4k | MIT | 11 Oct 2026 |
| #11 | chatgpt-cli | ChatGPT CLI is a powerful, multi-provider command-line interface for working with modern LLMs. It supports OpenAI, Azure, Perplexity, LLaMA, and more,… | 50/100 | ★ 962 | MIT | 30 Sept 2026 |
| #12 | ChatLLM-Web | Private local model studio, AI chat, and agent workspace powered by WebGPU and WebLLM. | 48/100 | ★ 638 | MIT | 12 Aug 2026 |
| #13 | Sidekick | A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without i… | 47/100 | ★ 3.3k | MIT | 30 Sept 2026 |
| #14 | comfyui_LLM_party | LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to … | 46/100 | ★ 2.4k | AGPL-3.0 | 29 Jul 2026 |
| #15 | samples | Agent samples built using the Strands Agents SDK. | 46/100 | ★ 909 | Apache-2.0 | 14 Oct 2026 |
| #16 | agents-from-scratch | Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning. | 31/100 | ★ 1k | MIT | 25 Jul 2026 |
Source: each project's public GitHub repository (description, stars, license, last push). Listed tools aren't tested or ranked by AgentPick.
How to choose
- Grant the narrowest permissions the server allows.
- Check whether it runs locally or calls a remote service.
- Prefer servers listed in the official MCP registry.
Get the best new agent tools every week. Free, with a verdict on each. Get the weekly digest
Related
AI agent tools for local-first setups →
MCP servers
AI agent tools for knowledge graphs and bases →
MCP servers
AI agent tools for RAG (retrieval-augmented generation) →
MCP servers
AI agent tools for MCP client →
MCP servers
AI agent tools for cybersecurity →
MCP servers
AI agent tools for DevOps →
MCP servers
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.