AI agent tools for llama cpp
Short answer: Our top pick for llama cpp: ODS, with the highest AgentPick Score (80/100) among tools tagged "llama-cpp". Runners-up: atomic-agent (74) and OGAM (74). Compare what each does, its license and how recently it was updated below.
| # | Tool | What it does | Score | Stars | License | Updated |
|---|---|---|---|---|---|---|
| #1 | ODS | ODS V3 Pre-Release: Public testing and refinement ahead of the official V3 launch. Turn your PC, Mac, or Linux box into a private AI server. | 80/100 | ★ 7.5k | Apache-2.0 | 14 Oct 2026 |
| #2 | atomic-agent | Atomic Agent is a local-first AI agent. Runs open-weight models on your own machine via llama.cpp. | 74/100 | ★ 3.3k | MIT | 14 Oct 2026 |
| #3 | OGAM | The Swiss Army Knife of Offline AI. Chat, see, speak, and generate images on your phone or Mac — GGUF LLMs, vision, Whisper speech-to-text, Stable Dif… | 74/100 | ★ 3.2k | MIT | 14 Oct 2026 |
| #4 | mirobody | Turn scattered health data into answers you can trace. Self-hosted AI health data engine for lab reports, wearables and genetics, with a built-in MCP … | 70/100 | ★ 1.4k | Apache-2.0 | 14 Oct 2026 |
| #5 | llmman | Run any agent on any model, models stored as OCI images | 67/100 | ★ 551 | Apache-2.0 | 14 Oct 2026 |
| #6 | hax | A minimalist, terminal-native coding agent written in C. | 66/100 | ★ 914 | MIT | 14 Oct 2026 |
| #7 | forge | A Python framework for self-hosted LLM tool-calling and multi-step agentic workflows | 63/100 | ★ 2.3k | MIT | 14 Oct 2026 |
| #8 | ClawMem | On-device memory layer for AI agents. Claude Code, OpenClaw and Hermes. Hooks + MCP server + hybrid RAG search. | 58/100 | ★ 210 | MIT | 11 Oct 2026 |
Source: each project's public GitHub repository (description, stars, license, last push). Listed tools aren't tested or ranked by AgentPick.
How to choose
- Grant the narrowest permissions the server allows.
- Check whether it runs locally or calls a remote service.
- Prefer servers listed in the official MCP registry.
Get the best new agent tools every week. Free, with a verdict on each. Get the weekly digest
Related
AI agent tools for local-first setups →
MCP servers
AI agent tools for knowledge graphs and bases →
MCP servers
AI agent tools for RAG (retrieval-augmented generation) →
MCP servers
AI agent tools for MCP client →
MCP servers
AI agent tools for cybersecurity →
MCP servers
AI agent tools for DevOps →
MCP servers
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.