llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSON output and function calls.
Ranked by AgentPick Score, our data score from public GitHub activity. Description is the project's own.
Topics: agents, function-calling, llamacpp, llm, llm-agent, llm-framework, llms, parallel-function-call
Starter prompt
Try llama-cpp-agent on one small, low-risk task: [task]. Tell me what worked, what didn't, and how long it took.
More in Agent building
LangChain →
The agent engineering platform.
DSPy →
DSPy: The framework for programming—not prompting—language models
CopilotKit →
The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Pr…
agentscope →
Build and run agents you can see, understand and trust.
Haystack →
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Des…
LlamaIndex →
LlamaIndex is the document processing platform for AI
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.