KVarN
KVarN is a native vLLM KV-cache quantization backend for your agents: 3-5x more context, throughput above FP16, and FP16-level accuracy. Calibration-free, one flag.
Ranked by AgentPick Score, our data score from public GitHub activity. Description is the project's own.
Topics: agentic-ai, kv-cache, llm, llm-inference, long-context, quantization, vllm
Starter prompt
Try KVarN on one small, low-risk task: [task]. Tell me what worked, what didn't, and how long it took.
More in Agent building
LangChain →
The agent engineering platform.
DSPy →
DSPy: The framework for programming—not prompting—language models
CopilotKit →
The Frontend Stack for Agents & Generative UI. React, Angular, Mobile, Slack, and more. Makers of the AG-UI Pr…
agentscope →
Build and run agents you can see, understand and trust.
Haystack →
Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Des…
LlamaIndex →
LlamaIndex is the document processing platform for AI
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.