AI agent tools for LLM evaluation
Short answer: Our top pick for LLM evaluation: trulens, with the highest AgentPick Score (75/100) among tools tagged "llm-evaluation". Runners-up: future-agi (74) and oumi (72). Compare what each does, its license and how recently it was updated below.
| # | Tool | What it does | Score | Stars | License | Updated |
|---|---|---|---|---|---|---|
| #1 | trulens | Evaluation and Tracking for LLM Experiments and AI Agents | 75/100 | ★ 3.6k | MIT | 13 Oct 2026 |
| #2 | future-agi | Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Ga… | 74/100 | ★ 2.1k | Apache-2.0 | 14 Oct 2026 |
| #3 | oumi | Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM! | 72/100 | ★ 9.4k | Apache-2.0 | 14 Oct 2026 |
| #4 | judgeval | The Continuous-Improvement Stack for Agents. Our environment data and evals power agent improvement and monitoring. | 68/100 | ★ 1.1k | Apache-2.0 | 13 Oct 2026 |
| #5 | agentenv-framework | Creating realistic RL environments requires collaboration between researchers, engineers, and domain experts across many dimensions: artifacts, enviro… | 64/100 | ★ 297 | Apache-2.0 | 14 Oct 2026 |
| #6 | overmind | The platform for continuously improving AI agents. | 63/100 | ★ 659 | AGPL-3.0 | 14 Oct 2026 |
| #7 | OrcaReplay | OrcaReplay — Time travel for AI agents. Record, replay, fork, and debug any agent run with any model. Built by the OrcaRouter.ai team. | 57/100 | ★ 284 | Apache-2.0 | 1 Oct 2026 |
| #8 | TrustLLM | [ICML 2024] TrustLLM: LLM trustworthiness evaluation across truthfulness, safety, fairness, robustness, privacy and ethics. Python/CLI toolkit for loc… | 53/100 | ★ 632 | MIT | 4 Oct 2026 |
| #9 | agentic_security | Agentic LLM Vulnerability Scanner / AI red teaming kit 🧪 | 52/100 | ★ 2k | Apache-2.0 | 22 Sept 2026 |
| #10 | agent-skills-eval | A test runner for agentskills.io-style AI agent skills | 41/100 | ★ 802 | MIT | 14 Oct 2026 |
| #11 | FinSight-AI | AI equity research agent with resilient workflows, evidence-grounded RAG, versioned reports, and automated quality evaluation. | 30/100 | ★ 560 | MIT | 2 Sept 2026 |
Source: each project's public GitHub repository (description, stars, license, last push). Listed tools aren't tested or ranked by AgentPick.
How to choose
- Read the license before using it commercially.
- Check how recently it was updated and how active its issues are.
- Run it on a small, low-risk task first.
Get the best new agent tools every week. Free, with a verdict on each. Get the weekly digest
Related
AI agent tools for agent memory →
Agent building
AI agent tools for self-hosted setups →
Agent building
AI agent tools for LangChain →
Agent building
AI agent tools for sandbox →
Agent building
AI agent tools for harness engineering →
Agent building
AI agent tools for penetration testing →
Agent building
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.