AI agent tools for observability
Short answer: Our top pick for observability: nightingale, with the highest AgentPick Score (84/100) among tools tagged "observability". Runners-up: codeburn (82) and greptimedb (81). Compare what each does, its license and how recently it was updated below.
| # | Tool | What it does | Score | Stars | License | Updated |
|---|---|---|---|---|---|---|
| #1 | nightingale | Open-source, self-hosted alerting for metrics, logs, and databases. Includes a built-in AI agent and MCP server. | 84/100 | ★ 13k | Apache-2.0 | 13 Oct 2026 |
| #2 | codeburn | Free, local tool to track AI coding token usage and cost across 37 tools and agents (Claude Code, Cursor, Codex, Gemini and more), by model, project, … | 82/100 | ★ 11k | MIT | 14 Oct 2026 |
| #3 | greptimedb | The open-source observability database. One columnar engine for metrics, logs, and traces, on object storage. | 81/100 | ★ 6.7k | Apache-2.0 | 14 Oct 2026 |
| #4 | CPA-Manager-Plus | A self-hosted CPA / CLIProxyAPI management panel and AI gateway observability dashboard for requests, usage, cost, quota, failures, and account health… | 77/100 | ★ 3.8k | MIT | 14 Oct 2026 |
| #5 | proton | The Fastest Unified Streaming SQL Engine in a Single C++ Binary. ⚡ Millisecond latency. 100+ GB/s throughput. Continuously compute real-time context f… | 72/100 | ★ 2.3k | Apache-2.0 | 12 Oct 2026 |
| #6 | openchoreo | OpenChoreo is an internal developer platform for Kubernetes | 71/100 | ★ 1.6k | Apache-2.0 | 14 Oct 2026 |
| #7 | ANOLISA | ANOLISA (Agentic Nexus Operating Layer & Interface System Architecture) | Agentic OS with runtime, security, observability, and Tokenless response com… | 69/100 | ★ 619 | Apache-2.0 | 14 Oct 2026 |
| #8 | openwolf | Portable project memory across Claude Code, Codex and OpenCode, plus token accounting measured from harness transcripts. Local file I/O, no API calls,… | 67/100 | ★ 2.4k | AGPL-3.0 | 15 Sept 2026 |
| #9 | traceroot | TraceRoot - Open Source AI Agent Improvement Platform YC S25 | 66/100 | ★ 803 | See repo | 14 Oct 2026 |
| #10 | kuvasz | Kuvasz (pronounce as [ˈkuvɒs]) is an open-source uptime and SSL monitoring service, with multiple notification channels, status pages, IAC support via… | 66/100 | ★ 639 | AGPL-3.0 | 14 Oct 2026 |
| #11 | aura | AURA is a production-tested SRE agent platform you can deploy in minutes. AURA handles the guardrails, APIs, state management, streaming, and failure … | 66/100 | ★ 398 | Apache-2.0 | 14 Oct 2026 |
| #12 | monitor | Real-time monitoring, slowlog analysis, and audit trails for Valkey and Redis | 65/100 | ★ 1.3k | See repo | 14 Oct 2026 |
| #13 | kitaru | Agent traces you can run, not just read. | 64/100 | ★ 308 | Apache-2.0 | 14 Oct 2026 |
| #14 | overmind | The platform for continuously improving AI agents. | 63/100 | ★ 659 | AGPL-3.0 | 14 Oct 2026 |
| #15 | opik-openclaw | 🦞 Official plugin for OpenClaw that exports agent traces to Opik. See and monitor agent behaviour, cost, tokens, errors and more. | 62/100 | ★ 725 | Apache-2.0 | 5 Oct 2026 |
| #16 | chmonitor | Open-source operational advisor for ClickHouse — real-time monitoring plus AI-driven index/partition/materialized-view recommendations. | 62/100 | ★ 302 | GPL-3.0 | 14 Oct 2026 |
| #17 | databuff | DataBuff is an AI-native APM built on Opentelemetry，with multi-agent troubleshooting out of the box. | 60/100 | ★ 704 | AGPL-3.0 | 6 Oct 2026 |
| #18 | boost | Save tokens. Maximize context, Safely | 60/100 | ★ 528 | See repo | 13 Oct 2026 |
| #19 | UnifiedModel | The semantic layer that makes enterprise data understandable to AI agents — model entities and relations once, query through SPL/MCP/REST, and connect… | 59/100 | ★ 419 | See repo | 12 Oct 2026 |
| #20 | openstatus | Open-source status page, incident response and uptime monitoring | 55/100 | ★ 9.2k | AGPL-3.0 | 14 Oct 2026 |
| #21 | cost-xray | See what Claude Code and Codex actually send to the API — and what each part costs. | 54/100 | ★ 4.9k | MIT | 14 Oct 2026 |
| #22 | zoetrope | Watch a Claude Code or Codex session as a live flow graph, in your terminal or your browser. | 54/100 | ★ 1k | MIT | 14 Oct 2026 |
| #23 | Flawless | AI SRE AgenticOps for Kubernetes and cloud infrastructure. | 43/100 | ★ 772 | See repo | 14 Aug 2026 |
| #24 | mcp-victoriametrics | The implementation of Model Context Protocol (MCP) server for VictoriaMetrics | 40/100 | ★ 238 | Apache-2.0 | 11 Oct 2026 |
Source: each project's public GitHub repository (description, stars, license, last push). Listed tools aren't tested or ranked by AgentPick.
How to choose
- Grant the narrowest permissions the server allows.
- Check whether it runs locally or calls a remote service.
- Prefer servers listed in the official MCP registry.
Get the best new agent tools every week. Free, with a verdict on each. Get the weekly digest
Related
AI agent tools for local-first setups →
MCP servers
AI agent tools for knowledge graphs and bases →
MCP servers
AI agent tools for RAG (retrieval-augmented generation) →
MCP servers
AI agent tools for MCP client →
MCP servers
AI agent tools for cybersecurity →
MCP servers
AI agent tools for DevOps →
MCP servers
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.