AI agent tools for web scraping
Short answer: Our top pick for web scraping: ketch, with the highest AgentPick Score (68/100) among tools tagged "web-scraping". Runners-up: x-reader (66) and reverse-api-engineer (65). Compare what each does, its license and how recently it was updated below.
| # | Tool | What it does | Score | Stars | License | Updated |
|---|---|---|---|---|---|---|
| #1 | ketch | Fast, stateless CLI for web search and scrape. Built for AI agents. | 68/100 | ★ 711 | MIT | 13 Oct 2026 |
| #2 | x-reader | Universal content reader MCP Server for 10+ platforms | 66/100 | ★ 967 | MIT | 14 Oct 2026 |
| #3 | reverse-api-engineer | The agent that turns websites into APIs! | 65/100 | ★ 1.4k | MIT | 23 Sept 2026 |
| #4 | oc | Turn any website into a compact CLI tailored for AI agents. Browse the web in hundreds of tokens, not tens of thousands. | 63/100 | ★ 540 | MIT | 14 Oct 2026 |
| #5 | cli | Firecrawl CLI and agent skills: web search, scraping, crawling and browser interaction from your terminal or any coding agent. Firecrawl is the most c… | 60/100 | ★ 651 | See repo | 14 Oct 2026 |
| #6 | spider | Foundational low latency web data collecting in Rust | 54/100 | ★ 2.8k | MIT | 1 Oct 2026 |
| #7 | agent-skills | Official Agent skills of Oxylabs products | 36/100 | ★ 876 | MIT | 30 Sept 2026 |
| #8 | facebook-ads-library-mcp | Free, self-hosted MCP server that scrapes the public Facebook Ad Library (no API token) for competitive ad research — advertiser, copy, landing pages,… | 24/100 | ★ 273 | MIT | 29 Aug 2026 |
| #9 | graphlit-mcp-server | Model Context Protocol (MCP) Server for Graphlit Platform | 21/100 | ★ 378 | MIT | 12 Jan 2026 |
Source: each project's public GitHub repository (description, stars, license, last push). Listed tools aren't tested or ranked by AgentPick.
How to choose
- Grant the narrowest permissions the server allows.
- Check whether it runs locally or calls a remote service.
- Prefer servers listed in the official MCP registry.
Get the best new agent tools every week. Free, with a verdict on each. Get the weekly digest
Related
AI agent tools for local-first setups →
MCP servers
AI agent tools for knowledge graphs and bases →
MCP servers
AI agent tools for RAG (retrieval-augmented generation) →
MCP servers
AI agent tools for MCP client →
MCP servers
AI agent tools for cybersecurity →
MCP servers
AI agent tools for DevOps →
MCP servers
AgentPick Weekly
The week's new agent tools with a verdict on each, every week. Free. We'll email you a link to confirm, and you can unsubscribe any time. See our Privacy Policy.