web-scraper

Agent-Reach

+4.5k

Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.

firecrawl

+2.1k

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

lexmount/moli

+1.2k

Best headless browser for AI agents. Lite, Fast, High-Compatibility. Built in Rust

Scrapling

+1k

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

google-maps-scraper

+218

scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place

getmaxun/maxun

+73

Turn any website into a structured API. Extract, automate, search and monitor the web.

Scrapegraph-ai

+181

Python scraper based on AI

donsetch

+33

Web fetch, search, and crawl for AI agents. Built from scratch in Rust. No keys, no accounts. AGPL v3.

fastcrw/crw

+20

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.