scraping

firecrawl

+2.1k

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Scrapling

+1k

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

reverse-api-engineer

+271

Reverse engineer any website into a typed API client. Works with Claude Code, Codex, Cursor and OpenCode.

soxoj/maigret

+180

🕵️‍♂️ Collect a dossier on a person by username from 6K websites

camoufox

+150

🦊 Anti-detect browser

scrapy/scrapy

+140

Scrapy, a fast high-level web crawling & scraping framework for Python.

camofox-browser

+182

Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.

Scrapegraph-ai

+181

Python scraper based on AI

apify/crawlee

+58

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.