List of packages, services, and manuals related to web scraping.
- Python - Python packages
- PHP - PHP packages
- Ruby - Ruby packages
- JavaScript - JavaScript packages
- Go - Go packages
- Command Line Tools - tools with a command line interface
- Web-Scraping Manuals - list of articles and books teaching web scraping
- dhamaniasad / HeadlessBrowsers - list of (almost) all headless web browsers in existence
- DNS over HTTPS providers - list of DNS over HTTPS providers
- Awesome Pastebins - list of pastebin sites
- Awesome Tunneling - List of tunneling software and services. Focus on self-hosting.
- @grablab_ru - web-scraping talks in Russian
Please see the CONTRIBUTING.md document.
The list is initially based on partial data from these sources awesome-python, awesome-php, awesome-ruby, ruby-nlp, awesome-javascript