All activity
We are launching Crawlee for Python, an open-source library for web scraping and browser automation.
Quickly scrape data, store it, and avoid getting blocked, headless browsers, and smart proxy rotation.
Crawlee for Python
Build reliable scrapers in Python
Ondra Urban
left a comment
Hey everyone, I'm Ondra, one of the early maintainers of Crawlee. This project really is a culmination of 4 years of work trying to make the best library for web scraping in production.
Web scraping is a very dynamic environment and what works today might not work tomorrow, so we had to go through a lot of trial and error to figure out the most reliable and convenient ways of crawling the web...
Crawlee
Build reliable web scrapers and robots, fast!
Crawlee is an intuitive, customizable open-source library for web scraping and browser automation.
Quickly scrape data, store it, and avoid getting blocked with auto-generated human-like fingerprints, headless browsers, and smart proxy rotation.
Quickly scrape data, store it, and avoid getting blocked with auto-generated human-like fingerprints, headless browsers, and smart proxy rotation.
Crawlee
Build reliable web scrapers and robots, fast!