Crawlab is a Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java and various web crawler frameworks including Scrapy, Puppeteer, Selenium. It currently has 6k+ stars on Github.
Recent launches
Crawlab
Crawlab is a Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java and various web crawler frameworks including Scrapy, Puppeteer, Selenium. It currently has 6k+ stars on Github.
