Are you using webscraping?

Fabian Maume
5 replies
There are plenty of actionable data out there on the internet. You can access them by using webscraping. I build my own saas using webscraping QApop, and I'm currently hunting a library to help out with webscraping development: Crawlee

Replies

Jefry Pozo
I'm currently developing a mobile application for which I will need to scrape data from some sites to notify users about deals and price changes.
Jefry Pozo
@fabian_maume of course. The mobile app will connect to an API in a server which will do the scraping
Fabian Maume
@jefrypozo1 Interesting. Are you running the scraping server side? Scraping from mobile phone would be expensive with data.
Alex Robinson
We couldn't find a tool to help us scrape blog posts, we ended up having to create our own. We needed to be able to parse any blog and find the author, published date, and article text. We use it to automatically generate videos from blogs, you can checkout it out at vidon.ai.