Crawlify
AI powered data extraction APIs. Hassle-free data retrieval.
Start new thread
Sandra Ionescu

Crawlify - AI powered data extraction APIs. Hassle-free data retrieval.

by•
Put your web data extraction on autopilot with AI technology that retrieves clean, structured data accessible via API. No coding, selectors or any manual input needed.

Add a comment

Replies

Best
Lena Arnaud
I believe there is Diffbot that also offers similar APIs. Curious to know any differences. Thanks.
Wayne Smallman
Hi @lenaarnaud, Diffbot appear to have more products, and Extraction is of particular interest to me.
Sandra Ionescu
Hunter
Hello hunters! At scale, websites change and crawlers break daily. Maintaining them is time consuming and painful. Crawlify is on a mission to help companies of all sizes automate their data extraction at scale. To achieve this, the platform fuses machine learning with natural language processing to retrieve clean, structured data without the need for manual rules or site-specific training. You can try it for yourself on our website. The current APIs are: 1. The Product API [Released] - it automatically extracts product data from any e-commerce page. 2. The Real Estate API [closed beta] - it automatically extracts data from real estate listings with other data points like crime & safety statistics, monitoring foreclosure/auctions listings, or urban planning and construction permits. 3. The Job Page API [close beta] extracts clean job listing data from any board. 4. The Article API (released) - enables the extraction of articles data from pages without an RSS feed.
Jeremy Crisp
@sandra_ionescu please confirm if this is still a live project or not, thanks!
Daniela Quiroz
Tried it out on several e-commerce websites from different countries. The results are accurate so far. It would be really handy for affiliate websites if you could provide an embed widget for any product to display details like price and title.
Sanda Gorcea
@daniela_quiroz I second that. I have a small review website in my native language and no affiliate pluginsare available for my country.
Sandra Ionescu
Hunter
@daniela_quiroz Thank you for your feedback! We plan to develop integrations with shopify and woocomerce in the next weeks.
Damien Tress
Did a few smoke tests using the Product API. Satisfied of the results so far. What load and concurrency the endpoint would reasonably handle? We have an use case in which we need to get pricing data across multiple e-commerce websites in a very short time frame.
Sandra Ionescu
Hunter
@damien_tress We use Google Cloud Run to handle requests using a serverless architecture. We scale automatically up and down depending on load. Therefore, we can handle any enterprise use case. We can set up up a custom trial account so you can test our API at the scale you need.
Conor Clarke
Looks really good, will try out the free version first! Left a few thoughts here too as I was looking through your landing page incase its helpful - https://app.usebubbles.com/45da6...
Sandra Ionescu
Hunter
@conor_clarke1 I can't access the link, can you please share it again? We are aware that our landing page needs some improvements :d therefore we are curious and thankful for your thoughts. Looking forward to read them
Olivia Belgea
Is there a demo available for the Jobs API?
Sandra Ionescu
Hunter
@olivia_belgea We can set that up for you. Please schedule a meeeting with us on our website. Thanks!
Matheo Noel
Found this on Reddit. I am working with a non profit to monitor used books bulk sales on several websites. I like the results I see so far. I've tried several other providers but they were a bit cost prohibitive. Do you think you can offer some free credits to power this use case?
Sandra Ionescu
Hunter
@matheo_noel Sure thing! Get in touch and we will set it up
Emmanuel Kaska
Curious if its possible to use this to extract data from social media sites like linkedin & instagram. Interested in analyzing hashtags & groups.
Sandra Ionescu
Hunter
@emmanuel_kaska We already have a few clients extracting data from the platforms you mentioned. Reach out on our website and we will talk specifics.
Jeremy Crisp
Is this project (Crawlify.II) still live or has it been discontinued? Please can someone confirm as I had initial conversations not long after this PH launch but now I want to use them, no one’s answering anymore. Thanks 🙏🏼
Barnea Florin
Played around with the demo on the website and it looks really good. Can't wait for the real estate API.
Sandra Ionescu
Hunter
@barnea_florin Thanks for the feedback. The real estate API is currently in beta, we plan to launch it to the public next month. Please subscribe on our website to get notified when we do so.
12
Next
Last