Web scraping

Discussion(27)

I use Olostep to gather data from millions of e-commerce pages for my AI shopping assistant service and it's the most cost-effective and reliable product on the market

104 Reply Share Delete Report

📊 Web scraping

This is one of the best scrapers I have ever seen, especially considering that Cloudflare explicitly advises against scraping their pages. What makes this scraper stand out is that it opens a virtual machine and runs an agent on top of it, which allows it to bypass bot detection errors effectively. This advanced approach enables it to grab the text content reliably, even from websites with strong anti-scraping measures. By simulating a real user environment, it avoids common blocks and restrictions.

5 Reply Share Delete Report

📊 Web scraping

AVOID AT ALL COSTS. Amateur hour if I ever saw it: they change their entire API endpoints on a whim on the SAME VERSION, breaking all of the work you've done to integrate with them (thousands of $), then tell you you're not an $5k / month Enterprise customer and they don't really support their self serve product so...tough luck buddy. I was one of their first customers and have been using them for over a year and a half only to wake up one day to customer complaints because our integration had broken and be told they basically don't care about. After I reached out to their team, it became clear that they had simply changed their entire API from one day to the next on the same version, with no notice and a documentation that doesn't reflect the changes they made. Literally everything is broken in one way or another: the UI fails to save changes every other try, the API has three different versions in use at the same time, some endpoints use v3 others use v4, similar payload responses don't even reply with the same structure for the data, the documentation is completely out of sync with the actual endpoints, the webhooks trigger 3 times in a row and on and on and on... Somehow they have several engineers, yet no-one there actually knows how to fix your problem. I've been a customer for over a year and a half and after breaking my entire integration, they just told me to go take my business elsewhere because they couldn't support their OWN breaking changes! Oh and by the way, it took a week of back and forth and trying to fix my integration and work with their broken documentation to tell me this. Total insanity. I couldn't ever imagine being an Enterprise customer with these people, their whole product is built on a shoestring and they have absolutely no respect whatsoever for their customers.

1 Reply Share Delete Report

📊 Web scraping

Kevin Spencer

4mo ago

I am looking for a web scrapper that can be used to download positive/good news and send them to me

Reply Share Delete Report

📊 Web scraping

Still working great as of 12/9/24

4 Reply Share Delete Report

📊 Web scraping

Super helpful with scraping for leads- intuitive setup!

4 Reply Share Delete Report

📊 Web scraping

Working great as of 30/11/2024. Let me tell you why I'm so happy about this, because I was desperate: - Firecrawl.dev? Inconsistent API documentation. Apify scrapers? Couldn't work on my target URL. - I spent $150 over 4-5 OTHER tools before finding this one, which is free to use locally right now. Wow. I'm dumb. - My target URL was a broken site, with 500 javascript errors, content violations, bad cookies, etc. - Not a single scraper worked that I tried, except for this one. So yeah, I'd say I'm pretty happy

155 Reply Share Delete Report

📊 Web scraping

1577080

1y ago

@Octoparse

If you want to scrape data without code, I would say Octoparse is the best choice! The most surprising thing of Octoparse is that they have crawler templates of all the popular website around the world, I don't even have to waste time learning and I can get what I want in minutes. Great software! Try it and you will never regret.

Reply Share Delete Report

📊 Web scraping

I've been using Octoparse for a few months now, and I must say, it has exceeded my expectations. As someone with limited coding knowledge, I was initially hesitant to try web scraping. However, Octoparse made the process incredibly easy with its intuitive interface and powerful features. I've been able to extract data from multiple websites without any hassle, and the automation capabilities have saved me a ton of time. The customer support team has also been incredibly helpful whenever I've had questions or encountered issues. Overall, I highly recommend Octoparse to anyone looking for a reliable and user-friendly web scraping tool. Another notable aspect of Octoparse is its versatility, catering to both beginners and advanced users alike. Its pre-built templates and workflows streamline the scraping process, while advanced users can leverage its customization options for more complex scraping tasks. Additionally, Octoparse offers scheduling and automation features, allowing users to automate repetitive scraping tasks and save time.

51 Reply Share Delete Report

📊 Web scraping

Solaya Ma

1y ago

@Simplescraper

Easy to use and the crawler is super powerful

Reply Share Delete Report

📊 Web scraping

Marshall Evans

1y ago

@WebscrapeAi

No pagination. Nothing really programatic. Throws errors. Billing email never came so I don't know how to cancel.

Reply Share Delete Report

📊 Web scraping

Shankar Venkataraman

1y ago

@GetOData

The contact email address provided for refunds is not valid. This could be a scam.

Reply Share Delete Report

Hi, I am the founder of the website and the email address is working correctly. Also, you can contact me on Twitter, @Swapbuilds if you get any issues. I am pretty active on social, so not creating any scamy stuff! 😅😁 I saw this now so just wanna share it.

1 Reply Share Delete Report

📊 Web scraping