Web scraping

Specialized tools 41

GPTWebScraper

Your guide for efficient web scraping.

Share

Released 2y ago
100% Free

691
14
82
Web Scraper API

Transforming URLs into structured source code.

Share

Released 2y ago
100% Free

684
9
134
Web Researcher - WebWorker v2

Stunspot's trusty Webhound.

Share

Released 2y ago
100% Free

648
10
750
WebScraper

Friendly and efficient web data extractor.

Share

Released 2y ago
100% Free

615
11
354
AgentQL

AI-powered web scraping and automation made simple.

262 www.agentql.com

Share

Released 1y ago
Free + from $99/mo

850
12
Agenty

AI-powered web scraping in 30 seconds

205 agenty.com

Share

Released 2y ago
Free + from $29/mo

791
14
2.0
Hystruct

AI-powered web scraping made easy

Share

Released 1y ago
Free + from $49/mo

569
25
Web Sacraping API

Inferring user needs for web data extraction.

Share

Released 2y ago
100% Free

540
11
3.0
20
Hexomatic

Web scraping and workflow automation made easy

81 hexomatic.com

Share

🇺🇸 United States

Released 4y ago
From $40.83/mo

621
11
WebPilot GPT

Read and Scrape Websites and Gather Data

Share

Released 2y ago
100% Free

448
8
1.0
202
Specification

Investigates specifications from the web and provides answers.

Share

Released 2y ago
100% Free

389
9
32
Reworkd AI

Effortless web scraping at scale.

Share

Released 2y ago
Free + from $99/mo

374
6
Site Harvester

Harvests data from websites into specific formats.

Share

Released 2y ago
100% Free

349
10
Python Scriptsmith

Friendly expert in Python web scraping scripts.

Share

Released 2y ago
100% Free

315
4
42
Chatbot for any site

Domain-specific content scanner and responder.

Share

Released 2y ago
100% Free

313
4
46
IntunedHQ

AI-powered browser automation for reliable web scraping.

210 intunedhq.com

Share

Released 2y ago
Free + from $150/mo

514
3
URL

Providing Chinese URL analysis and reviews.

Share

Released 2y ago
100% Free

287
4
33

Prev 1 2

Related Tasks✕

Data extraction92 0

Web browsing36 0

Document data extraction24 0

Ethical webscraping2 0

Website crawling2 0

Maps data scraping1 0

Financial data extraction1 0

Php script automation1 0

Image data extraction1 0

Discussion(27)

📊 Web scraping

I use Olostep to gather data from millions of e-commerce pages for my AI shopping assistant service and it's the most cost-effective and reliable product on the market

114 Reply Share Delete Report

📊 Web scraping

This is one of the best scrapers I have ever seen, especially considering that Cloudflare explicitly advises against scraping their pages. What makes this scraper stand out is that it opens a virtual machine and runs an agent on top of it, which allows it to bypass bot detection errors effectively. This advanced approach enables it to grab the text content reliably, even from websites with strong anti-scraping measures. By simulating a real user environment, it avoids common blocks and restrictions.

5 Reply Share Delete Report

📊 Web scraping

AVOID AT ALL COSTS. Amateur hour if I ever saw it: they change their entire API endpoints on a whim on the SAME VERSION, breaking all of the work you've done to integrate with them (thousands of $), then tell you you're not an $5k / month Enterprise customer and they don't really support their self serve product so...tough luck buddy. I was one of their first customers and have been using them for over a year and a half only to wake up one day to customer complaints because our integration had broken and be told they basically don't care about. After I reached out to their team, it became clear that they had simply changed their entire API from one day to the next on the same version, with no notice and a documentation that doesn't reflect the changes they made. Literally everything is broken in one way or another: the UI fails to save changes every other try, the API has three different versions in use at the same time, some endpoints use v3 others use v4, similar payload responses don't even reply with the same structure for the data, the documentation is completely out of sync with the actual endpoints, the webhooks trigger 3 times in a row and on and on and on... Somehow they have several engineers, yet no-one there actually knows how to fix your problem. I've been a customer for over a year and a half and after breaking my entire integration, they just told me to go take my business elsewhere because they couldn't support their OWN breaking changes! Oh and by the way, it took a week of back and forth and trying to fix my integration and work with their broken documentation to tell me this. Total insanity. I couldn't ever imagine being an Enterprise customer with these people, their whole product is built on a shoestring and they have absolutely no respect whatsoever for their customers.

41 Reply Share Delete Report

📊 Web scraping

Kevin Spencer

5mo ago

I am looking for a web scrapper that can be used to download positive/good news and send them to me

Reply Share Delete Report

📊 Web scraping

Still working great as of 12/9/24

4 Reply Share Delete Report

📊 Web scraping

Super helpful with scraping for leads- intuitive setup!

4 Reply Share Delete Report

📊 Web scraping

Working great as of 30/11/2024. Let me tell you why I'm so happy about this, because I was desperate: - Firecrawl.dev? Inconsistent API documentation. Apify scrapers? Couldn't work on my target URL. - I spent $150 over 4-5 OTHER tools before finding this one, which is free to use locally right now. Wow. I'm dumb. - My target URL was a broken site, with 500 javascript errors, content violations, bad cookies, etc. - Not a single scraper worked that I tried, except for this one. So yeah, I'd say I'm pretty happy

156 Reply Share Delete Report

📊 Web scraping

1577080

1y ago

@Octoparse

If you want to scrape data without code, I would say Octoparse is the best choice! The most surprising thing of Octoparse is that they have crawler templates of all the popular website around the world, I don't even have to waste time learning and I can get what I want in minutes. Great software! Try it and you will never regret.

Reply Share Delete Report

📊 Web scraping

I've been using Octoparse for a few months now, and I must say, it has exceeded my expectations. As someone with limited coding knowledge, I was initially hesitant to try web scraping. However, Octoparse made the process incredibly easy with its intuitive interface and powerful features. I've been able to extract data from multiple websites without any hassle, and the automation capabilities have saved me a ton of time. The customer support team has also been incredibly helpful whenever I've had questions or encountered issues. Overall, I highly recommend Octoparse to anyone looking for a reliable and user-friendly web scraping tool. Another notable aspect of Octoparse is its versatility, catering to both beginners and advanced users alike. Its pre-built templates and workflows streamline the scraping process, while advanced users can leverage its customization options for more complex scraping tasks. Additionally, Octoparse offers scheduling and automation features, allowing users to automate repetitive scraping tasks and save time.

51 Reply Share Delete Report

📊 Web scraping

Solaya Ma

1y ago

@Simplescraper

Easy to use and the crawler is super powerful

Reply Share Delete Report

📊 Web scraping

Marshall Evans

1y ago

@WebscrapeAi

No pagination. Nothing really programatic. Throws errors. Billing email never came so I don't know how to cancel.

Reply Share Delete Report

📊 Web scraping

Shankar Venkataraman

2y ago

@GetOData

The contact email address provided for refunds is not valid. This could be a scam.

Reply Share Delete Report

Hi, I am the founder of the website and the email address is working correctly. Also, you can contact me on Twitter, @Swapbuilds if you get any issues. I am pretty active on social, so not creating any scamy stuff! 😅😁 I saw this now so just wanna share it.

1 Reply Share Delete Report

📊 Web scraping