Crawl4AI Cloud
๐โ๏ธ Crawl4AI Cloud: LLM Friendly Web Crawling as a Service. Don't be shy, join here: https://discord.gg/jP8KfhDhyN
README
Crawl4AI Cloud
Hey, Beautiful People!
This is Uncle Code.
You know Crawl4AI. We built it together โ you, me, and this incredible community. It became the de facto standard for self-hosting โ the most-starred web crawler on GitHub. Battle-tested by developers worldwide. I am so proud of us.
We built it because access to data must be democratized. That principle hasn't changed.
Now I'm bringing it to the cloud.
Why Cloud?
Same principles. Same policies. But now:
- More accessible โ No browser setup, no Playwright headaches, no infrastructure to manage
- More affordable โ Serious crawls without breaking the bank
- Faster and smarter โ Not by cutting quality, but through intelligent creativity
The API you love, zero setup:
from crawl4ai_cloud import AsyncWebCrawler
async with AsyncWebCrawler(api_key="sk_live_...") as crawler:
result = await crawler.run("https://example.com")
print(result.markdown.raw_markdown)
That's it. Your existing Crawl4AI code works with minimal changes. See the SDK Documentation for Python, Node.js, and Go.
We Need You (Again)
Here's the truth: Crawl4AI open source became so solid because you complained loudly โ and I love that.
We need to do the same thing here.
This is version one. It will have issues. It will have bugs. The whole server might crash during the first week. But we love it. We're going to continue building every day.
I am a developer, and I love to build.
How to Help
| Action | Link |
|---|---|
| Report a Bug | Open an Issue |
| Request a Feature | Open an Issue |
| Ask Questions | Join Discord |
| Share Feedback | Join Discord |
Every bug report, every feature request, every piece of feedback โ it all makes this better.
Get Started
1. Join the Beta
Sign up for early access, get your API key (sk_live_...), and start crawling.
2. Install the SDK
# Python
pip install crawl4ai-cloud-sdk
# Node.js
npm install crawl4ai-cloud
# Go
go get github.com/unclecode/crawl4ai-cloud-sdk/go
3. Crawl
from crawl4ai_cloud import AsyncWebCrawler
async with AsyncWebCrawler(api_key="sk_live_...") as crawler:
result = await crawler.run("https://example.com")
print(result.markdown.raw_markdown)
Full SDK documentation: SDK.md
The Vision
Crawling is just the beginning.
I've always had an eye for context and refined data โ to make intelligence truly useful. Whether you're building an app, an agent, or something to help humanity, I hope Crawl4AI Cloud can be a part of it.
Let's build the next de facto standard โ this time for the cloud.
Resources
| Resource | Link |
|---|---|
| Cloud Dashboard | api.crawl4ai.com |
| SDK Documentation | SDK.md |
| API Reference | api.crawl4ai.com/docs |
| OSS Repository | github.com/unclecode/crawl4ai |
| Full Documentation | docs.crawl4ai.com |
Community
License
Apache 2.0
