Crawlbase
Crawlbase scores 90/100 on xpay's Agent-Ready Index v2: partial pricing visibility; self-serve checkout is available; a public API exists with documentation; usage-based / per-token pricing is published; a free entry path exists.
Crawlbase — 4 products
4 SKUs priced per requests
| Model / SKU | Input | Output |
|---|---|---|
Standard Price for 0‑1k requests; volume discounts apply | $3 / 1K requests | — |
Moderate Price for 0‑1k moderate requests; volume discounts apply | $4.5 / 1K requests | — |
Complex Price for 0‑1k complex requests; volume discounts apply | $6 / 1K requests | — |
$15 / 1K requests | — |
How Crawlbase scores on the agent-ready dimensions
Public pricing visibility
15 / 15
Self-serve checkout
15 / 15
Public API + docs
16 / 20
Usage-based / metered pricing
20 / 20
Free entry path
7 / 7
No sales call required
7 / 7
Card / wallet / x402 payment
5 / 6
Machine-readable bonus (MCP / OpenAPI)
5 / 10
Total
90 / 100
What it actually costs at typical scale
1,000 Standard requests
$3/mo
10,000 Standard requests
$21/mo
Can an autonomous agent transact here?
Can create account
Can enter payment method
Can upgrade plan
Can buy more usage
Can cancel online
Payment methods
Human approval recommended
Pricing transparency
full
Purchase motion
self_serve
Demo required
Quote required
Annual commit required
Auto-renewal mentioned
Cancellation policy visible
Refund policy visible
Invoice payment available
Purchase orders supported
MSA required
DPA available
Security review required
Trial
Available, no card
API & developer surface
API-first product
Sandbox present
Webhooks
MCP mentioned
Positioning & ecosystem
“Built for Developers 👨🏼💻, Priced for Growth”
Buyer persona
Six-step check: can an agent actually buy from Crawlbase?
Discover price
https://crawlbase.com/pricing — explicit per-1k-request table by tierSelect a plan
Standard/Moderate/Complex/Complex II + Smart Proxy + Cloud Storage all distinguishablePay per task
True PAYG, billed per 1,000 successful requestsAvoid a sales call
Calculator + dashboard self-serve for every productAPI docs without auth
https://crawlbase.com/docs — publicEstimate cost upfront
Pricing calculator returns per-domain per-volume cost in real timePros and cons for AI agents
Observational summary written by xpay from the signals captured on 2026-05-03. Not a review of the product — only of its current pricing posture for agent buyers.- Pricing is publicly visible on an indexable page — agents can read tiers without scraping past auth.
- Per-unit billing is published, so an agent can budget for a single task before committing.
- API documentation is reachable without a login — discovery and integration can happen in one session.
- Per-unit rate is concrete enough that an agent can model expected spend before issuing a request.
- A free tier exists, lowering the bar for an agent builder to prototype before committing budget.
- Some tiers are sales-led; the highest-capacity surfaces are not self-serve.
- PPU requires account creation and an issued API key; a fully unauthenticated agent purchase is not yet supported.
- No /.well-known/ai-pricing.json or equivalent machine-readable pricing manifest is published — agents must rely on HTML scraping.
How Crawlbase could lift its score
Add a per-unit price (e.g. $X / 1K calls) to the pricing page so an agent can compute its own cost before committing.
| pricing_visible | true |
| headline_phrasing | Built for Developers 👨🏼💻, Priced for Growth — ✨ Meet Crawlbase Web MCP: Feed LLMs real-time web data — no blocks, no CAPTCHAs. |
| tier_count | 0 |
| lowest_paid_entry_usd | 0 |
| free_tier | true |
| free_tier_terms | null |
| per_unit_price | null |
| annual_required | true |
| self_serve_paid_tiers | 1 |
| sales_only_tiers | 0 |
| public_api_docs_url | https://crawlbase.com/docs |
| api_docs_auth_walled | false |
| ai_pricing_json_present | false |
| agents_txt_present | false |
| anonymous_purchase_path | false |
| per_unit_classification | null |
| usage_headline_present | false |
| custom_tier_present | true |
| agent_friendly | {"ai_pricing_json":false,"agents_txt":false,"llms_txt":true,"sitemap_xml":true,"mcp_server_card":false,"agent_skills_index":false,"x402_supported":false} |
View raw extracted page text →
Claim this scorecard & lift your score.
Get the breakdown of every signal we measured, the one-line fix, and how your peers in Data Scraping APIs stack up.
Compare the agent-ready picks in Data Scraping APIs.
If you're building or running an AI agent that needs to buy from this category, see who's scoring highest right now.
See agent-ready picksCrawlbase
90
/ 100 (rubric v2.0)Data Scraping APIs
Not advertised
0
Yes
Free
1 / 0
Public
No
Not published
2026-05-10
Multi-product subscription
Crawlbase pricing starts at $0/mo for the Free Trial of Smart AI Proxy; pay-as-you-go rates begin at $3 per 1,000 Standard requests, $4.50 per 1,000 Moderate requests, and $6 per 1,000 Complex requests. Billed monthly.
Free Trial (Free)
Discovery files and protocols
Side-channel signals — informational, not part of the score. Each protocol is independent; adoption signals the publisher is thinking about agent buyers.ai-pricing.json
agents.txt
llms.txt
sitemap.xml
MCP Server Card
Agent Skills
x402 / MPP
Compare Crawlbase with peers
Highest-scoring companies in the same category that an AI agent might evaluate as an alternative.Scrapfly
92
Apify
84
Diffbot
78
Firecrawl
78
ScrapingBee
61
ScraperAPI
61
Browserless
60
Zyte
14
Explore the Agent-Ready SaaS Index
25,480+ SaaS scored on agent-buyability — browse by readiness band, category, or jump straight to a pay-per-run tool on xpay.tools.