The service's listing describes it this way: Use when an agent is about to crawl, train on or ingest a website into RAG: checks the domain's AI consent and licensing signals (robots.txt per AI bot, RSL license, IETF AIPREF, TDMRep, noai meta tags, llms.txt, C2PA), returns a 0-100 score and a training stance, and a signed EAS receipt anchored on Base proving what was checked and when. Errors: 400 invalid domain; 502 site unreachable (not charged). Website
A service is a tool an AI agent pays to call. CrawlWitness is listed on this page under Web scraping / crawling, settling on Base and Solana, through x402. 30-day settled volume on this page is $0.09. The listing comes from the service catalog. Open a row for payments, payers, and chains. See Bazaar, agent payment use cases, and the methodology.
FacilitatorsCoinbase
Payee
- 0xa20f…a5c5Base
- DEuats…FFrdSolana
Methodology · settled volume through 2026-11-02 · catalog Nov 2, 2026, 7:02 PM UTC
| Metric | 24h | 7d | 30d |
|---|---|---|---|
| Volume | $0.03 | $0.09 | $0.09 |
| Payments | 5 | 18 | 18 |
| Payers | 1 | 4 | 4 |
| Avg payment | $0.0064 | $0.0051 | $0.0051 |
| Share of Web scraping / crawling | 0.1% | 0.0% | 0.0% |
| Use-case rank | #17 | #37 | #61 |
Payers can be counted more than once when they paid through more than one facilitator.
Settled volume
$0.09
Weekly change from Nov 7
Payments
18
7d
Payers
4
7d
Avg payment
$0.0051
volume / payments
Daily settled volume for CrawlWitness
Data through Nov 2, 2026. Source: public settlement logs. Methodology
| Time | Daily settled volume for CrawlWitness |
|---|---|
| 2026-10-31 | $0.06 |
| 2026-11-01 | $0.00 |
| 2026-11-02 | $0.03 |
Payers
Daily buyers for CrawlWitness
| Time | Daily buyers for CrawlWitness |
|---|---|
| 2026-10-31 | 8 |
| 2026-11-01 | 3 |
| 2026-11-02 | 1 |
Buyer concentration
96.7%
Top payer's share of lifetime volume. Not the period selected above.
Repeat buyers
25.0%
Lifetime buyers with more than one payment, divided by all buyers.
Endpoints and prices
Price, network, and asset come from the x402 Bazaar catalog.
| Endpoint | Network | Asset | Price | Scheme |
|---|---|---|---|---|
| https://api.crawlwitness.com/v1/can-use Use when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) from robots.txt, IETF AIPREF, TDMRep, noai and RSL licenses, with a signed receipt. Errors: 400 invalid domain or unknown | base | USDC | $0.001 | exact |
| https://api.crawlwitness.com/v1/can-use Use when a crawler, scraper or RAG pipeline must decide whether it may use a website for AI: yes/no verdict for a domain, AI bot and use (train, rag, search) from robots.txt, IETF AIPREF, TDMRep, noai and RSL licenses, with a signed receipt. Errors: 400 invalid domain or unknown | solana | USDC | $0.002 | exact |
| https://api.crawlwitness.com/v1/senales Use when an agent is about to crawl, train on or ingest a website into RAG: checks the domain's AI consent and licensing signals (robots.txt per AI bot, RSL license, IETF AIPREF, TDMRep, noai meta tags, llms.txt, C2PA), returns a 0-100 score and a training stance, and a signed EA | base | USDC | $0.005 | exact |
| https://api.crawlwitness.com/v1/senales Use when an agent is about to crawl, train on or ingest a website into RAG: checks the domain's AI consent and licensing signals (robots.txt per AI bot, RSL license, IETF AIPREF, TDMRep, noai meta tags, llms.txt, C2PA), returns a 0-100 score and a training stance, and a signed EA | solana | USDC | $0.005 | exact |
| https://api.crawlwitness.com/v1/batch Use when a crawler or dataset builder needs AI-consent verdicts for many domains at once: yes/no per domain for one AI bot and use (train, rag, search), up to 100 domains per payment, with one signed receipt for the whole batch. Errors: 400 invalid input (not charged); 503 if too | base | USDC | $0.001 | upto |
| https://api.crawlwitness.com/v1/batch Use when a crawler or dataset builder needs AI-consent verdicts for many domains at once: yes/no per domain for one AI bot and use (train, rag, search), up to 100 domains per payment, with one signed receipt for the whole batch. Errors: 400 invalid input (not charged); 503 if too | solana | USDC | $0.02 | exact |
| https://api.crawlwitness.com/v1/wallet-check Use when an AI agent or treasury is about to pay, receive from or interact with a crypto wallet: checks the address against the US OFAC SDN sanctions list (all its digital-currency addresses: ETH/EVM, BTC, TRX, SOL, USDT, USDC…) and returns sanctioned true/false, the listed entit | base | USDC | $0.005 | exact |
| https://api.crawlwitness.com/v1/wallet-check Use when an AI agent or treasury is about to pay, receive from or interact with a crypto wallet: checks the address against the US OFAC SDN sanctions list (all its digital-currency addresses: ETH/EVM, BTC, TRX, SOL, USDT, USDC…) and returns sanctioned true/false, the listed entit | solana | USDC | $0.005 | exact |
Payment processors used
| Processor | Volume | Tx | Share |
|---|---|---|---|
| Coinbasex402 | $0.09 | 18 | 100.0% |
Other services in Web scraping / crawling
All in this use case- Apify#1 · $754.09 30d
- StableSocial#2 · $210.96 30d
- ReadEdge#3 · $46.81 30d
- Agent Web-Access#4 · $24.72 30d
- SCRIPTMASTERLABS#5 · $20.06 30d
How we count CrawlWitness
We read settlements directly from each chain's public records and refresh them every few minutes.
Data through 2026-11-02. Source: public settlement logs.
Cite this
APA
Agent GDP. (2026). CrawlWitness [Data set]. Retrieved November 2, 2026, from https://agentgdp.io/service/api.crawlwitness.com.
MLA
"CrawlWitness." Agent GDP, 2 Nov. 2026, https://agentgdp.io/service/api.crawlwitness.com.
BibTeX
@misc{agentgdp_crawlwitness_2026,
author = {{Agent GDP}},
title = {CrawlWitness},
year = {2026},
url = {https://agentgdp.io/service/api.crawlwitness.com},
note = {Retrieved November 2, 2026. Data through 2026-11-02. Licensed under CC BY 4.0.},
license = {https://creativecommons.org/licenses/by/4.0/}
}Plain text
CrawlWitness: $0.09 settled volume (7d), 18 payments, 4 buyers. Agent GDP, data through 2026-11-02. https://agentgdp.io/service/api.crawlwitness.com Retrieved November 2, 2026.
Data from Agent GDP (https://agentgdp.io/service/api.crawlwitness.com), licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/).
Payers on a day can be counted more than once if they paid through more than one facilitator. Weekly change compares the last 7 full days with the 7 days before, once both weeks are fully covered on this service's networks; other periods compare with the previous period of the same length. The page link uses the service's site when we have one, and the payee address otherwise.
Volume and payment counts include earlier days. Transaction-level detail available from arc from October 26, 2026, base from October 23, 2026, polygon from October 27, 2026, solana from April 12, 2026, tempo from June 22, 2026.
Get your badge
Paste this on your site. It says Indexed by Agent GDP, with this name, and it links back to this page.
Source: agentgdp.io · Beta
HTML
<a href="https://agentgdp.io/service/api.crawlwitness.com?utm_source=badge"><img src="https://agentgdp.io/badge/service/api.crawlwitness.com.svg" alt="CrawlWitness · Indexed by Agent GDP" /></a>
Get API access Higher limits cover the same figures. Full history, saved views, and morning alerts are on Pro.
Something wrong on this page? Report a correction