PennyAPI Robots Permission Check
The service's listing describes it this way: Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live provenance. Website
A service is a tool an AI agent pays to call. PennyAPI Robots Permission Check is listed on this page under Web scraping / crawling, settling on Base, through x402. 30-day settled volume on this page is $0.00. The listing comes from the service catalog. Open a row for payments, payers, and chains. See Bazaar, agent payment use cases, and the methodology.
FacilitatorsCoinbase
Payee
- 0x5dea…ef0aBase
Methodology · settled volume through 2026-10-25 · catalog Oct 25, 2026, 5:39 AM UTC
| Metric | 24h | 7d | 30d |
|---|---|---|---|
| Volume | $0.00 | $0.00 | $0.00 |
| Payments | 0 | 1 | 1 |
| Payers | 0 | 1 | 1 |
| Avg payment | $0.00 | $0.001 | $0.001 |
| Share of Web scraping / crawling | — | 0.0% | 0.0% |
| Use-case rank | — | #41 | #41 |
Payers can be counted more than once when they paid through more than one facilitator.
Settled volume
$0.00
New
Payments
1
7d
Payers
1
7d
Avg payment
$0.001
volume / payments
Daily settled volume for PennyAPI Robots Permission Check
Data through Oct 25, 2026. Source: public settlement logs. Methodology
| Time | Daily settled volume for PennyAPI Robots Permission Check |
|---|---|
| 2026-10-23 | $0.00 |
| 2026-10-24 | $0.00 |
| 2026-10-25 | $0.00 |
Payers
Daily buyers for PennyAPI Robots Permission Check
| Time | Daily buyers for PennyAPI Robots Permission Check |
|---|---|
| 2026-10-23 | 1 |
Buyer concentration
100.0%
Top payer's share of lifetime volume. Not the period selected above.
Repeat buyers
0.0%
Lifetime buyers with more than one payment, divided by all buyers.
Endpoints and prices
Price, network, and asset come from the x402 Bazaar catalog.
| Endpoint | Network | Asset | Price | Scheme |
|---|---|---|---|---|
| https://pennyregwatch.com/v1/robots Check robots.txt before crawling or scraping a page. Decide whether GPTBot, ClaudeBot, Googlebot, or another crawler may fetch the exact URL and return ALLOW/DENY, winning rule, crawl-delay, sitemap URLs, and live provenance. | base | USDC | $0.001 | exact |
| https://pennyregwatch.com/v1/headers Inspect HTTP response headers before an agent trusts or integrates a URL: content type, cache controls, CORS, HSTS, CSP, framing, referrer, permissions policy, server, ETag, and last-modified. | base | USDC | $0.001 | exact |
| https://pennyregwatch.com/v1/redirect Resolve a URL redirect chain before an agent follows a link. Return the final URL, HTTP status, redirect count, and chain for URL verification and safe navigation. | base | USDC | $0.001 | exact |
| https://pennyregwatch.com/v1/search Real-time web search for AI agents. Search the web for current and up-to-date information, news, facts, research, documentation, and sources beyond model training data. Returns ranked structured JSON results with title, URL, description, and position for web grounding, RAG retrie | base | USDC | $0.004 | exact |
| https://pennyregwatch.com/v1/x402/preflight Preflight an unfamiliar x402 paid API before spending. Validate the live 402 payment challenge, network, USDC asset, amount, payTo recipient, TLS, redirects, manifest presence, latency, and provenance. Returns deterministic GO/REVIEW/STOP and never signs or sends payment to the i | base | USDC | $0.001 | exact |
| https://pennyregwatch.com/v1/metadata Extract webpage metadata for agent research and URL triage: title, description, canonical URL, Open Graph, and Twitter metadata from a public page. | base | USDC | $0.001 | exact |
| https://pennyregwatch.com/web/places Real-time local business and places search for AI agents. Find restaurants, coffee shops, stores, services, and nearby businesses with structured names, addresses, coordinates, ratings, categories, phone numbers, and websites where available. Send query, optional num, country, an | base | USDC | $0.004 | exact |
Facilitators used
| Facilitator | Volume | Tx | Share |
|---|---|---|---|
| Coinbasex402 | $0.00 | 1 | 100.0% |
Other services in Web scraping / crawling
All in this use case- Apify#1 · $79.71 30d
- StableSocial#2 · $8.40 30d
- SCRIPTMASTERLABS#3 · $6.83 30d
- Horizon Pulse#4 · $6.02 30d
- api.clawfetch.ai#5 · $1.74 30d
Cite this
APA
Agent GDP. (2026). PennyAPI Robots Permission Check [Data set]. Retrieved October 25, 2026, from https://agentgdp.io/service/pennyregwatch.com.
MLA
"PennyAPI Robots Permission Check." Agent GDP, 25 Oct. 2026, https://agentgdp.io/service/pennyregwatch.com.
BibTeX
@misc{agentgdp_pennyapi_robots_permission_check_2026,
author = {{Agent GDP}},
title = {PennyAPI Robots Permission Check},
year = {2026},
url = {https://agentgdp.io/service/pennyregwatch.com},
note = {Retrieved October 25, 2026. Data through 2026-10-25. Licensed under CC BY 4.0.},
license = {https://creativecommons.org/licenses/by/4.0/}
}Plain text
PennyAPI Robots Permission Check: $0.00 settled volume (7d), 1 payments, 1 buyers. Agent GDP, data through 2026-10-25. https://agentgdp.io/service/pennyregwatch.com Retrieved October 25, 2026.
Data from Agent GDP (https://agentgdp.io/service/pennyregwatch.com), licensed under CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/).
Payers on a day can be counted more than once if they paid through more than one facilitator. Growth compares this period with the previous period of the same length. The page link uses the service's site when we have one, and the payee address otherwise.