Public Web Page to Markdown
Fetch a public HTTP(S) page with private-network blocking, remove boilerplate tags, and return bounded Markdown-like text.
Preview request
The preview path is rate-limited and does not charge. Production requests use the same parameters and return a standard x402 challenge when no payment signature is present.
curl --request POST \
"https://ai-data-marketplace-1042299154756.us-central1.run.app/api/v1/scrape_md?preview=true" \
--header "content-type: application/json" \
--data '{"url":"https://example.com/article/tech-news"}'Input contract
| Parameter | Type | Required | Description |
|---|---|---|---|
url | string | Yes | The target URL to scrape. |
timeout_ms | integer | No | Request timeout in milliseconds. |
Guaranteed response metadata
Every successful product response identifies how the result was produced. Product-specific output fields are documented in the paid OpenAPI contract and can be inspected through the preview request where available.
{
"marketplace_metadata": {
"data_mode": "live_source",
"billable": true,
"availability": "operational",
"source": "live public web fetch"
}
}Agent payment flow
Request the product, read the base64 PAYMENT-REQUIRED challenge, sign the exact Base-USDC authorization with an x402 buyer client, and retry using PAYMENT-SIGNATURE. A successful response includes PAYMENT-RESPONSE.