Public Page Metadata and Markdown Bundle
Fetch a public HTTP(S) page with private-network blocking and return bounded Markdown-like content plus title, description, Open Graph image, status, and URL metadata.
Preview request
The preview path is rate-limited and does not charge. Production requests use the same parameters and return a standard x402 challenge when no payment signature is present.
curl --request POST \
"https://ai-data-marketplace-1042299154756.us-central1.run.app/api/v1/deep_scrape?preview=true" \
--header "content-type: application/json" \
--data '{"url":"https://example-saas.com/pricing","wait_for_selector":".pricing-table"}'Input contract
| Parameter | Type | Required | Description |
|---|---|---|---|
url | string | Yes | Target URL to render and scrape. |
wait_for_selector | string | No | CSS selector to wait for before extracting content. |
extract_html | boolean | No | If true, returns full HTML. Otherwise returns text. |
Guaranteed response metadata
Every successful product response identifies how the result was produced. Product-specific output fields are documented in the paid OpenAPI contract and can be inspected through the preview request where available.
{
"marketplace_metadata": {
"data_mode": "live_source",
"billable": true,
"availability": "operational",
"source": "live public web fetch"
}
}Agent payment flow
Request the product, read the base64 PAYMENT-REQUIRED challenge, sign the exact Base-USDC authorization with an x402 buyer client, and retry using PAYMENT-SIGNATURE. A successful response includes PAYMENT-RESPONSE.