Crawl a website starting from a URL.

POST JSON body with starting URL. Returns crawl job ID — poll for results.

{
  "body": {
    "url": "string (required)",
    "limit": "number (optional, max pages)",
    "maxDepth": "number (optional)"
  }
}

Extract structured data from a web page.

POST JSON body with URLs and optional extraction schema. Returns structured data.

{
  "body": {
    "urls": [
      "string (required)"
    ],
    "schema": "object (optional, JSON schema for extraction)"
  }
}

Map a website's pages to discover all URLs.

POST JSON body with URL. Returns list of discovered page URLs.

{
  "body": {
    "url": "string (required)"
  }
}

Scrape a single URL and return clean content.

POST JSON body with URL. Returns page content in requested formats.

{
  "body": {
    "url": "string (required)",
    "formats": [
      "string (optional: 'markdown', 'html', 'rawHtml', 'screenshot')"
    ]
  }
}

Search the web and return scraped results.

POST JSON body with search query. Returns search results with scraped content.

{
  "body": {
    "query": "string (required)",
    "limit": "number (optional)"
  }
}