Authorizations
API key for authentication
Body
application/json
Body
Schema for starting a crawling session with support for both single URL and multiple URLs
Single URL to start crawling (for backward compatibility)
List of URLs for crawling
Regex patterns to include specific paths
Regex patterns to exclude specific paths
Type of proxy to use
Country for proxy selection
Timeout in milliseconds
Required range:
x >= 1
Maximum crawling depth
Required range:
x >= 1
Maximum number of pages to crawl
Required range:
x >= 1
Number of concurrent crawlers
Required range:
x >= 1
Whether to stay within the same domain
Whether to load images during crawling
Enable safe mode for crawling
Webhook URL for completion notifications