Learn more about our built-in compliance layer
Rule Type | Description |
---|---|
Source Blacklisting | Explicitly prevent extracting or accessing prohibited sources or domains. |
Captcha & Explicit TOS Enforcement | Prevent automated circumvention of explicit Terms of Service pop-ups and automated Captcha bypassing. |
Sensitive Data (PII) Detection | Automatically detects attempts to extract common forms of Personally Identifiable Information (PII) and can be configured to redact, flag, or block such data. |
robots.txt Check | Automatically checks robots.txt directives for all web interactions, promoting ethical data sourcing from websites. |
Custom Restrictions | Configure fine-grained custom restrictions. |