AI Navigation uses natural language instructions to navigate websites and extract data. The quality of your results depends heavily on how well you structure your prompts.

​
The 4-Step Formula

For best results, provide step-by-step instructions:

​
1. Start with navigation

Specify exactly where to go
  • ✅ “Navigate to the careers section, then click on ‘Engineering roles’”
  • ❌ “Find job postings”

​
2. Describe the data location

Help the AI identify what to extract
  • ✅ “Extract all products from the search results”
  • ❌ “Get products”

​
3. List specific fields

Be explicit about what data you need
  • ✅ “Schema: product_name, brand, price, SKU”
  • ❌ “Get all product information”

​
4. Handle pagination

Tell the AI how to get all data
  • ✅ “Click ‘Next’ or ‘Load More’ to go through all pages”
  • ❌ “Get everything”

​
Example Prompts

​
Good Example

- Navigate to the products/electrical section.
For each product, extract:
  - brand (e.g. AEM, Holley)
  - product_name
  - price
  - parent_page_url
- Click through all pagination to get all products.

​
Simple Example

- Navigate to the products on sale.
- For each product, extract: name, price, brand, and availability.
- If there's pagination, click through all pages to get all products.

​
Testing Your Prompts

  1. Start with a single page to test field extraction
  2. Verify the AI can find your specified elements
  3. Review the sample data
  4. Increase limit to full extraction