Crawl-related endpoints currently include:Documentation Index
Fetch the complete documentation index at: https://docs.bulkgrid.com/llms.txt
Use this file to discover all available pages before exploring further.
POST /api/v1/crawlPOST /api/v1/deep-crawl
What these endpoints do
- process known URL lists with crawl
- expand from a starting URL with deep crawl
- produce run-based asynchronous workflows
- generate result content such as markdown, HTML, links, and screenshots when configured