Skip to main content
Bulkgrid helps developers turn public web content into structured, usable data for AI applications, search experiences, and ingestion pipelines. Use Bulkgrid when you need to:
  • search indexed content across a collection
  • extract structured data from one or more URLs
  • crawl websites and retrieve result content
  • run deeper ingestion workflows over larger site areas
  • manage asynchronous jobs and fetch their results reliably

​
Choose your path

Evaluate Bulkgrid

Start with the product overview, workflow model, and core concepts.

Get first API success

Go from API key to first request in a few minutes.

Build a workflow

Follow task-based guides for search, extraction, crawl, and collections.

Integrate in production

Read the operational guidance for retries, timeouts, versioning, and troubleshooting.

​
Main product areas

Search

Retrieve ranked results from indexed content.

Extraction

Pull structured fields from one or more URLs.

Crawling

Generate normalized result content from known URLs or a starting URL.

​
What Bulkgrid exposes today

The current public API supports these main workflows:
  • POST /api/v1/search for searching indexed content
  • POST /api/v1/extract for structured extraction runs
  • POST /api/v1/crawl for crawl runs
  • POST /api/v1/deep-crawl for broader crawl runs from a starting URL
  • GET /api/v1/runs and related endpoints for run lifecycle management
  • GET /api/v1/runs/{runId}/results and result-content endpoints for output retrieval

​
Documentation structure

  • Introduction explains what Bulkgrid is, how the main workflows operate, and what the core concepts are.
  • Getting Started gets you from API key to first successful response.
  • Guides walk through real workflows end to end.
  • Integration Patterns show how to fit Bulkgrid into application backends and AI systems.
  • API Reference covers endpoint-level details.
  • Production covers reliability, operational behavior, security framing, and versioning.