Skip to main content
Bulkgrid exposes more than a top-level source record. Each source also has document, folder, change, and run-level views.

​
Source documents

For each source, the platform can expose documents with fields such as:
  • URL
  • title
  • status code
  • latest crawl result
  • last indexed crawl result
  • crawl result metadata
The document listing is paginated and supports browsing by parent path. It also supports withTotal, which is useful when you need a total count even though the endpoint computes folder-aware listings.

​
Source folders

Folders help customers navigate source content hierarchically instead of scanning one long list of URLs. The folder endpoint also supports a parent parameter so the dashboard can progressively drill into the source tree.

​
Source changes

Source changes help customers answer an operational question that most docs leave out: what actually changed since the previous crawl? The changes endpoint is paginated with offset and limit. Current implementation defaults to 50 items and caps the limit at 200.

​
Source runs

Source runs connect the source lifecycle to the underlying run system so customers can inspect history and failure behavior in context.