Docs

Product documentation

Compact product docs for SourceOfTruth.io crawler and supported document workflows, credits, exports, billing gates, and source-data preparation.

Quick actions
Core docs
Crawler workflow

Search + Web Crawler

The crawler workbench is an active customer surface for searching saved source content, scraping one page, crawling a bounded website, and exporting clean outputs.

  • Search saved source content
  • Scrape a single web page
  • Crawl a bounded website
  • Estimate usage before launch
  • Export Markdown, JSON, or CSV
Open crawler
Output workflow

Clean export package

Exports should stay readable, portable, and easy to move into another tool or RAG workflow after a crawl completes.

  • Markdown for human review
  • JSON for structured automation
  • CSV for spreadsheet workflows
  • History and job records for logged-in users
  • Cloud storage remains optional/prewired
View history
Launch guardrails
Document ETL is active; broader ETL/ELT remains gatedSupported document ETL/Transform workflows are active customer surfaces. Do not imply that broader connector-driven ETL/ELT automation, advanced document intelligence, or provider-dependent processing is generally live until separately released.
Billing is controlled by launch gatesCheckout and billing portal access remain controlled by live-billing gates. Existing access should stay unchanged when gates are closed.

Crawler credits

Metered units used by search, scrape, crawl, render, extraction, and export workflows.

Estimate before run

The crawler workbench should show a pre-run estimate before launching bounded crawling work.

Clean exports

Markdown, JSON, and CSV output packages designed for review, automation, and downstream AI workflows.

ETL/ELT Pipeline

Supported document ETL/Transform is available today. Broader connector-driven ETL/ELT automation remains a separate roadmap surface until its launch gates close.