DataBlue / Docs / Guide

Introduction

DataBlue is a hosted web scraping and structured data API platform. Use it to scrape pages, crawl sites, map URLs, extract structured fields, and call launch-ready data APIs across search, local, commerce, quick commerce, app stores, ads transparency, finance, news, and YouTube.

Base URL https://api.datablue.dev/v1

Auth Authorization: Bearer YOUR_API_KEY

Billing Success-based credits

What You Can Build

Scrape Return markdown, HTML, links, screenshots, headings, images, structured data, and optional LLM fields from any URL. Crawl & Map Discover pages, crawl bounded URL sets, and build URL maps with depth, include/exclude, and page-limit controls. Extract Use natural language prompts and JSON Schema with BYOK LLM providers to return typed JSON matching your schema. Data APIs Use production-tested endpoints for commerce, quick commerce, Google data, ads transparency, app store, and YouTube workloads.

Platform Notes

Multi-tier scraping engine: HTTP, stealth browser, Playwright, headless Chrome, and anti-bot bypass run in a staggered race. First valid result wins.
Strategy cache: Domains that need stealth are detected and upgraded automatically on future requests.
Firecrawl-compatible surface: Core scrape, crawl, map, and extract endpoints are shaped for migration with minimal integration changes.

Make Your First Request

curl -X POST "https://api.datablue.dev/v1/scrape" \
  -H "Authorization: Bearer wh_your_api_key" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://news.ycombinator.com",
    "formats": ["markdown", "links"]
  }'