surface↓extraction↓scrape
Extractionscalar · returns table

SCRAPE

Fetch a URL and return its content as clean markdown (via Firecrawl)

Per-row — runs once for each row.

extractionexternal-apiurl

Arguments

nametypedescription
urlVARCHARURL to scrape

About

Fetch a web URL and return its page content as clean markdown — plus title and source URL — as a one-row table. The scraper uses Firecrawl under the hood, which handles JavaScript rendering, anti-bot defenses, and main-content extraction automatically. Useful for making web pages queryable right from SQL: read an article and feed it to a semantic operator, pull product pages into a catalog, pull a small set of URLs into a workflow without writing a scraper. Cost: one Firecrawl credit per URL. For scraping many pages in one pipeline, consider WEB_MAP (discover URLs on a domain) or WEB_SCRAPE (batch scraping) instead of calling this one URL at a time.

Nearby rabbit holes

same domain
scalar

CRAWL_BATCH

Crawl a website and extract structured data from each page (via Firecrawl)

extractionexternal-apiurl
scalar

EXTRACT

Extract specific information from unstructured text (zero-shot NER)

extractionnlispecialist-zootext
scalar

EXTRACT_LLM

LLM-backed extraction (escape hatch for EXTRACTS)

extractionllmllm-escape-hatchtext
scalar

EXTRACT_STRUCTURED

Extract structured fields from text per a user-supplied schema

extractionllmtext
aggregate

MERGE_TIMELINES

Merge multiple timelines into unified chronological sequence

extractionllmjson
scalar

PARSE

Extract information from text using natural-language instructions

extractionllmtext
Climb back to The Looking Glass