surface↓search↓web_map
Searchscalar · returns table

WEB_MAP

Discover URLs on a website and return them as a table

Per-row — runs once for each row.

searchexternal-apiurl

Arguments

nametypedescription
urlVARCHARDomain or page URL to discover
search(optional)VARCHAROptional search term to filter discovered URLs
limit(optional)INTEGERMax URLs to return

About

Discover all URLs on a domain or website. Uses Firecrawl's /map endpoint which combines sitemap parsing and web crawling to discover pages quickly without scraping content. SQL Usage: SELECT * FROM web_map('https://example.com') SELECT url FROM web_map('https://docs.example.com', 'authentication')

Nearby rabbit holes

same domain
aggregate

VECTOR_SEARCH

Find similar documents via vector search

searchllmtext
aggregate

VECTOR_SEARCH_ELASTIC

Hybrid semantic + keyword search in Elasticsearch

searchllmtext
aggregate

VECTOR_SEARCH_PINECONE

Pure semantic search in Pinecone

searchllmtext
scalar

WEB_SEARCH

Search the web and return results as a table (via Firecrawl)

searchexternal-apiurl
Climb back to The Looking Glass