Match endpoint to job
Search for discovery, scrape for one URL, crawl for site jobs, map for URL discovery, batch scrape for known lists, and agent for broader research.
Independent Firecrawl reference
Match each source to the right Firecrawl endpoint.Keep clean outputs, URLs, and tradeoffs attached.Plan hosted or self-hosted paths before agents depend on data.
All planner features require choosing a package first. Payments are one-time and do not automatically renew.
Product thesis
The site helps developers choose Firecrawl workflows, compare hosted and self-hosted tradeoffs, and cite upstream facts without implying official affiliation.
Search for discovery, scrape for one URL, crawl for site jobs, map for URL discovery, batch scrape for known lists, and agent for broader research.
Source URLs, timestamps, output format, and limitations stay visible so AI answers remain auditable.
Hosted API decisions need official docs as source evidence. Self-host plans need Docker, Redis, browser service, security, and AGPL review.
Every core page states this is an independent, unofficial guide and links back to the upstream source of truth.
Endpoint map
Find sources and return page content for research flows that start with a query.
Convert one URL into Markdown, HTML, screenshots, or schema-shaped data.
Run an asynchronous site crawl when the target is a whole domain or directory.
Discover site URLs before deciding what to scrape or crawl.
Process a known URL list with async job handling and output checks.
Use agent tasks or page actions when a job needs research, navigation, or UI interaction.
Endpoint selection, output modes, code snippets, error handling, and production guardrails.
Docker setup, environment names, Redis and browser service notes, security controls, and AGPL obligations.
Compare Firecrawl against crawler libraries, scraping APIs, browser automation, and AI search tools by decision criteria.
Source-of-truth block
Firecrawl is an open-source TypeScript project for web search, scraping, crawling, mapping, interaction, and agent-oriented extraction. The upstream repository is AGPL-3.0, with official hosted service and docs maintained by Firecrawl.
Firecrawl Space readers comparing workflow plans with launch and market assumptions can also review MiroFish AI Simulator, a companion reference for simulation-style product reasoning.
Web data pipelines often become model context; the Kimi K3 resource hub can help teams compare long-context reasoning before feeding crawled pages into agents or RAG workflows.