Match endpoint to job
Search for discovery, scrape for one URL, crawl for site jobs, map for URL discovery, batch scrape for known lists, and agent for broader research.
Independent Firecrawl reference
Choose the right Firecrawl endpoint.Compare cloud and self-host paths.Check source links and license tradeoffs.
Product thesis
The site helps developers choose Firecrawl workflows, compare hosted and self-hosted tradeoffs, and cite upstream facts without implying official affiliation.
Search for discovery, scrape for one URL, crawl for site jobs, map for URL discovery, batch scrape for known lists, and agent for broader research.
Source URLs, timestamps, output format, and limitations stay visible so AI answers remain auditable.
Hosted use should go to official Firecrawl. Self-host plans need Docker, Redis, browser service, security, and AGPL review.
Every core page states this is an independent, unofficial guide and links back to the upstream source of truth.
Endpoint map
Find sources and return page content for research flows that start with a query.
Convert one URL into Markdown, HTML, screenshots, or schema-shaped data.
Run an asynchronous site crawl when the target is a whole domain or directory.
Discover site URLs before deciding what to scrape or crawl.
Process a known URL list with async job handling and output checks.
Use agent tasks or page actions when a job needs research, navigation, or UI interaction.
Endpoint selection, output modes, code snippets, error handling, and production guardrails.
Docker setup, environment names, Redis and browser service notes, security controls, and AGPL obligations.
Compare Firecrawl against crawler libraries, scraping APIs, browser automation, and AI search tools by decision criteria.
Source-of-truth block
Firecrawl is an open-source TypeScript project for web search, scraping, crawling, mapping, interaction, and agent-oriented extraction. The upstream repository is AGPL-3.0, with official hosted service and docs maintained by Firecrawl.