firecrawl/firecrawl
The API to search, scrape, and interact with the web at scale. 🔥
github.com/firecrawl/firecrawl/raw/main/LICENSEpepy.tech/project/firecrawl-pyGitHub.com/firecrawl/firecrawl/graphs/contributorsfirecrawl.devtwitter.com/firecrawl linkedin.com/company/104100957 discord.gg/firecrawl
🔥 Firecrawl
The API to search, scrape, and interact with the web at scale. 🔥 The web context API to find sources, extract content, and turn it into clean Markdown or structured data your agents can ship with. Open source and available as a hosted service.
Pst. Hey, you, join our stargazers 😃
github.com/firecrawl/firecrawl
Why Firecrawl?
• Industry-leading reliability: Covers 96% of the web, including JS-heavy pages — no proxy headaches, just clean data (see benchmarks)
• Blazingly fast: P95 latency of 3.4s across millions of pages, built for real-time agents and dynamic apps
• LLM-ready output: Clean markdown, structured JSON, screenshots, and more — spend fewer tokens, build better AI apps
• We handle the hard stuff: Rotating proxies, orchestration, rate limits, JS-blocked content, and more — zero configuration
• Agent ready: Connect Firecrawl to any AI agent or MCP client with a single command
• Media parsing: Parse and extract content from web-hosted PDFs, DOCX, and more
• Actions: Click, scroll, write, wait, and press before extracting content
• Open source: Developed transparently and collaboratively — join our community
Feature Overview
Core Endpoints
More
Quick Start
Sign up at firecrawl.dev to get your API key. Try the playground to test it out.
Search
Search the web and get full content from results.
Node.js / cURL / CLI
Node.js
cURL
CLI
Output:
Scrape
Get LLM-ready data from any website — markdown, JSON, screenshots, and more.
Node.js / cURL / CLI
Node.js
cURL
CLI
Output:
Interact
Scrape a page, then interact with it using AI prompts or code.
Node.js / cURL / CLI
Node.js
cURL
CLI
Output:
Power Your Agent
Connect Firecrawl to any AI agent or MCP client in minutes.
Skill
Give your agent easy access to real-time web data with one command.
Restart your agent after installing. Works with Claude Code, Antigravity, OpenCode, and more.
MCP
Connect any MCP-compatible client to the web in seconds.
Agent Onboarding
Are you an AI agent? Fetch this skill to sign up your user, get an API key, and start building with Firecrawl.
See the Skill + CLI documentation for all available commands. For MCP, see firecrawl-mcp-server.
More Endpoints
Agent
The easiest way to get data from the web. Describe what you need, and our AI agent searches, navigates, and retrieves it. No URLs required.
Agent is the evolution of our /extract endpoint: faster, more reliable, and doesn't require you to know the URLs upfront.
Response:
Agent with Structured Output
Use a schema to get structured data:
Agent with URLs (Optional)
Focus the agent on specific pages:
Model Selection
Choose between two models based on your needs:
When to use Pro:
• Comparing data across multiple websites
• Extracting from sites with complex navigation or auth
• Research tasks where the agent needs to explore multiple paths
• Critical data where accuracy is paramount
Learn more about Spark models in our Agent documentation.
Crawl
Crawl an entire website and get content from all pages.
Returns a job ID:
Check Crawl Status
Note: The SDKs handle polling automatically for a better developer experience.
Map
Discover all URLs on a website instantly.
Response:
Map with Search
Find specific URLs within a site:
Batch Scrape
Scrape multiple URLs at once:
SDKs
Our SDKs provide a convenient way to use all Firecrawl features and automatically handle polling for async operations.
Python
Install the SDK:
Node.js
Install the SDK:
Java
Add the dependency (Gradle/Maven):
Elixir
Add the dependency:
Rust
Add the dependency:
Community SDKs
• Go SDK
Integrations
Agents & AI Tools
Platforms
• Lovable
• Zapier
Missing your favorite tool? Open an issue and let us know!
Resources
Open Source vs Cloud
Firecrawl is open source under the AGPL-3.0 license. The cloud version at firecrawl.dev includes additional features:
To run locally, see the Contributing Guide. To self-host, see Self-Hosting Guide.
Contributing
We love contributions! Please read our Contributing Guide before submitting a pull request.
Contributors
github.com/firecrawl/firecrawl/graphs/contributors
License
This project is primarily licensed under the GNU Affero General Public License v3.0 (AGPL-3.0). The SDKs and some UI components are licensed under the MIT License. See the LICENSE files in specific directories for details.
It is the sole responsibility of end users to respect websites' policies when scraping. Users are advised to adhere to applicable privacy policies and terms of use. By default, Firecrawl respects robots.txt directives. By using Firecrawl, you agree to comply with these conditions.
点赞
收藏
点踩
分享