Firecrawl MCP Server: Web Scraping, Crawling, Search, Content Extraction, and More 96

小编 ·

Firecrawl MCP Server: Web Scraping, Crawling, Search, Content Extraction, and More

Firecrawl MCP Server is an MCP server integrated with Firecrawl that offers web scraping, crawling, search, content extraction, and more — for example, extracting product prices from shopping sites or conducting deep research. It supports both cloud and self-hosted instances, allows configuration of retry mechanisms, credit monitoring, and other parameters via environment variables, provides various AI tools along with detailed logging and error handling, and is easy to install in different development environments.

Firecrawl MCP Server: Web Scraping, Crawling, Search, Content Extraction, and More

What is the Firecrawl MCP Server?

The Firecrawl MCP Server is an MCP server integrated with Firecrawl. It offers features such as web scraping, crawling, search, and content extraction—for example, extracting product prices from shopping sites and conducting in-depth research. It supports both cloud and self-hosted instances, and its parameters like the retry mechanism and credit monitoring can be configured via environment variables. It provides a variety of AI tools, detailed logging, and error handling, and is easy to install and use across different development environments.

Firecrawl MCP Server: Offers web scraping, crawling, search, content extraction, and many other features.webp

Features of firecrawl-mcp-server

  • Diverse web processing: Supports web scraping, crawling, search, content extraction, deep research, and batch scraping.

  • JS rendering support: Capable of handling web pages that require JavaScript rendering.

  • URL discovery and crawling: Automatically discovers and crawls URLs within web pages.

  • Web search and content extraction: Supports searching within web pages and extracting relevant content.

  • Automatic retry mechanism: Uses an exponential backoff algorithm for automatic retries to ensure stable data retrieval.

  • Efficient batch processing: Built-in rate limiting to improve the efficiency of batch processing.

  • Credit usage monitoring: Monitors the credit usage of the cloud API.

  • Comprehensive logging system: Provides detailed logging for easier debugging and monitoring.

  • Multi-environment support: Supports both cloud environments and self-hosted Firecrawl instances.

  • Multi-viewport support: Supports both mobile and desktop viewports.

  • Intelligent content filtering: Enables intelligent content filtering through tag inclusion or exclusion.

  • SSE support: Supports Server-Sent Events (SSE).

Installation and Running of firecrawl-mcp-server

Run with npx

env FIRECRAWL_API_KEY=fc-YOUR_API_KEY npx -y firecrawl-mcp

Manual Installation

npm install -g firecrawl-mcp

Running in Cursor

Follow the corresponding configuration steps based on your version of Cursor, and replace your-api-key in the configuration with your Firecrawl API key.

Running in Windsurf

Add the specific configuration to the ./codeium/windsurf/model_config.json file, and replace YOUR_API_KEY with your Firecrawl API key.

Project Link

https://github.com/mendableai/firecrawl-mcp-server