How do I connect Crawl MCP Server to Claude?

Run `claude mcp add walksoda-crawl-mcp -- uvx --from git+https://github.com/walksoda/crawl-mcp crawl-mcp` in Claude Code, or add the same command and arguments under mcpServers in Cursor's mcp.json or Claude Desktop's claude_desktop_config.json, then restart the client. The blocks above are ready to paste.

Is Crawl MCP Server free?

The listed licence is MIT. Check the upstream terms for permitted use and commercial requirements; a public repository does not by itself mean the software is free or open source. Connected APIs and hosted services may have separate charges.

What can Crawl MCP Server do?

Crawl MCP Server documents 19 tools to the agent, including batch_crawl, batch_extract_youtube_transcripts, batch_search_google. The descriptions above come from project documentation. A live handshake does not test individual tool behavior.

Crawl MCP

Unclaimed

by walksoda

Crawl4AI MCP Server: Extract content from web pages, PDFs, Office docs, YouTube videos with AI-powered summarization. 17 tools, token reduction, production-ready.

Set up this server

Compare servers My Stack

01 / Choose your client

02 / Before you connect

Authentication is not specified. Check the project instructions before connecting.

Install the runtime required by the project and make it available to your client.

Project instructionsEnvironment variable names (optional)

Use names from the project instructions, separated by commas. Enter names only, never secret values.

03 / Add the configuration

Source: generated from public install instructions

claude mcp add --transport stdio 'walksoda-crawl-mcp' -- 'uvx' '--from' 'git+https://github.com/walksoda/crawl-mcp' 'crawl-mcp'

Run in your terminal after replacing any placeholders.

04 / Check it in your client

Open your client’s MCP settings and confirm the server connects and lists its tools. A copied configuration does not confirm a working connection.

Is this your MCP server?

This listing was auto-indexed from the public record. Claim it to edit the page, set compatibility and unlock growth tools. Takes under two minutes.

Claim this server

Security profile

Claimed and verified servers get a weekly static scan that shows what the code can reach: external services, environment variables, shell commands, agent configuration folders, plus any dependencies with known advisories. Claim this listing to get one. How the security profile works

19 of 19 tools

Documented tools (19)

From project documentation. A server handshake does not verify each tool’s description or behavior.

batch_crawl

Crawl multiple URLs with fallback (max 3 URLs)

batch_extract_youtube_transcripts

Extract transcripts from multiple YouTube videos (max 3)

batch_search_google

Perform multiple Google searches (max 3)

crawl_url

Extract web page content with JavaScript support

crawl_url_with_fallback

Crawl with fallback strategies for anti-bot sites

deep_crawl_site

Crawl multiple pages from a site with configurable depth

enhanced_process_large_content

Process large content with chunking and BM25 filtering

extract_entities

Extract entities (emails, phones, etc.) from web pages

extract_structured_data

Extract structured data using CSS selectors or LLM

extract_youtube_comments

Extract YouTube video comments with pagination

extract_youtube_transcript

Extract YouTube transcripts with timestamps

get_search_genres

Get available search genres

get_supported_file_formats

Get supported file formats and capabilities

get_youtube_video_info

Get YouTube video metadata and transcript availability

intelligent_extract

Extract specific data from web pages using LLM

multi_url_crawl

Multi-URL crawl with pattern-based config (max 5 URL patterns)

process_file

Convert PDF, Word, Excel, PowerPoint, ZIP to markdown

search_and_crawl

Search Google and crawl top results

search_google

Search Google with genre filtering

Tool change history

Compared across complete checks of the same configuration. Tools were listed, not invoked. Input-schema changes are not measured here.

No complete tool checks yet.

FAQ

Questions about Crawl MCP Server

How do I connect Crawl MCP Server to Claude?: Run `claude mcp add walksoda-crawl-mcp -- uvx --from git+https://github.com/walksoda/crawl-mcp crawl-mcp` in Claude Code, or add the same command and arguments under mcpServers in Cursor's mcp.json or Claude Desktop's claude_desktop_config.json, then restart the client. The blocks above are ready to paste.
Is Crawl MCP Server free?: The listed licence is MIT. Check the upstream terms for permitted use and commercial requirements; a public repository does not by itself mean the software is free or open source. Connected APIs and hosted services may have separate charges.
What can Crawl MCP Server do?: Crawl MCP Server documents 19 tools to the agent, including batch_crawl, batch_extract_youtube_transcripts, batch_search_google. The descriptions above come from project documentation. A live handshake does not test individual tool behavior.