crawl_site

MCP tool from Crawlie by spronta

Crawl + audit a whole site (SEO + GEO), returns scores, issues, per-page data

How to use it

crawl_site is exposed by the Crawlie MCP server. Add the server to your MCP client (Claude Desktop, Cursor, Windsurf and others), and the crawl_site tool becomes available to the model automatically. See the full listing for setup details and every tool this server provides.

Install Crawlie

$claude mcp add crawlie crawlie-mcp

FULL CRAWLIE LISTING

Other tools in Crawlie (4)

audit_url

Audit a single page

audit_urls

Audit an explicit list of pages

explain_issue

Why a rule matters + how to fix it

list_rules

The full catalogue of checks