crawl

MCP tool from Webclaw by 0xMassi

Follow same-origin links and extract discovered pages

How to use it

crawl is exposed by the Webclaw MCP server. Add the server to your MCP client (Claude Desktop, Cursor, Windsurf and others), and the crawl tool becomes available to the model automatically. See the full listing for setup details and every tool this server provides.

Install Webclaw

$npx create-webclaw

FULL WEBCLAW LISTING

Other tools in Webclaw (9)

batch

Scrape multiple URLs in parallel

brand

Extract colors, fonts, logos, and metadata

diff

Compare page content snapshots

extract

Convert page content into structured data