v2.48.4
dstotijn/hettyv2.48.4Mar 25, 2026by j-mendez
AI Summary
A new MCP (Model Context Protocol) server crate has been released, enabling integration with Claude AI tools for web scraping operations like fetching pages, crawling sites, and extracting links.
Key Highlights
- New `spider_mcp` crate for Model Context Protocol
- Integration with Claude Code and Claude Desktop
- Tools for scraping, crawling, and HTML transformation
- Support for markdown and link extraction
New Features
- MCP server implementation
- Claude AI integration
- Web scraping tools
Full Release Notes
New `spider_mcp` crate — MCP server for Spider.
```bash
cargo install spider_mcp
```
Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):
```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```
Usage examples:
```
Scrape a page: "Fetch https://example.com as markdown"
Crawl a site: "Crawl https://example.com up to 5 pages"
Extract links: "Get all links from https://example.com"
Transform HTML: "Convert this HTML to markdown: <h1>Hello</h1>"
```
Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`