v2.48.4

dstotijn/hettyv2.48.4Mar 25, 2026by j-mendez

AI Summary

A new MCP (Model Context Protocol) server crate has been released, enabling integration with Claude AI tools for web scraping operations like fetching pages, crawling sites, and extracting links.

Key Highlights

  • New `spider_mcp` crate for Model Context Protocol
  • Integration with Claude Code and Claude Desktop
  • Tools for scraping, crawling, and HTML transformation
  • Support for markdown and link extraction

New Features

  • MCP server implementation
  • Claude AI integration
  • Web scraping tools

Full Release Notes

New `spider_mcp` crate — MCP server for Spider.

```bash
cargo install spider_mcp
```

Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):

```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```

Usage examples:

```
Scrape a page:       "Fetch https://example.com as markdown"
Crawl a site:        "Crawl https://example.com up to 5 pages"
Extract links:       "Get all links from https://example.com"
Transform HTML:      "Convert this HTML to markdown: <h1>Hello</h1>"
```

Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`