v2.48.4

anthropics/anthropic-tokenizer-typescriptv2.48.4Mar 25, 2026by j-mendez

AI Summary

This release introduces an MCP server crate for Spider, enabling integration with Claude Code and Claude Desktop for web scraping and crawling capabilities. The new crate provides a convenient interface for developers to leverage Spider's web scraping tools within AI-powered applications.

Key Highlights

  • New `spider_mcp` crate for MCP server functionality
  • Integration with Claude Code and Claude Desktop
  • Four tools: scrape, crawl, links extraction, HTML transformation
  • Usage examples for various web scraping tasks

New Features

  • spider_mcp crate with MCP server functionality
  • spider_scrape tool
  • spider_crawl tool
  • spider_links tool
  • spider_transform tool

Full Release Notes

New `spider_mcp` crate — MCP server for Spider.

```bash
cargo install spider_mcp
```

Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):

```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```

Usage examples:

```
Scrape a page:       "Fetch https://example.com as markdown"
Crawl a site:        "Crawl https://example.com up to 5 pages"
Extract links:       "Get all links from https://example.com"
Transform HTML:      "Convert this HTML to markdown: <h1>Hello</h1>"
```

Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`