v2.48.4

enricoros/big-AGIv2.48.4Mar 25, 2026by j-mendez

AI Summary

Introduces a Model Context Protocol (MCP) server for Spider, enabling seamless integration with AI coding assistants like Claude for web scraping and content transformation tasks.

Key Highlights

Adds `spider_mcp` crate for MCP server functionality
Integrates with Claude Code and Desktop
Provides tools for scraping, crawling, and transforming content

New Features

Spider MCP server
Claude Code integration
Web scraping tools (scrape, crawl, links, transform)

Full Release Notes

New `spider_mcp` crate — MCP server for Spider.

```bash
cargo install spider_mcp
```

Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):

```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```

Usage examples:

```
Scrape a page:       "Fetch https://example.com as markdown"
Crawl a site:        "Crawl https://example.com up to 5 pages"
Extract links:       "Get all links from https://example.com"
Transform HTML:      "Convert this HTML to markdown: <h1>Hello</h1>"
```

Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`