v2.48.4

daydreamlive/DEMONv2.48.4Mar 25, 2026by j-mendez

AI Summary

This release introduces a new `spider_mcp` crate, enabling the use of Spider as an MCP (Model Context Protocol) server for Claude Code and Desktop, allowing for web scraping and crawling capabilities within AI workflows.

Key Highlights

New `spider_mcp` crate for MCP integration.
Tools for scraping pages, crawling sites, extracting links, and transforming HTML.
Configuration examples provided for Claude Code and Desktop environments.

New Features

spider_scrape tool
spider_crawl tool
spider_links tool
spider_transform tool

Full Release Notes

New `spider_mcp` crate — MCP server for Spider.

```bash
cargo install spider_mcp
```

Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):

```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```

Usage examples:

```
Scrape a page:       "Fetch https://example.com as markdown"
Crawl a site:        "Crawl https://example.com up to 5 pages"
Extract links:       "Get all links from https://example.com"
Transform HTML:      "Convert this HTML to markdown: <h1>Hello</h1>"
```

Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`