v2.48.4

pathwaycom/llm-appv2.48.4Mar 25, 2026by j-mendez

AI Summary

Introduces a new Model Context Protocol (MCP) server crate, allowing LLMs like Claude to directly interact with Spider scraping capabilities.

Key Highlights

New `spider_mcp` crate for MCP server functionality
Integration with Claude Code and Claude Desktop
Tools for scraping, crawling, and HTML transformation

New Features

spider_mcp crate
spider_scrape tool
spider_crawl tool
spider_links tool
spider_transform tool

Full Release Notes

New `spider_mcp` crate — MCP server for Spider.

```bash
cargo install spider_mcp
```

Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):

```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```

Usage examples:

```
Scrape a page:       "Fetch https://example.com as markdown"
Crawl a site:        "Crawl https://example.com up to 5 pages"
Extract links:       "Get all links from https://example.com"
Transform HTML:      "Convert this HTML to markdown: <h1>Hello</h1>"
```

Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`