v2.48.4

lingodotdev/lingo.devv2.48.4Mar 25, 2026by j-mendez

AI Summary

Introduces the `spider_mcp` crate, allowing the Spider web scraping library to be integrated as a Model Context Protocol (MCP) server for Claude AI tools.

Key Highlights

New `spider_mcp` crate enables scraping, crawling, link extraction, and HTML transformation via natural language.
Includes specific setup instructions for both Claude Code and Claude Desktop configurations.
Provides tools for scraping single pages, crawling sites, extracting links, and transforming HTML to markdown.

New Features

spider_mcp crate
spider_scrape tool
spider_crawl tool
spider_links tool
spider_transform tool

Full Release Notes

New `spider_mcp` crate — MCP server for Spider.

```bash
cargo install spider_mcp
```

Setup (Claude Code `~/.claude/settings.json` or Claude Desktop config):

```json
{ "mcpServers": { "spider": { "command": "spider-mcp" } } }
```

Usage examples:

```
Scrape a page:       "Fetch https://example.com as markdown"
Crawl a site:        "Crawl https://example.com up to 5 pages"
Extract links:       "Get all links from https://example.com"
Transform HTML:      "Convert this HTML to markdown: <h1>Hello</h1>"
```

Tools: `spider_scrape` · `spider_crawl` · `spider_links` · `spider_transform`