spider Releases

A major update titled 'Nightvision' featuring a diff-based improvement engine, a simplified single-port Docker architecture, and enhanced resume customization tools.

Apr 2, 2026

Focuses on security hardening through concurrency and memory audits, along with improvements to browser connection reliability, control maps, and dependency updates.

Mar 31, 2026

Adds CLI authentication functionality for Spider Cloud, allowing users to store API keys locally and utilize various cloud modes for remote crawling and headless browser operations.

Mar 31, 2026

Mar 31, 2026

Introduces the `spider_mcp` crate, enabling Spider to function as a Model Context Protocol (MCP) server for AI tools like Claude Code to perform web scraping tasks.

Mar 25, 2026

Introduces parallel crawl backends, allowing users to race alternative browser engines (such as LightPanda or Servo) against the primary crawler to select the best HTML result.

Mar 25, 2026

Focuses on precise parameter configurations for AI models across various providers and introduces support for new frontier models and AWS Bedrock.

Mar 25, 2026

Introduces extensible crawl pipelines with PageData & Crawler traits and adds proxy support for LLM requests alongside performance optimizations.

Mar 20, 2026

Adds NUMA thread pinning for multi-socket servers and implements zero-copy wire parsing for HTTP and DNS protocols.

Mar 19, 2026

Implements zero-copy page passing and uses mmap+hugepages for efficient URL deduplication.

Mar 19, 2026

Release notes for NVIDIA Nemo Ingest focusing on retrieval extraction capabilities.

Mar 18, 2026

Adds io_uring support for TCP connections and a lightweight background runtime for improved async performance.

Mar 15, 2026

Introduces comprehensive agentic automation features, enabling autonomous web interactions, self-healing selectors, and complex action chaining with AI-driven decision making.

Mar 3, 2026

A major update to Cloudflare's Pingora proxy server adding mTLS support, subrequest piping, and fixing various HTTP protocol and Windows compilation issues.

Mar 2, 2026

Hardens agent capabilities by capping LLM-controlled durations, adding timeouts, and improving error handling for browser automation.

Mar 2, 2026

Updates the platform to support digital products and Shadcn UI, while removing legacy components and upgrading Tailwind CSS.

Feb 25, 2026

Major performance release introducing cache-first fast path (5-50ms vs 1-3s), deferred Chrome processing, work-stealing for hedged requests, and io_uring for high-throughput file I/O. Also adds per-round model pool routing for the agent and several bug fixes for Chrome mode and SSL handling.

Feb 21, 2026

A major update titled 'Voyager' featuring AI-driven resume refinement, multi-pass generation, and extensive localization.

Feb 10, 2026

A bug fix release improving the JSON parsing logic in the automation module to handle LLM responses that include reasoning text before the JSON code block.

Feb 6, 2026

Introduces relevance gate feature for remote multimodal crawling that allows the LLM to determine page relevance and refund budget credits for irrelevant pages, enabling more efficient crawling of relevant content.

Feb 5, 2026