v2.48.2

drawdb-io/drawdbv2.48.2Mar 25, 2026by github-actions[bot]

AI Summary

Spider now supports running multiple browser engines (such as LightPanda and Servo) in parallel to ensure the highest quality HTML extraction. This feature allows users to race alternative engines and select the best result automatically.

Key Highlights

  • Parallel Crawl Backends
  • Race alternative browser engines
  • Quality validator
  • Zero overhead when disabled
  • Full network interception parity with Chrome

New Features

  • lightpanda backend
  • servo backend
  • parallel_backends_full feature
  • custom backends via BackendEngine::Custom

Full Release Notes

Race alternative browser engines alongside your primary crawl. Best HTML wins.

```rust
use spider::configuration::{BackendEndpoint, BackendEngine, ParallelBackendsConfig};

let mut website = Website::new("https://example.com");
website.configuration.parallel_backends = Some(ParallelBackendsConfig {
    backends: vec![BackendEndpoint {
        engine: BackendEngine::LightPanda,
        endpoint: Some("ws://127.0.0.1:9222".to_string()),
        binary_path: None,
        protocol: None,
    }],
    ..Default::default()
});
website.crawl().await;
// page.backend_source → "primary" | "lightpanda" | "servo" | "custom"
```

Features: `lightpanda`, `servo`, `parallel_backends_full`, custom backends via `BackendEngine::Custom`.

Zero overhead when disabled, anti-fingerprint jitter, auto-disable on failures, custom quality validator, full network interception parity with Chrome.