v2.48.2
liriliri/ayav2.48.2Mar 25, 2026by github-actions[bot]
AI Summary
Adds support for parallel crawl backends, allowing users to race multiple browser engines against each other to select the best HTML result.
Key Highlights
- Race alternative browser engines (LightPanda, Servo) alongside the primary crawl.
- Zero overhead when parallel backends are disabled.
- Custom quality validator for HTML selection and full network interception parity with Chrome.
- Support for custom backends via `BackendEngine::Custom`.
New Features
- Parallel Crawl Backends
- Custom backend support
- Quality validator
- Network interception parity
Full Release Notes
Race alternative browser engines alongside your primary crawl. Best HTML wins.
```rust
use spider::configuration::{BackendEndpoint, BackendEngine, ParallelBackendsConfig};
let mut website = Website::new("https://example.com");
website.configuration.parallel_backends = Some(ParallelBackendsConfig {
backends: vec![BackendEndpoint {
engine: BackendEngine::LightPanda,
endpoint: Some("ws://127.0.0.1:9222".to_string()),
binary_path: None,
protocol: None,
}],
..Default::default()
});
website.crawl().await;
// page.backend_source → "primary" | "lightpanda" | "servo" | "custom"
```
Features: `lightpanda`, `servo`, `parallel_backends_full`, custom backends via `BackendEngine::Custom`.
Zero overhead when disabled, anti-fingerprint jitter, auto-disable on failures, custom quality validator, full network interception parity with Chrome.