v2.48.2
rtk-ai/rtkv2.48.2Mar 25, 2026by github-actions[bot]
AI Summary
Introduces parallel crawl backends, allowing users to race alternative browser engines like LightPanda and Servo alongside their primary crawl to ensure the best HTML output.
Key Highlights
- Parallel Crawl Backends feature
- Race alternative browser engines (LightPanda, Servo, Custom)
- Quality validator for choosing the best HTML
- Zero overhead when disabled
New Features
- ParallelBackendsConfig
- BackendEngine::LightPanda
- BackendEngine::Servo
- BackendEngine::Custom
- backend_source attribute
Full Release Notes
Race alternative browser engines alongside your primary crawl. Best HTML wins.
```rust
use spider::configuration::{BackendEndpoint, BackendEngine, ParallelBackendsConfig};
let mut website = Website::new("https://example.com");
website.configuration.parallel_backends = Some(ParallelBackendsConfig {
backends: vec![BackendEndpoint {
engine: BackendEngine::LightPanda,
endpoint: Some("ws://127.0.0.1:9222".to_string()),
binary_path: None,
protocol: None,
}],
..Default::default()
});
website.crawl().await;
// page.backend_source → "primary" | "lightpanda" | "servo" | "custom"
```
Features: `lightpanda`, `servo`, `parallel_backends_full`, custom backends via `BackendEngine::Custom`.
Zero overhead when disabled, anti-fingerprint jitter, auto-disable on failures, custom quality validator, full network interception parity with Chrome.