v2.8.29

spider-rs/spiderv2.8.29Oct 5, 2024by j-mendez

AI Summary

Improves Chrome integration, request interception, and stealth capabilities.

Key Highlights

Fix request interception remote connections
Add set extra headers and spoofed plugins
Add mouse movement WAF
Add serializable crawl configuration

New Features

Add set extra headers
Add spoofed plugins
Add mouse movement WAF
Add serializable crawl configuration
Add HTTP fallback request

Full Release Notes

Whats Changed

Fix request interception remote connections. Intercept builder now uses `spider::features::chrome_common::RequestInterceptConfiguration` and adds more control.

* chrome performance improvement reducing dup events
* chore(chrome): add set extra headers
* chore(smart): add http fallback chrome smart mode request
* chore(chrome): add spoofed plugins
* chore(real-browser): add mouse movement waf
* chore(chrome): patch logs stealth mode
* chore(page): fix url join empty slash
* chore(chrome): fix return page response headers and cookies
* chore(page): add empty page validation
* chore(config): add serializable crawl configuration
* chore(retry): add check 502 notfound retry

**Full Changelog**: https://github.com/spider-rs/spider/compare/v2.7.1...v2.8.29