v2.6.15

spider-rs/spiderv2.6.15Sep 22, 2024by j-mendez

AI Summary

Fixes link parsing for redirects and adds configuration options for TLS and host headers.

Key Highlights

Fix parsing links for top-level redirected domains
Add `website.with_preserve_host_header`

New Features

Add `website.with_preserve_host_header`
Change default TLS to native roots

Full Release Notes

* fix parsing links for top level redirected domains
* add website.with_preserve_host_header
* default tls reqwest_native_tls_native_roots

**Full Changelog**: https://github.com/spider-rs/spider/compare/v2.5.2...v2.6.15