v2.1.9

spider-rs/spiderv2.1.9Aug 26, 2024by j-mendez

AI Summary

Bug fixes for Chrome hanging issues and new builder method to return page links.

Key Highlights

Fixed Chrome hangs on page opening
Added with_return_page_links builder method
Sitemap and smart scraping improvements

New Features

Return page links configuration
Sitemap support

Full Release Notes

# Whats New

This release brings bug fixes with chrome opening pages causing hangs. The builder method `website.with_return_page_links` can be used to attach the links found on the web page to the page object.

* chore(chrome): fix instances being left open from ignorable handler errors
* chore(scrape): add sitemap and smart [#206]
* feat(page): add return page links configuration
* chore(config): fix budget reset on crawl end

Thanks @DimitriTimoz

**Full Changelog**: https://github.com/spider-rs/spider/compare/v2.0.6...v2.1.9