Starstruk Logo MarkStarstruk

v2.26.1

spider-rs/spiderv2.26.1Jan 11, 2025by j-mendez

AI Summary

Performance improvements by skipping URL parsing per page, new functionality to collect links for a new domain target, and fixes for root domain parsing.

Key Highlights

  • Skipped URL parsing per page
  • Added domain target link collection
  • Fixed root domain handling

Breaking Changes

  • Users of `page::Page::take_url` must call `page::Page::set_url_parsed_direct_empty()` first or use `page::Page::get_url_parsed()` instead.

New Features

  • Performance optimization
  • Domain targeting

Full Release Notes

# Whats Changed

This release brings performance improvements by skipping URL parsing per page.
You can now also pass in a second param to the page link methods to collect the links with a new domain target.
Targeting the correct root domain for parsing the links is now handled across features.

If you used `page::Page::take_url` directly you may need to call `page::Page::set_url_parsed_direct_empty()` first or the `page::Page::get_url_parsed()` method.

1. perf(cli): add page links direct return
1. cli(scrape): now outputs full page links

**Full Changelog**: https://github.com/spider-rs/spider/compare/v2.24.15...v2.26.1