v1.84.11

spider-rs/spiderv1.84.11Mar 9, 2024by j-mendez

AI Summary

Adds a new method to pre-set or extend the list of links to be crawled before starting the crawling process.

Key Highlights

Added set_extra_links method for extended crawls
Allows pre-setting links to crawl

New Features

Extended crawl link management

Full Release Notes

# Whats Changed

You can now pre-set links to crawl or extend using `website.set_extra_links`.

* chore(website): add set extra links extended crawls

@oiwn thanks for the help!

**Full Changelog**: https://github.com/spider-rs/spider/compare/v1.84.9...v1.84.11