spider Releases
223 releases of spider-rs/spider
- v1.85.4
Adds a mid-crawl queue management system that allows users to dynamically update or add links to the crawl context during execution.
Mar 11, 2024
- v1.84.11
Adds a new method to pre-set or extend the list of links to be crawled before starting the crawling process.
Mar 9, 2024
- v0.5.0
This release (from the bore project) updates the port selection logic for the `--min-port` option and introduces a new `--max-port` option.
Apr 28, 2023