Starstruk Logo MarkStarstruk

v1.97.14

spider-rs/spiderv1.97.14Jun 13, 2024by j-mendez

AI Summary

Fixes Chrome User-Agent spoofing issues and introduces a shared queue strategy for fair workload distribution.

Key Highlights

  • Fixed invalid Chrome User-Agents when spoofing
  • New `shared_queue` strategy for fair workload distribution

New Features

  • New `shared_queue` strategy for semaphore management

Full Release Notes

# Whats Changed

Fix issue with invalid chrome User-Agents when spoofing. If you are using spider like a job use `website.with_shared_queue` to make the workload fair across all websites.

* chore(chrome): fix non chrome agents spoofing
* feat(sem): add shared queue strategy


**Full Changelog**: https://github.com/spider-rs/spider/compare/v1.97.12...v1.97.14