spider Releases
223 releases of spider-rs/spider
- v0.5.1
Focuses on infrastructure improvements including Homebrew updates, Docker image support for ARM64, and CI runner fixes.
Jun 11, 2024
- v1.97.12
Introduces scoped semaphores for website workload management and a 'cowboy' mode flag, while removing the budget feature.
Jun 4, 2024
- v1.96.0
Fixes Chrome stealth mode user-agent spoofing and improves semaphore safety.
Jun 4, 2024
- v2.11.52.11.5
This release focuses on bug fixes and security improvements for the Upscayl application, specifically addressing issues with notification icons, non-ASCII file paths, and Windows upscaling capabilities.
Jun 1, 2024
- v1.95.28
A minor maintenance release that resolves an issue preventing the website crawl status from resetting unexpectedly.
Jun 1, 2024
- v1.95.27
Addresses major efficiency bottlenecks in crawl delays by capping robot delays at 60 seconds and fixing crawl limit exits.
May 28, 2024
- v1.95.9
Optimizes OpenAI and Chrome integration by removing alpha flags, cleaning up prompt compression, and streamlining page activation.
May 18, 2024
- v1.94.4
Introduces configuration flags to enable hybrid caching between Chrome CDP and HTTP requests, as well as header simulation.
May 9, 2024
- v1.1.0Open-Sora V1.1.0 Release
Released Open-Sora v1.1, focusing on ST-DiT architecture improvements, a new data processing pipeline, and broader resolution support.
May 7, 2024
- v1.93.43
Enhances anti-detection capabilities by adding dynamic user-agent generation and header spoofing support.
May 3, 2024
- v2.11.02.11.0
A major update revamping the backend to support up to 16X scaling, adding custom width options, and implementing lossy/lossless compression formats.
Apr 25, 2024
- v1.93.13
Updates dependencies and renames core URL getter functions to improve code clarity and compatibility.
Apr 23, 2024
- v1.93.3
Adds screenshot functionality to the OpenAI pipeline and fixes Chrome proxy connections.
Apr 14, 2024
- v1.92.0
Introduces caching for OpenAI responses to reduce latency and improve performance during crawls.
Apr 13, 2024
- v.1.91.1
This release enhances the AI result reporting by expanding the returned data structures to include the original prompt, JavaScript output, and content output.
Apr 10, 2024
- v1.90.0
Version 1.90.0 introduces automatic RSS feed handling and optimizes build performance by removing crate pins, alongside several OpenAI integration fixes.
Mar 29, 2024
- v1.88.7
This release adds multi-step browser automation capabilities driven by OpenAI to navigate towards specific goals, along with new configuration options for extra AI data.
Mar 26, 2024
- v1.87.3
Adds a `real_browser` feature flag to enable bypassing Cloudflare protection when crawling web pages using Chrome.
Mar 25, 2024
- v1.86.16
Introduces dynamic browser interaction capabilities using custom scripts powered by OpenAI and adds support for crawling Cold Fusion files.
Mar 19, 2024
- v1.0.0Open-Sora V1.0.0 Release
Initial release of Open-Sora, providing source code for data processing and video generation, along with optimized system infrastructure.
Mar 17, 2024