v0.3.7
D4Vinci/Scraplingv0.3.7Oct 12, 2025by github-actions[bot]
AI Summary
A comprehensive update focusing on code quality, IDE compatibility, and enhanced browser session management.
Key Highlights
- Reworked `solve_cloudflare` to handle all custom Turnstile implementations
- Full refactoring for Pyright compliance for flawless IDE experience
- Added `user_data_dir` option to reuse browser session data across runs
- Added `additional_args` to DynamicFetcher for Playwright context customization
- Improved route logic to pass raw responses to parsers before browser processing
New Features
- Persistent browser session support via `user_data_dir`
- Custom Playwright context arguments via `additional_args`
- Refactored codebase for Pyright compliance and faster requests logic
Full Release Notes
**A new update with many important changes** # 🚀 New Stuff and quality of life changes - Reworked `solve_cloudflare` argument in `StealthyFetcher` to make it able to solve all kinds of custom implementations of Turnstile. - Refactored the entire codebase to be acceptable by Pyright, so expect a flawless IDE experience now with all software and many bugs solved. - Refactored the requests logic to be cleaner and faster (Also solves #97 ) - Added a new option `user_data_dir` to all browser-based session classes to allow the user to reuse the browser session data (cookies/storage/etc...) from previous sessions. Leaving it will cause Playwright to use a random directory on each run, as was happening before. - Added a new customization option `additional_args` to `Dynamic fetcher` and its session class to enable the user to pass extra arguments to Playwright's context, as we had with `StealthyFetcher` before. - The route logic for collecting the last navigation response for all browsers has been improved, which allows the raw responses to be passed to the parser before being processed by the browsers as before. This will be very helpful with text/JSON responses. # 🐛 Bug Fixes - The rework of the route logic solved an issue with retrieving the content of unstable websites on some Windows devices. - All the refactors that happened in this version solved a lot of bugs along the way that were hard to spot before, and weird autocompletion issues with some IDEs. - Many fixes to the documentation website _🙏 Special thanks to our [Discord community](https://discord.gg/EMgGbDceNQ) for all the continuous testing and feedback_ --- ### Big shoutout to our biggest Sponsors <a href="https://www.thordata.com/?ls=github&lk=D4Vinci" target="_blank" title="A global network of over 60M+ residential proxies with 99.7% availability, ensuring stable and reliable web data scraping to support AI, BI, and workflows."><img src="https://raw.githubusercontent.com/D4Vinci/Scrapling/main/images/thordata.jpg"></a><a href="https://evomi.com?utm_source=github&utm_medium=banner&utm_campaign=d4vinci-scrapling" target="_blank" title="Evomi is your Swiss Quality Proxy Provider, starting at $0.49/GB"><img src="https://raw.githubusercontent.com/D4Vinci/Scrapling/main/images/evomi.png"></a><a href="https://visit.decodo.com/Dy6W0b" target="_blank" title="Try the Most Efficient Residential Proxies for Free"><img src="https://raw.githubusercontent.com/D4Vinci/Scrapling/main/images/decodo.png"></a><a href="https://petrosky.io/d4vinci" target="_blank" title="PetroSky delivers cutting-edge VPS hosting."><img src="https://raw.githubusercontent.com/D4Vinci/Scrapling/main/images/petrosky.png"></a>