v0.2.6

D4Vinci/Scraplingv0.2.6Nov 24, 2024by D4Vinci

AI Summary

Added support for launching real Chrome browsers directly via the PlayWrightFetcher and fixed issues with header generation to reduce detection by protections.

Key Highlights

PlayWrightFetcher can now launch real Chrome browsers using the `real_chrome` argument.
BrowserForge headers updated to prevent detection by some protections.
Default value for `hide_canvas` changed to `False` to avoid ReCaptcha detection.

New Features

Real browser support via PlayWrightFetcher.
Updated headers for real browsers.

Full Release Notes

# What's changed
### New features
- Now the `PlayWrightFetcher` can use the real browser directly with the `real_chrome` argument passed to the `PlayWrightFetcher.fetch` function but this requires you to have Chrome browser installed. Scrapling will launch an instance of your Chrome browser and you can use most of the options as normal. (Before you only had the `cdp_url` argument to do so)
- Pumped up the version of headers generated for real browsers.


### Bugs Squashed
1. Turns out the format of the browser headers generated by `BrowserForge` was outdated which made Scrapling detected by some protections so now `BrowserForge` is only used to generate real useragent.
2. Now the `hide_canvas` argument is turned off by default as it's being detected by Google's ReCaptcha.

---

> [!NOTE] 
> A friendly reminder that maintaining and improving `Scrapling` takes a lot of time and effort which I have been happily doing for months even though it's becoming harder. So, if you like `Scrapling` and want it to keep improving, you can help by supporting me through the [Sponsor button](https://github.com/sponsors/D4Vinci).