v0.2.98

D4Vinci/Scraplingv0.2.98Mar 17, 2025by D4Vinci

AI Summary

Performance optimizations through lazy loading implementation.

Key Highlights

  • Implemented Lazy loading for all submodules
  • Memory usage reduced by ~40% for selection methods
  • Import memory usage dropped from 30-40MB to ~1.2MB

New Features

  • Lazy loading for reduced memory footprint
  • Optimized memory usage and slight speed increase

Full Release Notes

**This is an essential update for everyone to enjoy Scrapling as it's intended fully**

## What's changed
### Various memory usage and speed optimizations
- All selection methods' memory usage is ~40% of previous memory usage and the speed slightly increased.
- Implemented Lazy loading for all submodules of the library so now what you use is what you load, for example:
Before the update this import `from scrapling import Adaptor` was using `30-40mb` of RAM because it loaded all fetchers and stuff with it too, now it uses `~1.2mb`.
- The last update made the library use ~32% memory it used before with a large requests pool, now we adjusted the caching further to use even less than that.
- Overall speed increase in the parser by a slight 2-5%

**_Thanks for all your support and donations!_**

---

## Big shoutout to our biggest Sponsor: [Scrapeless](https://www.scrapeless.com/en/product/deep-serp-api?utm_source=website&utm_medium=ads&utm_campaign=scraping&utm_term=d4vinci)
<a href="https://www.scrapeless.com/en/product/deep-serp-api?utm_source=website&utm_medium=ads&utm_campaign=scraping&utm_term=d4vinci"><img src="https://raw.githubusercontent.com/D4Vinci/Scrapling/main/images/scrapeless.jpg" height="400" alt="Scrapeless Banner" ></a>