v0.2.98
D4Vinci/Scraplingv0.2.98Mar 17, 2025by D4Vinci
AI Summary
Performance optimizations through lazy loading implementation.
Key Highlights
- Implemented Lazy loading for all submodules
- Memory usage reduced by ~40% for selection methods
- Import memory usage dropped from 30-40MB to ~1.2MB
New Features
- Lazy loading for reduced memory footprint
- Optimized memory usage and slight speed increase
Full Release Notes
**This is an essential update for everyone to enjoy Scrapling as it's intended fully** ## What's changed ### Various memory usage and speed optimizations - All selection methods' memory usage is ~40% of previous memory usage and the speed slightly increased. - Implemented Lazy loading for all submodules of the library so now what you use is what you load, for example: Before the update this import `from scrapling import Adaptor` was using `30-40mb` of RAM because it loaded all fetchers and stuff with it too, now it uses `~1.2mb`. - The last update made the library use ~32% memory it used before with a large requests pool, now we adjusted the caching further to use even less than that. - Overall speed increase in the parser by a slight 2-5% **_Thanks for all your support and donations!_** --- ## Big shoutout to our biggest Sponsor: [Scrapeless](https://www.scrapeless.com/en/product/deep-serp-api?utm_source=website&utm_medium=ads&utm_campaign=scraping&utm_term=d4vinci) <a href="https://www.scrapeless.com/en/product/deep-serp-api?utm_source=website&utm_medium=ads&utm_campaign=scraping&utm_term=d4vinci"><img src="https://raw.githubusercontent.com/D4Vinci/Scrapling/main/images/scrapeless.jpg" height="400" alt="Scrapeless Banner" ></a>