Starstruk Logo MarkStarstruk

v1.8.0

adbar/trafilaturav1.8.0Mar 20, 2024by adbar

AI Summary

A performance and precision update that introduces better extraction accuracy, CSV output improvements, and LXML optimizations. It also changes the project license to Apache 2.0.

Key Highlights

  • Better extraction precision implemented.
  • Improved CSV output and code formatting in TXT/Markdown outputs.
  • LXML: compile XPath expressions for speedup.
  • License changed to Apache 2.0.

Breaking Changes

  • Removed `lxml.html.Cleaner` class.

New Features

  • Better precision for extraction
  • Improved CSV output
  • LXPath expression compilation
  • More robust scans with `is_live_page()`
  • Better sitemap start and safeguards

Full Release Notes

Extraction:
- Better precision by @felipehertzer (#509, #520)
- Code formatting in TXT/Markdown output added (#498)
- Improved CSV output (#496)
- LXML: compile XPath expressions (#504)
- Overall speedup about +5%

Downloads and Navigation:
- More robust scans with `is_live_page()` (#501)
- Better sitemap start and safeguards (#503, #506)
- Fix for headers in response object (#513)

Maintenance:
- License changed to Apache 2.0
- `Response` class: convenience functions added (#497)
- `lxml.html.Cleaner` removed (#491)
- CLI fixes: parallel cores and processing (#524)