Starstruk Logo MarkStarstruk

v1.5.0

adbar/trafilaturav1.5.0Mar 30, 2023by adbar

AI Summary

This release focuses on refining metadata extraction, fixing XML output, and refactoring URL management to an external library.

Key Highlights

  • Metadata extraction fixes and addition of pagetype and image URLs
  • New `as_dict` method for the Document class
  • XML output fixes and improved parsing robustness
  • Transfer of URL management to `courlan.UrlStore`
  • Code simplification and extended test coverage

New Features

  • as_dict method
  • pagetype and image URLs in metadata

Full Release Notes

Extraction:
- fixes for metadata extraction with @felipehertzer (#295, #296),  @andremacola (#282, #310), and @edkrueger (#303)
- pagetype and image urls added to metadata by @andremacola (#282, #310)
- add as_dict method to Document class with @edkrueger in #306
- XML output fix with @knit-bee in #315
- various smaller fixes: lists (#309), XPaths, metadata hardening

Navigation:
- transfer URL management to courlan.UrlStore (#232, #312)
- fixes for spider module

Maintenance:
- simplify code and extend tests
- underlying packages htmldate and courlan, update setup and docs

**Full Changelog**: https://github.com/adbar/trafilatura/compare/v1.4.1...v1.5.0