v1.6.2

adbar/trafilaturav1.6.2Sep 6, 2023by adbar

AI Summary

Improves parsing robustness and CLI usability. It allows more lenient HTML parsing, adds a `--probe` option to check content, and adds support for Python 3.12.

Key Highlights

  • More lenient HTML parsing support.
  • Added `--probe` CLI option to check for extractable content.
  • Support for Python 3.12.

New Features

  • More lenient HTML parsing
  • Added `--probe` option to CLI
  • Support for Python 3.12
  • Convert relative links to absolute
  • Improved code block support

Full Release Notes

Extraction:
- more lenient HTML parsing (#370)
- improved code block support with @idoshamun (#372, #401)
- convertion of relative links to absolute by @feltcat (#377)
- remove use of signal from core functions (#384)

Metadata:
- JSON-LD fix for sitenames by @felipehertzer (#383)

Command-line interface:
- more robust batch processing (#381)
- added `--probe` option to CLI to check for extractable content (#378, #392)

Maintenance:
- simplified code (#408)
- support for Python 3.12
- pinned LXML version for MacOS (#393)
- updated dependencies and parameters (notably `htmldate` and `courlan`)
- code cleaning by @marksmayo (#406)