v1.12.0

useautumn/autumnv1.12.0Jul 30, 2024by adbar

AI Summary

A major patch release enforcing fixed output formats and improving extraction accuracy through better link checks and fallback mechanisms.

Key Highlights

Enforces fixed list of output formats
Faster and more accurate extraction
Improved justext fallback
Fixes JSON-LD baseline errors

Breaking Changes

Enforce fixed list of output formats
Deprecate `-out` flag on CLI

New Features

Improved link and structure checks
Improved justext fallback
XML-TEI updates (RelaxNG to DTD)
Table conversion fixes

Full Release Notes

Breaking change:
- enforce fixed list of output formats, deprecate `-out` on the CLI (#647)

Faster, more accurate extraction:
- review link and structure checks (#653)
- improve justext fallback (#652)
- baseline: prevent LXML error in JSON-LD (#643), do not use as backup extraction (#646)
- review XPaths for undesirable content (#645)

Bugfixes and maintenance:
- CLI fix: markdown format should trigger `include_formatting` (#649)
- images fix: use a length threshold on src attribute (#654)
- XML-TEI: replace RelaxNG by DTD, remove pickle, and update (#655)
- formatting & markdown fix: add newlines (#656)
- table fix: prevent `MemoryError` & `ValueError` during conversion to text (#658)

Documentation:
- update `crawls.rst`: `known` is an unexpected argument, by @tommytyc in #638