v1.12.0

zhu-xlab/GlobalBuildingAtlasv1.12.0Jul 30, 2024by adbar

AI Summary

Focuses on performance and accuracy improvements alongside a breaking change to CLI output format handling.

Key Highlights

Enforce fixed list of output formats on CLI
Improve extraction accuracy and speed
Fix table and image handling issues
Update XML-TEI to use DTD instead of RelaxNG

Breaking Changes

Enforce fixed list of output formats, deprecate -out on the CLI

New Features

Improved link and structure checks
Better justext fallback mechanism
JSON-LD baseline prevention of LXML errors
Image length threshold on src attribute
Markdown formatting improvements

Full Release Notes

Breaking change:
- enforce fixed list of output formats, deprecate `-out` on the CLI (#647)

Faster, more accurate extraction:
- review link and structure checks (#653)
- improve justext fallback (#652)
- baseline: prevent LXML error in JSON-LD (#643), do not use as backup extraction (#646)
- review XPaths for undesirable content (#645)

Bugfixes and maintenance:
- CLI fix: markdown format should trigger `include_formatting` (#649)
- images fix: use a length threshold on src attribute (#654)
- XML-TEI: replace RelaxNG by DTD, remove pickle, and update (#655)
- formatting & markdown fix: add newlines (#656)
- table fix: prevent `MemoryError` & `ValueError` during conversion to text (#658)

Documentation:
- update `crawls.rst`: `known` is an unexpected argument, by @tommytyc in #638