v1.12.0

livekit/agents-jsv1.12.0Jul 30, 2024by adbar

AI Summary

A release focusing on faster and more accurate extraction with enforced output format handling on the command line interface.

Key Highlights

Enforced fixed list of output formats
Improved link and structure checks
Improved justext fallback mechanism
Fix for JSON-LD baseline errors
Fix for markdown format triggering

Breaking Changes

Enforce fixed list of output formats and deprecate `-out` on CLI

New Features

XML-TEI updates (RelaxNG to DTD)
Table fixes to prevent MemoryError
Improved image length thresholds

Full Release Notes

Breaking change:
- enforce fixed list of output formats, deprecate `-out` on the CLI (#647)

Faster, more accurate extraction:
- review link and structure checks (#653)
- improve justext fallback (#652)
- baseline: prevent LXML error in JSON-LD (#643), do not use as backup extraction (#646)
- review XPaths for undesirable content (#645)

Bugfixes and maintenance:
- CLI fix: markdown format should trigger `include_formatting` (#649)
- images fix: use a length threshold on src attribute (#654)
- XML-TEI: replace RelaxNG by DTD, remove pickle, and update (#655)
- formatting & markdown fix: add newlines (#656)
- table fix: prevent `MemoryError` & `ValueError` during conversion to text (#658)

Documentation:
- update `crawls.rst`: `known` is an unexpected argument, by @tommytyc in #638