v2.3.0
adbar/trafilaturav2.3.0Oct 2, 2026by adbar
Upgrading?
AI Summary
This update focuses on performance improvements through a downloads and decompression overhaul, alongside significant fixes for text extraction, Markdown output, and metadata handling.
Key Highlights
- Downloads and decompression overhaul
- Simplified document handling code for better correctness
- Simpler and faster deduplication with scoped caches
- Improved text extraction for forms, boilerplate, and complex layouts
- Better Markdown output and metadata preservation
New Features
- Scoped caches for deduplication
- Preserve requested images in fallbacks
- Support for zstd frames, sitemap namespaces, Atom links, and JSON feeds
Full Release Notes
Major changes: - Downloads and decompression overhaul by @adbar (#921) - Simplified document handling code and better correctness by @adbar (#938) - Simpler and faster deduplication, scoped caches accepted by @adbar (#919) Fixes: - Better text extraction: forms, link farms, inline code, infinite scroll, boilerplate widgets, inline links, nested lists and text after blocks by @cvl01, @ebarkhordar, @bobtheskull-flameeyes, @emecii, @SulimanAbdulrazzaq and @r0h1tb (#884, #898, #901, #911, #916, #927, #929, #937, #940) - Better Markdown output: spacing, bold spans, CommonMark escaping and LaTeX math by @cvl01, @scottwulf, @ebarkhordar and @jonathanavis96 (#899, #902, #915, #924) - Preserve requested images in fallbacks by @vvsotnikov (#904) - Better metadata: word boundaries, JSON-LD types, OpenGraph, license links, list values, canonical URLs and TXT/Markdown header by @adbar, @xblwh, @mfurkanakinci and @MohammadHijjawi97 (#918, #932, #934, #936, #941, #942, #947) - More robust downloads and link discovery: relative URLs, zstd frames, sitemap namespaces, Atom links and JSON feeds by @ebarkhordar, @audi0417, @be-student and @mfurkanakinci (#909, #920, #926, #933, #935) Maintenance: - Refine and restructure the docs by @adbar (#908) - Link URL discovery tools from extraction guidance by @workstonedai-collab (#944)
Related Repositories
public-apis/public-apis★ 491,139
A collective list of free APIs
NousResearch/hermes-agent★ 255,979
The agent that grows with you
yt-dlp/yt-dlp★ 200,075
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,496
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,705
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.