Starstruk Logo MarkStarstruk

v1.6.3

adbar/trafilaturav1.6.3Nov 29, 2023by adbar

AI Summary

Focuses on metadata precision and URL normalization. It updates the htmldate library for better date extraction and improves URL handling using the courlan library.

Key Highlights

  • More precise date extraction via updated htmldate.
  • URL normalization and tracker removal via updated courlan.
  • New config option for external URLs in feeds and sitemaps.

New Features

  • More precise date extraction
  • URL normalization and tracker removal
  • External URLs config option for feeds/sitemaps
  • Preserve space in certain elements

Full Release Notes

Extraction:
- preserve space in certain elements with @idoshamun (#429)
- optional list of xPaths to prune by @HeLehm (#414)

Metadata:
- more precise date extraction (see [htmldate](https://github.com/adbar/htmldate/releases/tag/v1.6.0))
- new `htmldate` extensive search parameter in config (#434)
- changes in URLs: normalization, trackers removed (see [courlan](https://github.com/adbar/courlan/releases/tag/v0.9.5))

Navigation:
- reviewed code for feeds (#443)
- new config option: external URLs for feeds/sitemaps (#441)

Documentation:
- update, add page on text embeddings with @tonyyanga (#428, #435, #447)
- fix quickstart by @sashkab (#419)