Starstruk Logo MarkStarstruk

v0.7.0

adbar/trafilaturav0.7.0Jan 4, 2021by adbar

AI Summary

This release focuses on performance improvements, better feed and sitemap handling, and increased configuration flexibility.

Key Highlights

  • Customizable configuration file to parametrize extraction and downloads
  • Better handling of feeds and sitemaps
  • Additional CLI options: cryptographic hash for file name and Internet Archive backup
  • More precise extraction
  • Faster downloads using urllib3

New Features

  • Customizable configuration file
  • CLI options for cryptographic hash and Internet Archive backup

Full Release Notes

- customizable configuration file to parametrize extraction and downloads
- better handling of feeds and sitemaps
- additional CLI options: crytographic hash for file name, use Internet Archive as backup
- more precise extraction
- faster downloads: `requests` replaced with bare `urllib3` and custom decoding
- consolidation: bug fixes and improvements, many thanks to the issues reporters!