Starstruk Logo MarkStarstruk

v0.6.3

quickwit-oss/quickwitv0.6.3Jul 28, 2023by github-actions[bot]

AI Summary

Added new tokenizers and improved timestamp parsing capabilities.

Key Highlights

  • Added Multilang tokenizer and Source code tokenizer.
  • Added support for sorting by two fields.
  • Added parsing for Unix timestamps passed as strings.

New Features

  • Multilang tokenizer
  • Source code tokenizer
  • Multi-field sorting
  • Unix timestamp string parsing

Full Release Notes

## Added

- Multilang tokenizer
- Source code tokenizer
- Sort by two fields
- Parse Unix timestamps passed as a string.

## Fixed

- Fix disabling of ANSI characters in logs
- Fix OTEL logs default tokenizer of `body.message` field

## Changed
- Default fast field tokenizer for fast fields is the raw tokenizer with remove filter above 256 bytes