v0.6.2
quickwit-oss/quickwitv0.6.2Jul 10, 2023by github-actions[bot]
AI Summary
Added cluster info endpoints, custom tokenizers, and storage flavors, along with fixes for the merge planner.
Key Highlights
- Added cluster info endpoint at `_elastic`.
- Added support for custom tokenizers ngram and regex.
- Added storage flavors.
- Fixed merge planner issue by fetching only immature splits.
New Features
- Cluster info endpoint
- Custom tokenizers (ngram, regex)
- Storage flavors
- Maturity timestamp migration for splits
Full Release Notes
# Added
- Add cluster info endpoint at `_elastic`
- Add support for custom tokenizers ngram and regex
- Add storage flavors
- Allow dots in identifier
# Fixed
- Fix mrecordlog corruption bug
- Fix merge planner issue #3576 by fetching only immature splits.
A short note on this fix. The upgrade will trigger a Postgresql migration, adding the column `maturity_timestamp` to the splits table.
By default, the `maturity_timestamp` is set to `1970-01-01 00:00:00`. All your splits will be considered mature and won't
undergo merge operations. This is primarily true for your splits, but... it may not be for splits created recently. You can do an additional
operation, like set the `maturity_timestamp` of recent splits with a low number of documents to a timestamp in the future, like `now + 48h`.
For the file-backed metastore, there is no migration process, the upgrade will add to a new field `maturity` for splits in the `metastore.json` file. By default it will be set to `{"type": "mature"}` but, as for Postgresql, you may want to set a different value for the split maturity like `{"type": "immature", "maturation_period_millis":172800000}`.
- Fix storage and metastore configuration