0.8.0
nextapps-de/flexsearch0.8.0Mar 17, 2025by ts-thomas
AI Summary
This major release introduces persistent index support across multiple databases (IndexedDB, Redis, SQLite, Postgres, MongoDB, Clickhouse) and adds the Encoder class for enhanced language customization. Query performance is up to 4.5x faster with improved result quality and up to 100x faster offset/limit traversal.
Key Highlights
- Persistent indexes support for IndexedDB, Redis, SQLite, Postgres, MongoDB, Clickhouse
- Enhanced language customization via new Encoder class
- Result Highlighting support
- Query performance up to 4.5x faster than v0.7.x
- Offset and limit processing up to 100x faster for large datasets
New Features
- Support for larger In-Memory index with extended key size (max: 2^24)
- Greatly enhanced performance of text encoding pipeline
- Improved indexing of numeric content (Triplets)
- Intermediate result sets and Resolver with operations: and, or, xor, not, limit, offset, boost, resolve
- New charset preset soundex for reduced memory and increased fuzziness
- Event-Loop-Caches for faster task polling
- Up to 100x faster deletion/replacement without fastupdate register
- Regex Pre-Compilation
- Extended support for multiple tags (DocumentIndex)
- Custom Fields (Virtual Fields)
- Custom Filter
- Custom Score Function
- French language preset (stop-word filter, stemmer)
- Enhanced Worker Support
- Export/Import index in chunks
- Improved Build System (CommonJS, ESM, Global Namespace)
- Full covering index.d.ts type definitions
- Fast-Boot Serialization for SSR (PHP, Python, Ruby, Rust, Java, Go, Node.js)
Full Release Notes
- Persistent indexes support for: `IndexedDB` (Browser), `Redis`, `SQLite`, `Postgres`, `MongoDB`, `Clickhouse`
- Enhanced language customization via the new `Encoder` class
- Result Highlighting
- Query performance achieve results up to 4.5 times faster compared to the previous generation v0.7.x by also improving the quality of results
- Enhanced support for larger indexes or larger result sets
- Improved offset and limit processing achieve up to 100 times faster traversal performance through large datasets
- Support for larger In-Memory index with extended key size (the defaults maximum keystore limit is: 2^24)
- Greatly enhanced performance of the whole text encoding pipeline
- Improved indexing of numeric content (Triplets)
- Intermediate result sets and `Resolver`
- Basic Resolver: `and`, `or`, `xor`, `not`, `limit`, `offset`, `boost`, `resolve`
- Improved charset collection
- New charset preset `soundex` which further reduces memory consumption by also increasing "fuzziness"
- Performance gain when polling tasks to the index by using "Event-Loop-Caches"
- Up to 100 times faster deletion/replacement when not using the additional "fastupdate" register
- Regex Pre-Compilation (transforms hundreds of regex rules into just a few)
- Extended support for multiple tags (DocumentIndex)
- Custom Fields ("Virtual Fields")
- Custom Filter
- Custom Score Function
- Added French language preset (stop-word filter, stemmer)
- Enhanced Worker Support
- Export / Import index in chunks
- Improved Build System + Bundler (Supported: CommonJS, ESM, Global Namespace), also the import of language packs are now supported for Node.js
- Full covering index.d.ts type definitions
- Fast-Boot Serialization optimized for Server-Side-Rendering (PHP, Python, Ruby, Rust, Java, Go, Node.js, ...)