0.8.0
maurosoria/dirsearch0.8.0Mar 17, 2025by ts-thomas
Upgrading?
AI Summary
A major performance and feature overhaul that introduces persistent indexes across multiple databases, a new Encoder class, and a Resolver system.
Key Highlights
- Support for persistent indexes in Redis, SQLite, Postgres, MongoDB, and Clickhouse
- Query performance improved up to 4.5 times compared to v0.7.x
- Regex Pre-Compilation transforming hundreds of rules into just a few
- Support for larger indexes with extended key size (up to 2^24)
New Features
- Enhanced language customization via the new `Encoder` class
- Basic Resolver with operators (and, or, xor, not, limit, offset, boost, resolve)
- Custom Fields ('Virtual Fields') and Custom Score Function
- Full covering index.d.ts type definitions
Full Release Notes
- Persistent indexes support for: `IndexedDB` (Browser), `Redis`, `SQLite`, `Postgres`, `MongoDB`, `Clickhouse`
- Enhanced language customization via the new `Encoder` class
- Result Highlighting
- Query performance achieve results up to 4.5 times faster compared to the previous generation v0.7.x by also improving the quality of results
- Enhanced support for larger indexes or larger result sets
- Improved offset and limit processing achieve up to 100 times faster traversal performance through large datasets
- Support for larger In-Memory index with extended key size (the defaults maximum keystore limit is: 2^24)
- Greatly enhanced performance of the whole text encoding pipeline
- Improved indexing of numeric content (Triplets)
- Intermediate result sets and `Resolver`
- Basic Resolver: `and`, `or`, `xor`, `not`, `limit`, `offset`, `boost`, `resolve`
- Improved charset collection
- New charset preset `soundex` which further reduces memory consumption by also increasing "fuzziness"
- Performance gain when polling tasks to the index by using "Event-Loop-Caches"
- Up to 100 times faster deletion/replacement when not using the additional "fastupdate" register
- Regex Pre-Compilation (transforms hundreds of regex rules into just a few)
- Extended support for multiple tags (DocumentIndex)
- Custom Fields ("Virtual Fields")
- Custom Filter
- Custom Score Function
- Added French language preset (stop-word filter, stemmer)
- Enhanced Worker Support
- Export / Import index in chunks
- Improved Build System + Bundler (Supported: CommonJS, ESM, Global Namespace), also the import of language packs are now supported for Node.js
- Full covering index.d.ts type definitions
- Fast-Boot Serialization optimized for Server-Side-Rendering (PHP, Python, Ruby, Rust, Java, Go, Node.js, ...)Related Repositories
public-apis/public-apis★ 491,235
A collective list of free APIs
NousResearch/hermes-agent★ 256,109
The agent that grows with you
yt-dlp/yt-dlp★ 200,281
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,570
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,699
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.