Starstruk Logo MarkStarstruk

v2

swisskyrepo/PayloadsAllTheThingsv2Sep 6, 2024by thomashacker

AI Summary

This major version (v2.0.0) features a complete migration to Weaviate v4 and async ingestion. It introduces a new file selection interface, directory uploads, and advanced chunking strategies like semantic and code chunking, along with a reworked admin interface and document explorer.

Key Highlights

  • Migrated to Weaviate v4 Client and introduced async ingestion
  • Added new file management features like directory upload and per-file settings
  • Introduced advanced chunking strategies including Semantic and Code chunking
  • Added DocumentExplorer with vector visualization and PCA
  • Enhanced UI with new themes and reworked admin interface

Breaking Changes

  • Migrated to Weaviate v4 Client (API changes likely required)

New Features

  • Async Ingestion with realtime logging
  • File Selection Interface and Directory Upload
  • Per-file control settings and multiple labels
  • Code Import and Code Chunking
  • Semantic Chunking
  • Label and Document Filters
  • VoyageAI integration
  • DocumentExplorer with Content, Chunk, and Vector views
  • Custom metadata support
  • Multiple themes

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️