v2

Laxcorp-Research/project-ravenv2Sep 6, 2024by thomashacker

AI Summary

This major update migrates to Weaviate v4, introduces async ingestion, and completely reworks the interface with new file selection, chunking strategies, and vector visualization tools.

Key Highlights

  • Migrated to Weaviate v4 Client
  • Added Async Ingestion
  • Added DocumentExplorer with Vector View (PCA)
  • Added Semantic Chunking
  • Reworked Admin Interface

Breaking Changes

  • Migrated to Weaviate v4 Client
  • Collection names changed to prevent conflicts
  • Python version range below 3.13

New Features

  • Async ingestion
  • File selection interface
  • Directory upload
  • Control settings per file
  • Multiple labels
  • Custom metadata
  • Recursive/HTML/Markdown chunkers
  • Semantic chunking
  • Reworked UI
  • VoyageAI
  • DocumentExplorer
  • Themes

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️