Starstruk Logo MarkStarstruk

v2

weaviate/Verbav2Sep 6, 2024by thomashacker

AI Summary

A major overhaul introducing asynchronous ingestion, a new DocumentExplorer with vector visualization, and migration to Weaviate v4 Client.

Key Highlights

  • Migrated to Weaviate v4 Client
  • Implemented Async Ingestion with real-time logging
  • Introduced DocumentExplorer with vector visualization (PCA)
  • Added new File Selection Interface and Directory Upload
  • Expanded chunking strategies (HTML, Code, Semantic)

Breaking Changes

  • Migrated to Weaviate v4 Client

New Features

  • Async Ingestion with realtime logging
  • Weaviate v4 Client
  • File Selection Interface
  • Directory Upload
  • Control Settings per file/url individually
  • Import individual files or all
  • Overwrite existing files
  • Add multiple labels to documents
  • Config Validation
  • HTML Reader
  • Recursive Chunker
  • HTML Chunker
  • Markdown Chunker
  • Code Import
  • Code Chunking
  • Semantic Chunking
  • Label Filter
  • Document Filter (Add document to chat)
  • Themes
  • Reworked Admin Interface
  • Suggestion View
  • VoyageAI
  • Custom metadata
  • DocumentExplorer with Content View, Chunk View, Vector View, and PCA

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️