v2

Developer-Y/cs-video-coursesv2Sep 6, 2024by thomashacker

AI Summary

A major version overhaul introducing async ingestion, a complete UI redesign, and advanced chunking strategies, alongside a migration to Weaviate v4.

Key Highlights

Migrated to Weaviate v4 Client
Added comprehensive chunking strategies (HTML, Code, Semantic)
Introduced Document Explorer with vector visualization (PCA)
Async ingestion with realtime logging

Breaking Changes

Migrated to Weaviate v4 Client
Collection names changed to prevent conflicts with older versions
Python version range changed below 3.13

New Features

Async Ingestion with realtime logging
Weaviate v4 Client
File Selection Interface
Directory Upload
Control Settings per file/url
Import individual files or all
Overwrite existing files
Multiple labels
Config Validation
HTML Reader
Recursive Chunker
HTML Chunker
Markdown Chunker
Code Import
Code Chunking
Semantic Chunking
Label Filter
Document Filter
Themes
Reworked Admin Interface
Suggestion View
VoyageAI
Custom metadata
DocumentExplorer

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️