v2

zai-org/GLM-5v2Sep 6, 2024by thomashacker

AI Summary

A major overhaul focusing on a complete UI redesign, async ingestion, and a massive expansion of document processing capabilities including multiple chunking strategies and vector visualization.

Key Highlights

Migrated to Weaviate v4 Client and Async Ingestion.
Added DocumentExplorer with Vector and PCA views.
Introduced multiple chunking strategies (HTML, Recursive, Semantic, Code).
Added VoyageAI and custom metadata support.

New Features

Async Ingestion with realtime logging.
Migrated to Weaviate v4 Client.
New File Selection Interface and Directory Upload.
Control settings per file/url individually.
Multiple chunking types (HTML, Recursive, Markdown, Code, Semantic).
DocumentExplorer with Content, Chunk, and Vector views.
VoyageAI support.

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️