v2

X-PLUG/mPLUG-DocOwlv2Sep 6, 2024by thomashacker

AI Summary

This is a major overhaul of the Verba application focusing on RAG capabilities, featuring a Weaviate v4 migration, VoyageAI integration, and a comprehensive new DocumentExplorer tool with vector visualization.

Key Highlights

Migrated to Weaviate v4 Client
Added DocumentExplorer with Vector View and PCA
Integrated VoyageAI for embeddings
Enhanced ingestion with async logging and directory upload
Reworked Admin Interface and Suggestion logic

New Features

Async Ingestion with realtime logging
Weaviate v4 Client
DocumentExplorer (Content, Chunk, Vector views)
VoyageAI integration
Multiple chunkers (HTML, Markdown, Code, Semantic, Recursive)
Directory upload and file selection interface

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️