Starstruk Logo MarkStarstruk

v2

cloudflare/pingorav2Sep 6, 2024by thomashacker

AI Summary

This is a major version update (v2.0.0) introducing async ingestion, real-time logging, and a comprehensive overhaul of the UI and chunking strategies. It includes new features like the Document Explorer, Code Import, and VoyageAI integration.

Key Highlights

  • Async Ingestion with realtime logging
  • Expanded chunking strategies (HTML, Markdown, Code, Semantic)
  • Document Explorer with Vector View and PCA
  • New File Selection Interface and Directory Upload
  • VoyageAI integration

New Features

  • Async Ingestion with realtime logging
  • Migrated to Weaviate v4 Client
  • New File Selection Interface and Directory Upload
  • Control Settings per file/url individually
  • Import individual files or all with overwrite option
  • Add multiple labels to documents
  • More configuration for readers, chunkers, and embedders
  • Improved Document Search UI and Config Validation
  • New Readers: HTML Reader
  • New Chunkers: Recursive, HTML, Markdown, Code, Semantic
  • Label Filter and Document Filter
  • Add more themes
  • Reworked Admin Interface and Suggestion View
  • Added VoyageAI and custom metadata
  • DocumentExplorer with Content, Chunk, and Vector Views (visualize vectors and PCA)

Full Release Notes

# Importastic Verba Update (v2.0.0)  🚀 

## What's New?

## Added

- Async Ingestion with realtime logging
- Migrated to Weaviate v4 Client
- Added new File Selection Interface
- Add Directory Upload
- Control Settings per file/url individually
- Import individual files or all
- Overwrite existing files
- Add multiple labels to documents
- More configuration for readers, chunkers, and embedders
- Improved Document Search UI
- Add Config Validation
- Add HTML Reader
- Add Recursive Chunker
- Add HTML Chunker
- Add Markdown Chunker
- Add Code Import
- Add Code Chunking
- Add Semantic Chunking
- Label Filter
- Document Filter (Add document to chat)
- Add more themes
- Reworked Admin Interface
- Added Suggestion View
- Reworked Suggestion logic
- Added VoyageAI
- Added custom metadata
- Added DocumentExplorer with
  - Content View
  - Chunk View
  - Vector View
    - Visualize vectors of chunks of one or multiple documents
    - PCA

## To get started with Verba, simply run:

`pip install goldenverba`

or download the wheels.

Happy RAG! ❤️