Starstruk Logo MarkStarstruk

v7.2.0

neuml/txtaiv7.2.0May 31, 2024by davidmezzetti

AI Summary

This release adds Postgres integration (pgvector), LLM chat messages, and vectorization support with llama.cpp and LiteLLM.

Key Highlights

  • Add pgvector ANN backend
  • Add RDBMS Graph
  • Add support for chat messages in LLM pipeline
  • Add support for llama.cpp vector backend
  • Add support for LiteLLM vector backend

New Features

  • pgvector ANN backend
  • RDBMS Graph
  • LLM chat messages support
  • llama.cpp vector backend
  • LiteLLM vector backend

Full Release Notes

**This release adds Postgres integration for all components, LLM Chat Messages and vectorization with llama.cpp/LiteLLM**

See below for full details on the new features, improvements and bug fixes.

New Features
--------------------------
- Add pgvector ANN backend (#698)
- Add RDBMS Graph (#699)
- Add notebook covering txtai integration with Postgres (#701)
- Add Postgres Full Text Scoring (#713)
- Add support for chat messages in LLM pipeline (#718)
- Add support for LiteLLM vector backend (#725)
- Add support for llama.cpp vector backend (#726)
- Add notebook showing to run RAG with llama.cpp and LiteLLM (#728)

Improvements
--------------------------
- Split similarity extras install (#696)
- Ensure config.path = None and config.path missing mean the same thing (#704)
- Add close methods to ANN and Graph (#711)
- Update finalizers to check object attributes haven't already been cleared (#722)
- Update LLM pipeline to support GPU parameter with llama.cpp backend (#724)
- Refactor vector module to support additional backends (#727)

Bug Fixes
--------------------------
- Fix issue with database.search and empty scores (#712)
- Update HFOnnx pipeline to default to opset 14 (#719)
- Fix incompatibility with ONNX models and transformers>=4.41.0 (#720)
- Fix incompatibility between latest skl2onnx and txtai (#729)