v8.4.0

neuml/txtaiv8.4.0Mar 11, 2025by davidmezzetti

AI Summary

Adds support for vision LLMs, graph vector search, embeddings checkpoints, observability, and an OpenAI-compatible API endpoint.

Key Highlights

  • Add support for vision models to HF LLM pipeline
  • Add similar query clause to graph queries
  • Add OpenAI API compatible endpoint to API
  • Feature Request: Enhance observability and tracing capabilities

New Features

  • Vision models support
  • Graph vector search
  • OpenAI-compatible API endpoint
  • Embeddings index checkpointing

Full Release Notes

**This release adds support for vision LLMs, graph vector search, embeddings checkpoints, observability and an OpenAI-compatible API**

See below for full details on the new features, improvements and bug fixes.

New Features
--------------------------
- Add support for vision models to HF LLM pipeline (#884)
- Add similar query clause to graph queries (#875)
- Feature Request: Embeddings index checkpointing (#695)
- Feature Request: Enhance observability and tracing capabilities (#869)
- Add OpenAI API compatible endpoint to API (#883)
- Add example notebook showing how to use OpenAI compatible API (#887)
- Add texttospeech pipeline to API (#552)
- Add upload endpoint to API (#659)

Improvements
--------------------------
- Add encoding parameter to TextToSpeech pipeline (#885)
- Add support for input streams to Transcription pipeline (#886)

Bug Fixes
--------------------------
- Fix bug with latest version of Transformers and model registry (#878)