Starstruk Logo MarkStarstruk

v2.3.0

rapidaai/voice-aiv2.3.0May 13, 2026by iamprashant

AI Summary

This release introduces three major features enabling users to bring their own LLM infrastructure, adds ambient audio for more natural live calls, and implements pre-session authentication verification. It allows organizations to use their own LLM providers while maintaining the same workflow inside Rapida.

Key Highlights

  • Custom LLM provider with support for OpenAI, Anthropic, Google Gemini, and OpenAI-compatible APIs (Ollama, vLLM, LM Studio, TGI)
  • Ambient audio for background presence on live calls - useful for receptionist, support, and outbound flows
  • Assistant authentication with configurable HTTP endpoint for inbound/outbound session verification
  • Redis-backed ownership for reliable multi-instance deployments
  • Breaking: None

New Features

  • Custom LLM with configurable base URL and optional headers
  • Ambient audio for natural call experience
  • Assistant authentication with Block/Do nothing fail behavior

Full Release Notes

## What's Changed

This release ships three major updates to Rapida.

### Custom LLM
You can now bring your own LLM into Rapida with the new `Custom LLM` provider.

Supported API compatibility:
- OpenAI Chat Completions (`/v1/chat/completions`)
- OpenAI Responses (`/v1/responses`)
- Anthropic Messages (`/v1/messages`)
- Google Gemini (`generateContent`)
- OpenAI Compatible (`Ollama`, `vLLM`, `LM Studio`, `TGI`)

You can point Rapida at your own base URL, pass optional headers, and keep the same workflow inside the product while changing the model layer underneath.

Related PR: `#108`

### Ambient Audio
We also added ambient audio so calls do not feel silent or broken in production.

- Adds background presence to live calls
- Useful for receptionist, support, concierge, and outbound flows
- Helps phone and web deployments feel more natural

Related PR: `#113`

### Assistant Authentication
You can now authenticate a session before the agent starts.

- Configure an HTTP authentication endpoint for inbound or outbound sessions
- Pass headers, request body, timeout, and condition rules
- Control fail behavior with `Block` or `Do nothing`
- Verify sessions before initialization instead of letting every call go straight to the agent

This makes it easier to add your own policy, routing, verification, or access control step before Rapida starts the conversation.

Related PR: `#116`

### Why This Matters

- Bring your own model infrastructure into Rapida
- Improve the live call experience without extra media plumbing
- Add a verification layer before the assistant starts a session

## Breaking Changes

None.

## Upgrade Guide

### Self-hosted

```bash
git pull origin main
docker compose up -d --build
```

### Rapida Cloud

No action required.


## New Contributors
* @eschmidbauer made their first contribution in https://github.com/rapidaai/voice-ai/pull/108

**Full Changelog**: https://github.com/rapidaai/voice-ai/compare/v2.2.0...v2.3.0