Starstruk Logo MarkStarstruk

v2.3.0

opendatalab/MinerUv2.3.0May 13, 2026by iamprashant

AI Summary

Introduces 'Bring Your Own LLM Infrastructure' to Rapida, featuring a Custom LLM provider, Ambient Audio for calls, and Assistant Authentication capabilities.

Key Highlights

  • Custom LLM provider supporting OpenAI, Anthropic, Google, and OpenAI-compatible APIs.
  • Ambient audio added to live calls for a more natural experience.
  • Assistant Authentication allows configuring HTTP endpoints before agent starts.

New Features

  • Custom LLM provider with support for OpenAI Chat Completions, Responses, Anthropic Messages, and Google Gemini.
  • Ambient audio for receptionist, support, and outbound flows.
  • Assistant Authentication with configurable HTTP endpoints, headers, and fail behavior.

Full Release Notes

## What's Changed

This release ships three major updates to Rapida.

### Custom LLM
You can now bring your own LLM into Rapida with the new `Custom LLM` provider.

Supported API compatibility:
- OpenAI Chat Completions (`/v1/chat/completions`)
- OpenAI Responses (`/v1/responses`)
- Anthropic Messages (`/v1/messages`)
- Google Gemini (`generateContent`)
- OpenAI Compatible (`Ollama`, `vLLM`, `LM Studio`, `TGI`)

You can point Rapida at your own base URL, pass optional headers, and keep the same workflow inside the product while changing the model layer underneath.

Related PR: `#108`

### Ambient Audio
We also added ambient audio so calls do not feel silent or broken in production.

- Adds background presence to live calls
- Useful for receptionist, support, concierge, and outbound flows
- Helps phone and web deployments feel more natural

Related PR: `#113`

### Assistant Authentication
You can now authenticate a session before the agent starts.

- Configure an HTTP authentication endpoint for inbound or outbound sessions
- Pass headers, request body, timeout, and condition rules
- Control fail behavior with `Block` or `Do nothing`
- Verify sessions before initialization instead of letting every call go straight to the agent

This makes it easier to add your own policy, routing, verification, or access control step before Rapida starts the conversation.

Related PR: `#116`

### Why This Matters

- Bring your own model infrastructure into Rapida
- Improve the live call experience without extra media plumbing
- Add a verification layer before the assistant starts a session

## Breaking Changes

None.

## Upgrade Guide

### Self-hosted

```bash
git pull origin main
docker compose up -d --build
```

### Rapida Cloud

No action required.


## New Contributors
* @eschmidbauer made their first contribution in https://github.com/rapidaai/voice-ai/pull/108

**Full Changelog**: https://github.com/rapidaai/voice-ai/compare/v2.2.0...v2.3.0