Starstruk Logo MarkStarstruk

v0.6

fixie-ai/ultravoxv0.6Aug 18, 2025by liPatrick

AI Summary

Ultravox v0.6 improves Hindi language understanding, adds noise token detection for non-human audio, and enhances background noise robustness across all languages. New gemma3 and qwen3 variants are introduced alongside the base llama 3.3 models.

Key Highlights

  • Hindi language understanding improvements
  • Produces <noise> token on noisy or non-human audio
  • Improved background noise and audio quality robustness in all languages
  • New gemma3 27b and qwen3 32b variants added
  • VoiceBench evaluation support for 9 different speech-language tasks

New Features

  • Hindi language improvements
  • Noise token generation for non-human audio
  • Background noise robustness
  • New model variants (gemma3 27b, qwen3 32b)
  • VoiceBench benchmark evaluation

Full Release Notes

We're releasing **Ultravox v0.6** today. The [weights](https://huggingface.co/fixie-ai) have been pushed to Hugging Face. If you're using the [Ultravox Realtime APIs](https://docs.ultravox.ai), v0.6 is the new default.

## What's New
* v0.6 improves upon 0.5 in the following ways:
* Improvements on Hindi language understanding.
* Produces <noise> token on noisy or non-human audio. 
* Improved background noise and audio quality robustness in all languages. 
* New gemma3 and qwen3 variants in addition to our base llama 3.3 models.

## Evals
New eval support for [VoiceBench](https://github.com/MatthewCYM/VoiceBench). The benchmark tests speech-language models on 9 different tasks ranging from open-form text generation to question-answering and instruction following. 

## Training
This version of Ultravox continues to use a frozen Llama pre-trained core (3.1 for 8B and 3.3 for 70B), along with new gemma3 27b and qwen3 32b variants.

## What's Changed
Training Stability: Patch HF Hub and Datasets methods and update [datasets.py](http://datasets.py/) by @farzadab #280
General improvement. by @zqhuang211 #281
Ultravox v0.6 + general improvements by @liPatrick #309
Allow response generation with no user message by @matthewclso #310
Add voicebench evaluation suite by @zqhuang211 #312

**Full Changelog**: https://github.com/fixie-ai/ultravox/compare/v0.5...v0.6