v0.6

devlikeapro/wahav0.6Aug 18, 2025by liPatrick

AI Summary

Ultravox v0.6 introduces improvements for audio robustness and language understanding, specifically enhancing Hindi support and handling noisy audio by generating noise tokens, alongside the addition of new Gemma3 and Qwen3 model variants.

Key Highlights

  • Improved Hindi language understanding
  • Noise token generation for non-human audio
  • Enhanced background noise robustness
  • New Gemma3 and Qwen3 variants

New Features

  • Hindi language understanding improvements
  • Noise token generation for noisy audio
  • Background noise and audio quality robustness
  • New Gemma3 and Qwen3 model variants
  • VoiceBench evaluation suite support

Full Release Notes

We're releasing **Ultravox v0.6** today. The [weights](https://huggingface.co/fixie-ai) have been pushed to Hugging Face. If you're using the [Ultravox Realtime APIs](https://docs.ultravox.ai), v0.6 is the new default.

## What's New
* v0.6 improves upon 0.5 in the following ways:
* Improvements on Hindi language understanding.
* Produces <noise> token on noisy or non-human audio. 
* Improved background noise and audio quality robustness in all languages. 
* New gemma3 and qwen3 variants in addition to our base llama 3.3 models.

## Evals
New eval support for [VoiceBench](https://github.com/MatthewCYM/VoiceBench). The benchmark tests speech-language models on 9 different tasks ranging from open-form text generation to question-answering and instruction following. 

## Training
This version of Ultravox continues to use a frozen Llama pre-trained core (3.1 for 8B and 3.3 for 70B), along with new gemma3 27b and qwen3 32b variants.

## What's Changed
Training Stability: Patch HF Hub and Datasets methods and update [datasets.py](http://datasets.py/) by @farzadab #280
General improvement. by @zqhuang211 #281
Ultravox v0.6 + general improvements by @liPatrick #309
Allow response generation with no user message by @matthewclso #310
Add voicebench evaluation suite by @zqhuang211 #312

**Full Changelog**: https://github.com/fixie-ai/ultravox/compare/v0.5...v0.6