0.2.18
QuentinFuxa/WhisperLiveKit0.2.18Feb 13, 2026by QuentinFuxa
AI Summary
Bug fix release addressing critical SimulStreaming VRAM leaks, translation functionality issues, and various type errors. Also adds probability field support to ASRToken and improves DiartDiarization interface.
Key Highlights
- Fix SimulStreaming VRAM leak - cross-attention tensors now capped to rolling window
- Fix --direct-english-translation not working with LocalAgreement
- Fix model_cache_dir ignored in SimulStreaming
- Fix NoneType concatenation in add_translation
- Add probability field to ASRToken
New Features
- Probability field in ASRToken for word-level probabilities
- insert_audio_chunk method added to DiartDiarization
- OpenaiApiASR.task initialization
Full Release Notes
## Bug Fixes - **Fix SimulStreaming VRAM leak** : cross-attention tensors were accumulating unboundedly during the decoding loop (up to env 5GB on repetition loops). Now capped to a rolling window (#283, #275) - **Fix `--direct-english-translation` not working with LocalAgreement backends** : `task="translate"` was never propagated to the ASR backend's `transcribe_kargs`, so whisper always ran in transcribe mode regardless of the flag. (#306) - **Fix `model_cache_dir` ignored in SimulStreaming** : download path was hardcoded to `None`. Also fixed `task` being passed as a boolean instead of a string (`"translate"`/`"transcribe"`). (#310) - **Fix `NoneType` concatenation in `add_translation`** : crash when `ts.text` was `None` during translation overlay. (#296) - **Fix `Segment().from_tokens()` bad classmethod call** : was incorrectly called on an instance instead of the class. (#331) - **Fix `token.has_ended` type narrowing** : replaced `token.is_silence()` (non-existent method) with proper `isinstance(token, Silence)` check. (#329) ## Improvements - **Add `probability` field to `ASRToken`** FasterWhisperASR now passes word-level probabilities through (#330, #313) - **Add `insert_audio_chunk` to `DiartDiarization`**, brings the interface in line with `SortformerDiarization` (#332) - **Initialize `OpenaiApiASR.task`** : was previously referenced but never set, causing potential `AttributeError`.