livekit-agents@1.6.5
lumina-ai-inc/chunkrlivekit-agents@1.6.5Jul 9, 2026by tinalenguyen
AI Summary
LiveKit Agents v1.6.5 introduces expressive mode, Deepgram Flux updates, and various fixes for OpenAI and STT providers, including the removal of structured LLM output from the voice pipeline.
Key Highlights
- New expressive mode implementation
- Deepgram Flux option updates in-band
- OpenAI realtime fixes including discard orphaned response
- Removal of structured LLM output from voice pipeline
New Features
- Expressive mode implementation
- ChatContext `remove()` method for flexible item removal
- Deepgram Flux option updates
- OpenAI STT temperature parameter
- Speech generation errors exposed via `SpeechHandle.exception()`
- Anam director notes configuration
Full Release Notes
## What's Changed * fix(google): broaden _is_gemini_3_flash_model to cover all Gemini 3 Flash variants by @balazssandor in https://github.com/livekit/agents/pull/6210 * fix(assemblyai): respect `mode` preset for turn-silence; remap deprecated `u3-pro` by @dlange-aai in https://github.com/livekit/agents/pull/6220 * Move frame processor url/token/stream info to client sdk by @1egoman in https://github.com/livekit/agents/pull/5867 * fix(worker): exit when connection fails after max retries by @longcw in https://github.com/livekit/agents/pull/6103 * fix(voice): don't re-issue in-flight tool calls on a new turn by @longcw in https://github.com/livekit/agents/pull/6227 * (phonic): Use stream_ahead_of_real_time mode for Phonic WebSocket and sample rate 24000 by @qionghuang6 in https://github.com/livekit/agents/pull/6236 * fix(anthropic): use non-whitespace trailing dummy to satisfy provider validation by @JasonGordonD in https://github.com/livekit/agents/pull/6216 * fix(deepgram): sync missing STT/TTS API params, fix duplicate languages, add TTS model list by @Namit1867 in https://github.com/livekit/agents/pull/5362 * chore(deps): update dependency msgpack to v1.2.1 [security] by @renovate[bot] in https://github.com/livekit/agents/pull/6243 * docs: fix hotel_receptionist architecture section after refactor by @detail-app[bot] in https://github.com/livekit/agents/pull/6230 * fix(deepgram): remove duplicate redact param by @longcw in https://github.com/livekit/agents/pull/6245 * fix(openai): delete trimmed empty audio items by @he-yufeng in https://github.com/livekit/agents/pull/5887 * fix(openai realtime): discard orphaned response after interrupt or timeout by @longcw in https://github.com/livekit/agents/pull/6244 * fix CI due to realtime_model test by @davidzhao in https://github.com/livekit/agents/pull/6261 * fix: preserve transcription item id by @nightcityblade in https://github.com/livekit/agents/pull/6120 * fix(openai): skip realtime truncate when no audio was played fixes : #6157 by @ByteMaster-1 in https://github.com/livekit/agents/pull/6158 * feat(assemblyai): add language_code streaming param for language steering by @gsharp-aai in https://github.com/livekit/agents/pull/6219 * fix(xai): emit interim transcripts for in-progress status in realtime by @ByteMaster-1 in https://github.com/livekit/agents/pull/6272 * conversation-aware STT recognition (keyterms + chat context) by @longcw in https://github.com/livekit/agents/pull/6039 * Allow LemonSlice avatars to join third party meeting platforms by @aweitz in https://github.com/livekit/agents/pull/6233 * (xai realtime): pass voice parameter by @tinalenguyen in https://github.com/livekit/agents/pull/6276 * feat(certifi): user certifi as a fallback when system store is not present by @chenghao-mou in https://github.com/livekit/agents/pull/6231 * chore(eot): update log message about slow stt transcript by @chenghao-mou in https://github.com/livekit/agents/pull/6179 * fix(fallback_adapter): update stream start time offset in stt fallbackadapter by @chenghao-mou in https://github.com/livekit/agents/pull/6246 * feat(voice): stream tool call status events by @longcw in https://github.com/livekit/agents/pull/6100 * set default shutdown reason by @davidzhao in https://github.com/livekit/agents/pull/6284 * bump worker drain timeout to 1hr by @chenghao-mou in https://github.com/livekit/agents/pull/6286 * feat(rime): support speed_alpha for arcana and coda models by @balazssandor in https://github.com/livekit/agents/pull/6287 * feat(deepgram): apply Flux option updates in-band by @longcw in https://github.com/livekit/agents/pull/6277 * feat: realtime model fallback adapter by @longcw in https://github.com/livekit/agents/pull/6282 * update keyterm detection default model by @longcw in https://github.com/livekit/agents/pull/6289 * fix(eot): tighten eot cancellation by speech acitivity by @chenghao-mou in https://github.com/livekit/agents/pull/6274 * silero: use onnx when explicitely using silero.VAD.load() by @theomonnom in https://github.com/livekit/agents/pull/6290 * fix(openai): emit start/end of speech events for realtime STT AGT-3051 by @chenghao-mou in https://github.com/livekit/agents/pull/6297 * feat(smallestai): word_timestamps for TTS, v4 STT endpoints, eou_timeout fix by @harshitajain165 in https://github.com/livekit/agents/pull/5953 * fix(aws): nest endpointingSensitivity under turnDetectionConfiguration for Nova Sonic 2 by @St-Luciferr in https://github.com/livekit/agents/pull/6201 * switch to blingfire tokenizer by default by @davidzhao in https://github.com/livekit/agents/pull/6301 * feat(plugins-tavus): rename replica/persona to face/pal by @carolin-tavus in https://github.com/livekit/agents/pull/6239 * fix(openai): avoid mutating raw tool schemas for Responses by @VectorPeak in https://github.com/livekit/agents/pull/6305 * feat(openai): add temperature parameter to STT by @longcw in https://github.com/livekit/agents/pull/6307 * fix(liveavatar): preserve provider status errors by @VectorPeak in https://github.com/livekit/agents/pull/6306 * fix incorrect attribution of latency in tts.ttfb by @davidzhao in https://github.com/livekit/agents/pull/6300 * update livekit to 1.1.13 by @davidzhao in https://github.com/livekit/agents/pull/6311 * fix(voice): race between session.run and an in-flight AgentTask handoff by @longcw in https://github.com/livekit/agents/pull/6315 * fix(voice): resolve video task leak in AgentSession by @Mayank-MSJ-Singh in https://github.com/livekit/agents/pull/6318 * Add `remove()` method to ChatContext for flexible item removal by @3eid in https://github.com/livekit/agents/pull/5131 * fix: expose speech generation errors via SpeechHandle.exception() by @longcw in https://github.com/livekit/agents/pull/6304 * chore(deps): update actions/checkout action to v7 by @renovate[bot] in https://github.com/livekit/agents/pull/6325 * fix(test): stop false-positive "Audio data isn't PCM" failures in TTS tests by @u9g in https://github.com/livekit/agents/pull/6331 * feat(anam) add director notes config by @sr-anam in https://github.com/livekit/agents/pull/6267 * fix(aws): preserve image format for Bedrock images by @VectorPeak in https://github.com/livekit/agents/pull/6328 * (feat) 11Labs STT : Add enable_logging by @Ludobaka in https://github.com/livekit/agents/pull/6273 * feat: expressive mode by @tinalenguyen in https://github.com/livekit/agents/pull/6116 * Add connection pooling for xAI TTS by @godququ5-code in https://github.com/livekit/agents/pull/6317 * voice: output retries for run(output_type=...) by @theomonnom in https://github.com/livekit/agents/pull/6080 * disable openai sdk max_retries by @chenghao-mou in https://github.com/livekit/agents/pull/6341 * Allow direct image uploads for LemonSlice avatars by @jp-lemon in https://github.com/livekit/agents/pull/6343 * remove structured LLM output from voice pipeline by @tinalenguyen in https://github.com/livekit/agents/pull/6345 * remove livekit-blingfire (moved) by @theomonnom in https://github.com/livekit/agents/pull/6320 * (expressive mode): <expr/> expression marker dialect by @tinalenguyen in https://github.com/livekit/agents/pull/6347 * (expressive mode): fix markup tags impacting pacing by @tinalenguyen in https://github.com/livekit/agents/pull/6350 * feat(core): add plain_text_content property for ChatMessage by @chenghao-mou in https://github.com/livekit/agents/pull/6348 * fix(tts): restart ChunkedStream retries under a fresh request_id by @u9g in https://github.com/livekit/agents/pull/6346 * send ServerInfo to CLI host on start by @davidzhao in https://github.com/livekit/agents/pull/6260 * docs: fix livekit-durable README title copied from removed blingfire plugin by @detail-app[bot] in https://github.com/livekit/agents/pull/6355 * Feat/updating documentation for Gnani by @Gnani-AI-Mintlify in https://github.com/livekit/agents/pull/6004 * feat(soniox): support speed parameter in TTS by @yui0303 in https://github.com/livekit/agents/pull/6339 * fix(azure): recover from STT error cancellations instead of hanging by @apoorva-01 in https://github.com/livekit/agents/pull/6362 * fix: honor IGNORE_ON_ENTER for tools inside a Toolset by @longcw in https://github.com/livekit/agents/pull/6361 * fix: send DTMF to the active session room by @longcw in https://github.com/livekit/agents/pull/6360 * docs(soniox): add speed parameter to TTS example in README by @detail-app[bot] in https://github.com/livekit/agents/pull/6366 * (expressive mode): hide and remove from examples by @tinalenguyen in https://github.com/livekit/agents/pull/6370 * fix(core): flip text content fields AGT-3103 by @chenghao-mou in https://github.com/livekit/agents/pull/6353 * livekit-agents@1.6.5 by @github-actions[bot] in https://github.com/livekit/agents/pull/6371 ## New Contributors * @balazssandor made their first contribution in https://github.com/livekit/agents/pull/6210 * @1egoman made their first contribution in https://github.com/livekit/agents/pull/5867 * @JasonGordonD made their first contribution in https://github.com/livekit/agents/pull/6216 * @ByteMaster-1 made their first contribution in https://github.com/livekit/agents/pull/6158 * @aweitz made their first contribution in https://github.com/livekit/agents/pull/6233 * @St-Luciferr made their first contribution in https://github.com/livekit/agents/pull/6201 * @carolin-tavus made their first contribution in https://github.com/livekit/agents/pull/6239 * @VectorPeak made their first contribution in https://github.com/livekit/agents/pull/6305 * @Mayank-MSJ-Singh made their first contribution in https://github.com/livekit/agents/pull/6318 * @3eid made their first contribution in https://github.com/livekit/agents/pull/5131 * @godququ5-code made their first contribution in https://github.com/livekit/agents/pull/6317 * @yui0303 made their first contribution in https://github.com/livekit/agents/pull/6339 * @apoorva-01 made their first contribution in https://github.com/livekit/agents/pull/6362 **Full Changelog**: https://github.com/livekit/agents/compare/livekit-agents@1.6.4...livekit-agents@1.6.5