livekit-agents@1.8.3
CaviraOSS/LongMemorylivekit-agents@1.8.3Sep 26, 2026by tinalenguyen
Upgrading?
AI Summary
A comprehensive update featuring Azure OpenAI support, integration of the OpenAI Realtime client into the core, and numerous bug fixes for STT/TTS providers.
Key Highlights
- Add Azure OpenAI support via with_azure
- Move OpenAI Realtime inference client into agents core
- Add configurable audio chunk duration for ElevenLabs STT
- Add AssemblyAI Universal 3-6-Pro STT model
- Support for Gemini 3.8 Live models
New Features
- Azure OpenAI support
- OpenAI Realtime core integration
- ElevenLabs audio chunk configuration
- AssemblyAI Universal 3-6-Pro STT support
- Gemini 3.8 Live support
- General STT/TTS bug fixes
Full Release Notes
## What's Changed * chore: refine pii review instructions by @chenghao-mou in https://github.com/livekit/agents/pull/7267 * bithuman: resolve the SDK on Python 3.10 and 3.14 again by @theomonnom in https://github.com/livekit/agents/pull/7280 * add pid to log lines from parent process by @andrewnitu in https://github.com/livekit/agents/pull/7290 * fix(tts): forward inner frames as-is in FallbackAdapter and StreamAdapter by @theomonnom in https://github.com/livekit/agents/pull/7273 * bithuman: type-check against bithuman 2.11 by @longcw in https://github.com/livekit/agents/pull/7301 * docs: add gemini-3.8-live models to google README model list by @detail-app[bot] in https://github.com/livekit/agents/pull/7311 * stt: reset the retry budget once an attempt outlived the connect timeout by @u9g in https://github.com/livekit/agents/pull/7275 * fix(liveavatar): honor agent.state_updated for speaking and barge-in by @cpruijsen in https://github.com/livekit/agents/pull/7245 * feat(elevenlabs): make realtime STT audio chunk duration configurable by @stevensukma in https://github.com/livekit/agents/pull/7183 * fix(liveavatar): register the plugin, interruption fix by @tinalenguyen in https://github.com/livekit/agents/pull/7313 * fix(google): send FunctionTool schemas as parameters_json_schema on the text API by @JustinScitech in https://github.com/livekit/agents/pull/7312 * fix(mistralai): standardize API error handling by @jeanprbt in https://github.com/livekit/agents/pull/7308 * fix: preserve configured elevenlabs stt language by @chenghao-mou in https://github.com/livekit/agents/pull/7306 * fix: report realtime transcription usage per session by @chenghao-mou in https://github.com/livekit/agents/pull/7303 * fix: initialize the otel example provider once per process by @chenghao-mou in https://github.com/livekit/agents/pull/7171 * worker: read agent name from livekit.toml as last fallback by @u9g in https://github.com/livekit/agents/pull/7295 * (meta muse stt): set heartbeat for the websocket by @tinalenguyen in https://github.com/livekit/agents/pull/7315 * fix(anam): retry retryable HTTP status failures when starting a session by @tinalenguyen in https://github.com/livekit/agents/pull/7314 * fix(voice): shield transcript rotation from cancellation by @DeepanshuPal in https://github.com/livekit/agents/pull/7300 * fix: don't let a parallel tool cancel an agent handoff by @simllll in https://github.com/livekit/agents/pull/7321 * fix(google): default tool_behavior to NON_BLOCKING on Gemini 3.8 Live by @longcw in https://github.com/livekit/agents/pull/7329 * feat(openai): add GPTLiveModel.with_azure for Azure OpenAI by @acharan-tech-200037 in https://github.com/livekit/agents/pull/7325 * fix: pair tool outputs with their call by call_id when copying a chat context by @longcw in https://github.com/livekit/agents/pull/7330 * Move OpenAI Realtime inference client into agents core by @russellmartin-livekit in https://github.com/livekit/agents/pull/7318 * fix(voice): report the error that stops a filler by @longcw in https://github.com/livekit/agents/pull/7334 * feat: support reply_required in tool results by @chenghao-mou in https://github.com/livekit/agents/pull/7340 * feat(assemblyai): surface language_confidence on transcript metadata by @dlange-aai in https://github.com/livekit/agents/pull/7339 * feat(inference): add assemblyai/universal-3-6-pro to STT model types by @dlange-aai in https://github.com/livekit/agents/pull/7347 * [Inference] Support realtime model literals by @keepingitneil in https://github.com/livekit/agents/pull/7344 * fix(voice): honor the dict form of the deprecated preemptive_generation kwarg by @JustinScitech in https://github.com/livekit/agents/pull/7348 * fix(voice): clamp the user_speaking span end to its start by @longcw in https://github.com/livekit/agents/pull/7332 * docs: fix LICENSE links in gnani plugin README by @yetuge in https://github.com/livekit/agents/pull/7350 * fix(liveavatar): use the job's shared http session instead of an unclosed private one by @Rehansanjay in https://github.com/livekit/agents/pull/7341 * fix(respeecher): invalidate the pool on model change instead of retiring it by @Rehansanjay in https://github.com/livekit/agents/pull/7237 * fix(google): drop unsupported JSON Schema keywords before validating by @feiiiiii5 in https://github.com/livekit/agents/pull/7353 * fix(tokenize): keep dotted numbers in one sentence by @sxh313 in https://github.com/livekit/agents/pull/7362 * telemetry: session_close covers the whole close by @davidzhao in https://github.com/livekit/agents/pull/7322 * fix(ipc): ThreadJobExecutor.aclose() hangs when the runner exits before its ack is read by @pabloFuente in https://github.com/livekit/agents/pull/7225 * fix(google): report a bad tool schema instead of ending the session in silence by @longcw in https://github.com/livekit/agents/pull/7371 * examples(homepage): disconnect scripted callers on a known opening line by @ShayneP in https://github.com/livekit/agents/pull/7297 * fix(google): keep declared property order in Live API tool schemas by @rosetta-livekit-bot[bot] in https://github.com/livekit/agents/pull/7387 * fix(sarvam): drop orphan tool history when a turn declares no tools by @dhruvladia-sarvam in https://github.com/livekit/agents/pull/7382 * fix(xai): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7364 * plugins/bithuman: let a session name the second-generation models by @sgu-bithuman in https://github.com/livekit/agents/pull/7366 * fix(soniox): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7357 * fix(simplismart): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7369 * fix(telnyx): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7359 * feat(phonic): add phonic_model option to select the phonic model version by @arunwpm-work in https://github.com/livekit/agents/pull/7393 * fix: unwrap tool results in terminal events by @chenghao-mou in https://github.com/livekit/agents/pull/7377 * fix: stop classifying llm fallback adapters as chat by @chenghao-mou in https://github.com/livekit/agents/pull/7373 * docs: fix 404 LiveKit docs link for multi-agent handoff by @5quan in https://github.com/livekit/agents/pull/7397 * feat(mistralai): add chat completions API mode by @leamoukarzel in https://github.com/livekit/agents/pull/7381 * test: freeze the clock in the transcription_delay anchor regression test by @u9g in https://github.com/livekit/agents/pull/7398 * gpt live service tier by @tinalenguyen in https://github.com/livekit/agents/pull/7401 * fix(deepgram): include word confidence for stt v1 alternatives by @Snowfly0709 in https://github.com/livekit/agents/pull/7181 * fix(core): preserve PCM samples across mid-stream flushes by @naszzz in https://github.com/livekit/agents/pull/7391 * fix(plugins/bithuman): drop the undeclared OpenCV import by @sgu-bithuman in https://github.com/livekit/agents/pull/7406 * fix: honor empty strings in word replacements by @YaoxinHuang in https://github.com/livekit/agents/pull/7407 * fix(aws): fall back to auto tool_choice for Claude Opus 5.5 on Bedrock by @kimnamu in https://github.com/livekit/agents/pull/7411 * fix: preserve fallback provider attribution on llm node spans by @chenghao-mou in https://github.com/livekit/agents/pull/7374 * fix: record exceptions consistently in the shared tracer by @chenghao-mou in https://github.com/livekit/agents/pull/7376 * fix: preserve custom span metadata inside jobs by @chenghao-mou in https://github.com/livekit/agents/pull/7428 * feat(workflows): add verify_spelling to GetEmailTask by @tinalenguyen in https://github.com/livekit/agents/pull/7402 * (google tts): add new gemini-3.8 models and add to expressive mode by @tinalenguyen in https://github.com/livekit/agents/pull/7425 * feat: reset the user away timer on DTMF input by @chenghao-mou in https://github.com/livekit/agents/pull/7395 * livekit-agents@1.8.3 by @github-actions[bot] in https://github.com/livekit/agents/pull/7429 ## New Contributors * @cpruijsen made their first contribution in https://github.com/livekit/agents/pull/7245 * @stevensukma made their first contribution in https://github.com/livekit/agents/pull/7183 * @JustinScitech made their first contribution in https://github.com/livekit/agents/pull/7312 * @DeepanshuPal made their first contribution in https://github.com/livekit/agents/pull/7300 * @simllll made their first contribution in https://github.com/livekit/agents/pull/7321 * @acharan-tech-200037 made their first contribution in https://github.com/livekit/agents/pull/7325 * @yetuge made their first contribution in https://github.com/livekit/agents/pull/7350 * @feiiiiii5 made their first contribution in https://github.com/livekit/agents/pull/7353 * @sxh313 made their first contribution in https://github.com/livekit/agents/pull/7362 * @sidxh made their first contribution in https://github.com/livekit/agents/pull/7364 * @5quan made their first contribution in https://github.com/livekit/agents/pull/7397 * @leamoukarzel made their first contribution in https://github.com/livekit/agents/pull/7381 * @Snowfly0709 made their first contribution in https://github.com/livekit/agents/pull/7181 * @YaoxinHuang made their first contribution in https://github.com/livekit/agents/pull/7407 * @kimnamu made their first contribution in https://github.com/livekit/agents/pull/7411 **Full Changelog**: https://github.com/livekit/agents/compare/livekit-agents@1.8.2...livekit-agents@1.8.3
Related Repositories
openclaw/openclaw★ 392,695
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,067
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 357,594
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 219,661
The open source coding agent.
n8n-io/n8n★ 208,250
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.