livekit-agents@1.8.3

CaviraOSS/LongMemorylivekit-agents@1.8.3Sep 26, 2026by tinalenguyen

Upgrading?

AI Summary

A comprehensive update featuring Azure OpenAI support, integration of the OpenAI Realtime client into the core, and numerous bug fixes for STT/TTS providers.

Key Highlights

  • Add Azure OpenAI support via with_azure
  • Move OpenAI Realtime inference client into agents core
  • Add configurable audio chunk duration for ElevenLabs STT
  • Add AssemblyAI Universal 3-6-Pro STT model
  • Support for Gemini 3.8 Live models

New Features

  • Azure OpenAI support
  • OpenAI Realtime core integration
  • ElevenLabs audio chunk configuration
  • AssemblyAI Universal 3-6-Pro STT support
  • Gemini 3.8 Live support
  • General STT/TTS bug fixes

Full Release Notes

## What's Changed
* chore: refine pii review instructions by @chenghao-mou in https://github.com/livekit/agents/pull/7267
* bithuman: resolve the SDK on Python 3.10 and 3.14 again by @theomonnom in https://github.com/livekit/agents/pull/7280
* add pid to log lines from parent process by @andrewnitu in https://github.com/livekit/agents/pull/7290
* fix(tts): forward inner frames as-is in FallbackAdapter and StreamAdapter by @theomonnom in https://github.com/livekit/agents/pull/7273
* bithuman: type-check against bithuman 2.11 by @longcw in https://github.com/livekit/agents/pull/7301
* docs: add gemini-3.8-live models to google README model list by @detail-app[bot] in https://github.com/livekit/agents/pull/7311
* stt: reset the retry budget once an attempt outlived the connect timeout by @u9g in https://github.com/livekit/agents/pull/7275
* fix(liveavatar): honor agent.state_updated for speaking and barge-in by @cpruijsen in https://github.com/livekit/agents/pull/7245
* feat(elevenlabs): make realtime STT audio chunk duration configurable by @stevensukma in https://github.com/livekit/agents/pull/7183
* fix(liveavatar): register the plugin, interruption fix by @tinalenguyen in https://github.com/livekit/agents/pull/7313
* fix(google): send FunctionTool schemas as parameters_json_schema on the text API by @JustinScitech in https://github.com/livekit/agents/pull/7312
* fix(mistralai): standardize API error handling by @jeanprbt in https://github.com/livekit/agents/pull/7308
* fix: preserve configured elevenlabs stt language by @chenghao-mou in https://github.com/livekit/agents/pull/7306
* fix: report realtime transcription usage per session by @chenghao-mou in https://github.com/livekit/agents/pull/7303
* fix: initialize the otel example provider once per process by @chenghao-mou in https://github.com/livekit/agents/pull/7171
* worker: read agent name from livekit.toml as last fallback by @u9g in https://github.com/livekit/agents/pull/7295
* (meta muse stt): set heartbeat for the websocket by @tinalenguyen in https://github.com/livekit/agents/pull/7315
* fix(anam): retry retryable HTTP status failures when starting a session by @tinalenguyen in https://github.com/livekit/agents/pull/7314
* fix(voice): shield transcript rotation from cancellation by @DeepanshuPal in https://github.com/livekit/agents/pull/7300
* fix: don't let a parallel tool cancel an agent handoff by @simllll in https://github.com/livekit/agents/pull/7321
* fix(google): default tool_behavior to NON_BLOCKING on Gemini 3.8 Live by @longcw in https://github.com/livekit/agents/pull/7329
* feat(openai): add GPTLiveModel.with_azure for Azure OpenAI by @acharan-tech-200037 in https://github.com/livekit/agents/pull/7325
* fix: pair tool outputs with their call by call_id when copying a chat context by @longcw in https://github.com/livekit/agents/pull/7330
* Move OpenAI Realtime inference client into agents core by @russellmartin-livekit in https://github.com/livekit/agents/pull/7318
* fix(voice): report the error that stops a filler by @longcw in https://github.com/livekit/agents/pull/7334
* feat: support reply_required in tool results by @chenghao-mou in https://github.com/livekit/agents/pull/7340
* feat(assemblyai): surface language_confidence on transcript metadata by @dlange-aai in https://github.com/livekit/agents/pull/7339
* feat(inference): add assemblyai/universal-3-6-pro to STT model types by @dlange-aai in https://github.com/livekit/agents/pull/7347
* [Inference] Support realtime model literals by @keepingitneil in https://github.com/livekit/agents/pull/7344
* fix(voice): honor the dict form of the deprecated preemptive_generation kwarg by @JustinScitech in https://github.com/livekit/agents/pull/7348
* fix(voice): clamp the user_speaking span end to its start by @longcw in https://github.com/livekit/agents/pull/7332
* docs: fix LICENSE links in gnani plugin README by @yetuge in https://github.com/livekit/agents/pull/7350
* fix(liveavatar): use the job's shared http session instead of an unclosed private one by @Rehansanjay in https://github.com/livekit/agents/pull/7341
* fix(respeecher): invalidate the pool on model change instead of retiring it by @Rehansanjay in https://github.com/livekit/agents/pull/7237
* fix(google): drop unsupported JSON Schema keywords before validating by @feiiiiii5 in https://github.com/livekit/agents/pull/7353
* fix(tokenize): keep dotted numbers in one sentence by @sxh313 in https://github.com/livekit/agents/pull/7362
* telemetry: session_close covers the whole close by @davidzhao in https://github.com/livekit/agents/pull/7322
* fix(ipc): ThreadJobExecutor.aclose() hangs when the runner exits before its ack is read by @pabloFuente in https://github.com/livekit/agents/pull/7225
* fix(google): report a bad tool schema instead of ending the session in silence by @longcw in https://github.com/livekit/agents/pull/7371
* examples(homepage): disconnect scripted callers on a known opening line by @ShayneP in https://github.com/livekit/agents/pull/7297
* fix(google): keep declared property order in Live API tool schemas by @rosetta-livekit-bot[bot] in https://github.com/livekit/agents/pull/7387
* fix(sarvam): drop orphan tool history when a turn declares no tools by @dhruvladia-sarvam in https://github.com/livekit/agents/pull/7382
* fix(xai): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7364
* plugins/bithuman: let a session name the second-generation models by @sgu-bithuman in https://github.com/livekit/agents/pull/7366
* fix(soniox): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7357
* fix(simplismart): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7369
* fix(telnyx): detect a silently dropped STT socket instead of hanging by @sidxh in https://github.com/livekit/agents/pull/7359
* feat(phonic): add phonic_model option to select the phonic model version by @arunwpm-work in https://github.com/livekit/agents/pull/7393
* fix: unwrap tool results in terminal events by @chenghao-mou in https://github.com/livekit/agents/pull/7377
* fix: stop classifying llm fallback adapters as chat by @chenghao-mou in https://github.com/livekit/agents/pull/7373
* docs: fix 404 LiveKit docs link for multi-agent handoff by @5quan in https://github.com/livekit/agents/pull/7397
* feat(mistralai): add chat completions API mode by @leamoukarzel in https://github.com/livekit/agents/pull/7381
* test: freeze the clock in the transcription_delay anchor regression test by @u9g in https://github.com/livekit/agents/pull/7398
* gpt live service tier by @tinalenguyen in https://github.com/livekit/agents/pull/7401
* fix(deepgram): include word confidence for stt v1 alternatives by @Snowfly0709 in https://github.com/livekit/agents/pull/7181
* fix(core): preserve PCM samples across mid-stream flushes by @naszzz in https://github.com/livekit/agents/pull/7391
* fix(plugins/bithuman): drop the undeclared OpenCV import by @sgu-bithuman in https://github.com/livekit/agents/pull/7406
* fix: honor empty strings in word replacements by @YaoxinHuang in https://github.com/livekit/agents/pull/7407
* fix(aws): fall back to auto tool_choice for Claude Opus 5.5 on Bedrock by @kimnamu in https://github.com/livekit/agents/pull/7411
* fix: preserve fallback provider attribution on llm node spans by @chenghao-mou in https://github.com/livekit/agents/pull/7374
* fix: record exceptions consistently in the shared tracer by @chenghao-mou in https://github.com/livekit/agents/pull/7376
* fix: preserve custom span metadata inside jobs by @chenghao-mou in https://github.com/livekit/agents/pull/7428
* feat(workflows): add verify_spelling to GetEmailTask by @tinalenguyen in https://github.com/livekit/agents/pull/7402
* (google tts): add new gemini-3.8 models and add to expressive mode by @tinalenguyen in https://github.com/livekit/agents/pull/7425
* feat: reset the user away timer on DTMF input by @chenghao-mou in https://github.com/livekit/agents/pull/7395
* livekit-agents@1.8.3 by @github-actions[bot] in https://github.com/livekit/agents/pull/7429

## New Contributors
* @cpruijsen made their first contribution in https://github.com/livekit/agents/pull/7245
* @stevensukma made their first contribution in https://github.com/livekit/agents/pull/7183
* @JustinScitech made their first contribution in https://github.com/livekit/agents/pull/7312
* @DeepanshuPal made their first contribution in https://github.com/livekit/agents/pull/7300
* @simllll made their first contribution in https://github.com/livekit/agents/pull/7321
* @acharan-tech-200037 made their first contribution in https://github.com/livekit/agents/pull/7325
* @yetuge made their first contribution in https://github.com/livekit/agents/pull/7350
* @feiiiiii5 made their first contribution in https://github.com/livekit/agents/pull/7353
* @sxh313 made their first contribution in https://github.com/livekit/agents/pull/7362
* @sidxh made their first contribution in https://github.com/livekit/agents/pull/7364
* @5quan made their first contribution in https://github.com/livekit/agents/pull/7397
* @leamoukarzel made their first contribution in https://github.com/livekit/agents/pull/7381
* @Snowfly0709 made their first contribution in https://github.com/livekit/agents/pull/7181
* @YaoxinHuang made their first contribution in https://github.com/livekit/agents/pull/7407
* @kimnamu made their first contribution in https://github.com/livekit/agents/pull/7411

**Full Changelog**: https://github.com/livekit/agents/compare/livekit-agents@1.8.2...livekit-agents@1.8.3

Related Repositories