@livekit/agents-plugin-openai@1.9.3
livekit/agents-js@livekit/agents-plugin-openai@1.9.3Oct 15, 2026by github-actions[bot]
Upgrading?
AI Summary
Significant update integrating voice models into LiveKit Inference, improving session stability and audio handling for OpenAI and third-party voice models.
Key Highlights
- Run OpenAI Realtime, Gemini Live, and Grok Voice models via LiveKit Inference
- Remember and restore GPT-Live input mute state after reconnection
- Retry WebSocket handshakes on failure for OpenAI Realtime sessions
- Automatically resample and downmix input audio to 24 kHz mono
New Features
- Integration of OpenAI Realtime models into inference.RealtimeModel
- Integration of GPT-Live models into inference.DuplexModel
- Improved audio processing for OpenAI Realtime sessions
- GPT-Live mute state persistence across reconnections
- Handling of trailing audio in committed turns
Full Release Notes
### Patch Changes - Remember GPT-Live input mute state and restore it after reconnecting. - [#2675](https://github.com/livekit/agents-js/pull/2675) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot)) - Run realtime and full-duplex voice models through LiveKit Inference: `inference.RealtimeModel` for OpenAI Realtime, Gemini Live, and Grok Voice, and `inference.DuplexModel` (or `llm: 'openai/gpt-live-1'`) for OpenAI GPT-Live. The OpenAI Realtime and GPT-Live clients move into agents core; `openai.realtime.RealtimeModel` and `openai.realtime.GPTLiveModel` keep working with direct OpenAI credentials. Gemini 3.x `generateReply` instructions are sent as a wrapped user turn instead of a trailing model turn the model continued. `GrokRealtimeModels` replaces `grok-voice-think-fast-2.0` with `grok-voice-3.0` and `grok-voice-latest`. OpenAI Realtime sessions now retry a refused or failed WebSocket handshake instead of crashing or ending the session, resample and downmix input that isn't 24 kHz mono, and keep a committed turn's trailing audio out of the next turn. - [#2532](https://github.com/livekit/agents-js/pull/2532) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot)) - Updated dependencies [[`6f29065`](https://github.com/livekit/agents-js/commit/6f290656d1c8008fd56d2cdfce5307d8830c771c), [`86b27fd`](https://github.com/livekit/agents-js/commit/86b27fd5a586fcfe15b431e79a59d2322b63dd13), [`5c63848`](https://github.com/livekit/agents-js/commit/5c6384841f46790cae78052d782fbcb08d8d1707), [`a98e389`](https://github.com/livekit/agents-js/commit/a98e389923422b7a4cba24eb16fdd6791c0c6cc6), [`21d2456`](https://github.com/livekit/agents-js/commit/21d245648d7c73ab3af7c4635024a2247de87d35), [`0cd613a`](https://github.com/livekit/agents-js/commit/0cd613ab064d3e3e6296059000cfc6975c5ab7f4), [`540837b`](https://github.com/livekit/agents-js/commit/540837b7e1194c09aeaef53fc95b9e224add2b75), [`edc9275`](https://github.com/livekit/agents-js/commit/edc92751fabe84f68307d0582bedf3f7b3e7e122), [`dcd8879`](https://github.com/livekit/agents-js/commit/dcd88795f714325cd01e0b7dc61252fd35827e54), [`bae7759`](https://github.com/livekit/agents-js/commit/bae775993e1517918cdf8b04bdbc068bee1ee578), [`c433a25`](https://github.com/livekit/agents-js/commit/c433a259309ea5e3d6004ae461e41cba43145b37), [`212a7b0`](https://github.com/livekit/agents-js/commit/212a7b0aa838d55d2f6adb75dbd4f14d02598bf5), [`3de8f13`](https://github.com/livekit/agents-js/commit/3de8f13b9ce2638261a2400846cff738f575e787), [`8ba33de`](https://github.com/livekit/agents-js/commit/8ba33deddeaa586f89a0f943fb1593fd925f6024), [`9ebffb7`](https://github.com/livekit/agents-js/commit/9ebffb79fc7d4c1092951d243a990c45352408fc), [`b6928f1`](https://github.com/livekit/agents-js/commit/b6928f158518d7db23bbe1647af426ab0eaf65e0)]: - @livekit/agents@1.9.3
Related Repositories
openclaw/openclaw★ 392,716
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,091
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 359,552
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 219,820
The open source coding agent.
n8n-io/n8n★ 208,270
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.