@livekit/agents-plugin-google@1.9.3
livekit/agents-js@livekit/agents-plugin-google@1.9.3Oct 15, 2026by github-actions[bot]
Upgrading?
AI Summary
A major update to the Google plugin introducing Gemini 4 Argon support, moving OpenAI Realtime models into the agents core, and improving error handling for tool schemas and WebSocket connections.
Key Highlights
- Added support for Gemini 4 Argon with bounded long-decode continuation
- Integrated OpenAI Realtime and GPT-Live models into agents core via LiveKit Inference
- Improved error reporting for invalid Gemini tool schemas
- Added retry logic for refused WebSocket handshakes in OpenAI Realtime sessions
- Enhanced audio processing with automatic resampling and downmixing
Breaking Changes
- OpenAI Realtime and GPT-Live clients have been moved into agents core, requiring users to migrate to `inference.RealtimeModel` or `inference.DuplexModel` instead of direct `openai.realtime` client usage.
New Features
- Gemini 4 Argon support
- OpenAI Realtime/GPT-Live integration
- Better tool schema error handling
- WebSocket handshake retry logic
- Improved audio processing
Full Release Notes
### Patch Changes - Add Gemini 4 Argon support with bounded long-decode continuation. - [#2719](https://github.com/livekit/agents-js/pull/2719) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot)) - Allow `generateReply` without instructions for Google realtime models with immutable chat context. - [#2694](https://github.com/livekit/agents-js/pull/2694) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot)) - Report invalid Gemini tool schemas with the originating tool name instead of silently ending realtime sessions. - [#2548](https://github.com/livekit/agents-js/pull/2548) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot)) - Run realtime and full-duplex voice models through LiveKit Inference: `inference.RealtimeModel` for OpenAI Realtime, Gemini Live, and Grok Voice, and `inference.DuplexModel` (or `llm: 'openai/gpt-live-1'`) for OpenAI GPT-Live. The OpenAI Realtime and GPT-Live clients move into agents core; `openai.realtime.RealtimeModel` and `openai.realtime.GPTLiveModel` keep working with direct OpenAI credentials. Gemini 3.x `generateReply` instructions are sent as a wrapped user turn instead of a trailing model turn the model continued. `GrokRealtimeModels` replaces `grok-voice-think-fast-2.0` with `grok-voice-3.0` and `grok-voice-latest`. OpenAI Realtime sessions now retry a refused or failed WebSocket handshake instead of crashing or ending the session, resample and downmix input that isn't 24 kHz mono, and keep a committed turn's trailing audio out of the next turn. - [#2532](https://github.com/livekit/agents-js/pull/2532) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot)) - Updated dependencies [[`6f29065`](https://github.com/livekit/agents-js/commit/6f290656d1c8008fd56d2cdfce5307d8830c771c), [`86b27fd`](https://github.com/livekit/agents-js/commit/86b27fd5a586fcfe15b431e79a59d2322b63dd13), [`5c63848`](https://github.com/livekit/agents-js/commit/5c6384841f46790cae78052d782fbcb08d8d1707), [`a98e389`](https://github.com/livekit/agents-js/commit/a98e389923422b7a4cba24eb16fdd6791c0c6cc6), [`21d2456`](https://github.com/livekit/agents-js/commit/21d245648d7c73ab3af7c4635024a2247de87d35), [`0cd613a`](https://github.com/livekit/agents-js/commit/0cd613ab064d3e3e6296059000cfc6975c5ab7f4), [`540837b`](https://github.com/livekit/agents-js/commit/540837b7e1194c09aeaef53fc95b9e224add2b75), [`edc9275`](https://github.com/livekit/agents-js/commit/edc92751fabe84f68307d0582bedf3f7b3e7e122), [`dcd8879`](https://github.com/livekit/agents-js/commit/dcd88795f714325cd01e0b7dc61252fd35827e54), [`bae7759`](https://github.com/livekit/agents-js/commit/bae775993e1517918cdf8b04bdbc068bee1ee578), [`c433a25`](https://github.com/livekit/agents-js/commit/c433a259309ea5e3d6004ae461e41cba43145b37), [`212a7b0`](https://github.com/livekit/agents-js/commit/212a7b0aa838d55d2f6adb75dbd4f14d02598bf5), [`3de8f13`](https://github.com/livekit/agents-js/commit/3de8f13b9ce2638261a2400846cff738f575e787), [`8ba33de`](https://github.com/livekit/agents-js/commit/8ba33deddeaa586f89a0f943fb1593fd925f6024), [`9ebffb7`](https://github.com/livekit/agents-js/commit/9ebffb79fc7d4c1092951d243a990c45352408fc), [`b6928f1`](https://github.com/livekit/agents-js/commit/b6928f158518d7db23bbe1647af426ab0eaf65e0)]: - @livekit/agents@1.9.3
Related Repositories
openclaw/openclaw★ 392,718
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
nilbuild/developer-roadmap★ 370,094
Interactive roadmaps, guides and other educational content to help developers grow in their careers.
morluto/rea★ 360,388
Reverse engineer anything with agents, from app behavior down to native binaries.
anomalyco/opencode★ 219,868
The open source coding agent.
n8n-io/n8n★ 208,278
Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.