@livekit/agents-plugin-google@1.9.3

livekit/agents-js@livekit/agents-plugin-google@1.9.3Oct 15, 2026by github-actions[bot]

Upgrading?

AI Summary

A major update to the Google plugin introducing Gemini 4 Argon support, moving OpenAI Realtime models into the agents core, and improving error handling for tool schemas and WebSocket connections.

Key Highlights

  • Added support for Gemini 4 Argon with bounded long-decode continuation
  • Integrated OpenAI Realtime and GPT-Live models into agents core via LiveKit Inference
  • Improved error reporting for invalid Gemini tool schemas
  • Added retry logic for refused WebSocket handshakes in OpenAI Realtime sessions
  • Enhanced audio processing with automatic resampling and downmixing

Breaking Changes

  • OpenAI Realtime and GPT-Live clients have been moved into agents core, requiring users to migrate to `inference.RealtimeModel` or `inference.DuplexModel` instead of direct `openai.realtime` client usage.

New Features

  • Gemini 4 Argon support
  • OpenAI Realtime/GPT-Live integration
  • Better tool schema error handling
  • WebSocket handshake retry logic
  • Improved audio processing

Full Release Notes

### Patch Changes

- Add Gemini 4 Argon support with bounded long-decode continuation. - [#2719](https://github.com/livekit/agents-js/pull/2719) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Allow `generateReply` without instructions for Google realtime models with immutable chat context. - [#2694](https://github.com/livekit/agents-js/pull/2694) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Report invalid Gemini tool schemas with the originating tool name instead of silently ending realtime sessions. - [#2548](https://github.com/livekit/agents-js/pull/2548) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Run realtime and full-duplex voice models through LiveKit Inference: `inference.RealtimeModel` for OpenAI Realtime, Gemini Live, and Grok Voice, and `inference.DuplexModel` (or `llm: 'openai/gpt-live-1'`) for OpenAI GPT-Live. The OpenAI Realtime and GPT-Live clients move into agents core; `openai.realtime.RealtimeModel` and `openai.realtime.GPTLiveModel` keep working with direct OpenAI credentials. Gemini 3.x `generateReply` instructions are sent as a wrapped user turn instead of a trailing model turn the model continued. `GrokRealtimeModels` replaces `grok-voice-think-fast-2.0` with `grok-voice-3.0` and `grok-voice-latest`. OpenAI Realtime sessions now retry a refused or failed WebSocket handshake instead of crashing or ending the session, resample and downmix input that isn't 24 kHz mono, and keep a committed turn's trailing audio out of the next turn. - [#2532](https://github.com/livekit/agents-js/pull/2532) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

- Updated dependencies [[`6f29065`](https://github.com/livekit/agents-js/commit/6f290656d1c8008fd56d2cdfce5307d8830c771c), [`86b27fd`](https://github.com/livekit/agents-js/commit/86b27fd5a586fcfe15b431e79a59d2322b63dd13), [`5c63848`](https://github.com/livekit/agents-js/commit/5c6384841f46790cae78052d782fbcb08d8d1707), [`a98e389`](https://github.com/livekit/agents-js/commit/a98e389923422b7a4cba24eb16fdd6791c0c6cc6), [`21d2456`](https://github.com/livekit/agents-js/commit/21d245648d7c73ab3af7c4635024a2247de87d35), [`0cd613a`](https://github.com/livekit/agents-js/commit/0cd613ab064d3e3e6296059000cfc6975c5ab7f4), [`540837b`](https://github.com/livekit/agents-js/commit/540837b7e1194c09aeaef53fc95b9e224add2b75), [`edc9275`](https://github.com/livekit/agents-js/commit/edc92751fabe84f68307d0582bedf3f7b3e7e122), [`dcd8879`](https://github.com/livekit/agents-js/commit/dcd88795f714325cd01e0b7dc61252fd35827e54), [`bae7759`](https://github.com/livekit/agents-js/commit/bae775993e1517918cdf8b04bdbc068bee1ee578), [`c433a25`](https://github.com/livekit/agents-js/commit/c433a259309ea5e3d6004ae461e41cba43145b37), [`212a7b0`](https://github.com/livekit/agents-js/commit/212a7b0aa838d55d2f6adb75dbd4f14d02598bf5), [`3de8f13`](https://github.com/livekit/agents-js/commit/3de8f13b9ce2638261a2400846cff738f575e787), [`8ba33de`](https://github.com/livekit/agents-js/commit/8ba33deddeaa586f89a0f943fb1593fd925f6024), [`9ebffb7`](https://github.com/livekit/agents-js/commit/9ebffb79fc7d4c1092951d243a990c45352408fc), [`b6928f1`](https://github.com/livekit/agents-js/commit/b6928f158518d7db23bbe1647af426ab0eaf65e0)]:
  - @livekit/agents@1.9.3

Related Repositories