@livekit/agents-plugin-openai@1.4.5

livekit/agents-js@livekit/agents-plugin-openai@1.4.5Jun 2, 2026by github-actions[bot]

AI Summary

This patch release enhances the OpenAI Realtime API integration by enabling word-by-word transcription deltas and fixing configuration handling.

Key Highlights

Stream `input_audio_transcription.delta` events as `UserInputTranscribed` partials for word-by-word transcription.
Honor `OPENAI_BASE_URL` for Realtime API defaults.
Include OpenAI Realtime response status details in incomplete response logs.
Sort function tools to keep tool order invariant.

New Features

Word-by-word user transcripts via delta events

Full Release Notes

### Patch Changes

-   fix(plugin-openai): honor OPENAI_BASE_URL for Realtime defaults. - [#1650](https://github.com/livekit/agents-js/pull/1650) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

-   fix(plugin-openai): include OpenAI Realtime response status details in incomplete response logs. - [#1631](https://github.com/livekit/agents-js/pull/1631) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

-   fix(llm): sort function tools to keep tool order invariant. - [#1641](https://github.com/livekit/agents-js/pull/1641) ([@rosetta-livekit-bot](https://github.com/apps/rosetta-livekit-bot))

-   feat(plugin-openai): stream `input_audio_transcription.delta` events on the OpenAI Realtime API as `UserInputTranscribed` partials (`isFinal: false`). Enables word-by-word user transcripts with `gpt-realtime-whisper` and any future delta-emitting transcription model. Accumulators are cleared on `.completed`, `.failed`, `conversation.item.deleted`, session close, and reconnect; `.failed` now emits a closing `isFinal: true` event when partials had streamed so consumers don't hang. - [#1581](https://github.com/livekit/agents-js/pull/1581) ([@jjsquillante](https://github.com/jjsquillante))

-   Updated dependencies \[[`278af00740f8ade253485afc1d51a19382cb5a2c`](https://github.com/livekit/agents-js/commit/278af00740f8ade253485afc1d51a19382cb5a2c), [`7c1cfcb1237f4aa7d36669754fc388bbaa872a71`](https://github.com/livekit/agents-js/commit/7c1cfcb1237f4aa7d36669754fc388bbaa872a71), [`703cffbfda8a8b830b78f2c89e0b2284244dc120`](https://github.com/livekit/agents-js/commit/703cffbfda8a8b830b78f2c89e0b2284244dc120), [`22b24ae18ca4f3dd690a948e9f9ab3ac9cdad4b0`](https://github.com/livekit/agents-js/commit/22b24ae18ca4f3dd690a948e9f9ab3ac9cdad4b0), [`8524731b39097fe521952f83b210b999834bbeda`](https://github.com/livekit/agents-js/commit/8524731b39097fe521952f83b210b999834bbeda), [`aa8d427391a79ec8e2ccda103e1460c720b73acf`](https://github.com/livekit/agents-js/commit/aa8d427391a79ec8e2ccda103e1460c720b73acf), [`4207d54c037ad0206814ae5e246735e357bb4c3b`](https://github.com/livekit/agents-js/commit/4207d54c037ad0206814ae5e246735e357bb4c3b), [`106c2b6820751ce3802d77e1e1e74ece130efc89`](https://github.com/livekit/agents-js/commit/106c2b6820751ce3802d77e1e1e74ece130efc89), [`710d112f70ce1134f3098729cda6a950d1deb66c`](https://github.com/livekit/agents-js/commit/710d112f70ce1134f3098729cda6a950d1deb66c), [`7479bd4640d2d82a4f0263dc0745e72bab733127`](https://github.com/livekit/agents-js/commit/7479bd4640d2d82a4f0263dc0745e72bab733127), [`b157d241ffaf402c0a2b8dc05dbf7e9ed96d21ee`](https://github.com/livekit/agents-js/commit/b157d241ffaf402c0a2b8dc05dbf7e9ed96d21ee), [`181c868d75fe8828e5193fc530f454d52fc776e0`](https://github.com/livekit/agents-js/commit/181c868d75fe8828e5193fc530f454d52fc776e0), [`f470e5531da74d66484194125fc0f950b5a53431`](https://github.com/livekit/agents-js/commit/f470e5531da74d66484194125fc0f950b5a53431), [`453b69965e0075f634f79c323194ceb16ccfe1a6`](https://github.com/livekit/agents-js/commit/453b69965e0075f634f79c323194ceb16ccfe1a6), [`0a27a700dcef89e6202872024d73452b47025788`](https://github.com/livekit/agents-js/commit/0a27a700dcef89e6202872024d73452b47025788), [`0f29f6bd34559ba98544c2c9621936b44a0573b8`](https://github.com/livekit/agents-js/commit/0f29f6bd34559ba98544c2c9621936b44a0573b8), [`c5eaadd27748aa2a69a4cb1a72b3de652fa841ef`](https://github.com/livekit/agents-js/commit/c5eaadd27748aa2a69a4cb1a72b3de652fa841ef), [`154189e4af2149c580aeaba7dfe3a8c79f3d682d`](https://github.com/livekit/agents-js/commit/154189e4af2149c580aeaba7dfe3a8c79f3d682d), [`d85a30757405158fb3182be1c77aaec6acecdd67`](https://github.com/livekit/agents-js/commit/d85a30757405158fb3182be1c77aaec6acecdd67), [`ee078ec394e697a989bd0faf53aa043392fa7ae4`](https://github.com/livekit/agents-js/commit/ee078ec394e697a989bd0faf53aa043392fa7ae4), [`7af2f8ebafe86fae52854ddc73b253f2d29da286`](https://github.com/livekit/agents-js/commit/7af2f8ebafe86fae52854ddc73b253f2d29da286), [`33578844ba169f1485465ea96346567c449b7ea7`](https://github.com/livekit/agents-js/commit/33578844ba169f1485465ea96346567c449b7ea7), [`62c8278eb1294088cad66285a799e84e20799eaf`](https://github.com/livekit/agents-js/commit/62c8278eb1294088cad66285a799e84e20799eaf), [`35a33ff0f89a23b17ea3ad79c642188e66e31604`](https://github.com/livekit/agents-js/commit/35a33ff0f89a23b17ea3ad79c642188e66e31604), [`ee078ec394e697a989bd0faf53aa043392fa7ae4`](https://github.com/livekit/agents-js/commit/ee078ec394e697a989bd0faf53aa043392fa7ae4), [`dfb34c27b8cb075ed77e63ceb5286fc504122abd`](https://github.com/livekit/agents-js/commit/dfb34c27b8cb075ed77e63ceb5286fc504122abd), [`98a46dd366fa69f9270d3ae780e50740ffe72c8a`](https://github.com/livekit/agents-js/commit/98a46dd366fa69f9270d3ae780e50740ffe72c8a), [`278af00740f8ade253485afc1d51a19382cb5a2c`](https://github.com/livekit/agents-js/commit/278af00740f8ade253485afc1d51a19382cb5a2c)]:
    -   @livekit/agents@1.4.5