v0.0.67

pipecat-ai/pipecatv0.0.67May 7, 2025by aconchillo

AI Summary

Release adding AWS services, smart turn detection, DebugLogObserver, and improvements to ElevenLabsTTSService.

Key Highlights

  • Added DebugLogObserver for detailed frame logging with configurable filtering
  • Added AWS Nova Sonic speech-to-speech model support with AWSNovaSonicLLMService
  • Added AWSBedrockLLMService and AWSTranscribeSTTService
  • ElevenLabsTTSService now uses beta websocket API with multi-stream-input

Breaking Changes

  • PollyTTSService is now deprecated, use AWSPollyTTSService instead
  • Observer on_push_frame(src, dst, frame, direction, timestamp) is now deprecated

New Features

  • DebugLogObserver
  • AWSNovaSonicLLMService
  • AWSBedrockLLMService
  • AWSTranscribeSTTService
  • enable_ssml_parsing and enable_logging to ElevenLabsTTSService
  • Support for arcana model in RimeHttpTTSService
  • on_active_speaker_changed event handler to DailyTransport

Full Release Notes

### Added

- Added `DebugLogObserver` for detailed frame logging with configurable filtering by frame type and endpoint. This observer automatically extracts and formats all frame data fields for debug logging.

- `UserImageRequestFrame.video_source` field has been added to request an image from the desired video source.

- Added support for the AWS Nova Sonic speech-to-speech model with the new `AWSNovaSonicLLMService`.
  See https://docs.aws.amazon.com/nova/latest/userguide/speech.html.
  Note that it requires Python >= 3.12 and `pip install pipecat-ai[aws-nova-sonic]`.

- Added new AWS services `AWSBedrockLLMService` and `AWSTranscribeSTTService`.

- Added `on_active_speaker_changed` event handler to the `DailyTransport` class.

- Added `enable_ssml_parsing` and `enable_logging` to `InputParams` in `ElevenLabsTTSService`.

- Added support to `RimeHttpTTSService` for the `arcana` model.

### Changed

- Updated `ElevenLabsTTSService` to use the beta websocket API (multi-stream-input). This new API supports context_ids and cancelling those contexts, which greatly improves interruption handling.

- Observers `on_push_frame()` now take a single argument `FramePushed` instead of multiple arguments.

- Updated the default voice for `DeepgramTTSService` to `aura-2-helena-en`.

### Deprecated

- `PollyTTSService` is now deprecated, use `AWSPollyTTSService` instead.

- Observer `on_push_frame(src, dst, frame, direction, timestamp)` is now deprecated, use `on_push_frame(data: FramePushed)` instead.

### Fixed

- Fixed a `DailyTransport` issue that was causing issues when multiple audio or video sources where being captured.

- Fixed a `UltravoxSTTService` issue that would cause the service to generate all tokens as one word.

- Fixed a `PipelineTask` issue that would cause tasks to not be cancelled if task was cancelled from outside of Pipecat.

- Fixed a `TaskManager` that was causing dangling tasks to be reported.

- Fixed an issue that could cause data to be sent to the transports when they were still not ready.

- Remove custom audio tracks from `DailyTransport` before leaving.

### Removed

- Removed `CanonicalMetricsService` as it's no longer maintained.