Starstruk Logo MarkStarstruk

v0.0.25

pipecat-ai/pipecatv0.0.25May 31, 2024by aconchillo

AI Summary

Added a WebSocket server transport, function calling, Cartesia TTS support, and Langchain processor.

Key Highlights

  • Added WebsocketServerTransport with protobuf serialization.
  • Added LLMService.register_function() for function calling.
  • Added Cartesia TTS support.
  • Added LangchainProcessor.

New Features

  • WebsocketServerTransport
  • Function calling
  • Cartesia TTS
  • LangchainProcessor

Full Release Notes

### Added

- Added `WebsocketServerTransport`. This will create a websocket server and will read messages coming from a client. The messages are serialized/deserialized with protobufs. See `examples/websocket-server` for a detailed example.

- Added function calling (`LLMService.register_function()`). This will allow the LLM to call functions you have registered when needed. For example, if you register a function to get the weather in Los Angeles and ask the LLM about the weather in Los Angeles, the LLM will call your function. See https://platform.openai.com/docs/guides/function-calling

- Added new `LangchainProcessor`.

- Added Cartesia TTS support (https://cartesia.ai/)

### Fixed

- Fixed SileroVAD frame processor.

- Fixed an issue where `camera_out_enabled` would cause the highg CPU usage if no image was provided.

### Performance

- Removed unnecessary audio input tasks.