v0.28.0
pathwaycom/pathwayv0.28.0Jan 8, 2026by github-actions[bot]
AI Summary
This release enhances connector groups with idle duration and priority support, allows schema fields to be specified from message keys or values in Kafka/Redpanda, enables connector groups in multiprocess runs, and includes breaking changes to JSON string handling.
Key Highlights
- Kafka and Redpanda read connectors allow schema fields from message key or value
- Connector groups support idle duration to exclude inactive sources
- Connector groups support priorities to prevent source lagging
- Connector groups now work in multiprocess runs
- Window functions now use deterministic UDFs internally
Breaking Changes
- pw.Json __str__ and dumps methods no longer enforce ASCII string output
New Features
- Flexible schema field mapping from message key or value in Kafka/Redpanda
- Idle duration specification for connector groups
- Priority assignment for sources within connector groups
- Multiprocess support for connector groups
Full Release Notes
### Added - `pw.io.kafka.read` and `pw.io.redpanda.read` now allow each schema field to be specified as coming from either the message key or the message value. - Connector groups now support the specification of an idle duration. When this is set, if a source does not provide any data for the specified period of time, it will be excluded from the group until it produces data again. - It is now possible to assign priorities to sources within a connector group. When a priority is set, it ensures that at any moment, the source is not lagging behind any other source with a higher priority in terms of the tracked column. - Connector groups can now be used in the multiprocess runs. ### Changed - **BREAKING**: The `__str__` and `dumps` methods in `pw.Json` no longer enforce the result to be an ASCII string. This way, the behavior of `pw.debug.compute_and_print` is now consistent with other output connectors. - The window functions now internally use deterministic UDFs, where possible.