v0.22.0

pathwaycom/pathwayv0.22.0Jun 5, 2025by github-actions[bot]

AI Summary

This release adds Azure Blob Storage as a persistence backend, enables UDF batching, and makes several breaking changes around DateTime creation and expression evaluation.

Key Highlights

Azure Blob Storage as a persistence backend
UDFs can now operate on batches of data with max_batch_size parameter
Expressions are now evaluated in batches for improved performance

Breaking Changes

pw.DateTimeUtc now requires passing time zone information
pw.DateTimeNaive no longer allows passing time zone information
Expressions are now evaluated in batches

New Features

pw.persistence.Backend.azure
Batching for UDFs with max_batch_size parameter

Full Release Notes

### Added
- Data persistence can now be configured to use Azure Blob Storage as a backend. An Azure backend instance can be created using `pw.persistence.Backend.azure` and included in the persistence config.
- Added batching to UDFs. It is now possible to make UDFs operate on batches of data instead of single rows. To do so `max_batch_size` argument has to be set.

### Changed
- **BREAKING**: when creating `pw.DateTimeUtc` it is now obligatory to pass the time zone information.
- **BREAKING**: when creating `pw.DateTimeNaive` passing time zone information is not allowed.
- **BREAKING**: expressions are now evaluated in batches. Generally, it speeds up the computations but might increase the memory usage if the intermediate state in the expressions is large.

### Fixed
- Synchronization groups now correctly handle cases where the source file-like object is updated during the reading process.