Starstruk Logo MarkStarstruk

v0.27.0

pathwaycom/pathwayv0.27.0Nov 13, 2025by github-actions[bot]

AI Summary

This release adds JetStream support for NATS connectors, Iceberg connector support for Glue catalog backend, and a new function for tracking row update times. It includes breaking changes to the Iceberg API and removes paddlepaddle as a dependency.

Key Highlights

  • JetStream extension support in NATS read and write connectors
  • Iceberg connectors now support Glue as catalog backend via GlueCatalog
  • New Table.add_update_timestamp_utc function for tracking row update times
  • BaseRAGQuestionAnswerer now supports document reranking for two-stage retrieval
  • Multiple bug fixes including HTTP rest_connector trailing slash handling and schema inheritance

Breaking Changes

  • Iceberg connectors now require catalog parameter (pw.io.iceberg.RestCatalog or pw.io.iceberg.GlueCatalog)
  • paddlepaddle is no longer a dependency - must be installed separately

New Features

  • JetStream support in NATS connectors
  • Iceberg connectors with Glue catalog backend support
  • Table.add_update_timestamp_utc function
  • Document reranking support in BaseRAGQuestionAnswerer
  • HTTP rest_connector accepts requests with/without trailing slash
  • Schemas automatically preserve parent schema properties

Full Release Notes

### Added
- JetStream extension is now supported in both NATS read and write connectors.
- The Iceberg connectors now support Glue as a catalog backend.
- New `Table.add_update_timestamp_utc` function for tracking update time of rows in the table

### Changed
- **BREAKING** The API for the Iceberg connectors has changed. The `catalog` parameter is now required in both `pw.io.iceberg.read` and `pw.io.iceberg.write`. This parameter can be either of type `pw.io.iceberg.RestCatalog` or `pw.io.iceberg.GlueCatalog`, and it must contain the connection parameters.
- **BREAKING** `paddlepaddle` is no longer a dependency of the Pathway package. The reason is that choosing a specific version for the hardware it will be run on is advantageous from the performance point of view. To install `paddlepaddle` follow instructions on https://www.paddlepaddle.org.cn/en/install/quick.
- `pw.xpacks.llm.question_answering.BaseRAGQuestionAnswerer` now supports document reranking. This enables two-stage retrieval where initial vector similarity search is followed by reranking to improve document relevance ordering.

### Fixed
- Endpoints created by `pw.io.http.rest_connector` now accept requests both with and without a trailing slash. For example, `/endpoint/` and `/endpoint` are now treated equivalently.
- Schemas that inherit from other schemas now automatically preserve all properties from their parent schemas.
- Fixed an issue where the persistence configuration failed when provided with a relative filesystem path.
- Fixed unique name autogeneration for the Python connectors.