v0.30.0

1Panel-dev/1Panelv0.30.0Mar 24, 2026by github-actions[bot]

AI Summary

This release introduces new database connectors for MongoDB and PostgreSQL, enhances NumPy array serialization support, and improves async handling. It also addresses dependency management and fixes a web dashboard initialization issue.

Key Highlights

  • New MongoDB and PostgreSQL connectors with snapshot and streaming support
  • PostgreSQL connectors now support NumPy array serialization
  • Airbyte connectors support dependency overrides
  • Breaking change: MongoDB BSON serialization now preserves array shape

Breaking Changes

  • pw.io.mongodb.write and pw.io.mongodb.read now serialize ndarrays as nested BSON arrays, changing the representation for multi-dimensional arrays
  • Dependencies for pw.io.pyfilesystem.read are no longer included by default and require pip install pathway[pyfilesystem]

New Features

  • pw.io.mongodb.read connector with full snapshot and change stream support
  • pw.io.postgres.read connector using Write-Ahead Log (WAL)
  • pw.io.postgres.write and read support for np.ndarray serialization
  • pw.io.airbyte.read accepts dependency_overrides parameter
  • Async callback available as pw.io.OnChangeCallbackAsync
  • pw.run and pw.run_all support event_loop parameter

Full Release Notes

### Added
- `pw.io.mongodb.read` connector, which reads data from a MongoDB collection. The connector first delivers a full snapshot of the collection and then, if the streaming mode is used, subscribes to the change stream to receive incremental updates in real time.
- `pw.io.postgres.read` connector, which reads data from a PostgreSQL table directly by parsing the Write-Ahead Log (WAL).
- `pw.io.postgres.write` and `pw.io.postgres.read` now support serialization/deserialization of `np.ndarray` (`int`/`float` elements), homogeneous `tuple` and `list` (via Postgres `ARRAY`; multidimensional rectangular arrays supported).
- `pw.io.airbyte.read` now accepts a `dependency_overrides` parameter, allowing users to pin specific versions of transitive dependencies (e.g. `airbyte-cdk`) installed into the connector's virtual environment. This unblocks connectors broken by upstream dependency changes without waiting for upstream fixes.

### Changed
- **BREAKING**: `pw.io.mongodb.write` and `pw.io.mongodb.read` now serialize and deserialize `np.ndarray` columns as nested BSON arrays that preserve the array's shape. Previously, all ndarrays were flattened to a single BSON array regardless of dimensionality, making it impossible to reconstruct the original shape on read-back. For 1-D arrays the representation is identical to before (`[1, 2, 3]`); only multi-dimensional arrays are affected.
- **BREAKING**: The dependencies for `pw.io.pyfilesystem.read` are no longer included in the default package installation. To install them, please use `pip install pathway[pyfilesystem]`.
- Asynchronous callback for `pw.io.python.write` is now available as `pw.io.OnChangeCallbackAsync`.
- `pw.run` and `pw.run_all` now have the `event_loop` parameter to support reusing async state across multiple graph runs.

### Fixed
- `pathway web-dashboard` now waits for the metrics database to be created instead of terminating instantly.