v0.30.0
kazuto-07/TTS-cacherv0.30.0Mar 24, 2026by github-actions[bot]
Upgrading?
AI Summary
This update adds MongoDB and PostgreSQL connectors, improves serialization support for arrays, and introduces async callback support.
Key Highlights
- New MongoDB connector with change stream support
- PostgreSQL connector reading directly from WAL
- Enhanced serialization for numpy arrays and lists
- Async callback support for Python IO
Breaking Changes
- MongoDB read/write now serialize ndarrays as nested BSON arrays to preserve shape (previously flattened)
- Dependencies for `pw.io.pyfilesystem.read` moved to extras, requiring `pip install pathway[pyfilesystem]`
New Features
- pw.io.mongodb.read connector
- pw.io.postgres.read connector
- Serialization support for np.ndarray and lists
- pw.io.OnChangeCallbackAsync
- event_loop parameter for pw.run
Full Release Notes
### Added - `pw.io.mongodb.read` connector, which reads data from a MongoDB collection. The connector first delivers a full snapshot of the collection and then, if the streaming mode is used, subscribes to the change stream to receive incremental updates in real time. - `pw.io.postgres.read` connector, which reads data from a PostgreSQL table directly by parsing the Write-Ahead Log (WAL). - `pw.io.postgres.write` and `pw.io.postgres.read` now support serialization/deserialization of `np.ndarray` (`int`/`float` elements), homogeneous `tuple` and `list` (via Postgres `ARRAY`; multidimensional rectangular arrays supported). - `pw.io.airbyte.read` now accepts a `dependency_overrides` parameter, allowing users to pin specific versions of transitive dependencies (e.g. `airbyte-cdk`) installed into the connector's virtual environment. This unblocks connectors broken by upstream dependency changes without waiting for upstream fixes. ### Changed - **BREAKING**: `pw.io.mongodb.write` and `pw.io.mongodb.read` now serialize and deserialize `np.ndarray` columns as nested BSON arrays that preserve the array's shape. Previously, all ndarrays were flattened to a single BSON array regardless of dimensionality, making it impossible to reconstruct the original shape on read-back. For 1-D arrays the representation is identical to before (`[1, 2, 3]`); only multi-dimensional arrays are affected. - **BREAKING**: The dependencies for `pw.io.pyfilesystem.read` are no longer included in the default package installation. To install them, please use `pip install pathway[pyfilesystem]`. - Asynchronous callback for `pw.io.python.write` is now available as `pw.io.OnChangeCallbackAsync`. - `pw.run` and `pw.run_all` now have the `event_loop` parameter to support reusing async state across multiple graph runs. ### Fixed - `pathway web-dashboard` now waits for the metrics database to be created instead of terminating instantly.
Related Repositories
public-apis/public-apis★ 491,268
A collective list of free APIs
NousResearch/hermes-agent★ 256,134
The agent that grows with you
yt-dlp/yt-dlp★ 200,318
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,598
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,705
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.