Starstruk Logo MarkStarstruk

v0.25.0

pathwaycom/pathwayv0.25.0Jul 17, 2025by github-actions[bot]

AI Summary

This release adds a QuestDB write connector, introduces 'only_metadata' format for filesystem reading, and makes several breaking changes including license tier restrictions and API changes.

Key Highlights

  • pw.io.questdb.write method for writing to Quest DB
  • pw.io.fs.read now supports 'only_metadata' format
  • Elasticsearch and BigQuery connectors moved to Scale license tier
  • pw.io.fs.read no longer accepts format='raw'

Breaking Changes

  • Elasticsearch and BigQuery connectors require Scale license tier
  • pw.io.fs.read no longer accepts format='raw'
  • pw.io.s3_csv.read connector has been removed

New Features

  • pw.io.questdb.write
  • pw.io.fs.read with format='only_metadata'

Full Release Notes

### Added
- `pw.io.questdb.write` method for writing to Quest DB.
- `pw.io.fs.read` now supports the `"only_metadata"` format. When this format is used, the table will contain only metadata updates for the tracked directory, without reading file contents.

### Changed
- **BREAKING** The Elasticsearch and BigQuery connectors have been moved to the Scale license tier. You can obtain the Scale tier license for free at https://pathway.com/get-license.
- **BREAKING** `pw.io.fs.read` no longer accepts `format="raw"`. Use `format="binary"` to read binary objects, `format="plaintext_by_file"` to read plaintext objects per file, or `format="plaintext"` to read plaintext objects split into lines.
- **BREAKING** The `pw.io.s3_csv.read` connector has been removed. Please use `pw.io.s3.read` with `format="csv"` instead.

### Fixed
- `pw.io.s3.read` and `pw.io.s3.write` now also check the `AWS_PROFILE` environment variable for AWS credentials if none are explicitly provided.