Starstruk Logo MarkStarstruk

v3.15.0

apify/crawleev3.15.0Sep 17, 2025by apify-service-account

AI Summary

This minor release adds the TandemRequestProvider for combined RequestList and RequestQueue usage, along with a collectAllKeys option for exportData. Several bug fixes improve reliability around timeouts, proxy URLs, and depth limiting.

Key Highlights

  • New TandemRequestProvider for combined RequestList and RequestQueue
  • Added collectAllKeys option for BasicCrawler.exportData
  • Fixed ImpitHttpClient respecting internal Request timeout
  • Fixed proxyUrls list accepting null values
  • Fixed exportData working on empty datasets

New Features

  • collectAllKeys option for BasicCrawler.exportData
  • TandemRequestProvider for combined RequestList and RequestQueue usage

Full Release Notes

# [3.15.0](https://github.com/apify/crawlee/compare/v3.14.1...v3.15.0) (2025-09-17)


### Bug Fixes

* `ImpitHttpClient` respects the internal `Request` timeout ([#3103](https://github.com/apify/crawlee/issues/3103)) ([a35376d](https://github.com/apify/crawlee/commit/a35376d2ce0a7dee15ec01aa04f42ba59bb82ea8))
* `proxyUrls` list can contain `null` ([#3142](https://github.com/apify/crawlee/issues/3142)) ([dc39cc2](https://github.com/apify/crawlee/commit/dc39cc223a90d0c97c60c5a715bdf524cc32bbac)), closes [#3136](https://github.com/apify/crawlee/issues/3136)
* don't fail `exportData` calls on empty datasets ([#3115](https://github.com/apify/crawlee/issues/3115)) ([298f170](https://github.com/apify/crawlee/commit/298f170ef032f76d5b252e2a08971bfd161a7ef5)), closes [#2734](https://github.com/apify/crawlee/issues/2734)
* respect `maxCrawlDepth` with a custom enqueueLinks `transformRequestFunction` ([#3159](https://github.com/apify/crawlee/issues/3159)) ([e2ecb74](https://github.com/apify/crawlee/commit/e2ecb745da6105d8d083b30b8b68197e53b1cf84))


### Features

* add `collectAllKeys` option for `BasicCrawler.exportData` ([#3129](https://github.com/apify/crawlee/issues/3129)) ([2ddfc9c](https://github.com/apify/crawlee/commit/2ddfc9c6108207d3289ee92fe3c5b646611cc508)), closes [#3007](https://github.com/apify/crawlee/issues/3007)
* add `TandemRequestProvider` for combined `RequestList` and `RequestQueue` usage ([#2914](https://github.com/apify/crawlee/issues/2914)) ([4ca450f](https://github.com/apify/crawlee/commit/4ca450f08b9fb69ae3b2ba3fc66361f14631b15b)), closes [#2499](https://github.com/apify/crawlee/issues/2499)