Starstruk Logo MarkStarstruk

v1.5.5

feyninc/chonkiev1.5.5Feb 4, 2026by chonknick

AI Summary

A patch release focused on stability, fixing OpenAI lazy imports, multiprocessing safety, and edge cases in CodeChunker and SlumberChunker.

Key Highlights

  • OpenAI Lazy Import allows importing Chonkie without installing OpenAI
  • BaseChunker defaults to sequential processing for multiprocessing safety
  • Fixed leaf node handling in CodeChunker
  • Improved split index handling in SlumberChunker

New Features

  • Lazy import for OpenAI features
  • Multiprocessing-safe default chunker behavior

Full Release Notes

## Chonkie v1.5.5 🦛

A patch release focused on stability improvements and bug fixes. This release makes Chonkie more robust for users with partial dependencies and custom implementations.

### 🐛 Bug Fixes

* **OpenAI Lazy Import** - Users without `openai` installed can now import Chonkie without errors. Previously, importing `chonkie` would fail with `ModuleNotFoundError` even when not using OpenAI features. (#481)

* **Multiprocessing Safe by Default** - Custom chunkers now work out-of-the-box without pickle errors. The `BaseChunker` now defaults to sequential processing, with parallel processing available as an opt-in. (#471)

* **CodeChunker Leaf Node Handling** - Fixed an edge case where leaf nodes in the syntax tree could produce empty output, causing valid code to be dropped during chunking. (#473)

* **SlumberChunker Safe Split** - Improved split index handling in SlumberChunker for better reliability. (#479)

### 🧹 Code Quality

* **CodeChunker Cleanup** - Removed dead code, improved variable naming consistency, and standardized UTF-8 decoding with error handling. (#482)

### 📚 Documentation

* Updated recipe repository link in documentation (#476)

---

## What's Changed

* fix: openai lazy import by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/481
* fix: make BaseChunker multiprocessing safe by default by @anaslimem in https://github.com/chonkie-inc/chonkie/pull/471
* Fix leaf node handling in CodeChunker to prevent missing chunks by @chimchim89 in https://github.com/chonkie-inc/chonkie/pull/473
* chore: cleanup CodeChunker leaf node handling by @chonknick in https://github.com/chonkie-inc/chonkie/pull/482
* slumber chunker with safe split_index by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/479
* Update recipe repository link in documentation by @bolzzzz in https://github.com/chonkie-inc/chonkie/pull/476
* chore: bump version to 1.5.5 by @chonknick in https://github.com/chonkie-inc/chonkie/pull/483

## New Contributors

* @anaslimem made their first contribution in https://github.com/chonkie-inc/chonkie/pull/471
* @bolzzzz made their first contribution in https://github.com/chonkie-inc/chonkie/pull/476

**Full Changelog**: https://github.com/chonkie-inc/chonkie/compare/v1.5.4...v1.5.5