v1.4.0

feyninc/chonkiev1.4.0Oct 11, 2025by chonknick

AI Summary

A major feature release introducing `chonkie.Pipeline` for composable workflows, `TableChef` support, and new visualizer themes.

Key Highlights

  • New `chonkie.Pipeline` for composable chunking and retrieval workflows
  • Added `TableChef` and `TableChunker` for smart table-aware chunking
  • New visualizer themes: `ocean_breeze` and `midnight`
  • File-handling helpers baked into cloud chunkers

Breaking Changes

  • numpy is now a core dependency
  • Renamed `tokenizer_or_token_counter` kwarg to `tokenizer`

New Features

  • Pipeline
  • TableChef and TableChunker
  • New visualizer themes
  • FileFetcher helpers

Full Release Notes

<img width="960" height="540" alt="Chonkie Logo (49)" src="https://github.com/user-attachments/assets/fab18c49-0139-463d-bc66-1a326561ec75" />

## ✨ Highlights

- Introduced `chonkie.Pipeline` for composable chunking + retrieval workflows
- Added `TableChef` and `TableChunker` for smart table-aware chunking, plus `MarkdownChef.parse()` for quick Markdown ingestion
- New search methods land on `ChromaHandshake`, `ElasticHandshake`, and `TurboPufferHandshake` for one-line vector-store checks
- Two new visualizer themes—`ocean_breeze` and `midnight`—for prettier chunk inspection
- File-handling helpers baked into every cloud chunker for drag-and-drop simplicity

## 🔨 Breaking

- `numpy` is now a core dependency—remove any pinned excludes in your env
- The old `tokenizer_or_token_counter` kwarg is gone; use `tokenizer` everywhere (single, consistent name)

## What's Changed
* Feat: add table chef by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/297
* Feat: add search method for chroma handshake by @AlanPonnachan in https://github.com/chonkie-inc/chonkie/pull/293
* docs: update docs by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/307
* Feat: Add `parse` method to the `MarkdownChef` + Enhance testing for chefs by @chonknick in https://github.com/chonkie-inc/chonkie/pull/310
* Fix: Remove error for malformed/absent tables in `Document` and more...  by @chonknick in https://github.com/chonkie-inc/chonkie/pull/308
* Feat: Add ElasticHandshake by @AlanPonnachan in https://github.com/chonkie-inc/chonkie/pull/314
* Docs: Update Cloud API docs by @shreyash-chonkie in https://github.com/chonkie-inc/chonkie/pull/318
* Feat: Change `tokenizer_or_token_counter` to `tokenizer` by @chonknick in https://github.com/chonkie-inc/chonkie/pull/311
* docs: fix broken links in python-sdk docs by @IvanMiao in https://github.com/chonkie-inc/chonkie/pull/316
* Fix: remove `legacy` chunkers for the next breaking change in `chonkie` by @chonknick in https://github.com/chonkie-inc/chonkie/pull/286
* feat(visualizer): Add ocean_breeze and midnight themes by @amithadityacp in https://github.com/chonkie-inc/chonkie/pull/328
* Fix: Update `TableChef` to always return `MarkdownTable` + remove stale `sdpm` docs by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/332
* Feat: Add `numpy` as a default install in `chonkie` by @chonknick in https://github.com/chonkie-inc/chonkie/pull/333
* Feat: Add logging by @chonknick in https://github.com/chonkie-inc/chonkie/pull/313
* Feat: Add `chonkie.Pipeline` by @chonknick in https://github.com/chonkie-inc/chonkie/pull/319
* Feat: add search method for turbopuffer handshake by @AlanPonnachan in https://github.com/chonkie-inc/chonkie/pull/303
* Update docs by @shreyash-chonkie in https://github.com/chonkie-inc/chonkie/pull/337
* Fix typos by @shreyash-chonkie in https://github.com/chonkie-inc/chonkie/pull/338
* A test was causing an error in a test. by @cappuch in https://github.com/chonkie-inc/chonkie/pull/334
* Docs: Add Pipelines + FileFetcher Documentation  by @chonknick in https://github.com/chonkie-inc/chonkie/pull/339
* Feat: Add pipeline tests + simplify some logic by @chonknick in https://github.com/chonkie-inc/chonkie/pull/340

## New Contributors
* @AlanPonnachan made their first contribution in https://github.com/chonkie-inc/chonkie/pull/293
* @IvanMiao made their first contribution in https://github.com/chonkie-inc/chonkie/pull/316
* @amithadityacp made their first contribution in https://github.com/chonkie-inc/chonkie/pull/328
* @cappuch made their first contribution in https://github.com/chonkie-inc/chonkie/pull/334

**Full Changelog**: https://github.com/chonkie-inc/chonkie/compare/v1.3.1...v1.4.0