v1.6.0

# Chonkie 1.6.0 🎉🦛

<p align="center">
  <img src="https://github.com/chonkie-inc/chonkie/blob/main/docs/assets/logo/chonkie_scientist.png?raw=true" height="200" alt="Chonkie logo" />
</p>

This release brings HTML table support, a self-hostable chunking API, native async capabilities, and a migration to `ty` for faster type-checking, alongside a range of internal refactors and quality improvements that make the library leaner and easier to extend.

---

### 田 HTML Table Support ✨

Structured data in HTML documents has historically been a challenge for chunking pipelines. With 1.6.0, we're introducing first-class support for HTML tables via two new components `TableChef` and `TableChunker`.

- **`TableChef`** handles the extraction and normalization of HTML tables into clean, structured representations that are ready for downstream processing.
- **`TableChunker`** builds on top of that to intelligently chunk tabular content, preserving row and column semantics rather than blindly splitting on token boundaries.

Whether you're working with HTML or markdown, you can now process tables in your chunking pipeline.




<table>
<thead>
<tr>
<th>Input Code</th>
<th>Original HTML Table</th>
<th>Chunked Output</th>
</tr>
</thead>

<tbody>
<tr>

<td>
<p align="center">
<img src="https://github.com/user-attachments/assets/251de10a-f97f-46cb-bddd-5f645c76e98e" height="400" alt="Chonkie table"/>
</p>

</td>

<td>

<table>
<thead>
<tr><th>ID</th><th>Status</th></tr>
</thead>
<tbody>
<tr><td>1</td><td>Active</td></tr>
<tr><td>2</td><td>Pending</td></tr>
<tr><td>3</td><td>Inactive</td></tr>
<tr><td>4</td><td>Active</td></tr>
</tbody>
</table>

</td>

<td>

<table>
<thead>
<tr><th>ID</th><th>Status</th></tr>
</thead>
<tbody>
<tr><td>1</td><td>Active</td></tr>
<tr><td>2</td><td>Pending</td></tr>
</tbody>
</table>

<br>

<table>
<thead>
<tr><th>ID</th><th>Status</th></tr>
</thead>
<tbody>
<tr><td>3</td><td>Inactive</td></tr>
<tr><td>4</td><td>Active</td></tr>
</tbody>
</table>

</td>

</tr>
</tbody>
</table>

---

### 💻 Chonkie API: Self-Hostable Chunking Server

Chonkie can now run as a fully self-hosted REST API, making it easy to expose chunking capabilities as a service within your infrastructure. Built on FastAPI, the Chonkie OSS API can be spun up with a single CLI command and accessed from any machine on your network.

This is ideal for teams that want to centralize their chunking logic, integrate Chonkie into polyglot stacks, or simply avoid re-initializing models in every service that needs chunking.

To start the server, run:
```bash
chonkie serve
```

Once running, any client on your network can hit the endpoint on the consumer side, full documentation can be found in `http://localhost:8000/docs`

<p align="center">

<img alt="image" src="https://github.com/user-attachments/assets/d57a83e7-1aa3-4b9e-bcf2-db13522f5e92" width="50%" height="auto" />

<img alt="api" src="https://github.com/user-attachments/assets/12c7f130-4ac5-431e-a2be-5390203cd3f0"  height="auto" width="50%" />

<p/>




---

### ⚡ Async Support

Chonkie now supports asynchronous chunking out of the box. This has been a long-requested feature for users building async-native applications, whether that's async data pipelines, or anything else running on an event loop. You can now `await` chunking operations without blocking, making Chonkie a natural fit for high-throughput, I/O-bound workloads.

| Method | Async Equivalent | Description |
|--------|-----------------|-------------|
| `chunk(text)` | `achunk(text)` | Chunk a single text |
| `chunk_batch(texts)` | `achunk_batch(texts)` | Chunk a list of texts |
| `chunk_document(doc)` | `achunk_document(doc)` | Chunk a `Document` object |

---

## What's Changed
* Add test coverage plan documenting gaps and implementation strategy by @chonknick in https://github.com/chonkie-inc/chonkie/pull/502
* docs: comprehensive documentation review and updates by @chonknick in https://github.com/chonkie-inc/chonkie/pull/503
* Refactor AutoTokenizer for less if/else by @akx in https://github.com/chonkie-inc/chonkie/pull/422
* chore: fix lint errors introduced in #502 by @akx in https://github.com/chonkie-inc/chonkie/pull/506
* refactor: replace redundant embedding providers with CatsuEmbeddings wrappers by @chonknick in https://github.com/chonkie-inc/chonkie/pull/505
* feat: support pathlib.Path objects for filesystem paths by @akx in https://github.com/chonkie-inc/chonkie/pull/507
* Use `logger.warning` for warnings by @akx in https://github.com/chonkie-inc/chonkie/pull/425
* chore: normalize import style for importlib.util by @akx in https://github.com/chonkie-inc/chonkie/pull/501
* chore: fix & simplify tests by @akx in https://github.com/chonkie-inc/chonkie/pull/509
* feat: switch to ty by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/409
* feat: support html tables by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/500
* feat: Add Chonkie OSS API - Self-hostable FastAPI server by @chonknick in https://github.com/chonkie-inc/chonkie/pull/504
* chore: cleanup unecessary files by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/514
* chore(deps): bump authlib from 1.6.6 to 1.6.7 by @dependabot[bot] in https://github.com/chonkie-inc/chonkie/pull/515
* Implement Async Support by @aryxenv in https://github.com/chonkie-inc/chonkie/pull/437
* bump version by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/518
* chore: add async docs by @chonk-lain in https://github.com/chonkie-inc/chonkie/pull/519

## New Contributors
* @aryxenv made their first contribution in https://github.com/chonkie-inc/chonkie/pull/437

**Full Changelog**: https://github.com/chonkie-inc/chonkie/compare/v1.5.6...v1.6.0