v1.5.1

bilibili/Index-anisorav1.5.1Mar 18, 2026by amirivojdan

AI Summary

This patch release expands the vocabulary for the Persian text processing toolkit and fixes normalization pipeline bugs.

Key Highlights

Expanded vocabulary for the Persian text processing toolkit.
Fixed minor bugs in the normalization pipeline.

New Features

Expanded Vocabulary

Full Release Notes

# What's New in v1.5.1

This is a patch release with normalization bug fixes and an expanded vocabulary for Shekar's Persian text processing toolkit.

## Highlights

- **Expanded Vocabulary** – the built-in lexicon has been extended with additional Persian words, improving accuracy across tokenization, stemming, and normalization tasks.

## Bug Fixes

- Fixed minor bugs in the normalization pipeline.