v1.5.1

amirivojdan/shekarv1.5.1Mar 18, 2026by amirivojdan

AI Summary

A patch release focused on fixing normalization bugs and expanding the built-in vocabulary.

Key Highlights

Built-in lexicon extended with additional Persian words.
Fixed minor bugs in the normalization pipeline.

New Features

Expanded vocabulary for better tokenization and stemming accuracy.

Full Release Notes

# What's New in v1.5.1

This is a patch release with normalization bug fixes and an expanded vocabulary for Shekar's Persian text processing toolkit.

## Highlights

- **Expanded Vocabulary** – the built-in lexicon has been extended with additional Persian words, improving accuracy across tokenization, stemming, and normalization tasks.

## Bug Fixes

- Fixed minor bugs in the normalization pipeline.