v1.4.1

amirivojdan/shekarv1.4.1Feb 22, 2026by amirivojdan

AI Summary

This release focuses on bug fixes and refactoring for more robust Persian text processing in Shekar, improving the sentence tokenizer, spellchecker, and spacing normalizer components.

Key Highlights

Fixed Sentence Tokenizer Bug – handles Persian quotations and multi-sentence structures correctly
Fixed Spellchecker Bug – improved accuracy and stability
Refactored Spacing Normalizer – split into four well-defined modules (Orthographic, Punctuation, Word, Verbal)

New Features

Sentence tokenizer now correctly handles Persian quotations and multi-sentence structures
Spellchecker improved for better accuracy and stability
Spacing Normalizer refactored into four modular components for enhanced clarity and maintainability

Full Release Notes

# What’s New in v1.4.1

This release focuses on bug fixes and refactoring for more robust Persian text processing in Shekar.

## Highlights

- **Fixed Sentence Tokenizer Bug** – handles Persian quotations and multi-sentence structures correctly.  
- **Fixed Spellchecker Bug** – improved accuracy and stability.  
- **Refactored Spacing Normalizer** – split into four well-defined modules:  
  - `OrthographicSpacingNormalizer`  
  - `PunctuationSpacingNormalizer`  
  - `WordSpacingNormalizer`  
  - `VerbalSpacingNormalizer`  
  Enhances clarity, maintainability, and modularity of preprocessing pipelines.