Starstruk Logo MarkStarstruk

v1.1.0

amirivojdan/shekarv1.1.0Nov 26, 2025by amirivojdan

AI Summary

An update improving core NLP features including colloquial verb spacing normalization, stemming, and lemmatization.

Key Highlights

  • Improved colloquial verb spacing normalization.
  • Smarter stemmer for better root extraction.
  • Better compound word half-space (ZWNJ) correction.
  • Improved lemmatizer for colloquial verb conjugations.

New Features

  • Improved stemmer algorithm
  • Improved lemmatizer
  • Better ZWNJ handling for compound words

Full Release Notes

###  What’s New in **v1.1.0**

This update brings key improvements to core NLP features:

- **Colloquial verb spacing normalization** (e.g. "می‌خوره" → "میخوره")  
- **Smarter stemmer** for better root extraction  
- **Better compound words half-space (ZWNJ) correction** with extended high-frequency vocab
- **Improved lemmatizer** with better handling of colloquial verb conjugations