Starstruk Logo MarkStarstruk

v0.4.9

datalab-to/suryav0.4.9May 27, 2024by VikParuchuri

AI Summary

Optimizes OCR model speed and memory usage while adding static caching capabilities.

Key Highlights

  • ~15-20% faster base OCR model
  • ~25% reduction in memory usage
  • Added static cache for torch.compile
  • Bugfix for different length language inputs

New Features

  • OCR speedup
  • Memory reduction
  • Static cache

Full Release Notes

- Speed up base OCR model ~15-20%, and reduce memory usage by ~25% (can do higher batch sizes)
- Add static cache for compilation - torch.compile will result in another 15% speedup
- Other optimizations, like faster image resizing
- Bugfixes, like enabling different length language inputs for OCR (batching different docs with different languages together)