Starstruk Logo MarkStarstruk

v0.2.1

oumi-ai/oumiv0.2.1Jul 11, 2025by kaisopos

AI Summary

Focuses on adaptive inference infrastructure, synthesis improvements, and fixes for the Judge API and configuration errors.

Key Highlights

  • Full support for adaptive inference added.
  • Data synthesis improvements (permutable attributes, combination sampling).
  • Judge API V2 fixes for prompt variable replacement.

New Features

  • Adaptive semaphores and concurrency controllers.
  • Data synthesis config support and document ingestion.
  • Multi-node verl SLURM job support.
  • Rich logging handler option.
  • Private method changes (`infer_online`, `infer_from_file`).

Full Release Notes

## What's Changed
* Set infer_online and infer_from_file to private by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1745
* Update launch.md by @shanghongsim in https://github.com/oumi-ai/oumi/pull/1781
* Add adaptive semaphore to enable future adaptive throughput scenarios by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1780
* Fix a pyright regression by @taenin in https://github.com/oumi-ai/oumi/pull/1783
* Judge API V2 | Fix judge config from repo path by @kaisopos in https://github.com/oumi-ai/oumi/pull/1782
* Add permutable attributes and combination sampling for data synthesis by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1773
* Removed collator in finetuning tutorial notebook by @shanghongsim in https://github.com/oumi-ai/oumi/pull/1788
* Update our contributing guidelines. by @taenin in https://github.com/oumi-ai/oumi/pull/1789
* Add adaptive concurrency controller in preparation for adaptive inference by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1784
* Fixed issue with final conversations not consistently being saved by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1795
* Add support for ingesting datasets for synthesis by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1790
* Add support for adaptive inference by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1791
* Add support for Example Sources in Synthesis by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1797
* Webinar announcement and other news by @stefanwebb in https://github.com/oumi-ai/oumi/pull/1800
* Added utm_source parameters by @stefanwebb in https://github.com/oumi-ai/oumi/pull/1802
* Add code to handle document ingestion by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1796
* Add code for handling basic document segmentation by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1803
* Update mflow support in oumi trainer by @oelachqar in https://github.com/oumi-ai/oumi/pull/1804
* Add multi-node verl SLURM job by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1798
* Fixed various tutorial notebooks by @shanghongsim in https://github.com/oumi-ai/oumi/pull/1792
* Add parameter logging to oumi trainer by @oelachqar in https://github.com/oumi-ai/oumi/pull/1807
* Judge API V2 | Enable prompt variable replacement by YAML by @kaisopos in https://github.com/oumi-ai/oumi/pull/1805
* [tiny] Update train config comment header by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1809
* Add experimental option to use the rich logging handler by @oelachqar in https://github.com/oumi-ai/oumi/pull/1810

## New Contributors
* @shanghongsim made their first contribution in https://github.com/oumi-ai/oumi/pull/1781

**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.2.0...v0.2.1