v0.1.9

oumi-ai/oumiv0.1.9Mar 24, 2025by nikg7

AI Summary

This release introduces QLoRA and QwQ configurations, updates the TRL library to 0.15, and adds support for Phi-4 multimodal training and inference.

Key Highlights

  • Added QLoRA and QwQ full fine-tune configurations
  • Updated TRL to version 0.15
  • Added Phi-4 multimodal training and inference support
  • Updated CLI to use Rich formatting for better output
  • Optimized VLM evaluation performance

Breaking Changes

  • Renamed `evaluation_platform` to `evaluation_backend`

New Features

  • Custom evaluation notebooks for reliability classifiers
  • Text truncation support (`max_length`) for vision language SFT collator
  • OUMI_FORCE_EDITABLE_INSTALL environment variable for editable installs
  • Auto-population and validation of VLM specific parameters in TrainingConfig

Full Release Notes

## What's Changed
* Add QwQ full fine-tune and QLoRA configs by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1518
* Update TRL to 0.15 and fix Liger/dataset code by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1507
* [tiny] Remove vLLM Colab link and fix Alpaca Eval quickstart by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1530
* Evaluation: Inference optimizations by @kaisopos in https://github.com/oumi-ai/oumi/pull/1522
* Qwen2.5 VL: Replace "from source" install with `transformers>=0.49` by @nikg4 in https://github.com/oumi-ai/oumi/pull/1528
* [Evaluation] Renaming `evaluation_platform` → `evaluation_backend` by @kaisopos in https://github.com/oumi-ai/oumi/pull/1526
* [tiny] Clean up datasets code by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1529
* Minor logging improvements in `BaseMapDataset` by @nikg4 in https://github.com/oumi-ai/oumi/pull/1532
* Upload scripts used in a Weekly Walkthrough by @taenin in https://github.com/oumi-ai/oumi/pull/1533
* Update VisionLanguageConversationFeatureGenerator by @nikg4 in https://github.com/oumi-ai/oumi/pull/1531
* [docs] add security.md by @oelachqar in https://github.com/oumi-ai/oumi/pull/1534
* [Evaluation] Custom evaluation notebook: a reliability classifier by @kaisopos in https://github.com/oumi-ai/oumi/pull/1535
* Multimodal: Limit max number of images per Conversation by @nikg4 in https://github.com/oumi-ai/oumi/pull/1536
* Auto-populate and validate params specific to `vision_language_sft` collator in `TrainingConfig` by @nikg4 in https://github.com/oumi-ai/oumi/pull/1537
* Update Oumi Env to use Rich formatting by @taenin in https://github.com/oumi-ai/oumi/pull/1541
* Update oumi launch to use Rich formatting by @taenin in https://github.com/oumi-ai/oumi/pull/1543
* Update oumi evaluate to use rich formatting. by @taenin in https://github.com/oumi-ai/oumi/pull/1544
* Update the CLI to replace all prints with Rich prints. by @taenin in https://github.com/oumi-ai/oumi/pull/1547
* Render the oumi env command as a shell block in bug reports. by @taenin in https://github.com/oumi-ai/oumi/pull/1548
* Define `Conversation` proto bufs by @nikg4 in https://github.com/oumi-ai/oumi/pull/1550
* [Evaluation] Modifying Alpaca Eval results format to be consistent with LM Harness by @kaisopos in https://github.com/oumi-ai/oumi/pull/1551
* Augmenting logging training/model statistics  by @optas in https://github.com/oumi-ai/oumi/pull/1545
* Misc no-op code cleanups by @nikg4 in https://github.com/oumi-ai/oumi/pull/1553
* Add code used for the evaluation demo. by @taenin in https://github.com/oumi-ai/oumi/pull/1556
* Add `OUMI_FORCE_EDITABLE_INSTALL` env var to do editable Oumi install from source in job configs by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1420
* Add letter counting GRPO example by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1539
* Remove UV install from notebooks as this breaks colab by @taenin in https://github.com/oumi-ai/oumi/pull/1558
* [Evaluation] Updates in hallucination notebook by @kaisopos in https://github.com/oumi-ai/oumi/pull/1552
* [Evaluations] Custom evals: Adding support for `eval_kwargs` by @kaisopos in https://github.com/oumi-ai/oumi/pull/1557
* Logging message update in `log_number_of_model_parameters` by @nikg4 in https://github.com/oumi-ai/oumi/pull/1560
* [Evaluation][Custom] Removing restrictions and better error checking by @kaisopos in https://github.com/oumi-ai/oumi/pull/1561
* Support text truncation (`max_length`) for `vision_language_sft` collator by @nikg4 in https://github.com/oumi-ai/oumi/pull/1559
* phi 4 multimodal training version 1 ( with limitations ) by @optas in https://github.com/oumi-ai/oumi/pull/1555
* Phi-4 basic inference with native/vllm by @optas in https://github.com/oumi-ai/oumi/pull/1563
* [minor] phi4 train improvements by @optas in https://github.com/oumi-ai/oumi/pull/1564
* Fix printing errors in oumi env for non-string values. by @taenin in https://github.com/oumi-ai/oumi/pull/1565


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.8...v0.1.9