Starstruk Logo MarkStarstruk

v0.1.7

oumi-ai/oumiv0.1.7Feb 25, 2025by taenin

AI Summary

This release adds support for Claude Sonnet 3.7, migrates the LM Harness integration, and includes a notebook for fine-tuning MiniMath-R1-1.5B.

Key Highlights

  • Added inference config for Claude Sonnet 3.7
  • Migrated LM Harness integration from `simple_evaluate` to `evaluate`
  • Updated RemoteInferenceEngine to handle OpenAI format batch prediction
  • Added notebook for fine-tuning MiniMath-R1-1.5B

New Features

  • OpenAI batch prediction endpoint support
  • Qwen2-VL evaluation job fixes
  • Updated transformer version to 4.48

Full Release Notes

## What's Changed
* Update the RemoteInferenceEngine to appropriately handle openai format batch prediction endpoints. by @taenin in https://github.com/oumi-ai/oumi/pull/1472
* Fix local models to not break the registry. by @taenin in https://github.com/oumi-ai/oumi/pull/1476
* Create an inference config for Claude Sonnet 3.7 by @taenin in https://github.com/oumi-ai/oumi/pull/1479
* Add notebook for fine-tuning MiniMath-R1-1.5B by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1480
* [Evaluation] Migrate LM Harness integration point from `simple_evaluate` to `evaluate` by @kaisopos in https://github.com/oumi-ai/oumi/pull/1455
* [tiny]Update trl to 0.14 by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1478


**Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.6...v0.1.7