v0.1.3
oumi-ai/oumiv0.1.3Jan 28, 2025by oelachqar
AI Summary
This release adds VLM/LoRA support, improves GGUF support in VLLM, and adds integration tests for evaluation functions.
Key Highlights
- Added Vision-Lang and LoRA support
- Improved support for GGUF models in VLLM engine
- Added integration tests for evaluation function output
- Added Llama 3.3v configs
New Features
- Native inference optimizations (min_p, temperature)
- VLLM Engine support for BitsAndBytes quantization
- Simplified inference engine API
- Added example distillation notebook
Full Release Notes
## What's Changed * Documentation: Judge | Custom Model page by @kaisopos in https://github.com/oumi-ai/oumi/pull/1195 * [WIP] Add a notebook for using CNN with custom dataset by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1196 * [Cherrypick for launch] Evaluate: return dict of results by @kaisopos in https://github.com/oumi-ai/oumi/pull/1197 * Configs Train/Infer/Eval and Llama 3.3v (70b) by @optas in https://github.com/oumi-ai/oumi/pull/1200 * Adding an integration test for evaluation fn's output (see PR-1197) by @kaisopos in https://github.com/oumi-ai/oumi/pull/1199 * [docs] Add more details and cross-references related to customization by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1198 * Define `single_gpu` test marker by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1201 * Native inference: Don't set `min_p`, `temperature` in `GenerationConfig` if sampling is disabled by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1202 * Update tests to make them runnable on GCP by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1203 * Add newline before `pformat(train_config)` by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1204 * GCP tests launcher script changes by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1205 * [Evaluation] Bug: serialization by @kaisopos in https://github.com/oumi-ai/oumi/pull/1207 * [docs] Add inference snippet for together.ai and DeepSeek APIs by @oelachqar in https://github.com/oumi-ai/oumi/pull/1208 * Exclude `multi_gpu` tests from GitHub GPU tests by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1210 * Update e2e tests to support multi-GPU machines by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1206 * Add wrappers for remote inference engines by @oelachqar in https://github.com/oumi-ai/oumi/pull/1209 * Vision-Lang & Inference (including LoRA) by @optas in https://github.com/oumi-ai/oumi/pull/1174 * [BugFix] Throw a runtime error for quantized models & inference=VLLM by @kaisopos in https://github.com/oumi-ai/oumi/pull/1212 * Fix most job configs by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1213 * e2e tests update by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1216 * [Notebook] Evaluation with Oumi by @kaisopos in https://github.com/oumi-ai/oumi/pull/1218 * gpt2: move `include_performance_metrics` param from script to yaml by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1217 * Simplify inference engine API by @oelachqar in https://github.com/oumi-ai/oumi/pull/1214 * Move configs to experimental by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1215 * [docs] Update index page by @oelachqar in https://github.com/oumi-ai/oumi/pull/1220 * Update ConsoleLogger to write to STDOUT by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1221 * Set `use_spot` to False in our JobConfigs by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1222 * Delete `oumi[optional]` install target by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1224 * Scaffolding and the first testcase for e2e evaluation tests by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1225 * [docs] Update inference engines doc page by @oelachqar in https://github.com/oumi-ai/oumi/pull/1227 * Clean-up inference engine builder by @oelachqar in https://github.com/oumi-ai/oumi/pull/1226 * [VLLM Engine] Enabling BitsAndBytes quantization by @kaisopos in https://github.com/oumi-ai/oumi/pull/1223 * Add example distillation notebook by @jgreer013 in https://github.com/oumi-ai/oumi/pull/1228 * Add a script to pre-download models for `gpu_tests` by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1231 * Fix multi-GPU inference integration test by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1229 * [tiny][docs] Update PEFT/LoRA content by @optas in https://github.com/oumi-ai/oumi/pull/1233 * [BugFix] GGUF does not work with VLLM by @kaisopos in https://github.com/oumi-ai/oumi/pull/1232 * Re-enable parallel evaluation for VLM-s by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1235 * Add multimodal exemplar dataset in our provided mini-datasets by @optas in https://github.com/oumi-ai/oumi/pull/1234 * [Tiny] renaming a field name (`init_lora_weights`) by @optas in https://github.com/oumi-ai/oumi/pull/1236 * Add more e2e evaluation tests by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1237 * Fix pyright breakage when vllm and llama_cpp are not installed by @taenin in https://github.com/oumi-ai/oumi/pull/1240 * Update our oumi launch documentation. by @taenin in https://github.com/oumi-ai/oumi/pull/1239 * Update index.md title for "Join the Community!" by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1242 * Update quickstart.md - nit for Oumi support request by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1241 * [VLLM Engine] Improve support for GGUF models (incl. auto-download) by @kaisopos in https://github.com/oumi-ai/oumi/pull/1238 * Update README.md title to "Join the Community!" by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1243 * Update quickstart.md by @brragorn in https://github.com/oumi-ai/oumi/pull/1251 * Update quickstart.md by @brragorn in https://github.com/oumi-ai/oumi/pull/1253 * Update quickstart.md by @brragorn in https://github.com/oumi-ai/oumi/pull/1252 * Update quickstart.md by @brragorn in https://github.com/oumi-ai/oumi/pull/1250 * [Minor refactor] Moving model caching to `oumi.utils` by @kaisopos in https://github.com/oumi-ai/oumi/pull/1246 * Add more details to troubleshooting FAQ by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1249 * Update training_methods.md - Change compute requirement suggestions by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1245 * Update train.md - nit description change by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1244 * [docs] misc docs feedback by @oelachqar in https://github.com/oumi-ai/oumi/pull/1248 * [tiny] Qwen2-VL activate experimental datapipes by @optas in https://github.com/oumi-ai/oumi/pull/1247 * Update Oumi - A Tour.ipynb by @brragorn in https://github.com/oumi-ai/oumi/pull/1254 * [docs] more docs feedback by @oelachqar in https://github.com/oumi-ai/oumi/pull/1255 * Update supported_models.md by @penfever in https://github.com/oumi-ai/oumi/pull/1256 * Rename `experimental_use_torch_datapipes` data param by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1257 * Add pypi release workflow using testpypi by @oelachqar in https://github.com/oumi-ai/oumi/pull/1259 * Update workflow names by @oelachqar in https://github.com/oumi-ai/oumi/pull/1262 * Update default idle_minutes_to_autostop to 1 hour. by @taenin in https://github.com/oumi-ai/oumi/pull/1264 * update pypi release workflow to use trusted env by @oelachqar in https://github.com/oumi-ai/oumi/pull/1265 * Add `padding_side` param to internal model config by @xrdaukar in https://github.com/oumi-ai/oumi/pull/1260 * Documentation: Updates on Evaluation/Judge (based on Manos' feedback) by @kaisopos in https://github.com/oumi-ai/oumi/pull/1261 * [tiny] less strict requirements by @oelachqar in https://github.com/oumi-ai/oumi/pull/1266 * Add Deepseek R1 Distill Llama 8B/70B configs by @wizeng23 in https://github.com/oumi-ai/oumi/pull/1263 * Update index.md to highlight beta stage by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1268 * Update README.md to highlight beta stage by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1267 * Disable pre-release packages by @oelachqar in https://github.com/oumi-ai/oumi/pull/1270 * Update common_workflows.md - Clarify OpenAI is just an example by @mkoukoumidis in https://github.com/oumi-ai/oumi/pull/1271 * Documentation: Evaluation page (update to highlight multi-modal) by @kaisopos in https://github.com/oumi-ai/oumi/pull/1269 * Update launch.md by @taenin in https://github.com/oumi-ai/oumi/pull/1272 * Add pypi release workflow by @oelachqar in https://github.com/oumi-ai/oumi/pull/1273 * Documentation: Judge | minor edit (bold) by @kaisopos in https://github.com/oumi-ai/oumi/pull/1274 **Full Changelog**: https://github.com/oumi-ai/oumi/compare/v0.1.2...v0.1.3