Starstruk Logo MarkStarstruk

August-2025

unslothai/unslothAugust-2025Aug 8, 2025by shimmyshimmer

AI Summary

Adds full support for fine-tuning gpt-oss models with significant VRAM reduction and speed improvements, alongside support for Qwen3 and new model variants.

Key Highlights

  • gpt-oss fine-tuning (1.5x faster, 50% less VRAM)
  • Works on RTX 50 and Blackwell GPUs
  • Qwen3-Coder and Qwen3-2507 support
  • New model support: Kimi-K2, GLM 4.5, Orpheus-3B, Hunyuan-A13B

New Features

  • gpt-oss training
  • Blackwell/RTX 50 support
  • Qwen3 support
  • new model mappings

Full Release Notes

<img width="2560" height="963" alt="gpt-oss unsloth" src="https://github.com/user-attachments/assets/b6783170-7fd4-478f-b4a9-252ccc57999e" />

## gpt-oss is here! ✨
Finetune gpt-oss for free with our Unsloth [Colab notebook](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/gpt-oss-(20B)-Fine-tuning.ipynb)!
- We’ve managed to make gpt-oss train on just 14GB of VRAM, making it possible to work on free Colab due to our linear conversions. For more details, [Read our Guide/Blogpost](https://docs.unsloth.ai/basics/gpt-oss)
- Fine-tuning gpt-oss is 1.5x faster and uses 50% less VRAM with Unsloth. **gpt-oss-120b model fits on 65GB of VRAM.**
- Model uploads: [20b GGUF](https://huggingface.co/unsloth/gpt-oss-20b-GGUF) • [120b GGUF](https://huggingface.co/unsloth/gpt-oss-120b-GGUF) • [All uploads](https://huggingface.co/collections/unsloth/gpt-oss-6892433695ce0dee42f31681)

###  :sloth: __Unsloth updates__
- We’ve made algorithmic updates to Unsloth so **every** model now trains faster and with less VRAM, no matter which.
- Unsloth now works on RTX 50 and Blackwell GPUs. [Read our guide](https://docs.unsloth.ai/basics/training-llms-with-blackwell-rtx-50-series-and-unsloth).
- Official Unsloth Docker image coming very soon!
- You can now run Unsloth models directly via Docker: `docker model pull hf.co/unsloth/gpt-oss-20b-GGUF`

### :stars: __Qwen3-Coder + Qwen3-2507__
Qwen made July, 2025 updates called 'Qwen3-2507' and launched their SOTA coding models!
- Qwen3-Coder (with Unsloth fixes): [Guide](https://docs.unsloth.ai/basics/qwen3-coder) • [Coder uploads](https://huggingface.co/collections/unsloth/qwen3-coder-687ff47700270447e02c987d)
- Qwen3-2507: [Guide](https://docs.unsloth.ai/basics/qwen3-2507) • [2507 uploads](https://huggingface.co/collections/unsloth/qwen3-680edabfb790c8c34a242f95)
- Fine-tune Qwen3-4B-2507 with [our Colab notebook](https://huggingface.co/collections/unsloth/qwen3-680edabfb790c8c34a242f95)

###  :crystal_ball: __New models + Support:__
Run these new models:
- Kimi-K2: [Guide](https://docs.unsloth.ai/basics/kimi-k2) • [GGUF](https://huggingface.co/unsloth/Kimi-K2-Instruct-GGUF)
- GLM: [4.5-Air](https://huggingface.co/unsloth/GLM-4.5-Air-GGUF) • [4.5](https://huggingface.co/unsloth/GLM-4.5-GGUF) • [4-32B-0414](https://huggingface.co/unsloth/GLM-4-32B-0414-GGUF)
- [Orpheus-3B](https://huggingface.co/unsloth/orpheus-3b-0.1-ft-GGUF) •  [Hunyuan-A13B](https://huggingface.co/unsloth/Hunyuan-A13B-Instruct-GGUF) 

Unsloth also now supports running + training for:
- We collabed with the Liquid & TII teams to support training for [Falcon-H1-7B](https://huggingface.co/unsloth/Falcon-H1-7B-Instruct-GGUF) and [LFM2-1.2B](https://huggingface.co/unsloth/LFM2-1.2B-GGUF)! Notebooks [here](https://github.com/unslothai/notebooks?tab=readme-ov-file#linear-attention-notebooks)
- [Devstral-2507](https://docs.unsloth.ai/basics/devstral) • [Magistral-2507](https://docs.unsloth.ai/basics/magistral) • [SmolLM3-3B](https://huggingface.co/unsloth/SmolLM3-3B-GGUF)

**Don't forget to also join our Reddit: [r/unsloth](https://www.reddit.com/r/unsloth/) 🥰**

## What's Changed
* Fix argument mismatch in GRPO _get_per_token_logps lambda function by @rolandtannous in https://github.com/unslothai/unsloth/pull/2929
* patch falcon h1 inference by @mmathew23 in https://github.com/unslothai/unsloth/pull/2932
* Fix falcon H1 dropout issue by @Datta0 in https://github.com/unslothai/unsloth/pull/2938
* fix: change lora_dropout from int to float for type consistency by @muzzlol in https://github.com/unslothai/unsloth/pull/2949
* GRPO fix dataloader_num_workers value error in GRPOTrainer by @rolandtannous in https://github.com/unslothai/unsloth/pull/2944
* GRPO Fix - Support vllm pre-dequantized quantization states in fast_dequantize kernel by @rolandtannous in https://github.com/unslothai/unsloth/pull/2943
* Bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/2982
* Update unsloth-cli.py by @qgallouedec in https://github.com/unslothai/unsloth/pull/2985
* use fastmodel falcon h1 by @mmathew23 in https://github.com/unslothai/unsloth/pull/2987
* Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model merge error by @rolandtannous in https://github.com/unslothai/unsloth/pull/2986
* Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized model merge error" by @danielhanchen in https://github.com/unslothai/unsloth/pull/2988
* Revert "Revert "Add Qwen2.5-VL-32B-Instruct mapping to fix quantized … by @danielhanchen in https://github.com/unslothai/unsloth/pull/2990
* Bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/2998
* Update README.md by @qgallouedec in https://github.com/unslothai/unsloth/pull/2991
* Bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/3017
* [bugs] fix for casual mask by @leizhenyuan in https://github.com/unslothai/unsloth/pull/3011
* [intel] add for intel path for llama.py by @leizhenyuan in https://github.com/unslothai/unsloth/pull/3012
* Fix Gemma 2 by @danielhanchen in https://github.com/unslothai/unsloth/pull/3024
* falcon h1 force float32 when dtype is torch.float16 by @mmathew23 in https://github.com/unslothai/unsloth/pull/3026
* Fix torch compile issues by @danielhanchen in https://github.com/unslothai/unsloth/pull/3028
* Fix Llama and Gemma inference by @Erland366 in https://github.com/unslothai/unsloth/pull/3034
* Fixup multi GPU workload. by @Datta0 in https://github.com/unslothai/unsloth/pull/3049
* Bug Fixes and Enhancements for Model Loading by @Etherll in https://github.com/unslothai/unsloth/pull/3052
* Add gemma-3n chat template to chat_templates.py by @Etherll in https://github.com/unslothai/unsloth/pull/3051
* Fix: Added specific check for Gemma so models like BERT properly init… by @Sekinal in https://github.com/unslothai/unsloth/pull/3055
* fixup rope sync for everything by @Datta0 in https://github.com/unslothai/unsloth/pull/3061
* get_per_token_logps_and_entropies: return tuple instead of dict by @mmathew23 in https://github.com/unslothai/unsloth/pull/3080
* Docs: Add WSL Installation Guide for Blackwell / RTX 5090 GPU by @dongbin-lunark in https://github.com/unslothai/unsloth/pull/3079
* GPT-OSS support by @mmathew23 in https://github.com/unslothai/unsloth/pull/3099
* Nightly by @danielhanchen in https://github.com/unslothai/unsloth/pull/3102
* gpt-oss manually call temporary patch by @mmathew23 in https://github.com/unslothai/unsloth/pull/3104

## New Contributors
* @muzzlol made their first contribution in https://github.com/unslothai/unsloth/pull/2949
* @Sekinal made their first contribution in https://github.com/unslothai/unsloth/pull/3055
* @dongbin-lunark made their first contribution in https://github.com/unslothai/unsloth/pull/3079

**Full Changelog**: https://github.com/unslothai/unsloth/compare/July-2025...August-2025