October-2025

Hey everyone, please update Unsloth to use the latest updates! 🦥
- Unsloth now has its own **🐋 Docker image**! Start training with no setup: [Read our Guide](https://docs.unsloth.ai/new/how-to-train-llms-with-unsloth-and-docker) • [Docker image](https://hub.docker.com/r/unsloth/unsloth)
- We collabed with NVIDIA for **Blackwell** and **DGX Spark** support. Read our [Blackwell guide](https://docs.unsloth.ai/basics/fine-tuning-llms-with-blackwell-rtx-50-series-and-unsloth) and [DGX guide](https://docs.unsloth.ai/new/fine-tuning-llms-with-nvidia-dgx-spark-and-unsloth).
<a href="https://docs.unsloth.ai/new/fine-tuning-llms-with-nvidia-dgx-spark-and-unsloth" target="_blank" rel="noopener noreferrer"><img width="200" height="2076" alt="unsloth nvidia dgx spark" src="https://github.com/user-attachments/assets/b1c6e807-59ff-4283-8614-794a06738454" /></a>

### New model updates
- **Qwen3-VL** models are all now supported: [Blogpost](https://docs.unsloth.ai/models/qwen3-vl-run-and-fine-tune) • [SFT 8B notebook](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_VL_(8B)-Vision.ipynb) • [GRPO 8B notebook](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Qwen3_VL_(8B)-Vision-GRPO.ipynb)
- **IBM Granite-4.0** models are now supported. [Granite-4.0 guide](https://docs.unsloth.ai/models/ibm-granite-4.0) • [Notebook](https://docs.unsloth.ai/models/ibm-granite-4.0#fine-tuning-granite-4.0-in-unsloth)
- OpenAI showcased our new **gpt-oss RL** notebook for autonomously solving the 2048 game. [Blogpost](https://docs.unsloth.ai/new/fine-tuning-llms-with-nvidia-dgx-spark-and-unsloth) • [Notebook](https://colab.research.google.com/github/openai/gpt-oss/blob/main/examples/reinforcement-fine-tuning.ipynb)
- Read about our **GLM-4.6** chat template fixes and how to run the model [here](https://docs.unsloth.ai/models/glm-4.6-how-to-run-locally#unsloth-chat-template-fixes)

### New features
- Introducing **Quantization-Aware Training**: We collabed with Pytorch for QAT, recovering as much 70% accuracy. [Read blog](https://docs.unsloth.ai/new/quantization-aware-training-qat)
<a href="https://docs.unsloth.ai/new/quantization-aware-training-qat" target="_blank" rel="noopener noreferrer"><img width="200" height="3100" alt="qat2" src="https://github.com/user-attachments/assets/7a39cec9-c1cc-4037-bcec-693885fc17c2" /></a>
- Unsloth supports OpenEnv to allow for **open RL environments**. Blog coming soon • [Notebook](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/OpenEnv_gpt_oss_(20B)_Reinforcement_Learning_2048_Game.ipynb)
- New [customer support agent](https://colab.research.google.com/github/unslothai/notebooks/blob/main/nb/Granite4.0.ipynb) notebook to enable real-time analysis & solving of customer interactions. You'll also learn how to train models using data from Google Sheets.
- Support for **Python 3.13**, **PyTorch 2.9** and the latest Hugging Face TRL and transformers are now fixed.
- Save to TorchAO supported as well:
```python
from torchao.quantization import Int4WeightOnlyConfig
model.save_pretrained_torchao("model", tokenizer, torchao_config = Int4WeightOnlyConfig())
```

> [!TIP]
> Update Unsloth via `pip install --upgrade --force-reinstall --no-cache-dir --no-deps unsloth unsloth_zoo`
> If you want PyTorch 2.9: `pip install --upgrade unsloth unsloth_zoo`

### RL Improvements
1. Fixed [Standby](https://docs.unsloth.ai/get-started/reinforcement-learning-rl-guide/memory-efficient-rl) consuming more VRAM than usual. Auto selects the maximum 80% to 95% of GPU utilization if `import os; os.environ["UNSLOTH_VLLM_STANDBY"] = "1"` is used.
2. Fixed GRPO training hangs with better environment timers - works on DGX Spark and all other GPUs.
4. Fixes GRPO `RuntimeError: shape '[1, 887, 1, 128]' is invalid for input of size 3633152` for all models

### RL Environment functions
1. New `execute_with_time_limit` function to force functions to execute within a time limit. E.g. with a 2 second time limit, use:
```python
from unsloth import execute_with_time_limit
@execute_with_time_limit(2)
def execute_strategy(strategy, game):
    return _execute_strategy(strategy, game)
try:
    execute_strategy(strategy, game)
except TimeoutError as e:
    print(f"Timed out with error = {str(e)}")
```
2. To check if only Python standard modules are used in a function, use `check_python_modules`.
3. Use `create_locked_down_function` to create a function without leakage of global variables.
4. Use `Benchmarker` ie `from unsloth import Benchmarker` to benchmark functions accurately. It wipes the L1 to L3 cache approximately to reduce chances of benchmark cheating.
5. Use `launch_openenv` to launch a continuous reloaded OpenEnv environment process (to stop it from closing down) ie `from unsloth import launch_openenv` It will auto find a port that is not used.

### Bug fixes
1. GPT-OSS BF16 The GPTOSSRouter works with `load_in_4bit = True` AttributeError: 'GptOssTopKRouter' object has no attribute 'weight'
2. Mistral training fixed - sentencepiece proto issue fixed (any protobuf version works)
3. Fix evaluation ie `UNSLOTH_RETURN_LOGITS="1"` works. Fixes https://github.com/unslothai/unsloth/issues/3126 https://github.com/unslothai/unsloth/issues/3071
4. Fixes `Output 0 of UnslothFusedLossBackward is a view and is being modified inplace.` for Gemma 3 and `transformers>=4.57.1`
6. If you see `ImportError: cannot import name '_Ink' from 'PIL._typing' (/usr/local/lib/python3.12/dist-packages/PIL/_typing.py)` please update and use our new notebooks

**Don't forget to also join our Reddit: [r/unsloth](https://www.reddit.com/r/unsloth/) 🥰**

## What's Changed
* Fix loading as 8bit by @Etherll in https://github.com/unslothai/unsloth/pull/3384
* Nightly by @danielhanchen in https://github.com/unslothai/unsloth/pull/3392
* Nightly by @danielhanchen in https://github.com/unslothai/unsloth/pull/3394
* Update int8-int4 QAT config to use Int8DynamicActivationIntxWeightConfig by @metascroy in https://github.com/unslothai/unsloth/pull/3391
* Gemma 3 bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/3410
* Transformers Fix v4.57 rename from PretrainedConfig to PreTrainedConfig by @mmathew23 in https://github.com/unslothai/unsloth/pull/3445
* improve qat by @Etherll in https://github.com/unslothai/unsloth/pull/3446
* Fix eval metric issue by @pluesclues in https://github.com/unslothai/unsloth/pull/3420
* [Part2] Reinstate llama.cpp Compatibility and GGUF Conversion with Multiple Quantizations and Automated Ollama Modelfile Creation by @rolandtannous in https://github.com/unslothai/unsloth/pull/3356
* vLLM FP8 quantized support for SFT/GRPO by @Datta0 in https://github.com/unslothai/unsloth/pull/3414
* Fix by @danielhanchen in https://github.com/unslothai/unsloth/pull/3466
* AMD fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/3467
* Fix transformers 4.57.1 by @danielhanchen in https://github.com/unslothai/unsloth/pull/3473
* GRPO bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/3474
* EOL LF (unix line endings) normalization by @djsaunde in https://github.com/unslothai/unsloth/pull/3478
* Fix out of resources issue for llama3.2 sft on amd gpu by @wangxunx in https://github.com/unslothai/unsloth/pull/3455
* Bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/3483
* Bug fixes by @danielhanchen in https://github.com/unslothai/unsloth/pull/3484
* Patch sleep mode properly for trl by @Datta0 in https://github.com/unslothai/unsloth/pull/3492
* Sleep trl patch by @Datta0 in https://github.com/unslothai/unsloth/pull/3494
* fix cross entropy loss issue for small vocab size on amd gpu by @wangxunx in https://github.com/unslothai/unsloth/pull/3503
* Gemma 3n fix by @mmathew23 in https://github.com/unslothai/unsloth/pull/3499
* enable intel for torch2.8 by @leizhenyuan in https://github.com/unslothai/unsloth/pull/3381
* add code for intel qlora by @leizhenyuan in https://github.com/unslothai/unsloth/pull/3370
* fix for intel memory calculation by @leizhenyuan in https://github.com/unslothai/unsloth/pull/3513
* [intel] enable support 2.9 for intel xpu by @leizhenyuan in https://github.com/unslothai/unsloth/pull/3514
* FP8 training enhancements by @Datta0 in https://github.com/unslothai/unsloth/pull/3496

## New Contributors
* @metascroy made their first contribution in https://github.com/unslothai/unsloth/pull/3391
* @djsaunde made their first contribution in https://github.com/unslothai/unsloth/pull/3478
* @wangxunx made their first contribution in https://github.com/unslothai/unsloth/pull/3455

**Full Changelog**: https://github.com/unslothai/unsloth/compare/September-2025-v3...October-2025