Starstruk Logo MarkStarstruk

v0.31.1

bjesus/pipetv0.31.1Jun 30, 2026by github-actions[bot]

AI Summary

Gemma 4 models are now significantly faster on Apple Silicon, generating tokens nearly 90% faster on average by leveraging multi-token prediction (MTP) without requiring user configuration.

Key Highlights

  • Gemma 4 performance boost on Apple Silicon
  • Multi-token prediction (MTP) enabled by default
  • Updated MLX engine with small-batch matmul kernel
  • Updated llama.cpp engine to build 9840

New Features

  • Multi-token prediction (MTP) performance
  • Tightened Gemma 4 MoE model loading
  • Small-batch matmul kernel

Full Release Notes

## Faster Gemma 4 on Apple Silicon

<img width="1037" height="485" alt="Screenshot 2026-06-30 at 5 25 29 PM" src="https://github.com/user-attachments/assets/547d5076-090f-43c4-a661-938e11abc955" />

Gemma 4 is now significantly faster in Ollama on Apple Silicon, generating tokens nearly 90% faster on average across a coding-agent benchmark by leveraging multi-token prediction (MTP). Ollama auto-tunes how many tokens to draft as it runs, so the speedup is on by default, requires no configuration, and does not change the model's output.

## What's Changed

- Tightened Gemma 4 MoE model loading in the MLX engine
- Updated the MLX engine to the latest version, including a new small-batch matmul kernel
- Updated the underlying llama.cpp engine to build 9840
- Improved Gemma 4 multi-token prediction (MTP) performance

**Full Changelog**: https://github.com/ollama/ollama/compare/v0.30.12...v0.31.1