b9642
ggml-org/llama.cppb9642Jun 15, 2026by github-actions[bot]1 days after b9637
What changed since b9637
CUDA backend now restricts GGML_OP_REPEAT to F32/F16, replacing the prior Cohere2-MoE parser addition.
Breaking changes
- CUDA execution of GGML_OP_REPEAT with dtypes other than F32 or F16 is no longer supported and may fail or fall back.
Improvements
- CUDA REPEAT kernel coverage narrowed to F32/F16, aligning the backend with supported tensor types.
- Refreshed pre-built binaries across macOS, Linux, Windows, and Android backends.
Upgrade notes
If you run CUDA inference on models or graphs that hit GGML_OP_REPEAT with quantized or other non-F32/F16 tensors, validate output and watch for unsupported-op errors after upgrading. Non-CUDA backends are unaffected by this change.
Analyzed Nov 1, 2026
Upgrading?
Release notes summary
This release restricts CUDA support for the GGML_OP_REPEAT operation to F32 and F16 formats, while providing comprehensive pre-built binaries for macOS, Linux, Windows, and Android across various hardware backends.
Key Highlights
- CUDA: Only supports F32/F16 for GGML_OP_REPEAT
- macOS binaries for Apple Silicon (arm64) and Intel (x64)
- Linux binaries supporting ROCm 7.2, OpenVINO, and SYCL
- Windows binaries supporting CUDA 12 and CUDA 13
- openEuler builds disabled
New Features
- Restriction of CUDA GGML_OP_REPEAT to F32/F16
- Pre-built binaries for multiple platforms and backends
Release Notes (excerpt)
<details open> CUDA: only support F32/F16 for GGML_OP_REPEAT (#24533) </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (ROCm 7.2) - Ubuntu x64 (OpenVINO) - Ubuntu x64 (SYCL FP32) - Ubuntu x64 (SYCL FP16) **Android:** - Android arm64 (CPU) **Windows:**…
Published by ggml-org on GitHub.
Read the full release notesRelated Repositories
:electron: Build cross-platform desktop apps with JavaScript, HTML, and CSS
Godot Engine – Multi-platform 2D and 3D game engine
ClickHouse® is a real-time analytics database management system
Self-hosted game stream host for Moonlight.
DuckDB is a high-performance analytical database system