b9642

ggml-org/llama.cppb9642Jun 15, 2026by github-actions[bot]1 days after b9637

What changed since b9637

medium risk

CUDA backend now restricts GGML_OP_REPEAT to F32/F16, replacing the prior Cohere2-MoE parser addition.

Breaking changes

  • CUDA execution of GGML_OP_REPEAT with dtypes other than F32 or F16 is no longer supported and may fail or fall back.

Improvements

  • CUDA REPEAT kernel coverage narrowed to F32/F16, aligning the backend with supported tensor types.
  • Refreshed pre-built binaries across macOS, Linux, Windows, and Android backends.

Upgrade notes

If you run CUDA inference on models or graphs that hit GGML_OP_REPEAT with quantized or other non-F32/F16 tensors, validate output and watch for unsupported-op errors after upgrading. Non-CUDA backends are unaffected by this change.

Analyzed Nov 1, 2026

Upgrading?

Release notes summary

This release restricts CUDA support for the GGML_OP_REPEAT operation to F32 and F16 formats, while providing comprehensive pre-built binaries for macOS, Linux, Windows, and Android across various hardware backends.

Key Highlights

  • CUDA: Only supports F32/F16 for GGML_OP_REPEAT
  • macOS binaries for Apple Silicon (arm64) and Intel (x64)
  • Linux binaries supporting ROCm 7.2, OpenVINO, and SYCL
  • Windows binaries supporting CUDA 12 and CUDA 13
  • openEuler builds disabled

New Features

  • Restriction of CUDA GGML_OP_REPEAT to F32/F16
  • Pre-built binaries for multiple platforms and backends

Release Notes (excerpt)

<details open> CUDA: only support F32/F16 for GGML_OP_REPEAT (#24533) </details> **macOS/iOS:** - macOS Apple Silicon (arm64) - macOS Apple Silicon (arm64, KleidiAI enabled) DISABLED - macOS Intel (x64) - iOS XCFramework **Linux:** - Ubuntu x64 (CPU) - Ubuntu arm64 (CPU) - Ubuntu s390x (CPU) - Ubuntu x64 (Vulkan) - Ubuntu arm64 (Vulkan) - Ubuntu x64 (ROCm 7.2) - Ubuntu x64 (OpenVINO) - Ubuntu x64 (SYCL FP32) - Ubuntu x64 (SYCL FP16) **Android:** - Android arm64 (CPU) **Windows:**…

Published by ggml-org on GitHub.

Read the full release notes

Related Repositories