v0.2.86

mlc-ai/web-llmv0.2.86Oct 11, 2026by akaashrp

Upgrading?

AI Summary

This release introduces Gemma 4 E2B instruction-tuned models with audio support and updates the bundled TVM runtime. It features extensive WebGPU library rebuilds, 4K-prefill capabilities for Phi-3.5 vision, and significant stability improvements for audio/image loading and generation.

Key Highlights

  • Added Gemma 4 E2B instruction-tuned models in q4f16_1 and q4f32_1 with text and audio input.
  • Updated bundled TVM runtime to version 0.28.0-dev0.
  • Implemented 4K-prefill Phi-3.5 vision libraries for better image support.
  • Added manifest-based audio/image loading and crash-resumable generation features.

New Features

  • Gemma 4 E2B instruction-tuned models (q4f16_1, q4f32_1) with audio input
  • Manifest-based audio and image loading
  • Crash-resumable generation
  • 4K-prefill Phi-3.5 vision libraries

Full Release Notes

- Add Gemma 4 E2B instruction-tuned models in `q4f16_1` and `q4f32_1`, with text and audio input. The FP32 variant does not require `shader-f16`.
- Update the bundled TVM runtime to `@mlc-ai/web-runtime@0.28.0-dev0` and switch the prebuilt catalog to `v0_2_86/base`.
- Rebuild 224 WebGPU libraries: 112 each in `base` and `sg32`. The release includes compiler revisions, configuration snapshots, checksums, validation results, and a rebuild script.
- Use 4K-prefill Phi-3.5 vision libraries so default square images fit. The previous 2K variants remain in the binary folder.
- Include manifest-based audio and image loading, crash-resumable generation, and fixes for interrupted conversations, cancelled streams, model locks, token counts, and audio cleanup. Manifest loading remains optional; existing records retain the legacy path.

Artifacts:
- [Gemma 4 E2B q4f16_1](https://huggingface.co/mlc-ai/gemma-4-E2B-it-q4f16_1-MLC)
- [Gemma 4 E2B q4f32_1](https://huggingface.co/mlc-ai/gemma-4-E2B-it-q4f32_1-MLC)
- [v0_2_86 model libraries and build provenance](https://github.com/mlc-ai/binary-mlc-llm-libs/tree/main/web-llm-models/v0_2_86)

Compiler sources: [TVM be03dc94b0](https://github.com/akaashrp/tvm/commit/be03dc94b001269b88ae010d2ac352256be55579), based on Apache main `27576ce2d1` with a WebGPU FP32 prefill fix; [MLC-LLM 42fa855891](https://github.com/akaashrp/mlc-llm/commit/42fa855891fcb5825bf0911047d7c91e8234abd1), based on main `8978ea9aec` with compatibility updates for current TVM APIs.

Related Repositories