v0.2.81

sherlock-project/sherlockv0.2.81Feb 18, 2026by akaashrp

AI Summary

This release features a major engine and API overhaul, adds OpenAI API compatibility, expands prebuilt model support, improves WebGPU performance, and integrates XGrammar.

Key Highlights

Engine and API overhaul with ChatModule refactoring
OpenAI API support including chat/completions and function calling
Expanded prebuilt model support (Llama, Mistral, Gemma, Qwen, Phi)
WebGPU performance and reliability improvements
XGrammar integration for JSON-schema/grammar-constrained generation

New Features

Engine refactoring
OpenAI API support
Expanded model support
WebGPU improvements
XGrammar integration
TVM-FFI refactoring

Full Release Notes

* Engine and API overhaul: ChatModule refactored into Engine/MLCEngine, consolidated constructor/reload behavior, multi-model loading, better worker lifecycle, concurrency handling
* OpenAI API: mirror chat/completions APIs, stateful options, function calling and embeddings support
* Conversation templates: unified conversation template schema with custom templates
* Expanded prebuilt model support: added support for more models (Llama 2/3/3.1/3.2, Mistral variants, Gemma 2, Qwen2/2.5/3, Phi family, including vision)
* Runtime and caching: WebGPU performance/reliability improvements (more GPU-side kernels, better OOM/deviceLost handling), wasm/prebuilt versioning updates, support IndexedDB caching
* XGrammar integration: JSON-schema/grammar-constrained generation, XGrammar structural tag
* TVM-FFI integration: refactor for compatibility with more recent TVM commits and TVM FFI 
* Examples: ServiceWorkerEngine + updated Chrome extension demos, new RAG/doc-chat examples, tool calls via structural tag
* CI: GitHub actions for linting and pre-commit hooks 

**Full Changelog**: https://github.com/mlc-ai/web-llm/compare/v0.2.0...v0.2.81