v0.3.25
NandhaKishorM/layav0.3.25Oct 3, 2026by github-actions[bot]
Upgrading?
AI Summary
Features significant performance and calibration improvements including histogram binning integration, idle model unloading, and a new FP32 TileLang CPU lowering for faster inference.
Key Highlights
- Histogram binning calibration integration
- Idle unload and shared-server MCP mode
- FP32 TileLang CPU lowering for kernels
- Per-bucket minConfidence map support
New Features
- Histogram binning calibration
- Idle unload and shared-server MCP mode
- FP32 TileLang CPU lowering
Full Release Notes
## What's Changed * fix(verify): numerics_check compares the unrounded outputs, not the 4-dp answers by @aashish254 in https://github.com/NandhaKishorM/laya/pull/884 * fix(agent): validate CUDA ordinals, accept auto, survive capability-probe failures by @sahiixx in https://github.com/NandhaKishorM/laya/pull/886 * fix(serve): split an oversized batch across forward passes instead of collating it whole by @keemsisi in https://github.com/NandhaKishorM/laya/pull/889 * feat(calibrate): wire histogram binning into answers and the calibration payload by @Bruce-Yii in https://github.com/NandhaKishorM/laya/pull/890 * feat(ts): accept the per-bucket minConfidence map by @Bruce-Yii in https://github.com/NandhaKishorM/laya/pull/891 * fix(cli): write redirected output as utf-8 by @plox-sumit in https://github.com/NandhaKishorM/laya/pull/893 * feat(serve): add idle unload and shared-server MCP mode by @Rish-it in https://github.com/NandhaKishorM/laya/pull/894 * feat(backends): restore the inference backend class layer by @cklxx in https://github.com/NandhaKishorM/laya/pull/895 * feat(fast): add an fp32 TileLang CPU lowering for the kernels by @cklxx in https://github.com/NandhaKishorM/laya/pull/896 * fix(model): match the action head dtype so AOTInductor packaging completes by @cklxx in https://github.com/NandhaKishorM/laya/pull/897 * feat(agent): carry the compile items left out of the #472 split by @cklxx in https://github.com/NandhaKishorM/laya/pull/898 * feat(ts): port per-bucket minConfidence map to on-device engine by @Swatantra-66 in https://github.com/NandhaKishorM/laya/pull/900 * perf(fast): use two pipeline stages for GEGLU by @RagingSilence in https://github.com/NandhaKishorM/laya/pull/901 ## New Contributors * @sahiixx made their first contribution in https://github.com/NandhaKishorM/laya/pull/886 **Full Changelog**: https://github.com/NandhaKishorM/laya/compare/v0.3.24...v0.3.25
Related Repositories
public-apis/public-apis★ 491,190
A collective list of free APIs
NousResearch/hermes-agent★ 256,045
The agent that grows with you
yt-dlp/yt-dlp★ 200,215
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,537
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,699
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.