v0.3.8
NandhaKishorM/layav0.3.8Sep 23, 2026by github-actions[bot]
Upgrading?
AI Summary
This release adds support for Intel XPU devices, introduces a TypeScript inference package, and integrates with LangChain and LangGraph for enhanced routing capabilities.
Key Highlights
- Detect and use Intel XPU (Arc/iGPU) devices
- Addition of laya-ts TypeScript inference package
- Support for ONNX Runtime and torch.compile
- Integration with LangChain and LangGraph routing
- MCP stdio server support
New Features
- Intel XPU device detection and usage
- laya-ts TypeScript package
- ONNX Runtime inference engine support
- LangChain and LangGraph integration
- MCP stdio server (laya[mcp] extra)
Full Release Notes
## What's Changed * fix(router): keep an empty preload selection empty by @Ai-Eastern in https://github.com/NandhaKishorM/laya/pull/240 * test: cover the load-time and budget errors no suite reached by @PerryLink in https://github.com/NandhaKishorM/laya/pull/237 * docs: the README's Router link points at a heading that does not exist by @PerryLink in https://github.com/NandhaKishorM/laya/pull/236 * fix(serve): honor published checkpoint model IDs by @AliAkbariAlashti in https://github.com/NandhaKishorM/laya/pull/235 * fix(research): the eval harness is the one ECE that binned differently by @PerryLink in https://github.com/NandhaKishorM/laya/pull/232 * test: repair three assertions that cannot fail by @PerryLink in https://github.com/NandhaKishorM/laya/pull/231 * fix(serve): run inference off the event loop by @PerryLink in https://github.com/NandhaKishorM/laya/pull/230 * fix(agent): keep non-ASCII characters in non-string instructions by @PerryLink in https://github.com/NandhaKishorM/laya/pull/228 * fix(email): the word confidential is not a disclaimer by @PerryLink in https://github.com/NandhaKishorM/laya/pull/227 * perf: parse each checkpoint's tokenizer once per process by @fwt1888 in https://github.com/NandhaKishorM/laya/pull/225 * fix(agent): preserve newest turn in chronological conversation lists by @Bruce-Yii in https://github.com/NandhaKishorM/laya/pull/224 * feat: detect and use Intel XPU (Arc/iGPU) devices by @pugong2019 in https://github.com/NandhaKishorM/laya/pull/242 * feat(ci): run the test suite on Windows as well as Linux by @PerryLink in https://github.com/NandhaKishorM/laya/pull/212 * fix(lang): route romanized Bangla to the multilingual checkpoint by @kishormorol in https://github.com/NandhaKishorM/laya/pull/187 * fix(training): honor decision-head activation checkpointing by @zhangxinping666 in https://github.com/NandhaKishorM/laya/pull/149 * fix(email): a sign-off word inside the body is not a signature by @LudwigJMarx in https://github.com/NandhaKishorM/laya/pull/132 * fix(common): truncate_left kept the whole state when no room was left by @ahmedembeddedxx in https://github.com/NandhaKishorM/laya/pull/112 * fix(research): make the Chinese benchmark audit platform-independent by @HankGrimm in https://github.com/NandhaKishorM/laya/pull/216 * fix(lang): route CJK text with Latin brand names to the multilingual checkpoint by @ahmedembeddedxx in https://github.com/NandhaKishorM/laya/pull/113 * Add a CLI for testing Laya locally by @aashish254 in https://github.com/NandhaKishorM/laya/pull/155 * Optional TileLang GPU fast path: 4-5x lower latency per call, identical answers by @cklxx in https://github.com/NandhaKishorM/laya/pull/25 * feat(ts): add laya-ts TypeScript inference package by @nnlgsakib in https://github.com/NandhaKishorM/laya/pull/243 * refactor(email): one definition of email_questions by @LudwigJMarx in https://github.com/NandhaKishorM/laya/pull/136 * research: re-run the 51-language sweep in both temperature regimes (the #208 ask) by @PerryLink in https://github.com/NandhaKishorM/laya/pull/222 * build(docker): add the Compose HTTP service laya-serve by @PerryLink in https://github.com/NandhaKishorM/laya/pull/234 * fix(agent): allow custom noul labels by @wasiqnauman in https://github.com/NandhaKishorM/laya/pull/163 * fix(lang): recognize Azerbaijani text when routing requests by @ch4ki in https://github.com/NandhaKishorM/laya/pull/36 * feat: optional MCP stdio server (laya[mcp] extra) by @davidberardozzi in https://github.com/NandhaKishorM/laya/pull/189 * feat(agent): predict_batch — score many states in shared forward passes (~10x GPU throughput) by @AlKor13 in https://github.com/NandhaKishorM/laya/pull/47 * feat: add torch.compile support and ONNX Runtime inference engine by @Swish78 in https://github.com/NandhaKishorM/laya/pull/215 * feat(integrations): add LangChain and LangGraph routing and guardrails by @LEVELING2108 in https://github.com/NandhaKishorM/laya/pull/229 * docs: name the gold-distribution target in the RLCD recipe line by @liwenjie200543 in https://github.com/NandhaKishorM/laya/pull/247 * fix(email): closings the case rule does not reach by @ahmedembeddedxx in https://github.com/NandhaKishorM/laya/pull/245 * fix(agent): don't rewrite tokenizer_config through the HuggingFace cache symlink by @emiliano-go in https://github.com/NandhaKishorM/laya/pull/107 * perf: keep torch out of import laya (lazy torch-backed exports) by @emiliano-go in https://github.com/NandhaKishorM/laya/pull/108 ## New Contributors * @Ai-Eastern made their first contribution in https://github.com/NandhaKishorM/laya/pull/240 * @AliAkbariAlashti made their first contribution in https://github.com/NandhaKishorM/laya/pull/235 * @fwt1888 made their first contribution in https://github.com/NandhaKishorM/laya/pull/225 * @pugong2019 made their first contribution in https://github.com/NandhaKishorM/laya/pull/242 * @kishormorol made their first contribution in https://github.com/NandhaKishorM/laya/pull/187 * @ahmedembeddedxx made their first contribution in https://github.com/NandhaKishorM/laya/pull/112 * @HankGrimm made their first contribution in https://github.com/NandhaKishorM/laya/pull/216 * @aashish254 made their first contribution in https://github.com/NandhaKishorM/laya/pull/155 * @nnlgsakib made their first contribution in https://github.com/NandhaKishorM/laya/pull/243 * @wasiqnauman made their first contribution in https://github.com/NandhaKishorM/laya/pull/163 * @ch4ki made their first contribution in https://github.com/NandhaKishorM/laya/pull/36 * @davidberardozzi made their first contribution in https://github.com/NandhaKishorM/laya/pull/189 * @AlKor13 made their first contribution in https://github.com/NandhaKishorM/laya/pull/47 * @Swish78 made their first contribution in https://github.com/NandhaKishorM/laya/pull/215 * @LEVELING2108 made their first contribution in https://github.com/NandhaKishorM/laya/pull/229 * @liwenjie200543 made their first contribution in https://github.com/NandhaKishorM/laya/pull/247 **Full Changelog**: https://github.com/NandhaKishorM/laya/compare/v0.3.7...v0.3.8
Related Repositories
public-apis/public-apis★ 491,136
A collective list of free APIs
NousResearch/hermes-agent★ 255,969
The agent that grows with you
yt-dlp/yt-dlp★ 200,062
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,491
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,703
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.