v0.3.8

NandhaKishorM/layav0.3.8Sep 23, 2026by github-actions[bot]

Upgrading?

AI Summary

This release adds support for Intel XPU devices, introduces a TypeScript inference package, and integrates with LangChain and LangGraph for enhanced routing capabilities.

Key Highlights

  • Detect and use Intel XPU (Arc/iGPU) devices
  • Addition of laya-ts TypeScript inference package
  • Support for ONNX Runtime and torch.compile
  • Integration with LangChain and LangGraph routing
  • MCP stdio server support

New Features

  • Intel XPU device detection and usage
  • laya-ts TypeScript package
  • ONNX Runtime inference engine support
  • LangChain and LangGraph integration
  • MCP stdio server (laya[mcp] extra)

Full Release Notes

## What's Changed
* fix(router): keep an empty preload selection empty by @Ai-Eastern in https://github.com/NandhaKishorM/laya/pull/240
* test: cover the load-time and budget errors no suite reached by @PerryLink in https://github.com/NandhaKishorM/laya/pull/237
* docs: the README's Router link points at a heading that does not exist by @PerryLink in https://github.com/NandhaKishorM/laya/pull/236
* fix(serve): honor published checkpoint model IDs by @AliAkbariAlashti in https://github.com/NandhaKishorM/laya/pull/235
* fix(research): the eval harness is the one ECE that binned differently by @PerryLink in https://github.com/NandhaKishorM/laya/pull/232
* test: repair three assertions that cannot fail by @PerryLink in https://github.com/NandhaKishorM/laya/pull/231
* fix(serve): run inference off the event loop by @PerryLink in https://github.com/NandhaKishorM/laya/pull/230
* fix(agent): keep non-ASCII characters in non-string instructions by @PerryLink in https://github.com/NandhaKishorM/laya/pull/228
* fix(email): the word confidential is not a disclaimer by @PerryLink in https://github.com/NandhaKishorM/laya/pull/227
* perf: parse each checkpoint's tokenizer once per process by @fwt1888 in https://github.com/NandhaKishorM/laya/pull/225
* fix(agent): preserve newest turn in chronological conversation lists by @Bruce-Yii in https://github.com/NandhaKishorM/laya/pull/224
* feat: detect and use Intel XPU (Arc/iGPU) devices by @pugong2019 in https://github.com/NandhaKishorM/laya/pull/242
* feat(ci): run the test suite on Windows as well as Linux by @PerryLink in https://github.com/NandhaKishorM/laya/pull/212
* fix(lang): route romanized Bangla to the multilingual checkpoint by @kishormorol in https://github.com/NandhaKishorM/laya/pull/187
* fix(training): honor decision-head activation checkpointing by @zhangxinping666 in https://github.com/NandhaKishorM/laya/pull/149
* fix(email): a sign-off word inside the body is not a signature by @LudwigJMarx in https://github.com/NandhaKishorM/laya/pull/132
* fix(common): truncate_left kept the whole state when no room was left by @ahmedembeddedxx in https://github.com/NandhaKishorM/laya/pull/112
* fix(research): make the Chinese benchmark audit platform-independent by @HankGrimm in https://github.com/NandhaKishorM/laya/pull/216
* fix(lang): route CJK text with Latin brand names to the multilingual checkpoint by @ahmedembeddedxx in https://github.com/NandhaKishorM/laya/pull/113
* Add a CLI for testing Laya locally by @aashish254 in https://github.com/NandhaKishorM/laya/pull/155
* Optional TileLang GPU fast path: 4-5x lower latency per call, identical answers by @cklxx in https://github.com/NandhaKishorM/laya/pull/25
* feat(ts): add laya-ts TypeScript inference package by @nnlgsakib in https://github.com/NandhaKishorM/laya/pull/243
* refactor(email): one definition of email_questions by @LudwigJMarx in https://github.com/NandhaKishorM/laya/pull/136
* research: re-run the 51-language sweep in both temperature regimes (the #208 ask) by @PerryLink in https://github.com/NandhaKishorM/laya/pull/222
* build(docker): add the Compose HTTP service laya-serve by @PerryLink in https://github.com/NandhaKishorM/laya/pull/234
* fix(agent): allow custom noul labels by @wasiqnauman in https://github.com/NandhaKishorM/laya/pull/163
* fix(lang): recognize Azerbaijani text when routing requests by @ch4ki in https://github.com/NandhaKishorM/laya/pull/36
* feat: optional MCP stdio server (laya[mcp] extra) by @davidberardozzi in https://github.com/NandhaKishorM/laya/pull/189
* feat(agent): predict_batch — score many states in shared forward passes (~10x GPU throughput) by @AlKor13 in https://github.com/NandhaKishorM/laya/pull/47
* feat: add torch.compile support and ONNX Runtime inference engine by @Swish78 in https://github.com/NandhaKishorM/laya/pull/215
* feat(integrations): add LangChain and LangGraph routing and guardrails by @LEVELING2108 in https://github.com/NandhaKishorM/laya/pull/229
* docs: name the gold-distribution target in the RLCD recipe line by @liwenjie200543 in https://github.com/NandhaKishorM/laya/pull/247
* fix(email): closings the case rule does not reach by @ahmedembeddedxx in https://github.com/NandhaKishorM/laya/pull/245
* fix(agent): don't rewrite tokenizer_config through the HuggingFace cache symlink by @emiliano-go in https://github.com/NandhaKishorM/laya/pull/107
* perf: keep torch out of import laya (lazy torch-backed exports) by @emiliano-go in https://github.com/NandhaKishorM/laya/pull/108

## New Contributors
* @Ai-Eastern made their first contribution in https://github.com/NandhaKishorM/laya/pull/240
* @AliAkbariAlashti made their first contribution in https://github.com/NandhaKishorM/laya/pull/235
* @fwt1888 made their first contribution in https://github.com/NandhaKishorM/laya/pull/225
* @pugong2019 made their first contribution in https://github.com/NandhaKishorM/laya/pull/242
* @kishormorol made their first contribution in https://github.com/NandhaKishorM/laya/pull/187
* @ahmedembeddedxx made their first contribution in https://github.com/NandhaKishorM/laya/pull/112
* @HankGrimm made their first contribution in https://github.com/NandhaKishorM/laya/pull/216
* @aashish254 made their first contribution in https://github.com/NandhaKishorM/laya/pull/155
* @nnlgsakib made their first contribution in https://github.com/NandhaKishorM/laya/pull/243
* @wasiqnauman made their first contribution in https://github.com/NandhaKishorM/laya/pull/163
* @ch4ki made their first contribution in https://github.com/NandhaKishorM/laya/pull/36
* @davidberardozzi made their first contribution in https://github.com/NandhaKishorM/laya/pull/189
* @AlKor13 made their first contribution in https://github.com/NandhaKishorM/laya/pull/47
* @Swish78 made their first contribution in https://github.com/NandhaKishorM/laya/pull/215
* @LEVELING2108 made their first contribution in https://github.com/NandhaKishorM/laya/pull/229
* @liwenjie200543 made their first contribution in https://github.com/NandhaKishorM/laya/pull/247

**Full Changelog**: https://github.com/NandhaKishorM/laya/compare/v0.3.7...v0.3.8

Related Repositories