v0.5.0
mizorewww/laya-mlxv0.5.0Oct 20, 2026by github-actions[bot]
Upgrading?
AI Summary
This release aligns the project with upstream laya v0.4.12, introducing support for batch and long-text inference, structured decisions, hooks, calibration, evaluation, Router, and HTTP/MCP. It includes extensive API audits and performance improvements while preserving native execution.
Key Highlights
- Migration to upstream v0.4.12 with expanded capabilities like batch and long-text inference.
- Performance improvements: MLX wins all 18 P50 comparisons; Core ML wins P50/P95/mean-throughput comparisons.
- New integrations and protocols including HTTP, MCP, and framework/tool integrations.
- Successful numerical stability and API audit campaigns.
Breaking Changes
- Upstream Router defaults, validation, and output semantics have changed.
- LlamaIndex adapter contracts have been updated to match current upstream BaseSelector and SingleSelection.
New Features
- Batch and long-text inference
- Structured decisions
- Hooks
- Calibration
- Evaluation
- Router
- HTTP/MCP support
- Framework and tool integrations
Full Release Notes
# 0.5.0 — upstream v0.4.12 migration This release aligns applicable host APIs with NandhaKishorM/laya `ffc142012af63d015fa19f05f29f9c5ff329a2cc`: batch and long-text inference, structured decisions, hooks, calibration, evaluation, Router, HTTP/MCP, and framework/tool integrations. Native execution and explicit unsupported backend boundaries are preserved. Compatibility changes include upstream Router defaults, validation and output semantics. The LlamaIndex adapter supports the actual current BaseSelector and SingleSelection contracts. See MIGRATION_0_4.md for behavior and dependency details. The 341-entry API audit and three-checkpoint FP32/FP16 numerical/stability campaign passed. The qualification report records unchanged applicable upstream assertions, real SDK HTTP checks, real optional-framework checks and clean-wheel inference. Package 0.5.0 changes version metadata relative to the recorded 0.4.0 development qualification builds; release gates verify the final distribution separately. Performance comparisons use upstream PyTorch 2.14, matched FP32 and fixed inputs. MLX wins all 18 P50 comparisons in the final matrix. Core ML's alternating-order confirmation wins all 18 P50/P95/mean-throughput comparisons; the initial four sequential regressions are retained in the report. Core ML adaptive graph and shape caches trade more resident memory for lower warm-call latency. Cold calls, other hardware and arbitrary workloads are outside these finite guarantees. See QUALIFICATION_0_4_12.md and UPSTREAM_0412_PROGRESS.json for raw evidence and limitations. Original historical benchmark and package receipts remain unchanged. MLX preserves native precision, compilation, row batch limits and bounded question-prefix caching. Local-only model resolution is supported by Agent and Router; ordinary inference needs no PyTorch or Transformers. Publication verified on 2026-10-20: GitHub Release and PyPI wheel/sdist hashes match, public wheel source matches the tag, and a public-index reinstall passes all three offline real-model checks. See `benchmarks/results/release-v050.json`. Post-release CI runs exposed intermittent failures in the unchanged upstream idle-window timing test. Running host contracts before native model tests in a separate process passed one complete CI, but a subsequent run reproduced the timing failure; isolation has not eliminated it. No runtime, assertion or timeout was changed. Failure diagnostics also run the original upstream idle-window tests for comparison. [CI evidence](https://github.com/mizorewww/laya-mlx/actions/runs/39354961828). The original pinned upstream suite reproduced the same idle-window failure on the same CI runner; all 254 native/integration tests passed. This timing instability remains documented in [CI evidence](https://github.com/mizorewww/laya-mlx/blob/main/docs/CI_TIMING.md).
Related Repositories
public-apis/public-apis★ 491,135
A collective list of free APIs
NousResearch/hermes-agent★ 255,963
The agent that grows with you
yt-dlp/yt-dlp★ 200,054
A feature-rich command-line audio/video downloader
microsoft/markitdown★ 191,491
Python tool for converting files and office documents to Markdown.
Significant-Gravitas/AutoGPT★ 187,703
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.