v4.0.0 v3.5.0
xorbitsai/inferenceOct 10, 2026 → Sep 25, 20260 days between releases
Generating AI comparison
Analyzing what changed between v4.0.0 and v3.5.0. This page updates automatically — usually within a minute.
The Two Releases
v4.0.0
Oct 10, 2026· 12 days ago
Version 4.0.0 introduces significant performance and architectural improvements, including native NIXL backend support for vLLM and SGLang PD deployments, advanced Xavier KV cache sharing across multiple engines, and a new runtime log center. The release adds new capabilities like Jina OCR v1, Confucius4-TTS, and a Stateless OpenAI Responses API, alongside performance optimizations and bug fixes for cross-platform compatibility.
Full release notesv3.5.0
Sep 25, 2026· 26 days ago
This release addresses a security vulnerability regarding custom-model registration and introduces extensive new features including support for various audio, image, and LLM models, along with logging and monitoring capabilities.
Full release notes