Starstruk Logo MarkStarstruk

v2.9.0

opensandbox-group/OpenSandboxv2.9.0May 23, 2026by XprobeBot

AI Summary

A comprehensive update to the inference platform introducing a new monitoring UI, log center, and support for several new AI models including Qwen and DeepSeek.

Key Highlights

  • Enhanced Monitoring UI with time picker, auto-refresh, and dashboard optimizations
  • Introduced Log Center UI with Elasticsearch integration
  • Added support for Qwen3.6-27B and DeepSeek-V4 models

New Features

  • Role/address in log format and structured inference logging
  • Monitoring metrics and stream label fixes
  • Log Center UI with Kibana-style enhancements
  • Qwen3.6-27B model support (pytorch + FP8)
  • DeepSeek-V4-Flash and DeepSeek-V4-Pro model support
  • Advanced authentication system
  • Collapsible sidebar with persistent state

Full Release Notes

# What's new in 2.9.0 (2026-05-23)
These are the changes in inference v2.9.0.
## New features
* feat: add role/address to log format and structured inference logging by @m199369309 in https://github.com/xorbitsai/inference/pull/4898
* feat: backport monitoring metrics and fix stream label / serve_count bugs by @m199369309 in https://github.com/xorbitsai/inference/pull/4899
* feat: enhance monitoring UI with time picker, auto-refresh, and dashboard optimizations by @m199369309 in https://github.com/xorbitsai/inference/pull/4900
* feat: add Log Center UI with Elasticsearch integration by @m199369309 in https://github.com/xorbitsai/inference/pull/4902
* feat: add Qwen3.6-27B model support (pytorch + FP8) by @m199369309 in https://github.com/xorbitsai/inference/pull/4904
* feat: add collapsible sidebar with persistent state by @m199369309 in https://github.com/xorbitsai/inference/pull/4906
* feat: add page titles to Monitoring and Log Center pages by @m199369309 in https://github.com/xorbitsai/inference/pull/4907
* feat(logs): Kibana-style enhancements for Log Center by @m199369309 in https://github.com/xorbitsai/inference/pull/4917
* FEAT: [model] DeepSeek-V4-Flash support by @llyycchhee in https://github.com/xorbitsai/inference/pull/4928
* feat(auth): add advanced authentication system by @m199369309 in https://github.com/xorbitsai/inference/pull/4931
* FEAT: [model] DeepSeek-V4-Pro support by @llyycchhee in https://github.com/xorbitsai/inference/pull/4929
* feat(i18n): update Japanese and Korean locale translations by @m199369309 in https://github.com/xorbitsai/inference/pull/4932
* feat(web): new UI (partially implemented) by @maoyuehui in https://github.com/xorbitsai/inference/pull/4933
* feat(vllm): support deepseek-v4 by @llyycchhee in https://github.com/xorbitsai/inference/pull/4938
## Enhancements
* ENH: update models JSON [llm] by @XprobeBot in https://github.com/xorbitsai/inference/pull/4905
* ENH: update model "qwen3.6" JSON by @llyycchhee in https://github.com/xorbitsai/inference/pull/4923
* ENH: update model "qwen3.6" JSON by @llyycchhee in https://github.com/xorbitsai/inference/pull/4937
* ENH: update 2 models JSON ("DeepSeek-V4-Flash", "DeepSeek-V4-Pro") by @llyycchhee in https://github.com/xorbitsai/inference/pull/4939
* BLD: Split Docker builds into separate jobs by @qinxuye in https://github.com/xorbitsai/inference/pull/4919
## Bug fixes
* fix(ocr): replace eval() with ast.literal_eval in deepseek_ocr coordinate parsing by @Ricardo-M-L in https://github.com/xorbitsai/inference/pull/4872
* fix: harden docs workflow against branch injection by @qinxuye in https://github.com/xorbitsai/inference/pull/4910
* fix(ci): harden gen docs workflow by @rogercloud in https://github.com/xorbitsai/inference/pull/4913
* fix: Fix tool_call messages handling in utils.py by @la1ty in https://github.com/xorbitsai/inference/pull/4915
* fix(ci): update vllm to 0.21.0 for Dockerfile  by @zwt-1234 in https://github.com/xorbitsai/inference/pull/4934
## Documentation
* doc: Add v2.8.0 release notes by @qinxuye in https://github.com/xorbitsai/inference/pull/4895

## New Contributors
* @maoyuehui made their first contribution in https://github.com/xorbitsai/inference/pull/4933

**Full Changelog**: https://github.com/xorbitsai/inference/compare/v2.8.0...v2.9.0