Starstruk Logo MarkStarstruk

2026.5.2

LizardByte/Sunshine2026.5.2May 20, 2026by GabrielBianconi

AI Summary

This minor update enhances the OpenAI-compatible inference endpoint by accepting both strings and arrays of strings for the `stop` parameter and adds OpenInference attributes for Arize compatibility.

Key Highlights

  • Accept both strings and array of strings for the `stop` parameter.
  • Emit additional OpenInference attributes for Arize compatibility.

New Features

  • Flexible `stop` parameter handling.
  • OpenInference attributes for Arize.

Full Release Notes

**New Features**

- Accept both strings and array of strings for `stop` in the OpenAI-compatible inference endpoint (thanks @pragnyanramtha).
- Emit additional OpenInference attributes for Arize compatibility.