Starstruk Logo MarkStarstruk

2026.5.2

LaurenzV/hayro2026.5.2May 20, 2026by GabrielBianconi

AI Summary

Enhances the OpenAI-compatible inference endpoint by supporting both string and array inputs for the `stop` parameter, and adds OpenInference attributes for better Arize compatibility.

Key Highlights

  • Accepts strings or arrays for the `stop` parameter in OpenAI-compatible inference
  • Adds OpenInference attributes for Arize compatibility

New Features

  • Support string or array for `stop` parameter
  • OpenInference attributes for Arize compatibility

Full Release Notes

**New Features**

- Accept both strings and array of strings for `stop` in the OpenAI-compatible inference endpoint (thanks @pragnyanramtha).
- Emit additional OpenInference attributes for Arize compatibility.