Starstruk Logo MarkStarstruk

2026.5.2

scottschiller/SoundManager22026.5.2May 20, 2026by GabrielBianconi

AI Summary

This release enhances the OpenAI-compatible inference endpoint by supporting flexible input types for the `stop` parameter and adds OpenInference attributes for Arize compatibility.

Key Highlights

  • Accept both strings and array of strings for `stop` parameter
  • Emit additional OpenInference attributes for Arize compatibility
  • Improvements to the OpenAI-compatible inference endpoint

New Features

  • Accept both strings and array of strings for `stop`
  • Emit additional OpenInference attributes for Arize compatibility

Full Release Notes

**New Features**

- Accept both strings and array of strings for `stop` in the OpenAI-compatible inference endpoint (thanks @pragnyanramtha).
- Emit additional OpenInference attributes for Arize compatibility.