2026.5.2

juliangarnier/anime2026.5.2May 20, 2026by GabrielBianconi

AI Summary

An update to the OpenAI-compatible inference endpoint to improve flexibility and Arize compatibility.

Key Highlights

  • Accept both strings and array of strings for the `stop` parameter
  • Emit additional OpenInference attributes for Arize compatibility

New Features

  • Flexible `stop` parameter handling
  • OpenInference attribute emission

Full Release Notes

**New Features**

- Accept both strings and array of strings for `stop` in the OpenAI-compatible inference endpoint (thanks @pragnyanramtha).
- Emit additional OpenInference attributes for Arize compatibility.