2026.5.2

Automattic/harper2026.5.2May 20, 2026by GabrielBianconi

AI Summary

This release improves the OpenAI-compatible inference endpoint by allowing flexible input types for the stop parameter and enhances observability with Arize-compliant OpenInference attributes.

Key Highlights

  • Accept both strings and array of strings for `stop` in the inference endpoint
  • Emit additional OpenInference attributes for Arize compatibility
  • OpenAI-compatible inference endpoint improvements

New Features

  • Accept both strings and array of strings for `stop`
  • Emit additional OpenInference attributes for Arize compatibility

Full Release Notes

**New Features**

- Accept both strings and array of strings for `stop` in the OpenAI-compatible inference endpoint (thanks @pragnyanramtha).
- Emit additional OpenInference attributes for Arize compatibility.