0.73.0

parruda/swarm0.73.0Jun 3, 2026by takahirom

AI Summary

Adds support for OpenAI's new Responses API and enables clicking by coordinates for mobile automation.

Key Highlights

  • OpenAI Responses API support (opt-in via `aiOptions.useResponsesApi`).
  • Clicking by position support (x and y coordinates) for UI automation.

New Features

  • OpenAI Responses API support
  • ClickAtCoordinates AI action

Full Release Notes

## OpenAI Responses API support
We now support OpenAI's new API format. Thanks to @imtoori for your contribution.
You can use it like this in the scenario file.
https://github.com/takahirom/arbigent/blob/main/sample-test/src/main/resources/projects/e2e-test-android-responses.yaml

## Clicking by position support
We can now click by x and y. This can be used when we need to click on the iOS permission dialog.
Thank you, @ibrahimtalabat, for your contribution!

## What's Changed
* Make OpenAI Responses API opt-in via aiOptions.useResponsesApi by @takahirom in https://github.com/takahirom/arbigent/pull/378
* Support Responses API for OpenAI reasoning tools by @imtoori in https://github.com/takahirom/arbigent/pull/377
* Add ClickAtCoordinates AI action (opt-in via additionalActions) by @takahirom in https://github.com/takahirom/arbigent/pull/379

## New Contributors
* @imtoori made their first contribution in https://github.com/takahirom/arbigent/pull/377
* @ibrahimtalabat made their first contribution in https://github.com/takahirom/arbigent/pull/376

**Full Changelog**: https://github.com/takahirom/arbigent/compare/0.72.0...0.73.0