Starstruk Logo MarkStarstruk

0.73.0

cortezaproject/corteza0.73.0Jun 3, 2026by takahirom

AI Summary

This release adds support for OpenAI's new Responses API and introduces the ability to click by coordinates to handle complex UI interactions like iOS permission dialogs.

Key Highlights

  • OpenAI Responses API support (opt-in)
  • Clicking by position support (x and y coordinates)
  • New AI actions for reasoning tools and coordinates

New Features

  • OpenAI Responses API integration
  • ClickAtCoordinates AI action
  • Responses API support for OpenAI reasoning tools

Full Release Notes

## OpenAI Responses API support
We now support OpenAI's new API format. Thanks to @imtoori for your contribution.
You can use it like this in the scenario file.
https://github.com/takahirom/arbigent/blob/main/sample-test/src/main/resources/projects/e2e-test-android-responses.yaml

## Clicking by position support
We can now click by x and y. This can be used when we need to click on the iOS permission dialog.
Thank you, @ibrahimtalabat, for your contribution!

## What's Changed
* Make OpenAI Responses API opt-in via aiOptions.useResponsesApi by @takahirom in https://github.com/takahirom/arbigent/pull/378
* Support Responses API for OpenAI reasoning tools by @imtoori in https://github.com/takahirom/arbigent/pull/377
* Add ClickAtCoordinates AI action (opt-in via additionalActions) by @takahirom in https://github.com/takahirom/arbigent/pull/379

## New Contributors
* @imtoori made their first contribution in https://github.com/takahirom/arbigent/pull/377
* @ibrahimtalabat made their first contribution in https://github.com/takahirom/arbigent/pull/376

**Full Changelog**: https://github.com/takahirom/arbigent/compare/0.72.0...0.73.0