Starstruk Logo MarkStarstruk

0.73.0

kroko-ai/kroko-onnx0.73.0Jun 3, 2026by takahirom

AI Summary

This release introduces OpenAI Responses API support as an opt-in feature and adds click-by-position capability for handling iOS permission dialogs through new AI actions.

Key Highlights

  • OpenAI Responses API support via aiOptions.useResponsesApi
  • ClickAtCoordinates AI action for position-based clicking
  • Support for OpenAI reasoning tools
  • New contributors from the community

New Features

  • OpenAI Responses API integration
  • ClickAtCoordinates AI action (opt-in via additionalActions)
  • Responses API support for OpenAI reasoning tools

Full Release Notes

## OpenAI Responses API support
We now support OpenAI's new API format. Thanks to @imtoori for your contribution.
You can use it like this in the scenario file.
https://github.com/takahirom/arbigent/blob/main/sample-test/src/main/resources/projects/e2e-test-android-responses.yaml

## Clicking by position support
We can now click by x and y. This can be used when we need to click on the iOS permission dialog.
Thank you, @ibrahimtalabat, for your contribution!

## What's Changed
* Make OpenAI Responses API opt-in via aiOptions.useResponsesApi by @takahirom in https://github.com/takahirom/arbigent/pull/378
* Support Responses API for OpenAI reasoning tools by @imtoori in https://github.com/takahirom/arbigent/pull/377
* Add ClickAtCoordinates AI action (opt-in via additionalActions) by @takahirom in https://github.com/takahirom/arbigent/pull/379

## New Contributors
* @imtoori made their first contribution in https://github.com/takahirom/arbigent/pull/377
* @ibrahimtalabat made their first contribution in https://github.com/takahirom/arbigent/pull/376

**Full Changelog**: https://github.com/takahirom/arbigent/compare/0.72.0...0.73.0