0.69.0
cortezaproject/corteza0.69.0Dec 29, 2025by takahirom
AI Summary
Introduces AI Hints, a feature that allows apps to provide domain-specific context to AI models via accessibility labels using a specific `[[aihint:...]]` syntax.
Key Highlights
- New AI Hints feature for app-provided context
- Uses `[[aihint:...]]` format for embedding hints
- Supports structured data like JSON within hints
- Coexists with standard accessibility labels
New Features
- AI Hints with `[[aihint:...]]` format
- Cross-platform support (Android, iOS, Web)
Full Release Notes
# New feature: **AI Hints - App-Provided Context:**
* Apps can provide domain-specific hints to help the AI understand the current screen better. The hint you provide serves as additional context for the AI.
* Embed hints in the accessibility label using the `[[aihint:...]]` format:
```kotlin
// Android (contentDescription)
view.contentDescription = "Play button [[aihint:Video player, buffering]]"
```
```swift
// iOS (accessibilityLabel)
button.accessibilityLabel = "Play button [[aihint:Video player, buffering]]"
```
```html
<!-- Web (aria-label) -->
<button aria-label="Play button [[aihint:Video player, buffering]]">Play</button>
```
* The `[[...]]` format allows hints to coexist with accessibility labels and supports structured data like JSON.
* **Note:** Since this uses accessibility labels, it affects screen readers (TalkBack, VoiceOver, etc.). Enable hints only during testing to avoid accessibility issues in production.
## What's Changed
* Add ArbigentHint feature for app-provided domain context by @takahirom in https://github.com/takahirom/arbigent/pull/361
* Refactor AI hints to use [[aihint:...]] format by @takahirom in https://github.com/takahirom/arbigent/pull/362
**Full Changelog**: https://github.com/takahirom/arbigent/compare/0.68.0...0.69.0