Skip to content

Add act command#859

Merged
mlikasam-askui merged 3 commits intomainfrom
add-act-command-
May 28, 2025
Merged

Add act command#859
mlikasam-askui merged 3 commits intomainfrom
add-act-command-

Conversation

@mlikasam-askui
Copy link
Copy Markdown
Collaborator

@mlikasam-askui mlikasam-askui commented May 26, 2025

Add act Command to TypeScript SDK

This PR adds the act command to the TypeScript SDK, allowing agents to perform autonomous UI interactions based on a high-level goal description.

Usage

await aui.act("Search for today's weather", {
  chatID: "weather-session"
});

The agent will analyze the screen and take the necessary actions—such as clicking, typing, or scrolling—to achieve the goal.

Options

  • chatID:
    A string used to maintain context across multiple act calls. When reusing the same chatID, the agent retains relevant memory such as extracted values or previous steps.

  • agentHistory:
    A shared interaction history object that enables context sharing between different agent clients (e.g., auiDesktop and auiAndroid).

Documentation

See inline JSDoc in the code for detailed usage examples and parameter descriptions.

Copy link
Copy Markdown
Contributor

@programminx-askui programminx-askui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hello @mlikasam-askui,

somtimes it does not want ot do what I want, but this is AI.

Seems so that it can click and type. ✅

I like that it has chat histroy and id. but does not realy know how to use it.

And the vscode setup is nice

@mlikasam-askui mlikasam-askui merged commit 6692296 into main May 28, 2025
3 checks passed
@mlikasam-askui mlikasam-askui deleted the add-act-command- branch May 28, 2025 10:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants