Action: UI Interaction

About

This action enables basic UI interactions with other apps, such as clicks and gestures (Android 7+), using Android's accessibility service.

Please note that macros utilizing this action may be fragile and prone to breaking if, for example, an application's UI is updated in the future.

Please note that this action cannot be performed when the screen is off.

Supported configurations

Click/Long Click

• Text content:

Taps the screen based on the text content, either by matching or containing.

• X,Y location

You can define X,Y coordinates to make the click, you can also define by percentage, support for variables (integer, decimal).

Standard Variable Types

• Identify in app

With this option, MacroDroid will try to automatically capture the values after touching the screen.
To use it correctly, after selecting this option, go back to the home screen, go to the application (to the specific screen you want to click on), then scroll down the notification bar and tap the notification that MacroDroid has created. Then click on the item you want, and Macrodroid will automatically open with the UI interaction action correctly configured in most situations.

• View ID

If you know the View ID of the element, you can type the View ID and click on the View ID to use the Read Screen Content action to find the expected View ID.

Action: Read Screen Content

Copy/Cut

Copies or cuts the selection of text.

Paste/Clear selection/Press enter

You must be in a text entry for these actions to take effect.

Gesture/Gesture Sequence

• Gesture

This gesture is unidirectional, for example, from up to down, left to right, diagonally, etc.
Requires start and end coordinates, also supports percentage and variable input (integer, decimal).
The duration admits input per ms, it is the speed at which the gesture will be performed.

Standard Variable Types

• Gesture Sequence

This gesture sequence is intended for directional turns, such as an unlock pattern.
supports percentage and variable input (integer, decimal).
The duration admits input per ms, it is the speed at which the gesture will be performed.

Standard Variable Types

Extras

• Include screens overlays (Pro only)

Examples of an overlay:

* A pop-up menu that appears when a button is tapped.
* A floating window displayed above the main screen.
* A dialog box that appears on the screen.

• Wildcards supported

Wildcards