MacroDroid Wiki

Difference between revisions of "Action: UI Interaction"

Page Discussion
 
Line 1: Line 1:
 +
===<p><b>About</b></p>===
 
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
−
This action can be used to perform basic Ul interactions with other apps, such as clicks and gestures (Android 7+) using Android's accessibility service.
+
This action enables basic UI interactions with other apps, such as clicks and gestures (Android 7+), using Android's accessibility service.
  
−
Please be aware that any macros that use this action may be fragile and subject to breaking if for example the UI of an application is updated in the future.
+
Please note that macros utilizing this action may be fragile and prone to breaking if, for example, an application's UI is updated in the future.
 +
</pre>
 +
 
 +
<pre style="background-color: #FFFF99; color: #112A46; border-radius: 10px; padding: 10px;">
 +
Please note that this action cannot be performed when the screen is off.
 +
</pre>
 +
==<p><b>Supported configurations</b></p>==
 +
 
 +
=== Click/Long Click===
 +
* '''''Text content: '''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
Taps the screen based on the text content, either by matching or containing.
 +
</pre>
 +
* '''''X,Y location'' '''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
You can define X,Y coordinates to make the click, you can also define by percentage, support for variables (integer, decimal).
 +
</pre>
 +
''[https://macrodroidforum.com/wiki/index.php/Variables#Standard_Variable_Types Standard Variable Types]''
 +
* '''''Identify in app'''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
With this option, MacroDroid will try to automatically capture the values after touching the screen.
 +
To use it correctly, after selecting this option, go back to the home screen, go to the application (to the specific screen you want to click on), then scroll down the notification bar and tap the notification that MacroDroid has created. Then click on the item you want, and Macrodroid will automatically open with the UI interaction action correctly configured in most situations.
 +
</pre>
 +
* '''''View ID'''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
If you know the View ID of the element, you can type the View ID and click on the View ID to use the Read Screen Content action to find the expected View ID.
 +
</pre>
 +
[https://macrodroidforum.com/wiki/index.php/Action:_Read_Screen_Contents Action: Read Screen Content]
 +
 
 +
=== Copy/Cut ===
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
Copies or cuts the selection of text.
 +
</pre>
 +
 
 +
=== Paste/Clear selection/Press enter ===
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
You must be in a text entry for these actions to take effect.
 +
</pre>
 +
=== Gesture/Gesture Sequence ===
 +
* '''''Gesture'''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
This gesture is unidirectional, for example, from up to down, left to right, diagonally, etc.
 +
Requires start and end coordinates, also supports percentage and variable input (integer, decimal).
 +
The duration admits input per ms, it is the speed at which the gesture will be performed.
 +
</pre>
 +
''[https://macrodroidforum.com/wiki/index.php/Variables#Standard_Variable_Types Standard Variable Types]''
 +
* '''''Gesture Sequence'''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
This gesture sequence is intended for directional turns, such as an unlock pattern.
 +
supports percentage and variable input (integer, decimal).
 +
The duration admits input per ms, it is the speed at which the gesture will be performed.
 +
</pre>
 +
''[https://macrodroidforum.com/wiki/index.php/Variables#Standard_Variable_Types Standard Variable Types]''
 +
 
 +
=== Extras ===
 +
* '''''Include screens overlays (Pro only)'''''
 +
<pre style="background-color: #ACC8E5; color: #112A46; border-radius: 10px; padding: 10px;">
 +
Examples of an overlay:
  
−
Note that this action cannot function when the screen is off.
+
* A pop-up menu that appears when a button is tapped.
 +
* A floating window displayed above the main screen.
 +
* A dialog box that appears on the screen.
 
</pre>
 
</pre>
 +
* '''''Wildcards supported'''''
 +
[https://macrodroidforum.com/wiki/index.php/Control_flow:_If_clause#The_wildcards_.27.2A.27_and_.27.3F.27 Wildcards]

Latest revision as of 22:24, 1 February 2024

About

This action enables basic UI interactions with other apps, such as clicks and gestures (Android 7+), using Android's accessibility service.

Please note that macros utilizing this action may be fragile and prone to breaking if, for example, an application's UI is updated in the future.

Please note that this action cannot be performed when the screen is off.

Supported configurations

Click/Long Click

  • Text content: 
Taps the screen based on the text content, either by matching or containing.
  • X,Y location 
You can define X,Y coordinates to make the click, you can also define by percentage, support for variables (integer, decimal).

Standard Variable Types

  • Identify in app
With this option, MacroDroid will try to automatically capture the values after touching the screen.
To use it correctly, after selecting this option, go back to the home screen, go to the application (to the specific screen you want to click on), then scroll down the notification bar and tap the notification that MacroDroid has created. Then click on the item you want, and Macrodroid will automatically open with the UI interaction action correctly configured in most situations.
  • View ID
If you know the View ID of the element, you can type the View ID and click on the View ID to use the Read Screen Content action to find the expected View ID.

Action: Read Screen Content

Copy/Cut

Copies or cuts the selection of text.

Paste/Clear selection/Press enter

You must be in a text entry for these actions to take effect.

Gesture/Gesture Sequence

  • Gesture
This gesture is unidirectional, for example, from up to down, left to right, diagonally, etc.
Requires start and end coordinates, also supports percentage and variable input (integer, decimal).
The duration admits input per ms, it is the speed at which the gesture will be performed.

Standard Variable Types

  • Gesture Sequence
This gesture sequence is intended for directional turns, such as an unlock pattern.
supports percentage and variable input (integer, decimal).
The duration admits input per ms, it is the speed at which the gesture will be performed.

Standard Variable Types

Extras

  • Include screens overlays (Pro only)
Examples of an overlay:

* A pop-up menu that appears when a button is tapped.
* A floating window displayed above the main screen.
* A dialog box that appears on the screen.
  • Wildcards supported

Wildcards

Retrieved from ‘https://macrodroidforum.com/wiki/index.php?title=Action:_UI_Interaction&oldid=1835’