Text Recognition problem.

shamsevan said:

Just need this 2 help.

I have set a Click Ui interaction on text "cool".(the green marked in the pic) But sometimes it clicks in the same words in other x,y location which i dont want. (Red marked in the pic)



Sometimes if it sees " cooler" it clicks on it. It seems, text reionization is working as "contains" not "matches "

So.

Qus 1: can i click on specific text with x,y location ( the word always View attachment 2168appears in same x,y location) View attachment 2166



Qus,2 : can i click exact word only? ( If i give conmand "cool " it will click onb"cool" only. Not "cooler ")

Click to expand...

Abalsam said:

Yes you can define the location manually within the app (bottom option I believe) then it will record the xy coordinates and txt/button details.

Click to expand...

Abalsam said:

Not that I am aware of and per your previous post where you could multiple matches on the same screen xy coordinates (with the app in the foreground) is likely your best bet. Sorry

Click to expand...

shamsevan said:

Just need this 2 help.

I have set a Click Ui interaction on text "cool".(the green marked in the pic) But sometimes it clicks in the same words in other x,y location which i dont want. (Red marked in the pic)



Sometimes if it sees " cooler" it clicks on it. It seems, text reionization is working as "contains" not "matches "

So.

Qus 1: can i click on specific text with x,y location ( the word always View attachment 2168appears in same x,y location) View attachment 2166



Qus,2 : can i click exact word only? ( If i give conmand "cool " it will click onb"cool" only. Not "cooler ")

Click to expand...

Dm114 said:

The 2 orange buttons on the image are probably pictures and cannot be recognized as plain text.

Click to expand...

shamsevan said:

Nope it recognizes sometimes...and sometimes the orange pictures are not available. Suppose it is written "Hot" and "Warm" there. At that moment, it clicks on the bottom "cooler" option. As it is searching for cool. Or if i give text command to click on "No" it clicks on "Notification" when it doesn’t directly get "No"

Click to expand...

1. If it's accurate that you want to click on the same spot every time (as you said in Question #1), then use the X,Y option to click in that location. You may have to adjust the X and Y values a bit manually, until you get to the right location (vs. using the "Identify in app" option to get the x and y position automatically)
2. If, instead, you really want to click on an exact text string that may be at different x,y points at different times, you could try the AutoInput plug-in. Neither MacroDroid nor AutoInput supports true regular expressions for specifying where to click, but AutoInput allows an additional "Additional Text Nearby" field, which may help you identify which text to click on, if the app always has identifiable text nearby. In your example, maybe the "nearby word" favrt could be used to guide AutoInput to click on the cool option at the top of the screen, vs. the latter instance of cooler.