Simulate buttons UI click (identified in apps)

[Senuhet]

Hello,

I would like to know if it's possible to simulate a button for commands used in (UI clicks identify in app command) I understand you can't use this feature when the screen is locked however using the simulated button for media pause play does function when the screen is locked. If it's possible to create a simulated button using the functions identified in UI identify in app, I feel like this could be useful to many peoples functions while their devices are locked.

For my specific use case I have a macro that can open a specific Spotify playlist but it cannot click the play button for that playlist while the phone is locked. I understand if it can't be done, but the ability to identify inside the app for a UI click makes me hopeful you can simulate a button for it?

 

[FrameXX]

I am not sure I perfectly understand how you mean it with that button, but I can assure you that media playback control actions doesn't have anything to do with ui interaction and clicking buttons. MacroDroid 'just sends the command' directly without any interaction hassle and that's why it also doesn't need accessibility services turned on.

I am sorry to disappoint you, but there's no way how to create such interactions that would work with screen locked, unless developer of the app you want to control implements some plugins and APIs for other apps to use, but than it's not an interaction anymore, but another sending of command.

Simply said ui interactions in Android work only with screen on and they are used to simulate human-like interaction. Other MacroDroid actions don't work like this. They are not trying to simulate human in any way.

 

[Senuhet]

I am not sure I perfectly understand how you mean it with that button, but I can assure you that media playback control actions doesn't have anything to do with ui interaction and clicking buttons. MacroDroid 'just sends the command' directly without any interaction hassle and that's why it also doesn't need accessibility services turned on.

I am sorry to disappoint you, but there's no way how to create such interactions that would work with screen locked, unless developer of the app you want to control implements some plugins and APIs for other apps to use, but than it's not an interaction anymore, but another sending of command.

Simply said ui interactions in Android work only with screen on and they are used to simulate human-like interaction. Other MacroDroid actions don't work like this. They are not trying to simulate human in any way.

Yes, I believe you understood what I wanted. I was hoping that if MD could recognize a button for UI purposes perhaps it could simulate that UI button. I knew it wasn't a guarantee and will trust that it's not possible.