Any example for computer use?

[artofspeed]

I'd like to use this model as an agent to control my computer. As far as I know, I'm responsible for sending screenshot image to the API, with some custom instruction telling Qwen to return me coordinates of things it should click.

Is there any example working prompt? Or any examples of how to use Qwen as a Computer/mobile-controlling agent? Thanks!

[devaliakbar]

https://github.com/QwenLM/Qwen2.5-VL/blob/main/cookbooks/computer_use.ipynb

[artofspeed]

thanks! can i use it via an API instead of locally-hosted model? @devaliakbar