Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

优化建议:将鼠标焦点移动到到目标图标的中间进行点击操作 #38

Open
6xdd opened this issue Jan 24, 2025 · 6 comments

Comments

@6xdd
Copy link

6xdd commented Jan 24, 2025

现象描述:可能是桌面的分辨率原因,在macos系统上发现,要求打开某个文件时,鼠标焦点移动的位置不在目标box中间,因此会出现无法点击的bug;

建议:通过识别到操作物,将鼠标移动到物体中心,减少偏移误差;

@mingcomplex
Copy link
Collaborator

hello ,能给一下当时的情境吗

@6xdd
Copy link
Author

6xdd commented Jan 24, 2025

hello ,能给一下当时的情境吗

input:双击打开桌面XXX.png
现象:鼠标识别到了这个图片,但是鼠标移动的位置比较偏图片的边缘(会出现定位不准,造成双击无效的)

@mingcomplex
Copy link
Collaborator

What model are you using for deployment?

@6xdd
Copy link
Author

6xdd commented Jan 24, 2025

What model are you using for deployment?

本地资源不足以运行视觉模型,因此选择云端的模型的api:
使用的是千问视觉模型
qwen-vl-max-latest
qwen-vl-max-1230

@osilverstein
Copy link

+1 on macbook pro it moves the mouse NEAR the red bullseye but not onto it. the bullseye is inthe right place but its not moving to the center of it. otherwise its working fine but because its not aligned with the bullseye it cant do much.

@osilverstein
Copy link

this is using claude sonnet through openrouter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants