Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Action click wrong coordinate #16

Open
SomeBigPig opened this issue Jan 23, 2025 · 4 comments
Open

Action click wrong coordinate #16

SomeBigPig opened this issue Jan 23, 2025 · 4 comments
Labels
model bug Model bug

Comments

@SomeBigPig
Copy link

I have local deloy ui-tars-2B model with Ollama, and use in ui-tars-desktop. I enter this instruction 'Get the current weather in SF using the web browser', but click wrong coordinate.

Image

@ycjcl868 ycjcl868 added the model bug Model bug label Jan 23, 2025
@JjjFangg
Copy link

Could you share the prompt you are using?

@devlux76
Copy link

I had this same issue then found this here...
https://juniper-switch-f10.notion.site/GUI-Model-Deployment-Guide-17b5350241e280058e98cea60317de71

It's implied that there's a max resolution your desktop can be. Make sure you set your desktop resolution so your width is no higher than 1340

@applebaconsoda123
Copy link

applebaconsoda123 commented Jan 23, 2025

I had this same issue then found this here... https://juniper-switch-f10.notion.site/GUI-Model-Deployment-Guide-17b5350241e280058e98cea60317de71

It's implied that there's a max resolution your desktop can be. Make sure you set your desktop resolution so your width is no higher than 1340

Correct, a 1920x1080 screenshot can apparently be ~120k tokens which is why the models are clicking incorrectly or not giving an output at all

I don't think the Windows desktop app resizes the images yet. 所以它对我不起作用

@JjjFangg
Copy link

JjjFangg commented Jan 23, 2025

As the GGUF model performance cannot be guaranteed, we have decided to downgrade it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
model bug Model bug
Projects
None yet
Development

No branches or pull requests

5 participants