Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Is User System Prompt in effect? #1068

Open
goncharovdk opened this issue Jan 19, 2025 · 3 comments
Open

Is User System Prompt in effect? #1068

goncharovdk opened this issue Jan 19, 2025 · 3 comments
Labels
bug Something isn't working

Comments

@goncharovdk
Copy link

My texts are in English, but after the latest plugin update, the "Make selection longer" command returns results in an arbitrarily chosen language. (Got Italian, Spanish, and German so far, but never English.) Tried to fix this with "Answer in English" User System Prompt, but don't see any effect. Using OpenAI API key.

@logancyang logancyang added the bug Something isn't working label Jan 19, 2025
@logancyang logancyang moved this to Ready in Copilot Kanban Jan 19, 2025
@logancyang
Copy link
Owner

Thanks for reporting. This is a known issue for GPT models, can you try if other models like Claude do it too?

Commands were taking in user system prompt before this update indeed, we decided not to combine them because some commands may not work with certain user system prompts. This random language issue should be fixed by #1043.

cc @zeroliu

@zeroliu
Copy link
Collaborator

zeroliu commented Jan 19, 2025

Do you mind sharing the language model that you used? The better prompts will definitely, but I still experienced random language outputs with smaller models like gpt 4o mini sometimes.

@goncharovdk
Copy link
Author

can you try if other models like Claude do it too?

Have no API key for Claude. Maybe later.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Ready
Development

No branches or pull requests

3 participants