New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

建议对deepseek-v2-coder-lite进行sft测试 #342

Open

bao-xiaoyi opened this issue Sep 12, 2024 · 1 comment

bao-xiaoyi commented Sep 12, 2024

sft训练后，生成代码容易产生明显语法错误，与抽风问题。目前尚未查明原因

Collaborator

jerryli1981 commented Sep 13, 2024

您好，试试在微调的时候加一个--reset-attention-mask

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment