New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于小模型的训练 #585

Open

11Boss opened this issue Apr 25, 2024 · 1 comment

11Boss commented Apr 25, 2024

我最近在做小模型的训练，但是没找到小模型的预训练权重只能从头开始训，发现好难训，目前想训一个小模型的预训练模型，关于训练的epochs，训练技巧，欢迎交流经验

ScottishFold007 commented May 5, 2024

底模从头开始训，你有什么心得吗？

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment