New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

lr_scheduler的更新位置和更新频次存在问题 #107

Open

li1127217ye opened this issue Dec 25, 2024 · 0 comments

li1127217ye commented Dec 25, 2024 •

edited

Loading

lr_scheduler的更新位置和更新频次存在问题，将学习率调度器的更新（self.lr_scheduler.step()）放到了训练阶段的每个批量位置上，过于频繁了，通常做法是放到训练阶段的每个轮次的结束位置上，例如下面代码：

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment