Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch size #31

Open
SASasfc opened this issue May 21, 2024 · 1 comment
Open

Batch size #31

SASasfc opened this issue May 21, 2024 · 1 comment
Assignees
Labels
question Further information is requested

Comments

@SASasfc
Copy link

SASasfc commented May 21, 2024

Hello, I would like to ask about the training process, the batchsize is set to 1 to train 500epoch, I think the training time is a bit long, can I increase the batchsize to improve the training speed, but does this have an impact on the training results? Thank you!

@usert5432 usert5432 self-assigned this May 21, 2024
@usert5432 usert5432 added the question Further information is requested label May 21, 2024
@usert5432
Copy link
Collaborator

Hi @SASasfc,

can I increase the batchsize to improve the training speed, but does this have an impact on the training results?

Based on my experience with CycleGAN-like models, increasing the batch size does not improve the training speed or the quality of the translations in most cases. In other words, generally one needs to train for 1M batches regardless of the batch size to get the same translation quality. However, the impact of the batch size can vary depending on your specific dataset. So, it might be beneficial to try increasing the batch size for your dataset to see if it helps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants