Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

当我使用5张A100 80G训练时,如何提高训练速度或者应该如何修改符合机器的参数 #74

Open
Cyclones-Y opened this issue Oct 11, 2023 · 2 comments

Comments

@Cyclones-Y
Copy link

这是我的参数设置
"args": {
"actor_device_cpu": false,
"alpha": 0.99,
"batch_size": 32,
"disable_checkpoint": false,
"epsilon": 1e-05,
"exp_epsilon": 0.01,
"gpu_devices": "0,1,2,3,4",
"learning_rate": 0.0001,
"load_model": false,
"max_grad_norm": 40.0,
"momentum": 0,
"num_actor_devices": 4,
"num_actors": 100,
"num_buffers": 50,
"num_threads": 4,
"objective": "adp",
"save_interval": 30,
"savedir": "douzero_checkpoints",
"total_frames": 50000000000,
"training_device": "4",
"unroll_length": 100,
"xpid": "douzero"

当我增加num_actors数量时,训练的frames并没有很好的变化一直在差不多2000左右,希望您能帮我指正一下我存在的错误。 @daochenzha

@XliOK
Copy link

XliOK commented Oct 29, 2023

有联系方式吗,我能给你看看,V:_Linuxer

@aishxi
Copy link

aishxi commented Nov 29, 2023

我也有同样的问题,有没有大佬支持一下?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants