Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Lc0 cudnn does not parallelize properly across multiple GPUs #687

Open
chara1ampos opened this issue May 28, 2018 · 0 comments
Open

Lc0 cudnn does not parallelize properly across multiple GPUs #687

chara1ampos opened this issue May 28, 2018 · 0 comments

Comments

@chara1ampos
Copy link

I am trying to run Alexander's lc0 cudnn on 3 GPUs (1 Titan V + 2 x 1080).
I use the command
lc0.exe -w weights.txt --no-smart-pruning --backend=multiplexing "--backend-opts=x(backend=cudnn,gpu=0,max_batch=512),y(backend=cudnn,gpu=1,max_batch=256),z(backend=cudnn,gpu=2,max_batch=256)" --threads=4
and then type
go nodes 130000
to do a benchmark. However, using more GPUs than just the Titan V does not help the NPS get any higher. In fact, NPS gets slightly lower. Also, the utilization of each GPU is 30%, whereas if I run lc0 on one GPU alone, its utilization is 90%.

Why doesn't lc0 properly parallelize / fully utilize the multiple GPUs?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant