Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Request for new "multidrive" functionality to be implemented #31

Open
karahbit opened this issue Jul 22, 2020 · 0 comments
Open

Request for new "multidrive" functionality to be implemented #31

karahbit opened this issue Jul 22, 2020 · 0 comments

Comments

@karahbit
Copy link

karahbit commented Jul 22, 2020

For the purpose of performing strong scaling experiments using HyperSpace, I propose the following:

HyperSpace as it is has a method called “hyperdrive” which runs each subspace/optimization on its own single rank/core. There is also “dualdrive” which runs 2 subspaces/optimizations per rank/core.

In order to perform strong scaling, we would need to create more of this functions, e.g. quadrive, octadrive, etc (I made those names up), so we can run 4 optimizations per rank, 8 optimizations per rank, 16 optimizations per rank, etc.

Eventually, we would like to name this method something like “multipledrive”, and specify the number of optimizations we would like per rank/core as an argument.

You can see a more detailed conversation about the topic in the following issue:

Yeah, that would be possible. In the case that `num_subspaces > num_ranks`, we could place the remaining `num_subspaces - num_ranks` on ranks that already have a search space to work on. I don't think that would take much to make that happen.

Originally posted by @yngtodd in #23 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant