Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding worker-based execution of simulations #93

Open
cchall opened this issue Dec 30, 2021 · 0 comments
Open

Adding worker-based execution of simulations #93

cchall opened this issue Dec 30, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@cchall
Copy link
Member

cchall commented Dec 30, 2021

When there are a very large number of workers running very short simulations it is much more efficient to have workers just execute the simulation directly rather than actually calling Executor.submit.

Technically, this workflow is possible right now if the user writes a python function that performs the setup and uses a subprocess. However, this requires creating a lot of setup that is normally handled by rsopt to generate new run files based on the work request.

A new execution_type could be created to allow the user to still call the code they would want to run (leveraging all the usual setup) but runing the simulation directly by the worker.

@cchall cchall added the enhancement New feature or request label Dec 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant