Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GPU support #43

Merged
merged 4 commits into from
Jan 12, 2024
Merged

Add GPU support #43

merged 4 commits into from
Jan 12, 2024

Conversation

hugy718
Copy link
Collaborator

@hugy718 hugy718 commented Jan 3, 2024

This PR allows task executor to access and schedule NVIDIA GPUs, Docker has support for accessing NVIDIA GPUs https://docs.docker.com/config/containers/resource_constraints/. Task executor uses go-nvml from NVIDIA to access the gpu stats.

  • GPU are exposed to the meca task executor via the docker runtime options, and turn on task executor support via has_gpu in the config yaml.
  • Tasks specify use_gpu and gpu_count to request for gpu resources.
  • For one GPU, it is allocated in full to a task.
  • the /stats handle now report the number of gpu available and the gpu model.

@LimJunxue LimJunxue mentioned this pull request Jan 11, 2024
@jeryongchan jeryongchan merged commit d0fe324 into main Jan 12, 2024
0 of 7 checks passed
@jeryongchan jeryongchan deleted the gpu-support branch February 28, 2024 09:27
@jeryongchan jeryongchan restored the gpu-support branch February 28, 2024 09:27
@LimJunxue LimJunxue deleted the gpu-support branch May 23, 2024 08:34
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants