Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Making filtering simpler #1085

Closed
wants to merge 2 commits into from
Closed

Making filtering simpler #1085

wants to merge 2 commits into from

Conversation

diptanu
Copy link
Collaborator

@diptanu diptanu commented Dec 6, 2024

  1. Made executors report a list of function images
  2. Making executors report Nvidia GPU card, memory available on a machine.
  3. Using placement constraints to filter out images don't match labels such as python runtime, image name and version.
  4. Made a copy on write in-memory cache of the executor state.

Next step

  1. Add support for committing resources to functions

Test Plan -

  1. Make 3 Compute Graphs which demands the same images
  2. Make one function of each compute graph to request for exclusive access for hardware.
  3. The scheduler needs to be able to select the right image and stick each function to one image. More than one function shouldn't occupy an image.

@diptanu diptanu force-pushed the diagnostic-info-refactor branch from 801f2ad to eeda16e Compare December 9, 2024 07:27
@diptanu diptanu closed this Jan 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant