Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CI support for all Hugging face non-CNN and MIGraphX models (VAI Team) #338

Closed
saienduri opened this issue Sep 13, 2024 · 1 comment
Closed
Assignees

Comments

@saienduri
Copy link
Contributor

saienduri commented Sep 13, 2024

We are currently running 1,000 models nightly in the CI on the cpu and mi300 backends.
The two main items that need to be accomplished to push to add in the Hugging face non-CNN and MIGraphX models from the tracker here (nod-ai/SHARK-ModelDev#564):

  • Port CI over to using alt_e2eshark (I have initial work ready here for this: https://github.com/nod-ai/SHARK-TestSuite/tree/alt-merge-reports/alt_e2eshark). The main reason for this port is because alt_e2eshark allows better configuration for different sources of models, external weights, and dynamic dims.

  • Add CI configuration to run the two new categories of models. We are limited to 8 shards of models at the moment so rework how exactly we want to shard the models now that we are adding over 1200 more models

  • A blocker for this is the torch-mlir release that is currently breaking https://github.com/llvm/torch-mlir-release/actions. We need this passing again so that the CI can pick up the latest torch-mlir version which is required in alt_e2eshark as it uses import/lowering from this project

@saienduri saienduri self-assigned this Sep 13, 2024
@saienduri saienduri changed the title Add CI support for all 4,000 models of interest for VAI Team Add CI support for all Hugging face non-CNN and MIGraphX models (VAI Team) Sep 13, 2024
@renxida
Copy link
Contributor

renxida commented Sep 17, 2024

Non-cnn models pr just in : D

#337

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants