Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add CI support for ONNX EP integrated with IREE for 30+ Models #339

Open
saienduri opened this issue Sep 13, 2024 · 0 comments
Open

Add CI support for ONNX EP integrated with IREE for 30+ Models #339

saienduri opened this issue Sep 13, 2024 · 0 comments

Comments

@saienduri
Copy link
Contributor

Gaurav and Vinayak have been working on integrating the IREE backend to onnxruntime, and they will have an initial implementation ready on 9/13. We want to test the 30 models that they have running through this branch on onnxruntime in SHARK-TestSuite nightly CI.

Main things required for this:

  • As we are currently working off a branch of onnx-runtime, would be nice to setup a nightly CI that builds this branch and generates a wheel for our nightly model testing to consume. But, as an initial setup, we can have one of the developers build and upload a wheel to azure storage and pull that in our nightly model CI for testing. Eventually, would be great to actually get this branch merged into onnx-runtime, so we don't have to do any maintenance :)

  • Incorporate running through the ONNX EP in the SHARK-TestSuite nightly CI and add reports for this backend to our e2eshark-reports repo (https://github.com/nod-ai/e2eshark-reports)

@saienduri saienduri assigned saienduri and unassigned saienduri Sep 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant