Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable hipBLASLt as an optional backend for MIOpen GEMM kernels #3041

Open
BrianHarrisonAMD opened this issue Jun 10, 2024 · 2 comments
Open
Assignees
Labels
enhancement request_for_comments See https://en.wikipedia.org/wiki/Request_for_Comments value_high

Comments

@BrianHarrisonAMD
Copy link
Contributor

BrianHarrisonAMD commented Jun 10, 2024

1. Description:

Enable hipBLASLt as an optional backend for MIOpen GEMM kernels.

For this first implementation we are proposing:

  • Enable hipBLASLt as an option when using the environment overrides MIOPEN_GEMM_ENFORCE_BACKEND == 5

2. Value & Motivation:

  • hipBLASLt is a new GEMM backend that is available for use, and we want to enable this backend as an option within MIOpen.
  • Adding support for this backend within MIOpen will give more options for selecting the optimal solver.
  • Starting with a limited roll out will allow for testing & benchmarking.

3. Any additional information:

  • This is intended to be a minimal & focused implementation to enable using the hipBLASLt backend within MIOpen.
@BrianHarrisonAMD BrianHarrisonAMD added enhancement value_high request_for_comments See https://en.wikipedia.org/wiki/Request_for_Comments labels Jun 10, 2024
@BrianHarrisonAMD BrianHarrisonAMD self-assigned this Jun 10, 2024
@BrianHarrisonAMD
Copy link
Contributor Author

Note: Associated draft PR here #3030

@BrianHarrisonAMD
Copy link
Contributor Author

In PR #3030 we discussed, "Use hipBLASLt as the backend GEMM kernels for RNNs on targeted hardware using half precision", and decided to instead have it only accessible via the environment variable, "MIOPEN_GEMM_ENFORCE_BACKEND=5" with this first limited rollout.

@BrianHarrisonAMD BrianHarrisonAMD changed the title Enable hipBLASLt as an optional backend for MIOpen GEMM kernels, and make it the default option for RNN's using half precision Enable hipBLASLt as an optional backend for MIOpen GEMM kernels Jul 9, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement request_for_comments See https://en.wikipedia.org/wiki/Request_for_Comments value_high
Projects
None yet
Development

No branches or pull requests

1 participant