GFX11 MIOpen Support?

[fruitpudding]

Dear MIOpen developers,

I bought a gfx1100 card and just realized there's no current MIOpen support for GFX11/RDNA3 GPUs. Before selling the card I got, I'm wondering if there's any plan or roadmap to support GFX11 cards?

And if possible, is there any workaround to run PyTorch for now?

Thank you!

[xuhuisheng]

i will suggest traditional workaround export HSA_OVERRIDE_GFX_VERSION=10.3.0, please let us know if it works. thank you.

[atamazov]

i will suggest traditional workaround export HSA_OVERRIDE_GFX_VERSION=10.3.0, please let us know if it works. thank you.

Does this correspond to gfx1030?

[jellersby]

i will suggest traditional workaround export HSA_OVERRIDE_GFX_VERSION=10.3.0, please let us know if it works. thank you.

Unfortunately it doesn't work for me. The function that always gives me trouble is hipMemcpy. I've tried it in a standalone C++ program, as well as via Pytorch. Here's an example gdb stacktrace from Pytorch (ROCm 5.2):

Thread 1 "python" received signal SIGSEGV, Segmentation fault.

#0  0x00007fff8a31bc92 in ihipMemcpyCommand(amd::Command*&, void*, void const*, unsigned long, hipMemcpyKind, amd::HostQueue&) ()
   from /home/jellersby/Development/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/lib/libamdhip64.so
#1  0x00007fff8a31c443 in ihipMemcpy(void*, void const*, unsigned long, hipMemcpyKind, amd::HostQueue&, bool) () from /home/jellersby/Development/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/lib/libamdhip64.so
#2  0x00007fff8a3566d1 in hipMemcpyWithStream () from /home/jellersby/Development/stable-diffusion-webui/venv/lib/python3.10/site-packages/torch/lib/libamdhip64.so

<rest of stacktrace discarded>

[atamazov]

@fruitpudding Currently ROCm does not support gfx11 HW, please refer to https://docs.amd.com/bundle/Hardware_and_Software_Reference_Guide/page/Hardware_and_Software_Support.html. We can consider supporting gfx11 in MIOpen only after ROCm supports it.

However, you can try the workaround recommended by @xuhuisheng + more MIOpen specific workarounds (TBD). Stay tuned.

[atamazov]

@fruitpudding FYI there is a ticket dedicated to gfx11 support in ROCm, ROCm/ROCm#1813

[littlewu2508]

There are gfx11 enabled in rocBLAS, so I suppose there are ongoing progress for ROCm math libraries, but it's not completed yet

[jellersby]

It looks like there is some movement on gfx11 support in miopen: #1925

[jellersby]

Can we expect gfx11 support in ROCm 5.5? 😇 🙏

[atamazov]

MIOpen already has the most of necessary support for it. About ROCm 5.5, please ask here: ROCm/ROCm#1813

[PennyFranklin]

months later and it seems still do not support RDNA3 yet

[atamazov]

you can take the most recent develop branch and build it. gfx11 support is there.

[PennyFranklin]

can you please give a more detailed guidance?I tride but failed to find the package match my gfx1100.