Fix GPU segfault introduced in #1219 #4717

Job	Run time
Save-PR-Number	3s
Formatting	13s
GPU-HIP	19m 34s
GPU-SYCL	33m 22s
CPU (ubuntu-latest, Release, NoOpenMP)	10m 16s
Docker	12m 34s
GPU-CUDA (11.4)	22m 41s
CPU (ubuntu-latest, Debug, OpenMP)	9m 4s
CPU (ubuntu-latest, Debug, NoOpenMP)	8m 17s
Lint-clang-tidy	29m 8s
Lint-codeql	15m 58s
CPU (macos-latest, Release, NoOpenMP)	2m 16s
Lint-codespell	10s
	2h 43m 36s

Provide feedback