CI: fix asv setup #5549

Job	Run time
pytest-ubuntu-py311-gcc11-noomp-base	48m 49s
pytest-ubuntu-py311-gcc11-noomp-adjoint	46m 20s
pytest-ubuntu-py38-gcc12-omp-base	1h 0m 14s
pytest-ubuntu-py38-gcc12-omp-adjoint	49m 49s
pytest-ubuntu-py37-gcc7-omp-base	55m 37s
pytest-ubuntu-py37-gcc7-omp-adjoint	1h 7m 35s
pytest-ubuntu-py310-gcc10-noomp-base	48m 52s
pytest-ubuntu-py310-gcc10-noomp-adjoint	56m 33s
pytest-ubuntu-py38-gcc8-omp-base	57m 46s
pytest-ubuntu-py38-gcc8-omp-adjoint	1h 8m 31s
pytest-ubuntu-py39-gcc9-omp-base	1h 7m 51s
pytest-ubuntu-py39-gcc9-omp-adjoint	49m 25s
pytest-osx-py37-clang-omp-base	5m 41s
pytest-docker-py39-gcc-omp-base	1h 15m 52s
pytest-docker-py39-gcc-omp-adjoint	54m 53s
pytest-docker-py39-icx-omp-base	51m 16s
pytest-docker-py39-icx-omp-adjoint	50m 17s
	15h 15m 21s

Provide feedback