Fix macos arm64 build #3516

Job	Run time
Linux	5m 53s
Lint	3m 33s
Lint for Docs	12s
Bazel Linux	46m 39s
macOS	10m 52s
Bazel macOS	26m 9s
Bazel Windows	19m 36s
Build Number	0s
Wheel ${{ matrix.python }} Windows	0s
Test ${{ matrix.python }} Windows	0s
Nightly ${{ matrix.python }} Windows	0s
Wheel 3.9 macOS	37s
Wheel 3.10 macOS	51s
Wheel 3.11 macOS	36s
Test 3.9 macOS	58m 15s
Nightly ${{ matrix.python }} macOS	0s
Wheel 3.9 Linux	1m 6s
Wheel 3.10 Linux	1m 9s
Wheel 3.11 Linux	1m 11s
Test 3.9 Linux	26m 8s
Nightly ${{ matrix.python }} Linux	0s
Release	0s
Release Candidate	0s
Docker Nightly	0s
Nightly	0s
Docker Release	0s
	3h 22m 47s

Provide feedback