Fix toeplitz #1985

Job	Run time
check_commit	6s
ci-tests (Black test, ubuntu-latest, 3.10, black, false)	18s
ci-tests (Py3.8 with old Astropy version, ubuntu-latest, 3.8, py38-test-astropy4-cov, false)	2m 16s
ci-tests (Linux, Py3.10 with coverage, ubuntu-latest, 3.10, py310-test-cov, false)	2m 11s
ci-tests (Windows, Py3.11 with coverage, windows-latest, 3.11, py311-test-cov, false)	3m 21s
ci-tests (Mac OS M1, Py3.11, macos-14, 3.11, py311-test, false)	1m 31s
ci-tests (Mac OS, Py3.11, macos-latest, 3.11, py311-test, false)	1m 43s
ci-tests (Linux, Py3.11 all dependencies and coverage, ubuntu-latest, 3.11, py311-test-alldeps-co...	3m 51s
ci-tests (Linux, Py3.12 basic dependencies and coverage, ubuntu-latest, 3.12, py312-test-cov, tru...	2m 33s
ci-tests (Linux, Py3.11 with dev versions of dependencies, ubuntu-latest, 3.11, py311-test-devdep...	2m 50s
ci-tests (Slow tests on Linux, Py3.11, all deps and coverage, ubuntu-latest, 3.11, py311-test-all...	11m 0s
ci-tests (Slow tests on Linux, Py3.11, basic deps and coverage, ubuntu-latest, 3.11, py311-test-c...	4m 43s
	36m 23s

Provide feedback