Check for invalid keys #3216

Job	Run time
run-tests (latest, test_prod)	1m 8s
run-tests (latest, test_core)	4m 17s
run-tests (latest, test_cli)	3m 1s
run-tests (latest, test_big_modeling)	1m 24s
run-tests (latest, test_deepspeed)	1m 24s
run-tests (latest, test_fsdp)	1m 15s
run-tests (latest, test_example_differences)	1m 8s
run-tests (latest, test_checkpoint_step)	7m 57s
run-tests (latest, test_checkpoint_epoch)	6m 17s
run-tests (latest, test_rest)	8m 25s
run-tests (minimum, test_prod)	55s
run-tests (minimum, test_core)	1m 41s
run-tests (minimum, test_cli)	3m 33s
run-tests (minimum, test_big_modeling)	1m 26s
run-tests (minimum, test_deepspeed)	1m 25s
run-tests (minimum, test_fsdp)	1m 22s
run-tests (minimum, test_example_differences)	5m 21s
run-tests (minimum, test_checkpoint_step)	8m 47s
run-tests (minimum, test_checkpoint_epoch)	2m 59s
run-tests (minimum, test_rest)	4m 26s
	1h 8m 11s

Provide feedback