[WIP] Initial PR for generating and loading state dict #1917

Job	Run time
test-advanced-any / linux-job	16m 22s
test-readme-any / linux-job	9m 0s
test-advanced-cpu / linux-job	16m 34s
test-evaluation-any / linux-job	4m 14s
test-evaluation-cpu / linux-job	4m 12s
test-gguf-any / linux-job	16m 23s
test-gguf-cpu / linux-job	16m 26s
test-quantization-any / linux-job	16m 30s
test-readme-cpu / linux-job	10m 46s
test-quantization-cpu / linux-job	16m 26s
	2h 6m 53s

Provide feedback