Skip to content

Feat (gptq): optimizing CPU to GPU memory transfer #1699

Feat (gptq): optimizing CPU to GPU memory transfer

Feat (gptq): optimizing CPU to GPU memory transfer #1699

Job Run time
1m 58s
1m 25s
1m 56s
2m 4s
1m 27s
1m 46s
1m 44s
1m 47s
1m 55s
2m 17s
1m 37s
1m 45s
1m 37s
1m 27s
2m 5s
2m 13s
1m 31s
1m 37s
1m 34s
1m 45s
2m 4s
2m 8s
1m 40s
1m 56s
1m 32s
1m 32s
2m 11s
2m 7s
1m 47s
1m 59s
1m 35s
1m 33s
2m 20s
2m 13s
1m 44s
2m 9s
1m 36s
1m 26s
2m 15s
1m 38s
1m 59s
2m 14s
1m 33s
1m 39s
55s
1m 10s
2m 10s
2m 5s
1m 32s
1m 55s
52s
1m 0s
2m 3s
2m 10s
1m 33s
2m 5s
1m 7s
1m 4s
2m 7s
2m 21s
1m 37s
1m 53s
1m 2s
54s
1m 57s
2m 21s
1m 47s
1m 59s
1m 7s
1m 6s
2m 10s
2m 14s
1m 50s
1m 59s
1m 4s
1m 9s
2h 12m 38s