torch distributed: add support for user-specified parameter synchronization #5688
Job | Run time |
---|---|
15s | |
45s | |
12s | |
4m 43s | |
43s | |
18m 6s | |
12s | |
1m 36s | |
55s | |
11s | |
1m 48s | |
53s | |
14s | |
1m 30s | |
4m 37s | |
12s | |
4m 6s | |
2m 58s | |
3m 11s | |
3m 37s | |
13s | |
1m 23s | |
1m 56s | |
5m 32s | |
10s | |
3m 48s | |
3m 41s | |
4m 39s | |
15s | |
1m 56s | |
43s | |
4m 38s | |
21s | |
2m 45s | |
56s | |
4m 3s | |
13s | |
1m 46s | |
1m 39s | |
3m 58s | |
11s | |
1m 43s | |
43s | |
3m 21s | |
1m 41s | |
24s | |
5m 10s | |
5m 22s | |
40s | |
3m 49s | |
3m 26s | |
2m 30s | |
5m 11s | |
32s | |
3m 28s | |
3m 1s | |
4m 52s | |
4m 47s | |
4m 4s | |
3m 45s | |
3m 33s | |
3m 57s | |
4m 8s | |
2h 45m 37s |