pt: support dpa2 model parallel inference #7132
Job | Run time |
---|---|
25s | |
1s | |
6m 20s | |
5m 41s | |
7m 24s | |
2m 40s | |
4m 51s | |
5m 59s | |
2m 33s | |
5s | |
2m 39s | |
0s | |
0s | |
4s | |
38m 42s |
Job | Run time |
---|---|
25s | |
1s | |
6m 20s | |
5m 41s | |
7m 24s | |
2m 40s | |
4m 51s | |
5m 59s | |
2m 33s | |
5s | |
2m 39s | |
0s | |
0s | |
4s | |
38m 42s |