Skip to content

qserve is slower then awq int4 for llama2-7b on H100 #13

qserve is slower then awq int4 for llama2-7b on H100

qserve is slower then awq int4 for llama2-7b on H100 #13

Triggered via issue December 2, 2024 04:43
@bobbolibobboli
commented on #2509 4420547
Status Skipped
Total duration 4s
Artifacts

blossom-ci.yml

on: issue_comment
Authorization
0s
Authorization
Upload log
0s
Upload log
Vulnerability scan
0s
Vulnerability scan
Start ci job
0s
Start ci job
Fit to window
Zoom out
Zoom in