Skip to content

qserve is slower then awq int4 for llama2-7b on H100 #13

qserve is slower then awq int4 for llama2-7b on H100

qserve is slower then awq int4 for llama2-7b on H100 #13