Skip to content

fix(llama.cpp): enable cont batching when parallel is set (#1622) #129

fix(llama.cpp): enable cont batching when parallel is set (#1622)

fix(llama.cpp): enable cont batching when parallel is set (#1622) #129

Triggered via push January 21, 2024 18:17
Status Success
Total duration 37m 2s
Artifacts

test.yml

on: push
Matrix: tests-apple
Matrix: tests-linux
Fit to window
Zoom out
Zoom in