Skip to content

fix(llama.cpp): enable cont batching when parallel is set (#1622) #127

fix(llama.cpp): enable cont batching when parallel is set (#1622)

fix(llama.cpp): enable cont batching when parallel is set (#1622) #127