Merge pull request #355 from janhq/update-submodule-2024-12-31-17-00 · janhq/cortex.llamacpp@14eac82

Commit

Merge pull request #355 from janhq/update-submodule-2024-12-31-17-00

Update llama.cpp submodule to latest release b4404

jan-service-account authored Dec 31, 2024

2 parents b816ea6 + 6336853 commit 14eac82

+17 −3		common/common.cpp
+3 −0		common/common.h
+3 −9		convert_hf_to_gguf.py
+5 −4		examples/run/run.cpp
+161 −91		examples/server/README.md
+167 −62		examples/server/server.cpp
+20 −3		examples/server/tests/unit/test_chat_completion.py
+35 −0		examples/server/tests/unit/test_completion.py
+3 −0		examples/server/tests/utils.py
+43 −17		examples/server/utils.hpp
+2 −2		ggml/src/CMakeLists.txt
+1 −2		ggml/src/ggml-cpu/CMakeLists.txt
+4 −1		ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp
+5 −1		ggml/src/ggml-cpu/ggml-cpu-quants.c
+3 −1		ggml/src/ggml-cpu/llamafile/sgemm.cpp
+6 −6		ggml/src/ggml-opencl/ggml-opencl.cpp
+51 −38		ggml/src/ggml-vulkan/ggml-vulkan.cpp
+53 −71		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec.comp
+33 −0		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_base.comp
+37 −55		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q2_k.comp
+29 −46		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q3_k.comp
+23 −41		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q4_k.comp
+43 −61		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q5_k.comp
+20 −38		ggml/src/ggml-vulkan/vulkan-shaders/mul_mat_vec_q6_k.comp
+1 −1		tests/test-backend-ops.cpp