Skip to content
ggml llama2 examples

[Example] ggml: add Qwen2-VL example #711

Sign in to view logs

[Example] ggml: add Qwen2-VL example

[Example] ggml: add Qwen2-VL example #711

Run time

Learn about OS pricing on GitHub Actions
Job Run time
ubuntu-20.04 - Tiny Llama - 0.13.5 - wasi_nn-ggml
31s
ubuntu-20.04 - Gemma 2B - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Llava v1.5 7B - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Llava v1.6 7B - 0.13.5 - wasi_nn-ggml
31s
ubuntu-20.04 - Llama2 7B - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Llama2 7B (Streaming) - 0.13.5 - wasi_nn-ggml
32s
ubuntu-20.04 - Llama3 8B - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Llama3 8B (Streaming) - 0.13.5 - wasi_nn-ggml
32s
ubuntu-20.04 - StarCoder 2 7B - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Multiple Models Example - 0.13.5 - wasi_nn-ggml
35s
ubuntu-20.04 - Embedding Example (All-MiniLM) - 0.13.5 - wasi_nn-ggml
22s
ubuntu-20.04 - Embedding Example (Llama-2) - 0.13.5 - wasi_nn-ggml
34s
ubuntu-20.04 - RPC Example - 0.13.5 - wasi_nn-ggml
34s
ubuntu-20.04 - Set Input Twice - 0.13.5 - wasi_nn-ggml
34s
ubuntu-20.04 - Yi 1.5 9B 16K - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Yi 1.5 9B - 0.13.5 - wasi_nn-ggml
34s
ubuntu-20.04 - Grammar Example - 0.13.5 - wasi_nn-ggml
33s
ubuntu-20.04 - Model Not Found - 0.13.5 - wasi_nn-ggml
22s
ubuntu-20.04 - Unload - 0.13.5 - wasi_nn-ggml
32s
ubuntu-20.04 - JSON Schema - 0.13.5 - wasi_nn-ggml
34s
ubuntu-20.04 - Qwen2-VL - 0.13.5 - wasi_nn-ggml
19s
ubuntu-20.04 - Build llama-stream - 0.13.5 - wasi_nn-ggml
18s
ubuntu-20.04 - Build llava-base64-stream - 0.13.5 - wasi_nn-ggml
23s
ubuntu-20.04 - Tiny Llama - 0.14.0 - wasi_nn-ggml
17s
ubuntu-20.04 - Gemma 2B - 0.14.0 - wasi_nn-ggml
31s
ubuntu-20.04 - Llava v1.5 7B - 0.14.0 - wasi_nn-ggml
32s
ubuntu-20.04 - Llava v1.6 7B - 0.14.0 - wasi_nn-ggml
30s
ubuntu-20.04 - Llama2 7B - 0.14.0 - wasi_nn-ggml
31s
ubuntu-20.04 - Llama2 7B (Streaming) - 0.14.0 - wasi_nn-ggml
30s
ubuntu-20.04 - Llama3 8B - 0.14.0 - wasi_nn-ggml
29s
ubuntu-20.04 - Llama3 8B (Streaming) - 0.14.0 - wasi_nn-ggml
19s
ubuntu-20.04 - StarCoder 2 7B - 0.14.0 - wasi_nn-ggml
29s
ubuntu-20.04 - Multiple Models Example - 0.14.0 - wasi_nn-ggml
34s
ubuntu-20.04 - Embedding Example (All-MiniLM) - 0.14.0 - wasi_nn-ggml
31s
ubuntu-20.04 - Embedding Example (Llama-2) - 0.14.0 - wasi_nn-ggml
32s
ubuntu-20.04 - RPC Example - 0.14.0 - wasi_nn-ggml
32s
ubuntu-20.04 - Set Input Twice - 0.14.0 - wasi_nn-ggml
33s
ubuntu-20.04 - Yi 1.5 9B 16K - 0.14.0 - wasi_nn-ggml
33s
ubuntu-20.04 - Yi 1.5 9B - 0.14.0 - wasi_nn-ggml
33s
ubuntu-20.04 - Grammar Example - 0.14.0 - wasi_nn-ggml
33s
ubuntu-20.04 - Model Not Found - 0.14.0 - wasi_nn-ggml
15s
ubuntu-20.04 - Unload - 0.14.0 - wasi_nn-ggml
30s
ubuntu-20.04 - JSON Schema - 0.14.0 - wasi_nn-ggml
19s
ubuntu-20.04 - Qwen2-VL - 0.14.0 - wasi_nn-ggml
13s
ubuntu-20.04 - Build llama-stream - 0.14.0 - wasi_nn-ggml
19s
ubuntu-20.04 - Build llava-base64-stream - 0.14.0 - wasi_nn-ggml
31s
macos-m1 - Tiny Llama - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Gemma 2B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Llava v1.5 7B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Llava v1.6 7B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Llama2 7B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Llama2 7B (Streaming) - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Llama3 8B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Llama3 8B (Streaming) - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - StarCoder 2 7B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Multiple Models Example - 0.13.5 - wasi_nn-ggml
30s
macos-m1 - Embedding Example (All-MiniLM) - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Embedding Example (Llama-2) - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - RPC Example - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Set Input Twice - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Yi 1.5 9B 16K - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Yi 1.5 9B - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Grammar Example - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Model Not Found - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Unload - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - JSON Schema - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Qwen2-VL - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Build llama-stream - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Build llava-base64-stream - 0.13.5 - wasi_nn-ggml
1s
macos-m1 - Tiny Llama - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Gemma 2B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Llava v1.5 7B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Llava v1.6 7B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Llama2 7B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Llama2 7B (Streaming) - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Llama3 8B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Llama3 8B (Streaming) - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - StarCoder 2 7B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Multiple Models Example - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Embedding Example (All-MiniLM) - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Embedding Example (Llama-2) - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - RPC Example - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Set Input Twice - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Yi 1.5 9B 16K - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Yi 1.5 9B - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Grammar Example - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Model Not Found - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Unload - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - JSON Schema - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Qwen2-VL - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Build llama-stream - 0.14.0 - wasi_nn-ggml
1s
macos-m1 - Build llava-base64-stream - 0.14.0 - wasi_nn-ggml
1s
ubuntu-20.04 - C4AI Command-R v01 - 0.14.0 - wasi_nn-ggml
32s
24m 1s