ggml llama2 examples #709

Run time

Learn about OS pricing on GitHub Actions

Job	Run time
ubuntu-20.04 - Tiny Llama - 0.13.5 - wasi_nn-ggml	52s
ubuntu-20.04 - Gemma 2B - 0.13.5 - wasi_nn-ggml	1m 25s
ubuntu-20.04 - Llava v1.5 7B - 0.13.5 - wasi_nn-ggml	2m 36s
ubuntu-20.04 - Llava v1.6 7B - 0.13.5 - wasi_nn-ggml	18m 2s
ubuntu-20.04 - Llama2 7B - 0.13.5 - wasi_nn-ggml	2m 45s
ubuntu-20.04 - Llama2 7B (Streaming) - 0.13.5 - wasi_nn-ggml	2m 49s
ubuntu-20.04 - Llama3 8B - 0.13.5 - wasi_nn-ggml	3m 12s
ubuntu-20.04 - Llama3 8B (Streaming) - 0.13.5 - wasi_nn-ggml	10m 1s
ubuntu-20.04 - StarCoder 2 7B - 0.13.5 - wasi_nn-ggml	3m 0s
ubuntu-20.04 - Multiple Models Example - 0.13.5 - wasi_nn-ggml	27m 2s
ubuntu-20.04 - Embedding Example (All-MiniLM) - 0.13.5 - wasi_nn-ggml	35s
ubuntu-20.04 - Embedding Example (Llama-2) - 0.13.5 - wasi_nn-ggml	2m 17s
ubuntu-20.04 - RPC Example - 0.13.5 - wasi_nn-ggml	8m 48s
ubuntu-20.04 - Set Input Twice - 0.13.5 - wasi_nn-ggml	3m 11s
ubuntu-20.04 - Yi 1.5 9B 16K - 0.13.5 - wasi_nn-ggml	3m 5s
ubuntu-20.04 - Yi 1.5 9B - 0.13.5 - wasi_nn-ggml	10m 52s
ubuntu-20.04 - Grammar Example - 0.13.5 - wasi_nn-ggml	3m 17s
ubuntu-20.04 - Model Not Found - 0.13.5 - wasi_nn-ggml	27s
ubuntu-20.04 - Unload - 0.13.5 - wasi_nn-ggml	5m 24s
ubuntu-20.04 - JSON Schema - 0.13.5 - wasi_nn-ggml	1m 44s
ubuntu-20.04 - Build llama-stream - 0.13.5 - wasi_nn-ggml	40s
ubuntu-20.04 - Build llava-base64-stream - 0.13.5 - wasi_nn-ggml	34s
ubuntu-20.04 - Tiny Llama - 0.14.0 - wasi_nn-ggml	57s
ubuntu-20.04 - Gemma 2B - 0.14.0 - wasi_nn-ggml	1m 14s
ubuntu-20.04 - Llava v1.5 7B - 0.14.0 - wasi_nn-ggml	3m 24s
ubuntu-20.04 - Llava v1.6 7B - 0.14.0 - wasi_nn-ggml	18m 11s
ubuntu-20.04 - Llama2 7B - 0.14.0 - wasi_nn-ggml	1m 26s
ubuntu-20.04 - Llama2 7B (Streaming) - 0.14.0 - wasi_nn-ggml	1m 17s
ubuntu-20.04 - Llama3 8B - 0.14.0 - wasi_nn-ggml	3m 11s
ubuntu-20.04 - Llama3 8B (Streaming) - 0.14.0 - wasi_nn-ggml	3m 17s
ubuntu-20.04 - StarCoder 2 7B - 0.14.0 - wasi_nn-ggml	2m 55s
ubuntu-20.04 - Multiple Models Example - 0.14.0 - wasi_nn-ggml	27m 16s
ubuntu-20.04 - Embedding Example (All-MiniLM) - 0.14.0 - wasi_nn-ggml	30s
ubuntu-20.04 - Embedding Example (Llama-2) - 0.14.0 - wasi_nn-ggml	54s
ubuntu-20.04 - RPC Example - 0.14.0 - wasi_nn-ggml	3m 5s
ubuntu-20.04 - Set Input Twice - 0.14.0 - wasi_nn-ggml	1m 30s
ubuntu-20.04 - Yi 1.5 9B 16K - 0.14.0 - wasi_nn-ggml	3m 18s
ubuntu-20.04 - Yi 1.5 9B - 0.14.0 - wasi_nn-ggml	3m 11s
ubuntu-20.04 - Grammar Example - 0.14.0 - wasi_nn-ggml	3m 17s
ubuntu-20.04 - Model Not Found - 0.14.0 - wasi_nn-ggml	31s
ubuntu-20.04 - Unload - 0.14.0 - wasi_nn-ggml	5m 32s
ubuntu-20.04 - JSON Schema - 0.14.0 - wasi_nn-ggml	1m 30s
ubuntu-20.04 - Build llama-stream - 0.14.0 - wasi_nn-ggml	26s
ubuntu-20.04 - Build llava-base64-stream - 0.14.0 - wasi_nn-ggml	34s
macos-m1 - Tiny Llama - 0.13.5 - wasi_nn-ggml	1m 6s
macos-m1 - Gemma 2B - 0.13.5 - wasi_nn-ggml	1m 14s
macos-m1 - Llava v1.5 7B - 0.13.5 - wasi_nn-ggml	3m 18s
macos-m1 - Llava v1.6 7B - 0.13.5 - wasi_nn-ggml	3m 26s
macos-m1 - Llama2 7B - 0.13.5 - wasi_nn-ggml	1m 22s
macos-m1 - Llama2 7B (Streaming) - 0.13.5 - wasi_nn-ggml	1m 20s
macos-m1 - Llama3 8B - 0.13.5 - wasi_nn-ggml	3m 22s
macos-m1 - Llama3 8B (Streaming) - 0.13.5 - wasi_nn-ggml	2m 53s
macos-m1 - StarCoder 2 7B - 0.13.5 - wasi_nn-ggml	3m 15s
macos-m1 - Multiple Models Example - 0.13.5 - wasi_nn-ggml	6m 36s
macos-m1 - Embedding Example (All-MiniLM) - 0.13.5 - wasi_nn-ggml	31s
macos-m1 - Embedding Example (Llama-2) - 0.13.5 - wasi_nn-ggml	2m 53s
macos-m1 - RPC Example - 0.13.5 - wasi_nn-ggml	2m 44s
macos-m1 - Set Input Twice - 0.13.5 - wasi_nn-ggml	1m 21s
macos-m1 - Yi 1.5 9B 16K - 0.13.5 - wasi_nn-ggml	3m 32s
macos-m1 - Yi 1.5 9B - 0.13.5 - wasi_nn-ggml	3m 45s
macos-m1 - Grammar Example - 0.13.5 - wasi_nn-ggml	2m 4s
macos-m1 - Model Not Found - 0.13.5 - wasi_nn-ggml	31s
macos-m1 - Unload - 0.13.5 - wasi_nn-ggml	3m 55s
macos-m1 - JSON Schema - 0.13.5 - wasi_nn-ggml	1m 30s
macos-m1 - Build llama-stream - 0.13.5 - wasi_nn-ggml	34s
macos-m1 - Build llava-base64-stream - 0.13.5 - wasi_nn-ggml	30s
macos-m1 - Tiny Llama - 0.14.0 - wasi_nn-ggml	41s
macos-m1 - Gemma 2B - 0.14.0 - wasi_nn-ggml	1m 13s
macos-m1 - Llava v1.5 7B - 0.14.0 - wasi_nn-ggml	1m 30s
macos-m1 - Llava v1.6 7B - 0.14.0 - wasi_nn-ggml	3m 29s
macos-m1 - Llama2 7B - 0.14.0 - wasi_nn-ggml	1m 20s
macos-m1 - Llama2 7B (Streaming) - 0.14.0 - wasi_nn-ggml	1m 24s
macos-m1 - Llama3 8B - 0.14.0 - wasi_nn-ggml	2m 54s
macos-m1 - Llama3 8B (Streaming) - 0.14.0 - wasi_nn-ggml	2m 56s
macos-m1 - StarCoder 2 7B - 0.14.0 - wasi_nn-ggml	2m 45s
macos-m1 - Multiple Models Example - 0.14.0 - wasi_nn-ggml	6m 10s
macos-m1 - Embedding Example (All-MiniLM) - 0.14.0 - wasi_nn-ggml	35s
macos-m1 - Embedding Example (Llama-2) - 0.14.0 - wasi_nn-ggml	1m 17s
macos-m1 - RPC Example - 0.14.0 - wasi_nn-ggml	2m 39s
macos-m1 - Set Input Twice - 0.14.0 - wasi_nn-ggml	1m 15s
macos-m1 - Yi 1.5 9B 16K - 0.14.0 - wasi_nn-ggml	3m 6s
macos-m1 - Yi 1.5 9B - 0.14.0 - wasi_nn-ggml	3m 11s
macos-m1 - Grammar Example - 0.14.0 - wasi_nn-ggml	2m 4s
macos-m1 - Model Not Found - 0.14.0 - wasi_nn-ggml	31s
macos-m1 - Unload - 0.14.0 - wasi_nn-ggml	3m 44s
macos-m1 - JSON Schema - 0.14.0 - wasi_nn-ggml	1m 35s
macos-m1 - Build llama-stream - 0.14.0 - wasi_nn-ggml	29s
macos-m1 - Build llava-base64-stream - 0.14.0 - wasi_nn-ggml	30s
ubuntu-20.04 - C4AI Command-R v01 - 0.14.0 - wasi_nn-ggml	6m 23s
	5h 3m 27s

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ggml llama2 examples #709

Usage

ggml llama2 examples #709

Jobs

Run details

Run time