Skip to content
Test SHARK

[WIP][Llama2] Add KVCache for prefill stage + interactive chat mode in llm_runner + StreamingLLM. #33

Sign in to view logs

[WIP][Llama2] Add KVCache for prefill stage + interactive chat mode in llm_runner + StreamingLLM.

[WIP][Llama2] Add KVCache for prefill stage + interactive chat mode in llm_runner + StreamingLLM. #33

Triggered via pull request January 5, 2024 17:47
@raikonenfnuraikonenfnu
synchronize #299
raikonenfnu:streaming
Status Success
Total duration 27m 51s
Artifacts –

test_shark.yml

on: pull_request
Matrix: test-shark
Fit to window
Zoom out
Zoom in

Annotations

1 error and 1 warning
test-shark (3.11, nodai-ubuntu-builder-large)
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
test-shark (3.11, nodai-ubuntu-builder-large)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/setup-python@75f3110429a8c05be0e1bf360334e4cced2b63fa. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/