GH Task Runner (Few Shot Tasks)

GH Task Runner (Few Shot Tasks) #17

Re-run triggered February 25, 2024 09:28

PicoCreator

⁠ 9b1cd24

gh-task-runner

Status Success

Total duration 5h 29m 48s

Artifacts 1

gh-task-runner-Few-Shot.yml

on: workflow_dispatch

Matrix: gh-task-runner

Upload to HF / B2

40s

Annotations

2 errors and 25 warnings

[mmlu - fs:1] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv

[hellaswag - fs:25] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[arc_challenge - fs:5] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/upload-artifact@v3. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

[arc_challenge - fs:2] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[hellaswag - fs:2] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[arc_challenge - fs:1] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[arc_challenge - fs:10] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[arc_challenge - fs:25] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[hellaswag - fs:10] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[hellaswag - fs:5] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[hellaswag - fs:1] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[truthfulqa_mc2 - fs:10] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[truthfulqa_mc2 - fs:5] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[truthfulqa_mc2 - fs:2] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[truthfulqa_mc2 - fs:1] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[winogrande - fs:1] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[winogrande - fs:2] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[winogrande - fs:10] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[winogrande - fs:25] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[truthfulqa_mc2 - fs:25] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[mmlu - fs:5] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[mmlu - fs:2] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[winogrande - fs:5] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[mmlu - fs:1] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

[hellaswag - fs:25] meta-llama/Llama-2-7b-hf - dtype=bfloat16,trust_remote_code=True

Upload to HF / B2

Node.js 16 actions are deprecated. Please update the following actions to use Node.js 20: actions/checkout@v3, actions/download-artifact@v2. For more information see: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.

Upload to HF / B2

The following actions uses node12 which is deprecated and will be forced to run on node16: actions/download-artifact@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/

Artifacts

Produced during runtime

Name	Size
output-files Expired	1.24 GB

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

GH Task Runner (Few Shot Tasks) #17

Summary

GH Task Runner (Few Shot Tasks) #17

Jobs

Run details

gh-task-runner-Few-Shot.yml

Annotations

Artifacts