Skip to content

Latest commit

 

History

History
executable file
·
15 lines (10 loc) · 398 Bytes

README.md

File metadata and controls

executable file
·
15 lines (10 loc) · 398 Bytes
Raw

LLM Submission - LauzHax (team 5)

Installation and running

Make sure to install the dependencies, using the following command.

python -m pip install -r requirements.txt

You can then run the model, with our parameters, using the following command.

python src/main.py --wandb --model llama2 --lr 1e-3 --n_layer 10 --batch_size 30 --grad_clip 1.0 --iterations 23000