Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
zhangce authored Jun 5, 2023
1 parent 437dfdb commit b9e0389
Showing 1 changed file with 7 additions and 5 deletions.
12 changes: 7 additions & 5 deletions examples/redpajama/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,13 @@ We highly appreciate the great effort from the fork of [gptneox.cpp](https://git

### RedPajama Chat Model:

- Dependencies

You may need to install torch and transformers to run the above scripts, e.g.:

pip install torch==2.0.0
pip install transformers==4.28.1

- Make the code:

make redpajama-chat quantize-gptneox
Expand Down Expand Up @@ -37,11 +44,6 @@ We highly appreciate the great effort from the fork of [gptneox.cpp](https://git
--repeat_penalty 1.1 \
--seed 0

Note that you may need to install torch and transformers to run the above scripts, e.g.:

pip install torch==2.0.0
pip install transformers==4.28.1


- Run RedPajama chat model (e.g., 7B, q4_0):

Expand Down

0 comments on commit b9e0389

Please sign in to comment.