Erebus for Google Colab #453
Closed
SoftwareLogico
started this conversation in
General
Replies: 1 comment
-
well it seems the problem was that i had to upgrade the RAM capacity in the enviroments setting |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Im not very good at python
I added this line based in the others
added OPT-6.7B-Erebus in #@param
model = "OPT-6.7B-Erebus" #@param ["Pygmalion 6B original (sharded, rehosted)", "Pygmalion 6B main (sharded, rehosted)", "Pygmalion 6B dev (sharded, rehosted)", "Pygmalion 350m (for debugging)", "OPT-6.7B-Erebus"] {allow-input: false}
then
"OPT-6.7B-Erebus": ("KoboldAI", "OPT-6.7B-Erebus", "main", "OPT-6.7B-Erebus"),
models = { "Pygmalion 6B original (sharded, rehosted)": ("waifu-workshop", "pygmalion-6b", "original-sharded", "pygmalion-6b_original-sharded"), "Pygmalion 6B main (sharded, rehosted)": ("waifu-workshop", "pygmalion-6b", "sharded", "pygmalion-6b_sharded"), "Pygmalion 6B dev (sharded, rehosted)": ("waifu-workshop", "pygmalion-6b", "dev-sharded", "pygmalion-6b_dev-sharded"), "Pygmalion 350m (for debugging)": ("PygmalionAI", "pygmalion-350m", "main", "pygmalion-350m"), "OPT-6.7B-Erebus": ("KoboldAI", "OPT-6.7B-Erebus", "main", "OPT-6.7B-Erebus"), }
it started but i got this error
Downloading the model to models/OPT-6.7B-Erebus
Downloading file 1 of 6...
100% 1.55k/1.55k [00:00<00:00, 1.61MiB/s]
Downloading file 2 of 6...
100% 456k/456k [00:00<00:00, 1.82MiB/s]
Downloading file 3 of 6...
100% 13.3G/13.3G [03:21<00:00, 66.2MiB/s]
Downloading file 4 of 6...
100% 548/548 [00:00<00:00, 592kiB/s]
Downloading file 5 of 6...
100% 849/849 [00:00<00:00, 1.14MiB/s]
Downloading file 6 of 6...
100% 999k/999k [00:00<00:00, 3.21MiB/s]
python server.py --share --model OPT-6.7B-Erebus --settings settings-colab.json --no-stream --extensions silero_tts gallery --cai-chat
Loading settings from settings-colab.json...
Loading OPT-6.7B-Erebus...
^C <<<<<< that
Beta Was this translation helpful? Give feedback.
All reactions