Releases: appvoid/gpt-edge
Redpajama Flavor Released!
GPT-J Flavor Released
Details
Bigger, better model from the amazing EleutherAI team. I wanted to play with this model for years, now it just take a few seconds to get it working on any pc, What a time to be alive. This is a 3GB size model (you need to download all files and unzip the zip one) so the bare minimum is 4GB RAM, but if you only have that much make sure you are not running other apps.
GPT-2 Flavor Released!
Details
Models were being evaluated taking two main metrics into account: speed and performance. I've noticed that performance for 5_1 quantization is the fastest model from which you cannot notice important performance degradation at all, below that size, it gets a little dumber, so I'm using it as default from now (for models below 2.7b parameters of course, from here and above will remain 4_0). So cool that it's just 1GB terminal app that you can use to power your own apps!