GPU enabled Vicuna 7B chatbot with your offline documents!!! #2412
sarutobiumon
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
This is a big new development as it uses your GPU and takes care of the extreme slow response issue when running on the CPU.
Please consider integrating with oobabooga's textgen webui.
Demo: https://www.youtube.com/watch?v=MlyoObdIHyo
Repo: https://github.com/PromtEngineer/localGPT
Beta Was this translation helpful? Give feedback.
All reactions