Slow Prompt evaluation. #5904
Slow Prompt evaluation.
#5904
Replies: 1 comment
-
|
I found the reason, and it's a very funny reason. It looks like the GPU was giving too many layers. I reduced it by one and immediately started reading quickly. I'm just shocked, I just sit and don't understand what the reason is, I even reinstalled it. God... |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I can’t figure out why my Prompt evaluation is slow for 17 seconds. per unit Before this it only took two or three seconds. When I reinstalled text gen everything became normal, but now there is a strong slowdown again. What could it be?
Everything was fine before.
Beta Was this translation helpful? Give feedback.
All reactions