You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I said panic, but that's not exactly correct, what happens is an error in llama.cpp's side, I forget if it's an exception or something else. Either way, this depends on how large you make your context/session, if you make it large enough and never use the same session for too long, you probably won't ever notice it, but this definitely still happens.
At the moment when the max context size is reached, the program panics. Methods such as sliding context window should be implemented.
The text was updated successfully, but these errors were encountered: