Chat does not halt

[averypelle]

Hi, first off thank you so much for this great library and for your hard work! I recently tried using the chat mode and noticed that text generation would keep going until I CTRL + C'ed to manually stop. It wasn't stopping and would generate new User: prompts and just keep talking to itself. Worth noting that I could not replicate this issue with MPT 7B Chat - it would emit a <|im_end|> and then stop generating.

I attempted a fix here: #364

Thank you!

Screenshots

with Falcon

with LLaMA