New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Is there a way to defines "bad_words"? #2700

Open

tonylek opened this issue Oct 28, 2024 · 1 comment

tonylek commented Oct 28, 2024

I want to define tokens that I don't to be ever generated by the model. Is there a simple way to do it using the API?

kozistr commented Oct 28, 2024

@tonylek maybe you might be interested in the logit_bias parameter, which seems not supported in TGI yet. (I might be wrong).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment