Skip to content

Parallel prompts evaluation #3363

Answered by ggerganov
Xarbirus asked this question in Q&A
Sep 27, 2023 · 3 comments · 6 replies
Discussion options

You must be logged in to vote

There is a batched example available now for parallel decoding

Replies: 3 comments 6 replies

Comment options

You must be logged in to vote
5 replies
@Xarbirus
Comment options

@Xarbirus
Comment options

@ggerganov
Comment options

@ggerganov
Comment options

@Xarbirus
Comment options

Answer selected by Xarbirus
Comment options

You must be logged in to vote
0 replies
Comment options

You must be logged in to vote
1 reply
@Xarbirus
Comment options

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
4 participants