Skip to content

[Question] Gemma-2 sliding window support? #1017

Closed Answered by Ying1123
joonkeekim asked this question in Q&A
Discussion options

You must be logged in to vote

Hi @joonkeekim, thanks for your interest! The support of window attention for gemma-2 is under review, see #1056. It is expected to be merged tomorrow.

Replies: 1 comment 1 reply

Comment options

You must be logged in to vote
1 reply
@joonkeekim
Comment options

Answer selected by joonkeekim
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants
Converted from issue

This discussion was converted from issue #1016 on August 10, 2024 09:32.