peft provides the position of the model input? #1570
Unanswered
ciaoyizhen
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
I went to the official repository of the ChatGLM fine-tuning code, and I asked them why position was not provided for the model. Their reply was that peft provided position, so it is no longer needed. Then I saw the following code in peft's code
It seems that it will process the position, but I looked at the code and didn't understand how it generated the position and provided it to the model.
Help, thank you
Beta Was this translation helpful? Give feedback.
All reactions