New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

关于FT inference benchmark数据的疑问 #200

Open

frankxyy opened this issue Jul 17, 2023 · 0 comments

frankxyy commented Jul 17, 2023

上图里, Encoder指的是？我理解应该是decode-only模型吧。。这里的意思是第一个token的预测吗

还有个问题是, 这里的sequence_length指的是input_len吗？实验测试的output_len是多少呢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment