关于MoE模型的参数配置问题 #2704
Unanswered
sitabulaixizawaluduo
asked this question in
Q&A
关于MoE模型的参数配置问题
#2704
Replies: 1 comment
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
我想跑一下自己微调的MoE模型，但是看到LmDeploy限制export per token最大为2，这个限制是出于什么目的呢？是因为kernel的性能还是说精度。谢谢
Beta Was this translation helpful? Give feedback.
All reactions