A100 40G显卡上推理缓慢
#976
Replies: 1 comment
-
|
更新master分支的最新代码，改了框架，可以看一下更新后的readme，运行效率有明显提升 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
A100的显卡，调用的模型是chatglm2-6b，目前推理很慢，有什么方式可以改进吗？
Beta Was this translation helpful? Give feedback.
All reactions