Replies: 1 comment 3 replies
-
|
这个可以帮忙回答一下吗？ |
Beta Was this translation helpful? Give feedback.
3 replies
-
|
vllm目前应该是recompute的方法，swap到cpu上会很影响性能 |
Beta Was this translation helpful? Give feedback.
-
|
lmdeploy一直都是recompute |
Beta Was this translation helpful? Give feedback.
-
|
谢谢 |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
如果不是，请问可以去哪里看？源码指出位置也可以
Beta Was this translation helpful? Give feedback.
All reactions