Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

单模型拆分到多个硬件上部署的问题 #10598

Open
chenglopl opened this issue Nov 21, 2024 · 1 comment
Open

单模型拆分到多个硬件上部署的问题 #10598

chenglopl opened this issue Nov 21, 2024 · 1 comment

Comments

@chenglopl
Copy link

我看到框架提供的set_nnadapter_device_names接口可以为单模型设置多个设备，请问可以让单模型在一个系统下的多设备上运行吗？比如模型的前半部分在昆仑芯上运行，后半部分在昇腾上运行，教程里面只提到了CPU+NPU的异构，没有查到如何处理这种情况。
@zhupengyang
Copy link
Collaborator

目前不支持这种情况

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@chenglopl @zhupengyang