New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问如何将所有的model都导出到一个 onnx 中。 #5

Open

QingshuiL opened this issue Nov 7, 2024 · 0 comments

QingshuiL commented Nov 7, 2024

我尝试调用 llm_exporter.export() 接口，遇到了 issues#3 同样的问题。
然后我添加如下代码：

self.image_start_id = self.config.im_start_token
self.blocks = torch.nn.ModuleList(self.blocks)

遇到了如下问题：

ValueError: Attention weights should be of size (tensor(1), 16, tensor(3), tensor(19)), but is torch.Size([1, 16, 3, 3])

请问是否有办法修复这个问题？ @BaofengZan

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment