-
Notifications
You must be signed in to change notification settings - Fork 50
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
编译SwiftTransformer失败 #37
Comments
is it version problem? |
Have you added the |
i have added --gpus all |
what's the GPU type in the system? |
maybe you can execute |
执行命令:
git clone https://github.com/LLMServe/SwiftTransformer.git cd SwiftTransformergit;submodule update --init --recursive;cmake -B build;cmake --build build -j$(nproc)
报错原因:
(截取部分具有代表性的错误)
/workspace/DistServe/SwiftTransformer/src/unittest/util/../unittest_utils.h:93:45: error: call of overloaded ‘fabs(__half)’ is ambiguous
93 | fabs(answer[i]-reference[i]), fabs(answer[i]-reference[i])/fabs(reference[i]));
| ~~~~^~~~~~~~~~~~~~~~~~~~~~~~
/workspace/DistServe/SwiftTransformer/src/unittest/util/../unittest_utils.h:93:75: error: call of overloaded ‘fabs(__half)’ is ambiguous
93 | fabs(answer[i]-reference[i]), fabs(answer[i]-reference[i])/fabs(reference[i]));
| ~~~~^~~~~~~~~~~~~~~~~~~~~~~~
/workspace/DistServe/SwiftTransformer/src/csrc/kernel/fused_context_stage_attention.cu(145): error: name followed by "::" must be a class or namespace name
wmma::fragment<wmma::matrix_a, 16ul, 16ul, 16ul, __half, wmma::row_major> a_frag;
^
/workspace/DistServe/SwiftTransformer/src/csrc/kernel/fused_context_stage_attention.cu(146): error: type name is not allowed
wmma::fragment<wmma::matrix_b, 16ul, 16ul, 16ul, __half, wmma::col_major> b_frag;
^
/workspace/DistServe/SwiftTransformer/src/csrc/kernel/fused_context_stage_attention.cu(146): error: identifier "b_frag" is undefined
wmma::fragment<wmma::matrix_b, 16ul, 16ul, 16ul, __half, wmma::col_major> b_frag;
^
编译环境
nvcr.io/nvidia/pytorch/23.10-py3镜像
CXX compiler: GNU 11.4.0
CUDA: NVIDIA 12.2.140
CUDAToolkit: 12.2.140
NCCL: libnccl.so.2.19.3
MPI: 3.1
The text was updated successfully, but these errors were encountered: