Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can not install by setup.py because /ld: cannot find -lcublas_static #14

Open
meicale opened this issue Jul 3, 2023 · 5 comments
Open

Comments

@meicale
Copy link

meicale commented Jul 3, 2023

Hi,
I think this repo is great and tried it using pre-baked docker image for nvidi, and after following the instructions in Readme.md, I got these errors.
/root/anaconda3/envs/int/bin/../lib/gcc/x86_64-conda-linux-gnu/9.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -lcublas_static
/root/anaconda3/envs/int/bin/../lib/gcc/x86_64-conda-linux-gnu/9.3.0/../../../../x86_64-conda-linux-gnu/bin/ld: cannot find -lcublasLt_static

I guess maybe the cublass location is different, but I can not figure out how to make it right. Would you mind helping me out? Thx!

I also can not find cublasLt_static or cublas_static by using find. The results were:
(int) root@bafd706ba0bf:/workspace/torch-int# find / -name "cublasLt" -print
/root/anaconda3/lib/python3.10/site-packages/torch/lib/libcublasLt.so.11
/root/anaconda3/envs/int/lib/python3.8/site-packages/torch/lib/libcublasLt.so.11
/usr/local/cuda-11.3/targets/x86_64-linux/lib/stubs/libcublasLt.so
/usr/local/cuda-11.3/targets/x86_64-linux/lib/libcublasLt.so
/usr/local/cuda-11.3/targets/x86_64-linux/lib/libcublasLt.so.11
/usr/local/cuda-11.3/targets/x86_64-linux/lib/libcublasLt.so.11.5.1.109
/usr/local/cuda-11.3/targets/x86_64-linux/include/cublasLt.h

BTW, if I link cublas without static it can finish the compilation. But is will fail the test on readme. python tests/test_linear_modules.py

@yunzhongOvO
Copy link

I met the same problem as you, does it fixed?

@FurryMushroom
Copy link

The same problem. Have you dear friends fixed, it's already October now

@FurryMushroom
Copy link

Friends I've successfully finished the compilation and test. I just modified the lib names in setup.py, removing _static suffix. You can have a look at my page for more details.

@Hukongtao
Copy link

Friends I've successfully finished the compilation and test. I just modified the lib names in setup.py, removing _static suffix. You can have a look at my page for more details.

I use your torch-int,and still got an error:
image

@FurryMushroom
Copy link

Friends I've successfully finished the compilation and test. I just modified the lib names in setup.py, removing _static suffix. You can have a look at my page for more details.

I use your torch-int,and still got an error: image

Please refer to Quantization work of DesignOrder, experiments on smoothquant

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants