-
Notifications
You must be signed in to change notification settings - Fork 46
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
pip install build. error #10
Comments
Could you please provide the environment you use?From your information,the trust library is not installed correctly which is included in cuda. Also,we recommend using the dockerfile in the EET repository to build your project. |
@NetEase-FuXi @SidaZh env: |
@520jefferson Which version is nvcc or cuda?Do torch and transformers work properly? |
@520jefferson can you provide your dockerfile, we will try to figure out what goes wrong |
yes, i can train the roberta with transofrmers and torch. nvcc: NVIDIA (R) Cuda compiler driver |
there is no docker file. i will try docker later. |
Thanks for the feedback, if you have any questions, contact with us. |
env:
gcc (Ubuntu 9.4.0-1ubuntu1~20.04.1) 9.4.0
python 3.8.10
torch 2.0.1+cu117
pip install .
Looking in indexes: https://pypi.tuna.tsinghua.edu.cn/simple, https://pypi.ngc.nvidia.com
Processing /home/classifier/data_test/EET
Preparing metadata (setup.py) ... done
Building wheels for collected packages: EET
Building wheel for EET (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [900 lines of output]
/home/py38_textcnn/lib/python3.8/site-packages/setuptools/dist.py:509: InformationOnly: Normalizing 'v1.0' to '1.0'
self.metadata.version = self.normalize_version(
running bdist_wheel
running build
running build_py
creating build
creating build/lib.linux-x86_64-cpython-38
creating build/lib.linux-x86_64-cpython-38/eet
copying python/eet/init.py -> build/lib.linux-x86_64-cpython-38/eet
creating build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/generation.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/zero_shot_image_classification.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/text_generation.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/image_classification.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/init.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/text_classification.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/fill_mask.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/question_answering.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/base.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/model_auto.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
copying python/eet/pipelines/token_classification.py -> build/lib.linux-x86_64-cpython-38/eet/pipelines
creating build/lib.linux-x86_64-cpython-38/eet/fairseq
copying python/eet/fairseq/init.py -> build/lib.linux-x86_64-cpython-38/eet/fairseq
copying python/eet/fairseq/transformer.py -> build/lib.linux-x86_64-cpython-38/eet/fairseq
copying python/eet/fairseq/config.py -> build/lib.linux-x86_64-cpython-38/eet/fairseq
creating build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_vit.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_ernie.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_clip.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/init.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_gpt2.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/encoder_decoder.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_bart.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_albert.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_roberta.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_bert.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_t5.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
copying python/eet/transformers/modeling_distilbert.py -> build/lib.linux-x86_64-cpython-38/eet/transformers
creating build/lib.linux-x86_64-cpython-38/eet/utils
copying python/eet/utils/mapping.py -> build/lib.linux-x86_64-cpython-38/eet/utils
copying python/eet/utils/init.py -> build/lib.linux-x86_64-cpython-38/eet/utils
running build_ext
/home/py38_textcnn/lib/python3.8/site-packages/torch/utils/cpp_extension.py:398: UserWarning: There are no x86_64-linux-gnu-g++ version bounds defined for CUDA version 12.0
warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
building 'EET' extension
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc/core
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc/op
creating /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc/py11
Emitting ninja build file /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/build.ninja...
Compiling objects...
Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
[1/22] /usr/local/cuda-12/bin/nvcc -DVERSION_INFO=v1.0 -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/TH -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-12/include -I/home/classifier/data_test/EET/csrc -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/TH -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-12/include -I/home/py38_textcnn/include -I/usr/include/python3.8 -c -c /home/classifier/data_test/EET/csrc/core/pre_process.cu -o /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc/core/pre_process.o -D__CUDA_NO_HALF_OPERATORS_ -D__CUDA_NO_HALF_CONVERSIONS__ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="gcc"' '-DPYBIND11_STDLIB="libstdcpp"' '-DPYBIND11_BUILD_ABI="cxxabi1011"' -DTORCH_EXTENSION_NAME=EET -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++17
FAILED: /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc/core/pre_process.o
/usr/local/cuda-12/bin/nvcc -DVERSION_INFO=v1.0 -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/TH -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-12/include -I/home/classifier/data_test/EET/csrc -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/torch/csrc/api/include -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/TH -I/home/py38_textcnn/lib/python3.8/site-packages/torch/include/THC -I/usr/local/cuda-12/include -I/home/py38_textcnn/include -I/usr/include/python3.8 -c -c /home/classifier/data_test/EET/csrc/core/pre_process.cu -o /home/classifier/data_test/EET/build/temp.linux-x86_64-cpython-38/home/classifier/data_test/EET/csrc/core/pre_process.o -D__CUDA_NO_HALF_OPERATORS -D__CUDA_NO_HALF_CONVERSIONS_ -D__CUDA_NO_BFLOAT16_CONVERSIONS__ -D__CUDA_NO_HALF2_OPERATORS__ --expt-relaxed-constexpr --compiler-options ''"'"'-fPIC'"'"'' -U__CUDA_NO_HALF_OPERATORS__ -U__CUDA_NO_HALF_CONVERSIONS__ -U__CUDA_NO_HALF2_OPERATORS__ -DTORCH_API_INCLUDE_EXTENSION_H '-DPYBIND11_COMPILER_TYPE="_gcc"' '-DPYBIND11_STDLIB="_libstdcpp"' '-DPYBIND11_BUILD_ABI="_cxxabi1011"' -DTORCH_EXTENSION_NAME=EET -D_GLIBCXX_USE_CXX11_ABI=0 -gencode=arch=compute_60,code=sm_60 -gencode=arch=compute_61,code=sm_61 -gencode=arch=compute_62,code=sm_62 -gencode=arch=compute_70,code=sm_70 -gencode=arch=compute_75,code=sm_75 -std=c++17
/home/classifier/data_test/EET/csrc/core/pre_process.cu(28): error: namespace "thrust" has no member "device"
....
....
[-Wattributes]
/home/py38_textcnn/lib/python3.8/site-packages/torch/include/pybind11/pybind11.h: In instantiation of ‘class pybind11::class_eet::op::LayerNorm’:
/home/classifier/data_test/EET/csrc/py11/eet2py.cpp:98:50: required from here
/home/py38_textcnn/lib/python3.8/site-packages/torch/include/pybind11/pybind11.h:1479:7: warning: ‘pybind11::class_eet::op::LayerNorm’ declared with greater visibility than its base ‘pybind11::detail::generic_type’ [-Wattributes]
ninja: build stopped: subcommand failed.
Traceback (most recent call last):
File "/home/py38_textcnn/lib/python3.8/site-packages/torch/utils/cpp_extension.py", line 1893, in _run_ninja_build
subprocess.run(
File "/usr/lib/python3.8/subprocess.py", line 516, in run
raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for EET
Running setup.py clean for EET
Failed to build EET
ERROR: Could not build wheels for EET, which is required to install pyproject.toml-based projects
The text was updated successfully, but these errors were encountered: