Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Failure to build netcdf fortran 4.6.0 w/ netcdf-c 4.9.2 on Centos 7 #406

Open
HathewayWill opened this issue Jul 25, 2023 · 14 comments
Open

Failure to build netcdf fortran 4.6.0 w/ netcdf-c 4.9.2 on Centos 7 #406

HathewayWill opened this issue Jul 25, 2023 · 14 comments
Assignees
@WardF
Milestone
4.6.2

Comments

@HathewayWill
Copy link

@edhartnett

  • environmental information (i.e. Operating System, compiler info, java version, python version, etc.)

Environment:

Centos 7 - VM
Libraries:L
zlib - 1.2.13
hdf5 - 1.14.1.2
netcdf-c - 4.9.0 (pass) 4.9.2 (fail)
netcdf-fortran - 4.6.0
libpng - 1.6.39
mpich - 4.1.2
jasper - 1.900.1
pnetcdf - 1.12.3

  • a description of the issue with the steps needed to reproduce it

see test scripts and log files attached in zip folder:

Errors.zip
@WardF
Copy link
Member

WardF commented Jul 26, 2023

Thanks for providing the error logs! From the failed log, I see the following:

opt/rh/devtoolset-11/root/usr/libexec/gcc/x86_64-redhat-linux/11/ld: /home/workhorse/WRF_SFIRE/Libs/NETCDF/lib/libnetcdf.a(libnchdf5_la-nc4hdf.o): warning: relocation against `H5T_STD_U16LE_g' in read-only section `.text'
/opt/rh/devtoolset-11/root/usr/libexec/gcc/x86_64-redhat-linux/11/ld: /home/workhorse/WRF_SFIRE/Libs/NETCDF/lib/libnetcdf.a(libdispatch_la-dinstance.o): relocation R_X86_64_PC32 against symbol `stderr@@GLIBC_2.2.5' can not be used when making a shared object; recompile with -fPIC
/opt/rh/devtoolset-11/root/usr/libexec/gcc/x86_64-redhat-linux/11/ld: final link failed: bad value

Long story short, you'll need to reinstall libnetcdf (netcdf-c); when you do so, specify CFLAGS='-fPIC' (in addition to any other CFLAGS you're setting). It appears that you're setting that when configuring netCDF-fortran. Can you see what happens if you recompile libnetcdf with CFLAGS=-fPIC, or let me know that you're already doing so?

@WardF WardF self-assigned this Jul 26, 2023
@WardF WardF added this to the 4.6.2 milestone Jul 26, 2023
@HathewayWill
Copy link
Author

HathewayWill commented Jul 26, 2023 via email

@HathewayWill
Copy link
Author

@WardF

The shell script attached in the zip files should show the exact steps I took for recreation.

@HathewayWill
Copy link
Author

@WardF

So for some reason CFLAGS is either getting removed or over written from autotools maybe?

@WardF
Copy link
Member

WardF commented Aug 15, 2023

@HathewayWill I'm revisiting this and the shell scripts you've provided; I am not immediately certain why CFLAGS is being removed. How are you invoking the script, simply running it from the command line vis-a-vis:

$ ./netcdf-4.9.2.sh

Or is it being invoked some other way?

@HathewayWill
Copy link
Author

@WardF being built from source tar file.

@HathewayWill
Copy link
Author

@WardF @edwardhartnett

This issue also occurs on any ubuntu system less than 22.04.2

Something about netcdf 4.9.1 & 4.9.2 w/ 4.6.1 causes the CFLAGS to be removed.

@WardF
Copy link
Member

WardF commented Dec 14, 2023

That is interesting; CFLAGS is an environmental variable, and I'm unable to replicate the issue where the CFLAGS just disappear. When you invoke the script, are you running it directly, are you running it via sudo or su?

@HathewayWill
Copy link
Author

That is interesting; CFLAGS is an environmental variable, and I'm unable to replicate the issue where the CFLAGS just disappear. When you invoke the script, are you running it directly, are you running it via sudo or su?

Let me send a file with the installation. @WardF

netcdf_error.zip

this is for ubuntu 20, works fine on ubuntu 22

@HathewayWill
Copy link
Author

@WardF

Just wanted to give you an update. I tested netcdf 4.9.0, 4.9.1, 4.9.2 with netcdf fortrtan 4.6.1

and the only one that works is 4.9.0 with 4.6.1. So the error seems to be with netcdf-c.

Tested on these operating systems: MacOS 13, Centos9, Centos7, Ubuntu22, Ubuntu20

@WardF
Copy link
Member

WardF commented Jan 5, 2024

@WardF

Just wanted to give you an update. I tested netcdf 4.9.0, 4.9.1, 4.9.2 with netcdf fortrtan 4.6.1

and the only one that works is 4.9.0 with 4.6.1. So the error seems to be with netcdf-c.

Tested on these operating systems: MacOS 13, Centos9, Centos7, Ubuntu22, Ubuntu20

Running the script you provided on a Ubuntu 23.10 machine, I'm seeing a failure although it is unrelated to any changes in CFLAGS; rather, it looks like there is a problem in how the script is trying to build libnetcdf. Investigating, and will follow up; I've added a -e invocation before the compilation step in the script, so that an error will cause the script to stop running.

@HathewayWill
Copy link
Author

HathewayWill commented Jan 5, 2024 via email

@WardF
Copy link
Member

WardF commented Jan 5, 2024

Take care of yourself, I will keep working on this; I am travelling but have put a pin on this so we can get it sorted out. I'm finding an error in the script provided in which configure for libhdf5 fails, reporting a failure related to -m64 for gfortran. libhdf5 is not generated, which means libnetcdf is not generated, which means netCDF-Fortran will not build. Peculiar. I will stand up an older VM to see if the behavior changes, or if this is something on the latest Ubuntu and not related to the initial issue.

@HathewayWill
Copy link
Author

@WardF

What did you need again? I just got back

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@WardF WardF

Labels
None yet
Projects
None yet
Milestone
4.6.2
Development

No branches or pull requests
2 participants
@WardF @HathewayWill