Using A_s instead of sigma8 in a 3x2pt forecast is generating invalid values in CCL boltzmann.py when performing derivative calculations

[bruno-moraes]

TL;DR: A call to boltzmann.py within CCL is failing in the derivative calculation, presumably due to O(10^-9) values in A_s.

Explanation: When attempting a 3x2pt forecast, it runs and completes when the sigma8 parameter is used. If A_s is used instead, the Jupyter kernel dies after a few seconds when trying to calculate the Fisher matrix. Running the code as a python script from the command line, the error returned is:

(forecasting) brunomor@Brunos-MacBook-Pro-2 forecasts_neutrinos_workshop2024 % time python 2024-07-02_neutrino_3x2pt_SRD.py 
forecasting_strawberry_run.sacc
/Users/brunomor/miniforge3/envs/forecasting/lib/python3.12/site-packages/pyccl/boltzmann.py:170: RuntimeWarning: invalid value encountered in log
  ln_p_k_and_z[i, :] = np.log(pk[sind, :])
zsh: abort      python 2024-07-02_neutrino_3x2pt_SRD.py

The trace did not contain information about where this error occurred, so I ran pdb on the script (my first time, so not very skillfully) and found the spot where it is breaking:

> /Users/brunomor/lib/python/augur/augur/analyze.py(191)get_fisher_matrix()
-> if self.derivatives is None:
(Pdb) n
> /Users/brunomor/lib/python/augur/augur/analyze.py(192)get_fisher_matrix()
-> self.get_derivatives(method=method)
(Pdb) n
/Users/brunomor/miniforge3/envs/forecasting/lib/python3.12/site-packages/pyccl/boltzmann.py:170: RuntimeWarning: invalid value encountered in log ln_p_k_and_z[i, :] = np.log(pk[sind, :])
zsh: abort      python 2024-07-02_neutrino_3x2pt_SRD.py

[bruno-moraes]

I will work on this now.

[bruno-moraes]

@fjaviersanchez , I could pinpoint more or less where the error is, but this is something I never fixed before. I assume it's numerical instabilities in the derivatives due to the small values of A_s compared to the other parameters. I won't be able to solve it now.

[fjaviersanchez]

Thank you for checking and identifying the issue! I think this can be potentially solved when we add the stem derivative method. One potential solution is to normalize all parameters internally for the derivatives and then change back or change the step size dynamically, but will check first if the easy fix works.

[fjaviersanchez]

I included a way to normalize the parameters if you pass parameter bounds in the input configuration file (à la cosmosis) in #68. If you want to take a look at the latest master branch and retry. You will need to modify the test.yaml file changing var_pars to a parameters section that might look like:

fisher:
    # var_pars: ['Omega_c', 'sigma8', 'n_s', 'w0', 'wa', 'Omega_b', 'h', 'ia_bias', 'lens0_mag_bias', 'lens1_mag_bias', 'lens2_mag_bias', 'lens3_mag_bias', 'lens4_mag_bias', 'lens0_bias', 'lens1_bias', 'lens2_bias', 'lens3_bias', 'lens4_bias', 'src0_delta_z', 'src1_delta_z', 'src2_delta_z', 'src3_delta_z', 'src4_delta_z', 'lens0_delta_z', 'lens1_delta_z', 'lens2_delta_z', 'lens3_delta_z', 'lens4_delta_z']
    parameters:  # TODO: For now priors are ignored
         Omega_c: [0.06, 0.2664315, 0.46]
         sigma8: [0.03, 0.831, 1.2]
         n_s: [0.85, 0.9645, 1.10]
         w0: [-3.0, -1.0, -0.33]
         wa: [-3.0, 0.0, 3.0]
         Omega_b: [0.03, 0.0491685, 0.07]
         h: [0.5, 0.6727, 0.8]
        #  ia_bias: [-5.0, 1.0, 5.0]
        #  lens0_mag_bias: [-10, 0, 10]
        #  lens1_mag_bias: [-10, 0, 10]
        #  lens2_mag_bias: [-10, 0, 10]
        #  lens3_mag_bias: [-10, 0, 10]
        #  lens4_mag_bias: [-10, 0, 10]
        #  lens0_bias: [0.8, 1.23885511, 2.5]
        #  lens1_bias: [0.8, 1.3781005, 2.5]
        #  lens2_bias: [0.8, 1.52472019, 2.5]
        #  lens3_bias: [0.8, 1.67665752, 2.5]
        #  lens4_bias: [0.8, 1.83243479, 2.5]
        #  src0_delta_z: [-10, 0, 10]
        #  src1_delta_z: [-10, 0, 10]
        #  src2_delta_z: [-10, 0, 10]
        #  src3_delta_z: [-10, 0, 10]
        #  src4_delta_z: [-10, 0, 10]
        #  lens0_delta_z: [-10, 0, 10]
        #  lens1_delta_z: [-10, 0, 10]
        #  lens2_delta_z: [-10, 0, 10]
        #  lens3_delta_z: [-10, 0, 10]
        #  lens4_delta_z: [-10, 0, 10]