Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Se era5 v2 pp #15

Open
wants to merge 34 commits into
base: master
Choose a base branch
from
Open

Se era5 v2 pp #15

wants to merge 34 commits into from

Conversation

SabineEmbacher
Copy link
Collaborator

Updates from version 1.5.8 to 1.6.0

  • The VariableCache now uses an LRU cache with a listener to automatically free the oldest cached, no longer
    needed variables and file handles when the maximum cache size is reached.* fix wrong corner point order of
    era5 interpolation in SatelliteFields
  • Instead, the four era5 interpolation vertices are read directly from the variable
  • Remove reading of subset from entire era5 variable array and remove to read the entire era5 variable in VariableCache
  • Remove creation of rectangles for InterpolationContext and remove field era5Region in InterpolationContext
  • era5 post processing .. can now also handle satellite longitude data which not fits the range [-180 to 180].
    In such cases (e.g. Windsat-Coriolis [0 to 360]), longitude data will be converted so that it fits into the
    required range of [-180 to 180] to be able to create correct interpolation of era5 data.
  • era5 post processing .. In era5-post-processing-general-info.xml a fill value per
    variable can be defined.
  • era5 post processing .. can now load generalized information from an optional
    era5-post-processing-general-info.xml in the config directory.
    A general info file can contain variable definition for satellite-fields.
  • Upgrade Mockito to version 4.11.0 and also include artifact mockito-inline for static mocking
  • era5 post processing .. setter and getter of variable names in class SatelliteFieldsConfiguration was
    generalized. E.g. config.set_an_ml_q_name("abcde") was replaced by config.setVarName("an_ml_q", "abcde")
  • era5 post processing .. "length" attribute of tag <z_dim name='up' length='???' />" is no
    longer optional.
  • era5 post processing .. The translation of variable name to variable name for file access has been made
    switchable.
  • post processing .. added PostProcessingContext to method PostProcessingPlugin.createPostProcessing(...).
    Now plugins can perform extended initializations. E.g. by loading extra files from config directory.
  • post processing .. the config directory has been added to the PostProcessingContext so that plugins can load
    additional generalized information required for the plugin from this directory.

SabineEmbacher and others added 28 commits February 26, 2024 11:03
…ll value per variable can be defined.

era5 post processing .. can now load generalized information from an optional era5-post-processing-general-info.xml in the config directory. A general info file can contain variable definition for satellite-fields.
Upgrade Mockito to version 4.11.0 and also include artifact mockito-inline for static mocking
era5 post processing .. setter and getter of variable names in class SatelliteFieldsConfiguration was generalized. E.g. config.set_an_ml_q_name("abcde") was replaced by config.setVarName("an_ml_q", "abcde")
era5 post processing .. "length" attribute of tag <satellite-fields><z_dim name='up' length='???' />" is no longer optional.
era5 post processing .. The translation of variable name to variable name for file access has been made switchable.
post processing .. added PostProcessingContext to method PostProcessingPlugin.createPostProcessing(...). Now plugins can perform extended initializations. E.g. by loading extra files from config directory.
post processing .. the config directory has been added to the PostProcessingContext so that plugins can load additional generalized information required for the plugin from this directory.
… [-180 to 180].

In such cases (e.g. Windsat-Coriolis [0 to 360]), longitude data will be converted so that it fits into the
required range of [-180 to 180] to be able to create correct interpolation of era5 data.
…ld era5Region in InterpolationContext

Remove reading of subset from entire era5 variable array and remove to read the entire era5 variable in VariableCache
Instead read the four era5 interpolation corner ponts directly from variable
The VariableCache now uses an LRU cache with a listener to automatically free the oldest cached, no longer needed variables and file handles when the maximum cache size is reached.
…ll value per variable can be defined.

era5 post processing .. can now load generalized information from an optional era5-post-processing-general-info.xml in the config directory. A general info file can contain variable definition for satellite-fields.
Upgrade Mockito to version 4.11.0 and also include artifact mockito-inline for static mocking
era5 post processing .. setter and getter of variable names in class SatelliteFieldsConfiguration was generalized. E.g. config.set_an_ml_q_name("abcde") was replaced by config.setVarName("an_ml_q", "abcde")
era5 post processing .. "length" attribute of tag <satellite-fields><z_dim name='up' length='???' />" is no longer optional.
era5 post processing .. The translation of variable name to variable name for file access has been made switchable.
post processing .. added PostProcessingContext to method PostProcessingPlugin.createPostProcessing(...). Now plugins can perform extended initializations. E.g. by loading extra files from config directory.
post processing .. the config directory has been added to the PostProcessingContext so that plugins can load additional generalized information required for the plugin from this directory.
… [-180 to 180].

In such cases (e.g. Windsat-Coriolis [0 to 360]), longitude data will be converted so that it fits into the
required range of [-180 to 180] to be able to create correct interpolation of era5 data.
…ld era5Region in InterpolationContext

Remove reading of subset from entire era5 variable array and remove to read the entire era5 variable in VariableCache
Instead read the four era5 interpolation corner ponts directly from variable
The VariableCache now uses an LRU cache with a listener to automatically free the oldest cached, no longer needed variables and file handles when the maximum cache size is reached.
# Conflicts:
#	post-processing-tool/src/main/java/com/bc/fiduceo/post/plugin/era5/MatchupFields.java
#	post-processing-tool/src/main/java/com/bc/fiduceo/post/plugin/era5/SatelliteFields.java
#	post-processing-tool/src/test/java/com/bc/fiduceo/post/plugin/era5/InterpolationContextTest.java
…plugin

solution convert longitude values to match the range -180 .. 180
…plugin

solution convert longitude values to match the range -180 .. 180
NaN, negativ Unendlich und positiv unendlich werden nun auch berücksichtigt.
…plugin

solution convert longitude values to match the range -180 .. 180
NaN, negative infinity and positive infinity are now also taken into account.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants