Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add ESMF weights for tripole->rectilinear post #1992

Closed
1 of 4 tasks
DeniseWorthen opened this issue Oct 27, 2023 · 12 comments
Closed
1 of 4 tasks

add ESMF weights for tripole->rectilinear post #1992

DeniseWorthen opened this issue Oct 27, 2023 · 12 comments
Assignees
@WalterKolczynski-NOAA @KateFriedman-NOAA
Labels
Static Data Mgmt Update of static data (fix, ICs, etc.)

Comments

@DeniseWorthen
Copy link

Target fix directory

mom6

Type of change

  • Update existing files
  • Remove files
  • Add new files to existing directory
  • Add new fix directory

Any workflow changes needed?

No change needed

Related issues

In NOAA-EMC/gfs-utils#25, fortran code was added to replicate the functionality of the previous NCL scripts to remap ocean and ice tripole grid output to a set of known rectilinear grids. This code relies on a set of ESMF weights generated by the cpld_gridgen utility in UFS_UTILS. These files now reside in the UFS-UTILS regression test directory on Hera,Jet,Orion and WCOSS2.

Currently there is a post subdirectory within the mom6 fix files (ie, global/glopara/fix/mom6/20220805/post) where the new weights files should be added.

All weights files have source resolution and destination resolution specified in the file name, so all files can be placed in the single directory. The required files from the pickup location listed below are all those found with ls *.41f7ca9/tripole*to*

025.41f7ca9/tripole.mx025.Bu.to.Ct.bilinear.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.0p25.bilinear.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.0p25.conserve.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.0p5.bilinear.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.0p5.conserve.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.1p0.bilinear.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.1p0.conserve.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.5p0.bilinear.nc
025.41f7ca9/tripole.mx025.Ct.to.rect.5p0.conserve.nc
025.41f7ca9/tripole.mx025.Cu.to.Ct.bilinear.nc
025.41f7ca9/tripole.mx025.Cv.to.Ct.bilinear.nc
050.41f7ca9/tripole.mx025.Ct.to.mx050.Ct.neareststod.nc
050.41f7ca9/tripole.mx050.Bu.to.Ct.bilinear.nc
050.41f7ca9/tripole.mx050.Ct.to.rect.0p5.bilinear.nc
050.41f7ca9/tripole.mx050.Ct.to.rect.0p5.conserve.nc
050.41f7ca9/tripole.mx050.Ct.to.rect.1p0.bilinear.nc
050.41f7ca9/tripole.mx050.Ct.to.rect.1p0.conserve.nc
050.41f7ca9/tripole.mx050.Ct.to.rect.5p0.bilinear.nc
050.41f7ca9/tripole.mx050.Ct.to.rect.5p0.conserve.nc
050.41f7ca9/tripole.mx050.Cu.to.Ct.bilinear.nc
050.41f7ca9/tripole.mx050.Cv.to.Ct.bilinear.nc
100.41f7ca9/tripole.mx025.Ct.to.mx100.Ct.neareststod.nc
100.41f7ca9/tripole.mx100.Bu.to.Ct.bilinear.nc
100.41f7ca9/tripole.mx100.Ct.to.rect.1p0.bilinear.nc
100.41f7ca9/tripole.mx100.Ct.to.rect.1p0.conserve.nc
100.41f7ca9/tripole.mx100.Ct.to.rect.5p0.bilinear.nc
100.41f7ca9/tripole.mx100.Ct.to.rect.5p0.conserve.nc
100.41f7ca9/tripole.mx100.Cu.to.Ct.bilinear.nc
100.41f7ca9/tripole.mx100.Cv.to.Ct.bilinear.nc
500.41f7ca9/tripole.mx025.Ct.to.mx500.Ct.neareststod.nc
500.41f7ca9/tripole.mx500.Bu.to.Ct.bilinear.nc
500.41f7ca9/tripole.mx500.Ct.to.rect.5p0.bilinear.nc
500.41f7ca9/tripole.mx500.Ct.to.rect.5p0.conserve.nc
500.41f7ca9/tripole.mx500.Cu.to.Ct.bilinear.nc
500.41f7ca9/tripole.mx500.Cv.to.Ct.bilinear.nc

Pickup location

/scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/cpld_gridgen/baseline_data

Size

4200 MB
@DeniseWorthen DeniseWorthen added Static Data Mgmt Update of static data (fix, ICs, etc.) triage Issues that are triage labels Oct 27, 2023
@DeniseWorthen DeniseWorthen mentioned this issue Oct 27, 2023
Merged
@KateFriedman-NOAA KateFriedman-NOAA removed the triage Issues that are triage label Oct 27, 2023
@KateFriedman-NOAA
Copy link
Member

@DeniseWorthen I did a rsync with -L to pull through the symlinks so that, for example, the 025.41f7ca9 folder becomes the 025 folder in the primary fix set. See rsync below. Let me know if this looks correct on Hera now (/scratch1/NCEPDEV/global/glopara/fix/mom6/20220805/post). If so, I will sync this to the other platforms to complete this request/issue. Thanks!

[role.glopara@hfe08 post]$ pwd
/scratch1/NCEPDEV/global/glopara/fix/mom6/20220805/post
[role.glopara@hfe08 post]$ ll
total 198128
-rw-r--r-- 1 role.glopara global    17877 May 15  2020 Vertical_coordinate.nc
-rw-r--r-- 1 role.glopara global  6235132 May 15  2020 bgvar_min.nc
-rw-r--r-- 1 role.glopara global  2608950 May 15  2020 coast_dist.nc
-rw-r--r-- 1 role.glopara global 38726866 May 15  2020 ocean_geometry.nc
-rw-r--r-- 1 role.glopara global 29764861 May 15  2020 remap.grid_t.025deg.bil.nc
-rw-r--r-- 1 role.glopara global 33720282 May 15  2020 remap.grid_t.025deg.con.nc
-rw-r--r-- 1 role.glopara global 18765043 May 15  2020 remap.grid_t.05deg.bil.nc
-rw-r--r-- 1 role.glopara global 28346251 May 15  2020 remap.grid_t.05deg.con.nc
-rw-r--r-- 1 role.glopara global 17602036 May 15  2020 remap.grid_t.1deg.bil.nc
-rw-r--r-- 1 role.glopara global 26127442 May 15  2020 remap.grid_t.1deg.con.nc
-rw-r--r-- 1 role.glopara global   947346 May 15  2020 remap.grid_t.angle.nc
[role.glopara@hfe08 post]$ rsync -azvL /scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/cpld_gridgen/baseline_data/025 .
sending incremental file list
025/
025/Bu.mx025_SCRIP.nc
025/C384.mx025.tile1.nc
025/C384.mx025.tile2.nc
025/C384.mx025.tile3.nc
025/C384.mx025.tile4.nc
025/C384.mx025.tile5.nc
025/C384.mx025.tile6.nc
025/Ct.mx025.to.C384.nc
025/Ct.mx025_SCRIP.nc
025/Ct.mx025_SCRIP_land.nc
025/Cu.mx025_SCRIP.nc
025/Cv.mx025_SCRIP.nc
025/grid_cice_NEMS_mx025.nc
025/kmtu_cice_NEMS_mx025.nc
025/mesh.mx025.nc
025/rect.0p25_SCRIP.nc
025/rect.0p5_SCRIP.nc
025/rect.1p0_SCRIP.nc
025/rect.5p0_SCRIP.nc
025/tripole.mx025.Bu.to.Ct.bilinear.nc
025/tripole.mx025.Ct.to.rect.0p25.bilinear.nc
025/tripole.mx025.Ct.to.rect.0p25.conserve.nc
025/tripole.mx025.Ct.to.rect.0p5.bilinear.nc
025/tripole.mx025.Ct.to.rect.0p5.conserve.nc
025/tripole.mx025.Ct.to.rect.1p0.bilinear.nc
025/tripole.mx025.Ct.to.rect.1p0.conserve.nc
025/tripole.mx025.Ct.to.rect.5p0.bilinear.nc
025/tripole.mx025.Ct.to.rect.5p0.conserve.nc
025/tripole.mx025.Cu.to.Ct.bilinear.nc
025/tripole.mx025.Cv.to.Ct.bilinear.nc
025/tripole.mx025.nc

sent 716,832,642 bytes  received 609 bytes  6,100,708.52 bytes/sec
total size is 4,812,175,700  speedup is 6.71
[role.glopara@hfe08 post]$ rsync -azvL /scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/cpld_gridgen/baseline_data/050 .
sending incremental file list
050/
050/Bu.mx050_SCRIP.nc
050/C192.mx050.tile1.nc
050/C192.mx050.tile2.nc
050/C192.mx050.tile3.nc
050/C192.mx050.tile4.nc
050/C192.mx050.tile5.nc
050/C192.mx050.tile6.nc
050/Ct.mx025_SCRIP.nc
050/Ct.mx050.to.C192.nc
050/Ct.mx050_SCRIP.nc
050/Ct.mx050_SCRIP_land.nc
050/Cu.mx050_SCRIP.nc
050/Cv.mx050_SCRIP.nc
050/grid_cice_NEMS_mx050.nc
050/kmtu_cice_NEMS_mx050.nc
050/mesh.mx050.nc
050/rect.0p5_SCRIP.nc
050/rect.1p0_SCRIP.nc
050/rect.5p0_SCRIP.nc
050/tripole.mx025.Ct.to.mx050.Ct.neareststod.nc
050/tripole.mx050.Bu.to.Ct.bilinear.nc
050/tripole.mx050.Ct.to.rect.0p5.bilinear.nc
050/tripole.mx050.Ct.to.rect.0p5.conserve.nc
050/tripole.mx050.Ct.to.rect.1p0.bilinear.nc
050/tripole.mx050.Ct.to.rect.1p0.conserve.nc
050/tripole.mx050.Ct.to.rect.5p0.bilinear.nc
050/tripole.mx050.Ct.to.rect.5p0.conserve.nc
050/tripole.mx050.Cu.to.Ct.bilinear.nc
050/tripole.mx050.Cv.to.Ct.bilinear.nc
050/tripole.mx050.nc

sent 174,899,849 bytes  received 590 bytes  4,926,772.93 bytes/sec
total size is 1,510,064,620  speedup is 8.63
[role.glopara@hfe08 post]$ rsync -azvL /scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/cpld_gridgen/baseline_data/100 .
sending incremental file list
100/
100/Bu.mx100_SCRIP.nc
100/C96.mx100.tile1.nc
100/C96.mx100.tile2.nc
100/C96.mx100.tile3.nc
100/C96.mx100.tile4.nc
100/C96.mx100.tile5.nc
100/C96.mx100.tile6.nc
100/Ct.mx025_SCRIP.nc
100/Ct.mx100.to.C96.nc
100/Ct.mx100_SCRIP.nc
100/Ct.mx100_SCRIP_land.nc
100/Cu.mx100_SCRIP.nc
100/Cv.mx100_SCRIP.nc
100/grid_cice_NEMS_mx100.nc
100/kmtu_cice_NEMS_mx100.nc
100/mesh.mx100.nc
100/rect.1p0_SCRIP.nc
100/rect.5p0_SCRIP.nc
100/tripole.mx025.Ct.to.mx100.Ct.neareststod.nc
100/tripole.mx100.Bu.to.Ct.bilinear.nc
100/tripole.mx100.Ct.to.rect.1p0.bilinear.nc
100/tripole.mx100.Ct.to.rect.1p0.conserve.nc
100/tripole.mx100.Ct.to.rect.5p0.bilinear.nc
100/tripole.mx100.Ct.to.rect.5p0.conserve.nc
100/tripole.mx100.Cu.to.Ct.bilinear.nc
100/tripole.mx100.Cv.to.Ct.bilinear.nc
100/tripole.mx100.nc
100/ufs.topo_edits_011818.nc

sent 70,594,546 bytes  received 552 bytes  5,229,266.52 bytes/sec
total size is 591,417,522  speedup is 8.38
[role.glopara@hfe08 post]$ rsync -azvL /scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/cpld_gridgen/baseline_data/500 .
sending incremental file list
500/
500/Bu.mx500_SCRIP.nc
500/C48.mx500.tile1.nc
500/C48.mx500.tile2.nc
500/C48.mx500.tile3.nc
500/C48.mx500.tile4.nc
500/C48.mx500.tile5.nc
500/C48.mx500.tile6.nc
500/Ct.mx025_SCRIP.nc
500/Ct.mx500.to.C48.nc
500/Ct.mx500_SCRIP.nc
500/Ct.mx500_SCRIP_land.nc
500/Cu.mx500_SCRIP.nc
500/Cv.mx500_SCRIP.nc
500/grid_cice_NEMS_mx500.nc
500/kmtu_cice_NEMS_mx500.nc
500/mesh.mx500.nc
500/rect.5p0_SCRIP.nc
500/tripole.mx025.Ct.to.mx500.Ct.neareststod.nc
500/tripole.mx500.Bu.to.Ct.bilinear.nc
500/tripole.mx500.Ct.to.rect.5p0.bilinear.nc
500/tripole.mx500.Ct.to.rect.5p0.conserve.nc
500/tripole.mx500.Cu.to.Ct.bilinear.nc
500/tripole.mx500.Cv.to.Ct.bilinear.nc
500/tripole.mx500.nc

sent 32,316,240 bytes  received 476 bytes  4,308,895.47 bytes/sec
total size is 293,765,334  speedup is 9.09
[role.glopara@hfe08 post]$ ll
total 198144
dr-xr-sr-x 2 role.glopara global     4096 Oct 25 20:21 025
dr-xr-sr-x 2 role.glopara global     4096 Oct 25 20:21 050
dr-xr-sr-x 2 role.glopara global     4096 Oct 25 20:20 100
dr-xr-sr-x 2 role.glopara global     4096 Oct 25 20:20 500
-rw-r--r-- 1 role.glopara global    17877 May 15  2020 Vertical_coordinate.nc
-rw-r--r-- 1 role.glopara global  6235132 May 15  2020 bgvar_min.nc
-rw-r--r-- 1 role.glopara global  2608950 May 15  2020 coast_dist.nc
-rw-r--r-- 1 role.glopara global 38726866 May 15  2020 ocean_geometry.nc
-rw-r--r-- 1 role.glopara global 29764861 May 15  2020 remap.grid_t.025deg.bil.nc
-rw-r--r-- 1 role.glopara global 33720282 May 15  2020 remap.grid_t.025deg.con.nc
-rw-r--r-- 1 role.glopara global 18765043 May 15  2020 remap.grid_t.05deg.bil.nc
-rw-r--r-- 1 role.glopara global 28346251 May 15  2020 remap.grid_t.05deg.con.nc
-rw-r--r-- 1 role.glopara global 17602036 May 15  2020 remap.grid_t.1deg.bil.nc
-rw-r--r-- 1 role.glopara global 26127442 May 15  2020 remap.grid_t.1deg.con.nc
-rw-r--r-- 1 role.glopara global   947346 May 15  2020 remap.grid_t.angle.nc

@DeniseWorthen
Copy link
Author

DeniseWorthen commented Oct 27, 2023 •
edited
Loading

@KateFriedman-NOAA Files which are not actually the weights file are present. Only the weights files need to be added (tripoletonc). Most of the other files are intermediate files. There is no real harm I suppose in having them present, but it might be less confusing if only the weight files themselves were in the post directory.

Edit---I tried to write "tripole[wildcard]to[wildcard]nc" but it is formatting it as italics.

@KateFriedman-NOAA
Copy link
Member

@DeniseWorthen Oops my bad, you did say only the tripole*to* files. I have corrected it. Please see /scratch1/NCEPDEV/global/glopara/fix/mom6/20220805/post now.

@DeniseWorthen
Copy link
Author

DeniseWorthen commented Oct 27, 2023 •
edited
Loading

Thanks, that looks better. I think putting them in subdirectories by source resolution should be OK, unless those on the workflow side think it's easier to have them all in subdirectory post itself. I really don't know what the preference would be but I think it is fine as you've done it. Thanks.

@KateFriedman-NOAA
Copy link
Member

So my vote would be to put them in the resolution folders instead of post. Example:

[role.glopara@hfe08 20220805]$ pwd
/scratch1/NCEPDEV/global/glopara/fix/mom6/20220805
[role.glopara@hfe08 20220805]$ mv post/025/tripole.mx025.* 025/

That would leave the post folder as is and just add the new tripole files into the existing resolution folders.

I had figured you needed them in the post folder (based on your request) but if not then can we move them into the resolution folders at the same level as the post folder? Let me know!

@DeniseWorthen
Copy link
Author

@KateFriedman-NOAA What is currently in the 025 etc directories are the MOM6 input files. The weights files are not used by MOM6 in any manner. So I think it makes more sense for them to remain in post. And, the weights files are actually used by either the ocean or ice post, which is just an additional twist!

The fortran code looks for a file name based on the source grid (tripole.mx[X]) grid and the destination grid (rect.[X]) within a given named directory, so I think it is fine if all the weights are just in post or in a post/025 etc. The directory name will just need to point to a specific subdirectory of post.

@KateFriedman-NOAA
Copy link
Member

@DeniseWorthen Okie dokie! The new files are in place then and I will proceed with rsyncing them to the other fix sets on the other supported platforms. If there is nothing else for this request, I will close this issue when the rsyncs are complete. Thanks!

@DeniseWorthen
Copy link
Author

@KateFriedman-NOAA Thanks for your help. Have a nice weekend (80 deg!)

@KateFriedman-NOAA
Copy link
Member

@DeniseWorthen Sure thing! Have a nice weekend too! :)

@WalterKolczynski-NOAA can you update just the mom6/20220805 folder in the fix set on Orion? I don't want the orog updates to get pulled around yet. Thanks!

@KateFriedman-NOAA
Copy link
Member

The mom6/20220805 folders have been updated with the new files on Jet, WCOSS2-Dogwood, and WCOSS2-Cactus.

@WalterKolczynski-NOAA
Copy link
Contributor

mom6/20220805 has been synchronized to Orion

@KateFriedman-NOAA
Copy link
Member

Thanks @WalterKolczynski-NOAA ! Closing this issue now.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@WalterKolczynski-NOAA WalterKolczynski-NOAA

@KateFriedman-NOAA KateFriedman-NOAA

Labels
Static Data Mgmt Update of static data (fix, ICs, etc.)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@WalterKolczynski-NOAA @KateFriedman-NOAA @DeniseWorthen