Archive the experiment directory along with git status/diff output

[DavidHuber-NOAA]

Description

This adds the capability to archive the experiment directory. Additionally, this adds options to run git status and git diff on the HOMEgfs global workflow (but not the submodules) and store that information within the experiment directory's archive. These options are specified in config.base with the following defaults:

export ARCH_EXPDIR='YES'     # Archive the EXPDIR configs, XML, and database
export ARCH_EXPDIR_FREQ=0    # How often to archive the EXPDIR in hours or 0 for first and last cycle only
export ARCH_HASHES='YES'     # Archive the hashes of the GW and submodules and 'git status' for each; requires ARCH_EXPDIR
export ARCH_DIFFS='NO'       # Archive the output of 'git diff' for the GW; requires ARCH_EXPDIR

Resolves #2994

Type of change

• New feature (adds functionality)

Change characteristics

• Is this a breaking change (a change in existing functionality)? NO
• Does this change require a documentation update? YES
• Does this change require an update to any of the following submodules? YES (If YES, please add a link to any PRs that are pending.)
  • wxflow Fix chdir and add tests for fsutils functions wxflow#45

How has this been tested?

• Local archiving on Hercules for a C48_ATM case
• Cycled testing on Hercules with ARCH_DIFFS=YES and ARCH_EXPDIR_FREQ=6,12
• Testing with ARCH_EXPDIR=NO or ARCH_HASHES=NO

Checklist

• Any dependent changes have been merged and published
• My code follows the style guidelines of this project
• I have performed a self-review of my own code
• I have commented my code, particularly in hard-to-understand areas
• I have documented my code, including function, input, and output descriptions
• My changes generate no new warnings
• New and existing tests pass with my changes
• This change is covered by an existing CI test or a new one has been added
• Any new scripts have been added to the .github/CODEOWNERS file with owners
• I have made corresponding changes to the system documentation if necessary

[DavidHuber-NOAA]

FYI @AndrewEichmann-NOAA

[DavidHuber-NOAA]

Tests were performed on Hercules and the experiment directory tarballs for both cycled and forecast-only modes were found to have been created as expected. Opening for review.

[WalterKolczynski-NOAA]

Should only need this in one of gdas or gfs, but there is a bit of a coordination problem since either can be run without the other.

[DavidHuber-NOAA]

Agreed. I added a method to archive.py to determine which RUN to archive this in and set the archive_expdir boolean accordingly.