Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add ability to compress ocean and ice products #3111

Conversation

EricSinsky-NOAA
Copy link
Contributor

@EricSinsky-NOAA EricSinsky-NOAA commented Nov 19, 2024

Description

This PR adds the ability to optionally compress ocean and ice products for the GEFS reforecast. Compression can be set using a new config.base variable called DO_OCNICE_COMPRESS. For the reforecast, the ice history data and the 0p25 ocean post-processed data are gzipped at the end of the ice and ocean prod tasks, respectively. The archive task was also modified to allow either gzipped or non-gzipped ocean and ice data to be sent to HPSS, which is controlled by DO_OCNICE_COMPRESS.

Furthermore, an option was added to skip the ocean and ice post-processing within the ocean and ice prod jobs, respectively. This can be controlled by DO_ICE_INTERP and DO_OCN_INTERP in config.base. In order to meet the reforecast requirements, DO_ICE_INTERP is set to NO and and DO_OCN_INTERP is set to YES by default.

This PR also accomplishes the following:

  • The default WCOSS2 STMP and PTMP were modified to /lfs/h3/emc/gefstemp/ because this is the space where the reforecast will be performed.
  • The wavepostpnt task has been removed.
  • If a group account is used, divide the stmp and ptmp directories by SUDO_USER.
  • The clean_up job has been modified for the reforecast.

Type of change

  • Bug fix (fixes something broken)
  • New feature (adds functionality)
  • Maintenance (code refactor, clean-up, new CI test, etc.)

Change characteristics

  • Is this a breaking change (a change in existing functionality)? NO
  • Does this change require a documentation update? NO
  • Does this change require an update to any of the following submodules? NO (If YES, please add a link to any PRs that are pending.)
    • EMC verif-global
    • GDAS
    • GFS-utils
    • GSI
    • GSI-monitor
    • GSI-utils
    • UFS-utils
    • UFS-weather-model
    • wxflow

How has this been tested?

The GEFS replay configuration was tested on WCOSS2.

Checklist

  • Any dependent changes have been merged and published
  • My code follows the style guidelines of this project
  • I have performed a self-review of my own code
  • I have commented my code, particularly in hard-to-understand areas
  • I have documented my code, including function, input, and output descriptions
  • My changes generate no new warnings
  • New and existing tests pass with my changes
  • This change is covered by an existing CI test or a new one has been added
  • Any new scripts have been added to the .github/CODEOWNERS file with owners
  • I have made corresponding changes to the system documentation if necessary

@EricSinsky-NOAA EricSinsky-NOAA merged commit e020fce into NOAA-EMC:feature/gefs_reforecast Nov 22, 2024
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants