Add ability to compress ocean and ice products #3111
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This PR adds the ability to optionally compress ocean and ice products for the GEFS reforecast. Compression can be set using a new
config.base
variable calledDO_OCNICE_COMPRESS
. For the reforecast, the ice history data and the 0p25 ocean post-processed data are gzipped at the end of the ice and ocean prod tasks, respectively. The archive task was also modified to allow either gzipped or non-gzipped ocean and ice data to be sent to HPSS, which is controlled byDO_OCNICE_COMPRESS
.Furthermore, an option was added to skip the ocean and ice post-processing within the ocean and ice prod jobs, respectively. This can be controlled by
DO_ICE_INTERP
andDO_OCN_INTERP
inconfig.base
. In order to meet the reforecast requirements,DO_ICE_INTERP
is set toNO
and andDO_OCN_INTERP
is set toYES
by default.This PR also accomplishes the following:
STMP
andPTMP
were modified to/lfs/h3/emc/gefstemp/
because this is the space where the reforecast will be performed.SUDO_USER
.Type of change
Change characteristics
How has this been tested?
The GEFS replay configuration was tested on WCOSS2.
Checklist