Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add coupled support and update UFS #500

Merged
merged 143 commits into from
Dec 10, 2021
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
143 commits
Select commit Hold shift + click to select a range
3b6c248
files from existing coupled-crow branch intake
Jul 19, 2021
d7090e7
Revert "files from existing coupled-crow branch intake"
Jul 19, 2021
2d5a8ec
Merge remote-tracking branch 'origin/develop' into feature/coupled_sp…
KateFriedman-NOAA Jul 20, 2021
471d67e
Unify build system (#375)
WalterKolczynski-NOAA Jul 29, 2021
0234fae
Update free forecast EXPDIR setup for coupled model (#376)
KateFriedman-NOAA Jul 30, 2021
0085d97
remove wave_grid_interp.sh which is not being used (wave_grid_interp_…
JessicaMeixner-NOAA Aug 3, 2021
140ab02
update wave related files based on updates made in feature/coupled-crow
JessicaMeixner-NOAA Aug 3, 2021
46b8cf8
Feature/script update (#371)
JianKuang-Intelsat Aug 11, 2021
e3b0796
Merge remote-tracking branch 'EMC/feature/coupled_sprint' into couple…
JessicaMeixner-NOAA Aug 12, 2021
3edba4c
Free-forecast mode support on Jet (#394) (#405)
WalterKolczynski-NOAA Aug 12, 2021
9e6c946
Add temporary README with instructions for running atmos-only C192 te…
KateFriedman-NOAA Aug 13, 2021
1629ac5
Merge remote-tracking branch 'EMC/feature/coupled_sprint' into couple…
JessicaMeixner-NOAA Aug 16, 2021
5d7bc9d
update with latest feature/coupled-crow changes
JessicaMeixner-NOAA Aug 16, 2021
0448d98
Merge pull request #409 from JessicaMeixner-NOAA/sprint/updatetolates…
WalterKolczynski-NOAA Aug 17, 2021
13c3332
Merge pull request #396 from JessicaMeixner-NOAA/coupled-sprint/updat…
WalterKolczynski-NOAA Aug 17, 2021
e2b694b
Add ocnpost scripts from feature/coupled-crow (#411)
KateFriedman-NOAA Aug 17, 2021
e7214ff
Fix CCPP_SUITE definition
WalterKolczynski-NOAA Aug 17, 2021
8ce1b17
Choose nems.configure template correctly
WalterKolczynski-NOAA Aug 17, 2021
93b389e
Standardize partition settings
WalterKolczynski-NOAA Aug 17, 2021
42316bc
Standardize partition settings for earc task
WalterKolczynski-NOAA Aug 19, 2021
15a404e
Standardize partition settings
WalterKolczynski-NOAA Aug 17, 2021
68385d9
Fix error in workflow utils magic string
WalterKolczynski-NOAA Aug 19, 2021
107e99f
Consolidate fcst resources and reorg configs
WalterKolczynski-NOAA Aug 19, 2021
3fd6bbd
Turn off date cutoff for waves
WalterKolczynski-NOAA Aug 19, 2021
6000368
Fix forecast launcher for Orion
WalterKolczynski-NOAA Aug 19, 2021
7cb3692
Fix WW3 input settings for coupled
WalterKolczynski-NOAA Aug 19, 2021
c7db79a
Add partition setting for GDAS tasks on slurm
WalterKolczynski-NOAA Aug 19, 2021
9429a03
Change how indirect variable reference is used
WalterKolczynski-NOAA Aug 19, 2021
87d37da
Properly define ocn/ice mesh filename
WalterKolczynski-NOAA Aug 23, 2021
c3c0599
Change default slow coupling interval
WalterKolczynski-NOAA Aug 23, 2021
4027377
Merge pull request #418 from WalterKolczynski-NOAA/feature/fix_partit…
WalterKolczynski-NOAA Aug 23, 2021
688273c
Add ocean model resolution case block in config.efcs
KateFriedman-NOAA Aug 23, 2021
68a25a9
Merge pull request #428 from KateFriedman-NOAA/feature/coupled_sprint
KateFriedman-NOAA Aug 23, 2021
0763009
Coupled atm to wave for S2SW app
WalterKolczynski-NOAA Aug 23, 2021
5da523e
Turn on lheatstrg and lseaspray
WalterKolczynski-NOAA Aug 23, 2021
164d871
Fix mosaic and mesh files
WalterKolczynski-NOAA Aug 24, 2021
afa9a7d
Merge branch 'feature/coupled_sprint' into feature/sprint_coupled_fcst
WalterKolczynski-NOAA Aug 24, 2021
eb7c657
Remove unused variable in resources
WalterKolczynski-NOAA Aug 24, 2021
d7c8362
Add trailing new line to ocean config
WalterKolczynski-NOAA Aug 24, 2021
0650b07
Add coupled version of atm post script
WalterKolczynski-NOAA Aug 24, 2021
86cba79
Remove override of threads for C386 fcst
WalterKolczynski-NOAA Aug 25, 2021
d83428c
Remove check for existence of tiled fix files
WalterKolczynski-NOAA Aug 25, 2021
104915c
Update SEND block in forecast_postdet.sh to populate RESTART folder
KateFriedman-NOAA Aug 26, 2021
08aedd9
Merge remote-tracking branch 'origin/develop' into feature/coupled_sp…
KateFriedman-NOAA Aug 27, 2021
71408fd
Remove unneeded LATB_CASE check in forecast_predet.sh for C192
KateFriedman-NOAA Aug 27, 2021
c59260b
Add WRITE_NSFLIP variable in place of prior WRITE_NEMSIOFLIP variable
KateFriedman-NOAA Aug 27, 2021
6a57ba3
Move lheatstrg with rest of lsm-dependent vars
WalterKolczynski-NOAA Aug 30, 2021
3dc7169
Modify ocean PETs to match prototypes
WalterKolczynski-NOAA Aug 30, 2021
a6030fd
Add runoff to data_table
WalterKolczynski-NOAA Aug 30, 2021
cfae675
Export stochastic switches from config.fcst
WalterKolczynski-NOAA Aug 30, 2021
1ae20e0
Merge pull request #432 from KateFriedman-NOAA/feature/coupled_sprint
KateFriedman-NOAA Aug 30, 2021
41845bb
Remove unneeded global_chgres symlinks from link_workflow.sh
KateFriedman-NOAA Aug 30, 2021
fb5db21
Merge remote-tracking branch 'origin/feature/coupled_sprint' into fea…
KateFriedman-NOAA Aug 30, 2021
2f5c1f3
Merge pull request #434 from KateFriedman-NOAA/feature/coupled_sprint…
KateFriedman-NOAA Aug 30, 2021
16eedb8
Fix default PEs when component not used
WalterKolczynski-NOAA Sep 3, 2021
36b2fa1
Fix coupling interval for atm-wav
WalterKolczynski-NOAA Sep 3, 2021
e6cd4fb
Remove duplicate do_tofd from namelist
WalterKolczynski-NOAA Sep 9, 2021
39be16b
Move OCNRES back to config.base
WalterKolczynski-NOAA Sep 9, 2021
de22455
Merge branch 'feature/coupled_sprint' into feature/sprint_coupled_fcst
WalterKolczynski-NOAA Sep 9, 2021
ac8f618
Merge pull request #430 from WalterKolczynski-NOAA/feature/sprint_cou…
WalterKolczynski-NOAA Sep 14, 2021
90a31c4
Update UFS for memory bug
JessicaMeixner-NOAA Aug 23, 2021
2425c65
Merge pull request #445 from KateFriedman-NOAA/feature/coupled_sprint…
KateFriedman-NOAA Sep 23, 2021
e3fae7a
Merge pull request #447 from WalterKolczynski-NOAA/feature/sprint_upd…
WalterKolczynski-NOAA Sep 23, 2021
d958883
Merge branch 'develop' into feature/coupled_sprint
WalterKolczynski-NOAA Sep 23, 2021
2a2282a
Merge pull request #448 from WalterKolczynski-NOAA/feature/coupled_sp…
WalterKolczynski-NOAA Sep 23, 2021
dc78e8e
Merge branch 'develop' into feature/coupled_sprint
WalterKolczynski-NOAA Oct 8, 2021
a7690c7
Merge pull request #456 from WalterKolczynski-NOAA/feature/coupled_sp…
WalterKolczynski-NOAA Oct 8, 2021
81ad8b3
Update to UFS version as of 2021 Oct 07
WalterKolczynski-NOAA Oct 12, 2021
e670dc8
Update ESMF & FMS and add new CICE setting
WalterKolczynski-NOAA Oct 13, 2021
e4e6892
Merge pull request #458 from WalterKolczynski-NOAA/feature/update_ufs
WalterKolczynski-NOAA Oct 14, 2021
332bf01
Make switching to coupled defaults easier
WalterKolczynski-NOAA Oct 18, 2021
c6b8619
Undo addition of all but necessary overrides
WalterKolczynski-NOAA Oct 20, 2021
b6d0d06
Merge pull request #464 from WalterKolczynski-NOAA/feature/s2s_defaults
WalterKolczynski-NOAA Oct 20, 2021
1ab88d9
Fix typo in UFS hash
WalterKolczynski-NOAA Nov 1, 2021
cbe45c4
Merge pull request #477 from WalterKolczynski-NOAA/feature/coupled_sp…
WalterKolczynski-NOAA Nov 1, 2021
82d9a0e
Change taskname of post jobs
WalterKolczynski-NOAA Nov 4, 2021
b5ea79f
Add ability to turn off wave boundary point post jobs
WalterKolczynski-NOAA Nov 4, 2021
dc818d5
Determine wavepost dependencies from wave grids
WalterKolczynski-NOAA Nov 4, 2021
0761d8e
Add scripts for staging coupled ICs
WalterKolczynski-NOAA Nov 4, 2021
47a0973
Remove redundant setting for coupled ICs
WalterKolczynski-NOAA Nov 4, 2021
3d1af01
Load NCL for ocean post
WalterKolczynski-NOAA Nov 4, 2021
1a6f0a8
Symlink ocean/wave output to component directories in COM
WalterKolczynski-NOAA Nov 4, 2021
0c146fe
Change reg2grb2 fix variable to match existing
WalterKolczynski-NOAA Nov 4, 2021
8bc8505
Remove redirection of ocnpost output
WalterKolczynski-NOAA Nov 4, 2021
809a976
Add memory specification for ocean post
WalterKolczynski-NOAA Nov 4, 2021
879a7cb
Add coupled tasks to forecast-only workflow setup
WalterKolczynski-NOAA Nov 4, 2021
ba537ea
Fix permissions on setup scripts
WalterKolczynski-NOAA Nov 4, 2021
2253773
Remove unnecessary exit code checks when creating symlinks
WalterKolczynski-NOAA Nov 4, 2021
8bd7128
Add exit code checks after ncks calls
WalterKolczynski-NOAA Nov 4, 2021
4862d82
Check for wave tasks in more pythonic way
WalterKolczynski-NOAA Nov 4, 2021
27f0e58
Use more verbose loop indicies
WalterKolczynski-NOAA Nov 4, 2021
f391fa6
Remove extra permissions from ocean/ice COM directories
WalterKolczynski-NOAA Nov 4, 2021
11f5f41
Remove unneeded pwd from ocean post
WalterKolczynski-NOAA Nov 4, 2021
d0d4596
Stop creating unneeded working directory for coupled IC job
WalterKolczynski-NOAA Nov 4, 2021
47709c3
Remove wavepostbndpnt from arch dependency if it is off
WalterKolczynski-NOAA Nov 4, 2021
6a06e44
Fix error in workflow generation for coupled IC
WalterKolczynski-NOAA Nov 6, 2021
a051750
Export coupled IC location
WalterKolczynski-NOAA Nov 6, 2021
33e705a
Fix syntax error in ocnpost
WalterKolczynski-NOAA Nov 6, 2021
99a1fad
Merge pull request #488 from WalterKolczynski-NOAA/feature/coupled_wo…
WalterKolczynski-NOAA Nov 7, 2021
24b5e08
Merge pull request #491 from NOAA-EMC/develop
WalterKolczynski-NOAA Nov 9, 2021
ad0c54c
Add missing &nam_sfcperts namelist section to input.nml
KateFriedman-NOAA Nov 9, 2021
4469bb8
Reduce C96 timestep to 450
KateFriedman-NOAA Nov 9, 2021
503c6cf
Merge pull request #492 from KateFriedman-NOAA/feature/coupled_sprint
KateFriedman-NOAA Nov 10, 2021
e66723f
Update restart_interval in forecast configs
KateFriedman-NOAA Nov 10, 2021
5085c70
Merge pull request #494 from KateFriedman-NOAA/feature/coupled_sprint
KateFriedman-NOAA Nov 10, 2021
dab793b
Only read from wavepostsbs when waves are on
WalterKolczynski-NOAA Nov 12, 2021
7c7ce19
Merge pull request #499 from WalterKolczynski-NOAA/feature/coupled_sp…
WalterKolczynski-NOAA Nov 12, 2021
613b3dd
Update readme with coupled instructions
WalterKolczynski-NOAA Nov 17, 2021
9489b9f
Fix bug in post checking for analysis group
WalterKolczynski-NOAA Nov 17, 2021
a6b74b6
Add missing post script for coupled
WalterKolczynski-NOAA Nov 18, 2021
e66c5fc
Add another missing post script for coupled
WalterKolczynski-NOAA Nov 18, 2021
ee2bb96
Remove redundant deletion of $DATA in forecast
WalterKolczynski-NOAA Nov 19, 2021
c696585
update so that coupled matches p7.2
JessicaMeixner-NOAA Nov 19, 2021
c454714
always use second string of restarts for waves
JessicaMeixner-NOAA Nov 19, 2021
04266c1
Merge pull request #509 from JessicaMeixner-NOAA/feature/coupled_sprint
WalterKolczynski-NOAA Nov 19, 2021
3edaceb
Update rocoto_viewer with updated version
WalterKolczynski-NOAA Nov 19, 2021
a3c850e
Update launcher to provide exact procs to srun on Hera for model fore…
aerorahul Nov 22, 2021
413a4a7
update how wave ICs are handled
JessicaMeixner-NOAA Nov 22, 2021
2154673
Update launcher to provide exact procs to srun on Hera for ensemble f…
aerorahul Nov 22, 2021
47167cf
fix coupled ic job for waves -- need DO_WAVE not cplwav
JessicaMeixner-NOAA Nov 23, 2021
045059d
updates for getting forecast job to start:
JessicaMeixner-NOAA Nov 23, 2021
b69e61f
Merge branch 'feature/coupled_sprint' of https://github.com/NOAA-EMC/…
JessicaMeixner-NOAA Nov 23, 2021
2fee718
Merge pull request #511 from JessicaMeixner-NOAA/feature/coupled_sprint
WalterKolczynski-NOAA Nov 29, 2021
5f43b23
Add dependency on ocean post for archive
WalterKolczynski-NOAA Dec 1, 2021
b83d89f
Use correct warm start setting in forecast det
WalterKolczynski-NOAA Dec 2, 2021
c7a545c
Add coupled files to archive and streamline
WalterKolczynski-NOAA Dec 2, 2021
caec93c
Fix variable names of archive overrides for coupled
WalterKolczynski-NOAA Dec 2, 2021
61b6e52
Fix location of ww3_multi* for archive job
WalterKolczynski-NOAA Dec 2, 2021
d56ea30
Use correct ocean control variable in archive job
WalterKolczynski-NOAA Dec 2, 2021
27afa10
Fix location of input.nml in archive job
WalterKolczynski-NOAA Dec 3, 2021
f8ca0b0
Fix SENDCOM for post job
WalterKolczynski-NOAA Dec 4, 2021
38ae18c
Add memory specification for prep job
WalterKolczynski-NOAA Dec 6, 2021
a404fb0
Fix location of ocean data in archive job
WalterKolczynski-NOAA Dec 7, 2021
3dddace
Restore correct comroot path on Hera
WalterKolczynski-NOAA Dec 7, 2021
0f28d8c
Stop copying input.nml for GDAS
WalterKolczynski-NOAA Dec 7, 2021
f150ffe
Remove redundant Jet block from build_all
WalterKolczynski-NOAA Dec 7, 2021
ef6ccfc
Turn off archival of gaussian files by default
WalterKolczynski-NOAA Dec 8, 2021
c988e75
Replace 0p50 pgrb2b with 1p00 in archive, fix 1p00 flux
WalterKolczynski-NOAA Dec 8, 2021
48c69ce
Merge pull request #517 from WalterKolczynski-NOAA/feature/coupled_ar…
WalterKolczynski-NOAA Dec 8, 2021
025dfac
Remove unnecessary readme
WalterKolczynski-NOAA Dec 8, 2021
b6918b5
Use a different minimum sea-ice value for coupled and standalone
JessicaMeixner-NOAA Dec 8, 2021
fe93fe7
Extend wall clock for C384 forecast
WalterKolczynski-NOAA Dec 8, 2021
2d47e47
Always append AOD diag table
WalterKolczynski-NOAA Dec 8, 2021
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -30,7 +30,7 @@ parm/wafs
#--------------------------------------------
sorc/*log
sorc/logs
sorc/fv3gfs.fd
sorc/ufs_model.fd
sorc/gfs_post.fd
sorc/gfs_wafs.fd
sorc/gldas.fd
Expand Down
20 changes: 17 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,9 @@ The global-workflow current supports the following machines:
* WCOSS-Dell
* WCOSS-Cray
* Hera
* Orion

Quick-start instructions are below. Full instructions are available in the [wiki](https://github.com/NOAA-EMC/global-workflow/wiki/Run-Global-Workflow)

## Build global-workflow:

Expand All @@ -25,15 +28,26 @@ $ sh checkout.sh
### 2. Build components

While in /sorc folder:

Uncoupled
```
$ sh build_all.sh
```
Coupled
```
$ sh build_all.sh -c
```

### 3. Link components

While in /sorc folder:

Uncoupled
```
$ sh link_fv3gfs.sh emc $MACHINE
$ sh link_workflow.sh emc $MACHINE
```

...where $MACHINE is "dell", "cray", or "hera".
Coupled
```
$ sh link_workflow.sh emc $MACHINE coupled
```
...where $MACHINE is "dell", "cray", "hera", or "orion".
7 changes: 5 additions & 2 deletions env/HERA.env
Original file line number Diff line number Diff line change
Expand Up @@ -135,7 +135,10 @@ elif [ $step = "fcst" ]; then
export NTHREADS_FV3=${nth_fv3:-$nth_max}
[[ $NTHREADS_FV3 -gt $nth_max ]] && export NTHREADS_FV3=$nth_max
export cores_per_node=$npe_node_max
export APRUN_FV3="$launcher"
if [[ $CDUMP == "gfs" ]]; then
npe_fcst=$npe_fcst_gfs
fi
export APRUN_FV3="$launcher -n $npe_fcst"

export NTHREADS_REGRID_NEMSIO=${nth_regrid_nemsio:-1}
[[ $NTHREADS_REGRID_NEMSIO -gt $nth_max ]] && export NTHREADS_REGRID_NEMSIO=$nth_max
Expand All @@ -152,7 +155,7 @@ elif [ $step = "efcs" ]; then
export NTHREADS_FV3=${nth_efcs:-$nth_max}
[[ $NTHREADS_FV3 -gt $nth_max ]] && export NTHREADS_FV3=$nth_max
export cores_per_node=$npe_node_max
export APRUN_FV3="$launcher"
export APRUN_FV3="$launcher -n $npe_efcs"

export NTHREADS_REGRID_NEMSIO=${nth_regrid_nemsio:-1}
[[ $NTHREADS_REGRID_NEMSIO -gt $nth_max ]] && export NTHREADS_REGRID_NEMSIO=$nth_max
Expand Down
7 changes: 5 additions & 2 deletions env/ORION.env
Original file line number Diff line number Diff line change
Expand Up @@ -131,7 +131,10 @@ elif [ $step = "fcst" ]; then
export NTHREADS_FV3=${nth_fv3:-$nth_max}
[[ $NTHREADS_FV3 -gt $nth_max ]] && export NTHREADS_FV3=$nth_max
export cores_per_node=$npe_node_max
export APRUN_FV3="$launcher"
if [[ $CDUMP == "gfs" ]]; then
npe_fcst=$npe_fcst_gfs
fi
export APRUN_FV3="$launcher -n $npe_fcst"

export NTHREADS_REGRID_NEMSIO=${nth_regrid_nemsio:-1}
[[ $NTHREADS_REGRID_NEMSIO -gt $nth_max ]] && export NTHREADS_REGRID_NEMSIO=$nth_max
Expand All @@ -148,7 +151,7 @@ elif [ $step = "efcs" ]; then
export NTHREADS_FV3=${nth_efcs:-$nth_max}
[[ $NTHREADS_FV3 -gt $nth_max ]] && export NTHREADS_FV3=$nth_max
export cores_per_node=$npe_node_max
export APRUN_FV3="$launcher"
export APRUN_FV3="$launcher -n $npe_efcs"

export NTHREADS_REGRID_NEMSIO=${nth_regrid_nemsio:-1}
[[ $NTHREADS_REGRID_NEMSIO -gt $nth_max ]] && export NTHREADS_REGRID_NEMSIO=$nth_max
Expand Down
21 changes: 6 additions & 15 deletions jobs/JGLOBAL_FORECAST
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,12 @@ date
if [ $RUN_ENVIR = "emc" ]; then
#--------------------------------

##############################################
# Set variables used in the exglobal script
##############################################
export CDATE=${CDATE:-${PDY}${cyc}}
export CDUMP=${CDUMP:-${RUN:-"gfs"}}

#############################
# Source relevant config files
#############################
Expand All @@ -20,15 +26,6 @@ for config in $configs; do
status=$?
[[ $status -ne 0 ]] && exit $status
done
# Source additional configs
if [ ${DO_WAVE:-"NO"} = "YES" ]; then
configs="wave"
for config in $configs; do
. $config_path/config.$config
status=$?
[[ $status -ne 0 ]] && exit $status
done
fi

##########################################
# Source machine runtime environment
Expand Down Expand Up @@ -65,12 +62,6 @@ export pgmout="OUTPUT.${pid}"
export pgmerr=errfile


##############################################
# Set variables used in the exglobal script
##############################################
export CDATE=${CDATE:-${PDY}${cyc}}
export CDUMP=${CDUMP:-${RUN:-"gfs"}}

if [ $RUN_ENVIR = "nco" ]; then
export ROTDIR=${COMROOT:?}/$NET/$envir
export RSTDIR=${GESROOT:?}/$envir
Expand Down
30 changes: 17 additions & 13 deletions jobs/JGLOBAL_WAVE_PREP
Original file line number Diff line number Diff line change
Expand Up @@ -73,19 +73,23 @@ if [ $RUN_ENVIR = "nco" ]; then
export COMIN_WAV_ICE=${COMIN_WAV_ICE:-$(compath.py gfs/prod)}/${CDUMP}.${PDY}/${cyc}/atmos
export COMIN_WAV_RTOFS=${COMIN_WAV_RTOFS:-$(compath.py ${WAVECUR_DID}/prod)}
else
if [ ! -d $DMPDIR/${WAVECUR_DID}.${RPDY} ]; then export RPDY=`$NDATE -24 ${PDY}00 | cut -c1-8`; fi
if [ ! -L $ROTDIR/${WAVECUR_DID}.${RPDY} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/${WAVECUR_DID}.${RPDY} $ROTDIR/${WAVECUR_DID}.${RPDY}
fi
BRPDY=`$NDATE -24 ${RPDY}00 | cut -c1-8`
if [ ! -L $ROTDIR/${WAVECUR_DID}.${BRPDY} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/${WAVECUR_DID}.${BRPDY} $ROTDIR/${WAVECUR_DID}.${BRPDY}
fi
if [ ! -L $ROTDIR/${CDUMP}.${PDY}/${cyc}/atmos/${WAVICEFILE} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/$CDUMP.${PDY}/$cyc/${WAVICEFILE} $ROTDIR/$CDUMP.${PDY}/$cyc/atmos/${WAVICEFILE}
fi
export COMIN_WAV_ICE=${COMIN_WAV_ICE:-$ROTDIR/$RUN.$PDY/$cyc/atmos}
export COMIN_WAV_RTOFS=${COMIN_WAV_RTOFS:-$ROTDIR}
if [ $WW3CURINP = "YES" ]; then
if [ ! -d $DMPDIR/${WAVECUR_DID}.${RPDY} ]; then export RPDY=`$NDATE -24 ${PDY}00 | cut -c1-8`; fi
if [ ! -L $ROTDIR/${WAVECUR_DID}.${RPDY} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/${WAVECUR_DID}.${RPDY} $ROTDIR/${WAVECUR_DID}.${RPDY}
fi
BRPDY=`$NDATE -24 ${RPDY}00 | cut -c1-8`
if [ ! -L $ROTDIR/${WAVECUR_DID}.${BRPDY} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/${WAVECUR_DID}.${BRPDY} $ROTDIR/${WAVECUR_DID}.${BRPDY}
fi
export COMIN_WAV_RTOFS=${COMIN_WAV_RTOFS:-$ROTDIR}
fi
if [ $WW3ICEINP = "YES" ]; then
if [ ! -L $ROTDIR/${CDUMP}.${PDY}/${cyc}/atmos/${WAVICEFILE} ]; then # Check if symlink already exists in ROTDIR
$NLN $DMPDIR/$CDUMP.${PDY}/$cyc/${WAVICEFILE} $ROTDIR/$CDUMP.${PDY}/$cyc/atmos/${WAVICEFILE}
fi
export COMIN_WAV_ICE=${COMIN_WAV_ICE:-$ROTDIR/$RUN.$PDY/$cyc/atmos}
fi
fi

# Execute the Script
Expand Down
106 changes: 31 additions & 75 deletions jobs/rocoto/arch.sh
Original file line number Diff line number Diff line change
Expand Up @@ -175,59 +175,35 @@ cd $ROTDIR

if [ $CDUMP = "gfs" ]; then

#for targrp in gfsa gfsb - NOTE - do not check htar error status
for targrp in gfsa gfsb; do
htar -P -cvf $ATARDIR/$CDATE/${targrp}.tar `cat $ARCH_LIST/${targrp}.txt`
done
targrp_list="gfsa gfsb"

#for targrp in gfs_flux gfs_netcdf/nemsio gfs_pgrb2b; do
if [ ${SAVEFCSTNEMSIO:-"YES"} = "YES" ]; then
if [ ${ARCH_GAUSSIAN:-"NO"} = "YES" ]; then
targrp_list="$targrp_list gfs_flux gfs_${format}b gfs_pgrb2b"
if [ $MODE = "cycled" ]; then
targrp_list=`gfs_flux gfs_${format}a gfs_${format}b gfs_pgrb2b`
elif [ $MODE = "free" ]; then
targrp_list=`gfs_flux gfs_${format}b gfs_pgrb2b`
targrp_list="$targrp_list gfs_${format}a"
fi
#for targrp in gfs_flux gfs_${format}a gfs_${format}b gfs_pgrb2b; do
for targrp in $targrp_list; do
htar -P -cvf $ATARDIR/$CDATE/${targrp}.tar `cat $ARCH_LIST/${targrp}.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE ${targrp}.tar failed"
exit $status
fi
done
fi

#for targrp in gfswave
if [ $DO_WAVE = "YES" -a "$WAVE_CDUMP" != "gdas" ]; then
for targrp in gfswave; do
htar -P -cvf $ATARDIR/$CDATE/${targrp}.tar `cat $ARCH_LIST/${targrp}.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE ${targrp}.tar failed"
exit $status
fi
done
targrp_list="$targrp_list gfswave"
fi

if [ $DO_OCN = "YES" ]; then
targrp_list="$targrp_list ocn_ice_grib2_0p5 ocn_ice_grib2_0p25 ocn_2D ocn_3D ocn_xsect ocn_daily wavocn gfs_flux_1p00"
fi

if [ $DO_ICE = "YES" ]; then
targrp_list="$targrp_list ice"
fi

#for restarts
if [ $SAVEFCSTIC = "YES" ]; then
htar -P -cvf $ATARDIR/$CDATE/gfs_restarta.tar `cat $ARCH_LIST/gfs_restarta.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gfs_restarta.tar failed"
exit $status
fi
targrp_list="$targrp_list gfs_restarta"
fi

#for downstream products
if [ $DO_BUFRSND = "YES" -o $WAFSF = "YES" ]; then
htar -P -cvf $ATARDIR/$CDATE/gfs_downstream.tar `cat $ARCH_LIST/gfs_downstream.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gfs_downstream.tar failed"
exit $status
fi
targrp_list="$targrp_list gfs_downstream"
fi

#--save mdl gfsmos output from all cycles in the 18Z archive directory
Expand All @@ -239,57 +215,37 @@ if [ $CDUMP = "gfs" ]; then
exit $status
fi
fi
elif [ $CDUMP = "gdas" ]; then

fi


if [ $CDUMP = "gdas" ]; then

htar -P -cvf $ATARDIR/$CDATE/gdas.tar `cat $ARCH_LIST/gdas.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gdas.tar failed"
exit $status
fi
targrp_list="gdas"

#gdaswave
if [ $DO_WAVE = "YES" ]; then
htar -P -cvf $ATARDIR/$CDATE/gdaswave.tar `cat $ARCH_LIST/gdaswave.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gdaswave.tar failed"
exit $status
fi
targrp_list="$targrp_list gdaswave"
fi

if [ $SAVEWARMICA = "YES" -o $SAVEFCSTIC = "YES" ]; then
htar -P -cvf $ATARDIR/$CDATE/gdas_restarta.tar `cat $ARCH_LIST/gdas_restarta.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gdas_restarta.tar failed"
exit $status
fi
targrp_list="$targrp_list gdas_restarta"

if [ $DO_WAVE = "YES" ]; then
htar -P -cvf $ATARDIR/$CDATE/gdaswave_restart.tar `cat $ARCH_LIST/gdaswave_restart.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gdaswave_restart.tar failed"
exit $status
fi
targrp_list="$targrp_list gdaswave_restart"
fi
fi

if [ $SAVEWARMICB = "YES" -o $SAVEFCSTIC = "YES" ]; then
htar -P -cvf $ATARDIR/$CDATE/gdas_restartb.tar `cat $ARCH_LIST/gdas_restartb.txt`
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE gdas_restartb.tar failed"
exit $status
fi
targrp_list="$targrp_list gdas_restartb"
fi

fi

for targrp in $targrp_list; do
htar -P -cvf $ATARDIR/$CDATE/${targrp}.tar $(cat $ARCH_LIST/${targrp}.txt)
status=$?
if [ $status -ne 0 -a $CDATE -ge $firstday ]; then
echo "HTAR $CDATE ${targrp}.tar failed"
exit $status
fi
done

###############################################################
fi ##end of HPSS archive
###############################################################
Expand Down
Loading