Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rt update #261

Merged
merged 25 commits into from
Nov 19, 2020
Merged
Show file tree
Hide file tree
Changes from 18 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
0b5b705
If ufs.cpld.cpl.r.* files do not reproduce, try nccmp
MinsukJi-NOAA Oct 30, 2020
dba78a5
Modify/add to run cpld 35d bmark tests
MinsukJi-NOAA Oct 31, 2020
03b6300
Fix nccmp implementation. Fix a bug for 35d tests
MinsukJi-NOAA Nov 1, 2020
3873e9c
Use env var NCCMP
MinsukJi-NOAA Nov 1, 2020
6a168c2
Add hera.intel to rt_35 and rt_wave_35d
MinsukJi-NOAA Nov 2, 2020
3f1e03f
Merge remote-tracking branch 'upstream/develop' into feature/rt-update
MinsukJi-NOAA Nov 3, 2020
d0c964e
Use which to find nccmp path. Apply nccmp to all files that fail cmp.…
MinsukJi-NOAA Nov 3, 2020
5d418b8
Change compare method from nccmp to compare_ncfile.py
MinsukJi-NOAA Nov 5, 2020
95c41e4
Netcdf compare changes on Hera; skip-ci
MinsukJi-NOAA Nov 6, 2020
b471f00
Netcdf compare changes on WCOSS Dell P3; skip-ci
MinsukJi-NOAA Nov 6, 2020
1085343
Modify comopare_ncfile.py
MinsukJi-NOAA Nov 9, 2020
4790637
Netcdf compare changes on wcoss cray
MinsukJi-NOAA Nov 10, 2020
645ce50
Combine rt_35d.conf with rt_wave_35d.conf
MinsukJi-NOAA Nov 10, 2020
52e3394
Merge upstream develop into feature/rt-update
MinsukJi-NOAA Nov 10, 2020
12d783d
Add orion RT results
MinsukJi-NOAA Nov 11, 2020
0b0fed2
Add Hera RT results; skip-ci
MinsukJi-NOAA Nov 11, 2020
4f0ef6b
Add wcoss dell p3 RT results
MinsukJi-NOAA Nov 11, 2020
171eeb3
Add wcoss cray RT results
MinsukJi-NOAA Nov 12, 2020
3cebcd4
Merge ufs weather develop branch into feature/rt-update
MinsukJi-NOAA Nov 18, 2020
31e3e88
Implement Dusan's ecflow fix #273
MinsukJi-NOAA Nov 18, 2020
2cf1c6f
Move miniconda3 to emc.nemspara on Hera and Orion. Minor change in de…
MinsukJi-NOAA Nov 18, 2020
5efd2bf
Add Orion RT results
MinsukJi-NOAA Nov 19, 2020
a0265e2
Add Hera Intel and GNU RT results
MinsukJi-NOAA Nov 19, 2020
0d3ca3b
Add wcoss dell p3 RT results; skip ci
MinsukJi-NOAA Nov 19, 2020
71c2b2e
Add wcoss cray RT results; skip ci
MinsukJi-NOAA Nov 19, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion modulefiles/wcoss_cray/fv3
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ module load intel/18.1.163
module rm NetCDF-intel-sandybridge/4.2
module load xt-lsfhpc/9.1.3
module load craype-haswell
module load python/2.7.14
module load python/3.6.3
module load cmake/3.16.2
module load gcc/5.3.0
#
Expand Down
3 changes: 1 addition & 2 deletions modulefiles/wcoss_dell_p3/fv3
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,7 @@ module-whatis "loads UFS Model prerequisites on Venus and Mars"
module load ips/18.0.1.163
module load impi/18.0.1
module load lsf/10.1
# module load python/3.6.3
module load python/2.7.14
module load python/3.6.3

module load cmake/3.16.2
setenv CMAKE_C_COMPILER mpiicc
Expand Down
3 changes: 1 addition & 2 deletions modulefiles/wcoss_dell_p3/fv3_debug
Original file line number Diff line number Diff line change
Expand Up @@ -9,8 +9,7 @@ module-whatis "loads UFS Model prerequisites on Venus and Mars"
module load ips/18.0.1.163
module load impi/18.0.1
module load lsf/10.1
# module load python/3.6.3
module load python/2.7.14
module load python/3.6.3

module load cmake/3.16.2
setenv CMAKE_C_COMPILER mpiicc
Expand Down
675 changes: 374 additions & 301 deletions tests/RegressionTests_hera.intel.log

Large diffs are not rendered by default.

635 changes: 354 additions & 281 deletions tests/RegressionTests_orion.intel.log

Large diffs are not rendered by default.

421 changes: 240 additions & 181 deletions tests/RegressionTests_wcoss_cray.log

Large diffs are not rendered by default.

571 changes: 322 additions & 249 deletions tests/RegressionTests_wcoss_dell_p3.log

Large diffs are not rendered by default.

15 changes: 15 additions & 0 deletions tests/compare_ncfile.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,15 @@
#!/usr/bin/env python
import sys
import numpy as np
from netCDF4 import Dataset

with Dataset(sys.argv[1]) as nc1, Dataset(sys.argv[2]) as nc2:
if nc1.variables.keys()!=nc2.variables.keys():
print("Variables are different")
sys.exit(1)

for varname in nc1.variables.keys():
diff = nc2[varname][:]-nc1[varname][:]
if (np.abs(diff)).max() != 0:
print(varname,"is different")
sys.exit(1)
4 changes: 2 additions & 2 deletions tests/rt.conf
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@ RUN | fv3_ccpp_restart
RUN | fv3_ccpp_read_inc | standard | | fv3 |
RUN | fv3_ccpp_wrtGauss_netcdf_esmf | standard | | fv3 |
RUN | fv3_ccpp_wrtGauss_netcdf | standard | | fv3 |
#RUN | fv3_ccpp_wrtGauss_netcdf_parallel | standard | | fv3 |
RUN | fv3_ccpp_wrtGauss_netcdf_parallel | standard | | fv3 |
RUN | fv3_ccpp_wrtGlatlon_netcdf | standard | | fv3 |
RUN | fv3_ccpp_wrtGauss_nemsio | standard | | fv3 |
RUN | fv3_ccpp_wrtGauss_nemsio_c192 | standard | | fv3 |
Expand Down Expand Up @@ -61,7 +61,7 @@ COMPILE | CCPP=Y SUITES=FV3_GFS_2017_gfdlmp_regional,FV3_GFS_2017_gfdlmp_regiona
RUN | fv3_ccpp_regional_control | standard | | fv3 |
RUN | fv3_ccpp_regional_restart | standard | | fv3 | fv3_ccpp_regional_control
RUN | fv3_ccpp_regional_quilt | standard | | fv3 |
#RUN | fv3_ccpp_regional_quilt_netcdf_parallel | standard | | fv3 |
RUN | fv3_ccpp_regional_quilt_netcdf_parallel | standard | | fv3 |
RUN | fv3_ccpp_regional_c768 | standard | wcoss_dell_p3 | fv3 |
RUN | fv3_ccpp_regional_c768 | standard | hera.intel | fv3 |
RUN | fv3_ccpp_regional_c768 | standard | gaea.intel | fv3 |
Expand Down
52 changes: 40 additions & 12 deletions tests/rt.sh
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,19 @@ rt_single() {
fi
}

rt_35d() {
local sy=$(echo ${DATE_35D} | cut -c 1-4)
local sm=$(echo ${DATE_35D} | cut -c 5-6)
local new_test_name="tests/${TEST_NAME}_${DATE_35D}"
rm -f $new_test_name
cp tests/$TEST_NAME $new_test_name

sed -i -e "s/\(export SYEAR\)/\1=\"$sy\"/" $new_test_name
sed -i -e "s/\(export SMONTH\)/\1=\"$sm\"/" $new_test_name

TEST_NAME=${new_test_name#tests/}
}

rt_trap() {
[[ ${ROCOTO:-false} == true ]] && rocoto_kill
[[ ${ECFLOW:-false} == true ]] && ecflow_kill
Expand Down Expand Up @@ -105,7 +118,7 @@ if [[ $MACHINE_ID = wcoss_cray ]]; then
module use $PATHTR/modulefiles/${MACHINE_ID}
module load fv3

module load python/2.7.14
module load python/3.6.3

module use /usrx/local/emc_rocoto/modulefiles
module load rocoto/1.3.0rc2
Expand All @@ -114,8 +127,9 @@ if [[ $MACHINE_ID = wcoss_cray ]]; then
ROCOTOCOMPLETE=$(which rocotocomplete)
ROCOTO_SCHEDULER=lsfcray

module load ecflow/intel/4.7.1
ECFLOW_START=${ECF_ROOT}/intel/bin/ecflow_start.sh
module use /gpfs/hps/nco/ops/nwtest/modulefiles
module load ecflow/intel/4.17.0.1
ECFLOW_START=${ECF_ROOT}/bin/ecflow_start.sh
ECF_PORT=$(grep $USER /usrx/local/sys/ecflow/assigned_ports.txt | awk '{print $2}')

DISKNM=/gpfs/hps3/emc/nems/noscrub/emc.nemspara/RT
Expand All @@ -142,7 +156,7 @@ elif [[ $MACHINE_ID = wcoss_dell_p3 ]]; then
module use $PATHTR/modulefiles/${MACHINE_ID}
module load fv3

module load python/2.7.14
module load python/3.6.3

module use /usrx/local/dev/emc_rocoto/modulefiles
module load ruby/2.5.1 rocoto/1.3.0rc2
Expand All @@ -152,8 +166,8 @@ elif [[ $MACHINE_ID = wcoss_dell_p3 ]]; then
ROCOTO_SCHEDULER=lsf

module load ips/18.0.1.163
module load ecflow/4.7.1
ECFLOW_START=${ECF_ROOT}/intel/bin/ecflow_start.sh
module load ecflow/4.17.0
ECFLOW_START=${ECF_ROOT}/bin/ecflow_start.sh
ECF_PORT=$(grep $USER /usrx/local/sys/ecflow/assigned_ports.txt | awk '{print $2}')

DISKNM=/gpfs/dell2/emc/modeling/noscrub/emc.nemspara/RT
Expand Down Expand Up @@ -203,9 +217,9 @@ elif [[ $MACHINE_ID = hera.* ]]; then
ROCOTOCOMPLETE=$(which rocotocomplete)
ROCOTO_SCHEDULER=slurm

export PATH=/scratch2/NCEPDEV/fv3-cam/Dusan.Jovic/ecflow/bin:$PATH
export PYTHONPATH=/scratch2/NCEPDEV/fv3-cam/Dusan.Jovic/ecflow/lib/python2.7/site-packages
ECFLOW_START=/scratch2/NCEPDEV/fv3-cam/Dusan.Jovic/ecflow/bin/ecflow_start.sh
export PATH=/scratch2/NCEPDEV/stmp3/Minsuk.Ji/opt/miniconda3/bin:$PATH
MinsukJi-NOAA marked this conversation as resolved.
Show resolved Hide resolved
export PYTHONPATH=/scratch2/NCEPDEV/stmp3/Minsuk.Ji/opt/miniconda3/lib/python3.8/site-packages
ECFLOW_START=/scratch2/NCEPDEV/stmp3/Minsuk.Ji/opt/miniconda3/bin/ecflow_start.sh
ECF_PORT=$(( $(id -u) + 1500 ))

QUEUE=batch
Expand Down Expand Up @@ -234,10 +248,11 @@ elif [[ $MACHINE_ID = orion.* ]]; then
ROCOTORUN=$(which rocotorun)
ROCOTOSTAT=$(which rocotostat)
ROCOTOCOMPLETE=$(which rocotocomplete)
export PATH=/work/noaa/fv3-cam/djovic/ecflow/bin:$PATH
export PYTHONPATH=/work/noaa/fv3-cam/djovic/ecflow/lib/python2.7/site-packages
ECFLOW_START=/work/noaa/fv3-cam/djovic/ecflow/bin/ecflow_start.sh
export PATH=/work/noaa/stmp/jminsuk/opt/miniconda3/bin:$PATH
export PYTHONPATH=/work/noaa/stmp/jminsuk/opt/miniconda3/lib/python3.8/site-packages
ECFLOW_START=/work/noaa/stmp/jminsuk/opt/miniconda3/bin/ecflow_start.sh
ECF_PORT=$(( $(id -u) + 1500 ))

QUEUE=batch
COMPILE_QUEUE=batch
# ACCNR= # detected in detect_machine.sh
Expand Down Expand Up @@ -268,6 +283,7 @@ elif [[ $MACHINE_ID = jet.* ]]; then
export PYTHONPATH=/lfs4/HFIP/hfv3gfs/software/ecFlow-5.3.1/lib/python2.7/site-packages
ECFLOW_START=/lfs4/HFIP/hfv3gfs/software/ecFlow-5.3.1/bin/ecflow_start.sh
ECF_PORT=$(( $(id -u) + 1500 ))

QUEUE=batch
COMPILE_QUEUE=batch
ACCNR=hfv3gfs
Expand All @@ -290,6 +306,7 @@ elif [[ $MACHINE_ID = cheyenne.* ]]; then
export PYTHONPATH=/glade/p/ral/jntp/tools/ecFlow-5.3.1/lib/python2.7/site-packages
ECFLOW_START=/glade/p/ral/jntp/tools/ecFlow-5.3.1/bin/ecflow_start.sh
ECF_PORT=$(( $(id -u) + 1500 ))

QUEUE=regular
COMPILE_QUEUE=regular
PARTITION=
Expand Down Expand Up @@ -340,6 +357,7 @@ ROCOTO=false
ECFLOW=false
KEEP_RUNDIR=false
SINGLE_NAME=''
TEST_35D=false

TESTS_FILE='rt.conf'

Expand Down Expand Up @@ -399,6 +417,10 @@ if [[ $SINGLE_NAME != '' ]]; then
rt_single
fi

if [[ $TESTS_FILE =~ '35d' ]]; then
TEST_35D=true
fi

if [[ $MACHINE_ID = hera.* ]] || [[ $MACHINE_ID = orion.* ]] || [[ $MACHINE_ID = cheyenne.* ]] || [[ $MACHINE_ID = jet.* ]]; then
RTPWD=${RTPWD:-$DISKNM/NEMSfv3gfs/develop-20201106/${RT_COMPILER^^}}
else
Expand Down Expand Up @@ -636,11 +658,16 @@ EOF
MACHINES=$( echo $line | cut -d'|' -f4)
CB=$( echo $line | cut -d'|' -f5)
DEP_RUN=$( echo $line | cut -d'|' -f6 | sed -e 's/^ *//' -e 's/ *$//')
DATE_35D=$( echo $line | cut -d'|' -f7 | sed -e 's/^ *//' -e 's/ *$//')

[[ -e "tests/$TEST_NAME" ]] || die "run test file tests/$TEST_NAME does not exist"
[[ $SET_ID != ' ' && $SET != *${SET_ID}* ]] && continue
[[ $MACHINES != ' ' && $MACHINES != *${MACHINE_ID}* ]] && continue
[[ $CREATE_BASELINE == true && $CB != *fv3* ]] && continue

# 35 day tests
[[ $TEST_35D == true ]] && rt_35d

# skip all *_appbuild runs if rocoto or ecFlow is used. FIXME
if [[ ${ROCOTO} == true && ${ECFLOW} == true ]]; then
if [[ ${TEST_NAME} == *_appbuild ]]; then
Expand Down Expand Up @@ -748,6 +775,7 @@ else
rm -f fv3_*.x fv3_*.exe modules.fv3_*
[[ ${KEEP_RUNDIR} == false ]] && rm -rf ${RUNDIR_ROOT}
[[ ${ROCOTO} == true ]] && rm -f ${ROCOTO_XML} ${ROCOTO_DB} *_lock.db
[[ ${TEST_35D} == true ]] && rm -f tests/cpld_bmark*_20*
fi

date >> ${REGRESSIONTEST_LOG}
Expand Down
19 changes: 19 additions & 0 deletions tests/rt_35d.conf
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
COMPILE | CCPP=Y SUITES=FV3_GFS_2017_coupled,FV3_GFS_2017_satmedmf_coupled,FV3_GFS_v15p2_coupled S2S=Y | | hera.intel orion.intel | fv3 | |
RUN | cpld_bmark_35d | | | fv3 | | 2012010100
RUN | cpld_bmark_35d | | | fv3 | | 2012040100
RUN | cpld_bmark_35d | | | fv3 | | 2012070100
RUN | cpld_bmark_35d | | | fv3 | | 2012100100
RUN | cpld_bmark_35d | | | fv3 | | 2013010100
RUN | cpld_bmark_35d | | | fv3 | | 2013040100
RUN | cpld_bmark_35d | | | fv3 | | 2013070100
RUN | cpld_bmark_35d | | | fv3 | | 2013100100
MinsukJi-NOAA marked this conversation as resolved.
Show resolved Hide resolved

COMPILE | CCPP=Y SUITES=FV3_GFS_2017_coupled,FV3_GFS_2017_satmedmf_coupled,FV3_GFS_v15p2_coupled S2S=Y WW3=Y | | hera.intel orion.intel | fv3 | |
RUN | cpld_bmark_wave_35d | | | fv3 | | 2012010100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2012040100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2012070100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2012100100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2013010100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2013040100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2013070100
RUN | cpld_bmark_wave_35d | | | fv3 | | 2013100100
12 changes: 10 additions & 2 deletions tests/rt_utils.sh
Original file line number Diff line number Diff line change
Expand Up @@ -270,8 +270,16 @@ check_results() {
d=$( cmp ${RTPWD}/${CNTL_DIR}/$i ${RUNDIR}/$i | wc -l )

if [[ $d -ne 0 ]] ; then
echo ".......NOT OK" >> ${REGRESSIONTEST_LOG}
echo ".......NOT OK"
if [[ ${MACHINE_ID} =~ orion || ${MACHINE_ID} =~ hera || ${MACHINE_ID} =~ wcoss_dell_p3 || ${MACHINE_ID} =~ wcoss_cray ]]; then
printf ".......ALT CHECK.." >> ${REGRESSIONTEST_LOG}
printf ".......ALT CHECK.."
d=$( ${PATHRT}/compare_ncfile.py ${RTPWD}/${CNTL_DIR}/$i ${RUNDIR}/$i 2>/dev/null | wc -l )
MinsukJi-NOAA marked this conversation as resolved.
Show resolved Hide resolved
fi
fi

if [[ $d -ne 0 ]]; then
echo "....NOT OK" >> ${REGRESSIONTEST_LOG}
echo "....NOT OK"
test_status='FAIL'
else
echo "....OK" >> ${REGRESSIONTEST_LOG}
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_2threads
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_bmark
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/MOM.res_1.nc \
RESTART/MOM.res_2.nc \
RESTART/MOM.res_3.nc \
RESTART/iced.2013-04-02-00000.nc"
#RESTART/ufs.cpld.cpl.r.2013-04-02-00000.nc"
RESTART/iced.2013-04-02-00000.nc \
RESTART/ufs.cpld.cpl.r.2013-04-02-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_bmark_wave
Original file line number Diff line number Diff line change
Expand Up @@ -56,8 +56,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/MOM.res_1.nc \
RESTART/MOM.res_2.nc \
RESTART/MOM.res_3.nc \
RESTART/iced.2013-04-02-00000.nc"
#RESTART/ufs.cpld.cpl.r.2013-04-02-00000.nc"
RESTART/iced.2013-04-02-00000.nc \
RESTART/ufs.cpld.cpl.r.2013-04-02-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_ca
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_control
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_control_12h
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,8 @@ export LIST_FILES="phyf012.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-03-43200.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-03-43200.nc"
RESTART/iced.2016-10-03-43200.nc \
RESTART/ufs.cpld.cpl.r.2016-10-03-43200.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_control_c192
Original file line number Diff line number Diff line change
Expand Up @@ -50,8 +50,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_control_c384
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/MOM.res_1.nc \
RESTART/MOM.res_2.nc \
RESTART/MOM.res_3.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_control_mx025
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/MOM.res_1.nc \
RESTART/MOM.res_2.nc \
RESTART/MOM.res_3.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_control_mx025_12h
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,8 @@ export LIST_FILES="phyf012.tile1.nc \
RESTART/MOM.res_1.nc \
RESTART/MOM.res_2.nc \
RESTART/MOM.res_3.nc \
RESTART/iced.2016-10-03-43200.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-03-43200.nc"
RESTART/iced.2016-10-03-43200.nc \
RESTART/ufs.cpld.cpl.r.2016-10-03-43200.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_controlfrac_c384
Original file line number Diff line number Diff line change
Expand Up @@ -53,8 +53,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/MOM.res_1.nc \
RESTART/MOM.res_2.nc \
RESTART/MOM.res_3.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_debug
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,8 @@ export LIST_FILES="phyf006.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-03-21600.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-03-21600.nc"
RESTART/iced.2016-10-03-21600.nc \
RESTART/ufs.cpld.cpl.r.2016-10-03-21600.nc"

export_fv3
export_cpl
Expand Down
4 changes: 2 additions & 2 deletions tests/tests/cpld_decomp
Original file line number Diff line number Diff line change
Expand Up @@ -51,8 +51,8 @@ export LIST_FILES="phyf024.tile1.nc \
RESTART/sfc_data.tile5.nc \
RESTART/sfc_data.tile6.nc \
RESTART/MOM.res.nc \
RESTART/iced.2016-10-04-00000.nc"
#RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"
RESTART/iced.2016-10-04-00000.nc \
RESTART/ufs.cpld.cpl.r.2016-10-04-00000.nc"

export_fv3
export_cpl
Expand Down
Loading