Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

GDAS_INIT data scripts point to the wrong HPSS GFS v16 retro directory #558

Closed
GeorgeGayno-NOAA opened this issue Aug 9, 2021 · 2 comments
Closed

GDAS_INIT data scripts point to the wrong HPSS GFS v16 retro directory #558

GeorgeGayno-NOAA opened this issue Aug 9, 2021 · 2 comments
Assignees
@GeorgeGayno-NOAA
Labels
bug Something isn't working

Comments

@GeorgeGayno-NOAA
Copy link
Collaborator

Sajal Kar tried to pull GFS v16 retrospective data for 2020/12/23/00 and get_v16retro.data.sh could not find the data. Apparently, the HPSS directory name changed. Updating the script as follows seem to have fixed it:

--- a/util/gdas_init/get_v16retro.data.sh
+++ b/util/gdas_init/get_v16retro.data.sh
@@ -25,7 +25,7 @@ if [ "$MEMBER" = "gfs" ]; then
   elif [ ${yy}${mm}${dd}${hh} -lt 2020122206 ]; then
     directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/${yy}${mm}${dd}${hh}
   else
-    directory=/NCEPDEV/emc-global/5year/emc.gloparadev/WCOSS_D/gfsv16/v16rt2n/${yy}${mm}${dd}${hh}
+    directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/${yy}${mm}${dd}${hh}
   fi

   file=gfs_netcdfa.tar
@@ -68,7 +68,7 @@ else
   elif [ $date10_m6 -lt 2020122200 ]; then
    directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/${yy_m6}${mm_m6}${dd_m6}${hh_m6}
   else
-   directory=/NCEPDEV/emc-global/5year/emc.gloparadev/WCOSS_D/gfsv16/v16rt2n/${yy_m6}${mm_m6}${dd_m6}${hh_m6}
+   directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/${yy_m6}${mm_m6}${dd_m6}${hh_m6}
   fi

 #----------------------------------------------------------------------
@@ -109,7 +109,7 @@ else
   elif [ ${yy}${mm}${dd}${hh} -lt 2020122206 ]; then
     directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/${yy}${mm}${dd}${hh}
   else
-    directory=/NCEPDEV/emc-global/5year/emc.gloparadev/WCOSS_D/gfsv16/v16rt2n/${yy}${mm}${dd}${hh}
+    directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/${yy}${mm}${dd}${hh}
   fi
@GeorgeGayno-NOAA GeorgeGayno-NOAA added the bug Something isn't working label Aug 9, 2021
@GeorgeGayno-NOAA GeorgeGayno-NOAA self-assigned this Aug 9, 2021
GeorgeGayno-NOAA added a commit to GeorgeGayno-NOAA/UFS_UTILS that referenced this issue Aug 10, 2021
@GeorgeGayno-NOAA
Update ./get_v16retro.data.sh for new location of v16rt2n
e37184f 
parallel data. Add error message to alert users when they
choose a date after the v16rt2n parallel ended. Fix
transition date between the v16rt2 and v16rt2n parallel data.

Fixes ufs-community#558
GeorgeGayno-NOAA added a commit to GeorgeGayno-NOAA/UFS_UTILS that referenced this issue Aug 10, 2021
@GeorgeGayno-NOAA
Merge branch 'develop' into bugfix/gdas_init
d86aabd 
Fixes ufs-community#558
@GeorgeGayno-NOAA
Copy link
Collaborator Author

GeorgeGayno-NOAA commented Aug 10, 2021 •
edited
Loading

First, test the new error message. The last complete GDAS v16rt2n dataset is 2021/03/25/00, and the last GFS dataset is 2021/03/25/06. Running for both dates show:

GDAS test:

+ '[' 2021032606 -lt 2020122212 ']'
+ '[' 2021032606 -le 2021032500 ']'
+ set +x
NO DATA FOR 2021032606

GFS test:

+ '[' 2021032612 -le 2020122200 ']'
+ '[' 2021032612 -le 2021032506 ']'
+ set +x
NO DATA FOR 2021032612

@GeorgeGayno-NOAA
Copy link
Collaborator Author

GeorgeGayno-NOAA commented Aug 10, 2021 •
edited
Loading

Next, check the transition date between the v16rt and v16rtn parallels. For the GFS dump, this occurs at 2020/12/22/06.

For 2020/12/22/00 it correctly chooses v16rt:

$  grep v16rt log.data.v16retro.gfs.save
+ directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122200
+ htar -tvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122200/gfs_netcdfa.tar
+ htar -xvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122200/gfs_netcdfa.tar -L ./list.hires3
HTAR: Extract complete for /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122200/gfs_netcdfa.tar, 2 files.

For 2020/12/22/06, it correctly chooses v16rtn:

$ grep v16rt log.data.v16retro.gfs.save2
+ directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122206
+ htar -tvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122206/gfs_netcdfa.tar
+ htar -xvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122206/gfs_netcdfa.tar -L ./list.hires3
HTAR: Extract complete for /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122206/gfs_netcdfa.tar, 2 files.

Next, check the transition date between the v16rt and v16rtn parallels. For the GDAS dump, this occurs at 2020/12/22/12.

For 2020/12/22/12 it correctly picks v16rt2:

$ grep v16rt2 log.data.v16retro.gdas.save
+ directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122206
+ htar -tvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122206/gdas_restartb.tar
+ htar -xvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122206/gdas_restartb.tar -L ./list.hires3
HTAR: Extract complete for /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122206/gdas_restartb.tar, 32 files.
+ directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122212
+ htar -tvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122212/gdas_restarta.tar
+ htar -xvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122212/gdas_restarta.tar -L ./list.hires3
HTAR: Extract complete for /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2/2020122212/gdas_restarta.tar, 5 files.

For 2020/12/22/18, it correctly picks v16rt2n:

/scratch1/NCEPDEV/da/George.Gayno/ufs_utils.git/UFS_UTILS/util/gdas_init $ grep v16rt2 log.data.v16retro.gdas.save2
+ directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122212
+ htar -tvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122212/gdas_restartb.tar
+ htar -xvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122212/gdas_restartb.tar -L ./list.hires3
HTAR: Extract complete for /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122212/gdas_restartb.tar, 32 files.
+ directory=/NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122218
+ htar -tvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122218/gdas_restarta.tar
+ htar -xvf /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122218/gdas_restarta.tar -L ./list.hires3
HTAR: Extract complete for /NCEPDEV/emc-global/5year/emc.glopara/WCOSS_D/gfsv16/v16rt2n/2020122218/gdas_restarta.tar, 5 files.

@GeorgeGayno-NOAA GeorgeGayno-NOAA mentioned this issue Aug 10, 2021
Merged
@KateFriedman-NOAA KateFriedman-NOAA mentioned this issue Aug 10, 2021
Closed
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@GeorgeGayno-NOAA GeorgeGayno-NOAA

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@GeorgeGayno-NOAA