Add lightning data paths from disk to machine files.

[EdwardSnyder-NOAA]

The purpose of this issue is to determine which RDHPCS platforms have stagged lightning obs data and update the corresponding machine files.

[EdwardSnyder-NOAA]

Lightning obs data is found on Hera, Jet, and Orion. Hera has two directory one with current data and one archive. Jet and Orion both have archive datasets.
Hera (current): /scratch2/BMC/public/data/lightning
Hera (archive): /scratch2/BMC/zrtrr/rli/data/lightning
Jet: /mnt/lfs4/BMC/wrfruc/Ruifang.Li/data/lightning
Orion: /work/noaa/wrfruc/mhu/rrfs/data/lightning

[EdwardSnyder-NOAA]

Added lightning paths to Hera, Jet, and Orion via PR #644. Didn't add the current Hera lightning path. We will need to address how we will switch between retro and non-retro runs as these paths and other variables will change. The dev1 branch has this script that switched between paths.

[EdwardSnyder-NOAA]

Daniel's PR 647 addresses how to switch between a retro and non-retro run.

[EdwardSnyder-NOAA]

Archive paths need to point to files under /path/to/UFS_SRW_data folder on our RDHPCS platforms. Copy only the case data we want. Look to our RRFS.config.yaml for which data we should copy over.

[christinaholtNOAA]

@EdwardSnyder-NOAA I'm finding these supported paths on those platforms:

Hera: /scratch2/BMC/public/data/lightning/vaisala/netcdf
Jet: /public/data/lightning/vaisala/netcdf/

I'm not seeing any paths set for WCOSS in RRFS_dev1.

@mkavulich Might also find this helpful with his work on retrieving data.

[EdwardSnyder-NOAA]

Awesome, you found the current lightning data on Jet! I was missing that. I'll tag @danielabdi-noaa so he can add that path to the LIGHTNING_ROOT in Jet's real time section of his PR 647.

[danielabdi-noaa]

@EdwardSnyder-NOAA I have Updated the realtime path on Jet. It was not specified in set_rrfs_config.sh file for some reason.

[EdwardSnyder-NOAA]

Decided to put the lightning data under a new directory called rrfs_retro_data since we have more rrfs data to stage. The full path to the lightning data on Jet and Hera are as followed:
Jet: /mnt/lfs4/HFIP/hfv3gfs/role.epic/UFS_SRW_data/develop/rrfs_retro_data/lightning/vaisala/netcdf
Hera: /scratch1/NCEPDEV/nems/role.epic/UFS_SRW_data/develop/rrfs_retro_data/lightning/vaisala/netcdf

I put the first 12 hours of lightning data for the July 20th, 2022, case in these directories. This is the case that is listed in the config.rrfs.yaml. Down the road we should talk about which cases we would like to include in the config files and for the release.

[EdwardSnyder-NOAA]

@danielabdi-noaa - I created these lightning paths on Hera and Jet and staged 12 hours of the config.rrfs.yaml case lightning data there. Could you update the LIGHTNING_ROOT paths for the retro section of the Hera and Jet machine files? Thanks!

[danielabdi-noaa]

@EdwardSnyder-NOAA Ok I will updated it. Thanks!

[EdwardSnyder-NOAA]

Closing since we have paths on Jet and Hera with enough lightning data to run a short cycle.