GFSv16.3.22 - OBSPROCv1.3 and updated USAF snow filename #2913
Comments
KateFriedman-NOAA
changed the title
KateFriedman-NOAA
changed the title
|
Release branch for this created: https://github.com/NOAA-EMC/global-workflow/tree/release/gfs.v16.3_obsproc_snow Will rename release branch to version once the version is known. |
|
The new snow file will need to be exported from here. I have been using AFWA_GLOBAL_FILE. The AFWA_NH_FILE and AFWA_SH_FILE variables can be removed. How can we test this? |
@ilianagenkova Do you have a para COM for |
|
On Dogwood: /lfs/h2/emc/stmp/iliana.genkova/CRON/R13/com/obsproc/v1.3/g*/*/atmos/usaf -rw-r--r-- 1 iliana.genkova emc 42315832 Sep 12 05:40 gdas.20240912/00/atmos/gdas.t00z.snow.usaf.grib2 |
|
Branch renamed and recut based on |
KateFriedman-NOAA
changed the title
KateFriedman-NOAA
changed the title
@ilianagenkova Is this available on Cactus as well? |
Replace AFWA_NH_FILE and AFWA_SH_FILE with AFWA_GLOBAL_FILE Refs NOAA-EMC#2913
|
@ilianagenkova Do you have a copy of the new obsproc |
Also include mention of related updates for AFWA snow filename and GSI code update. Refs NOAA-EMC#2913
Nevermind, I see it now, thanks!
I've gone ahead and installed copies of both the obsproc and prepobs release branches for this upgrade. I will use the provided COM and installs to test the GFS on Cactus. |
|
@ilianagenkova I ran the GFSv16 workflow with the new Please take a look at the following log and output on WCOSS2-Cactus and let me know if the prep job ran as expected. Thanks! |
|
@KateFriedman-NOAA , thanks for testing the processing end-to-end. The prep job output looks good! |
|
@ilianagenkova Excellent! I see I even reproduced your prepbufr file: Thanks for checking and confirming! |
|
@GeorgeGayno-NOAA I think we're ready for a UFS_UTILS tag to include in the release branch for this update. |
See: https://github.com/ufs-community/UFS_UTILS/releases/tag/ops-gfsv16.3.20 |
Add it back if decision is made to update for saildrone. Refs NOAA-EMC#2913
Add further information to describe change to AFWA global snow file Refs NOAA-EMC#2913
Updates for the new `obsproc/v1.3` and AFWA global snow filename. A new UFS_UTILS tag (`ops-gfsv16.3.20`) is used for the snow filename changes. The prepobs package is also updated to `v1.2.0` but is internal to the upstream obsproc package so only the `prepobs_run_ver` variables are updated for dev mode usage. Additionally, workflow updates are made to allow the EMCSFC_SFC_PREP (sfcprep) job to be run as part of the rocoto mesh in dev/emc mode. A new switch `DO_SFCPREP` is added to `config.base.emc.dyn` and is set to "NO" by default. Setting it to "YES" will add the `sfcprep` job to the rocoto mesh ahead of the `prep` job and will generate the snogrb files that are usually generated in ops and used via the GDA. Refs #2913
|
Once the ARFC in issue #2951 goes in I will sync those updates into the release branch for this. Only remaining question is whether a GSI update to handle saildrone data in the new |
|
@ADCollard I added you as an assignee as a formality since the GSI is updating for this version. |
|
Hand-off tag |
- Now consistent with the same resources set in config.resources.emc.dyn. - Also added "sfcprep" and "prep" to task list in both versions of config.resources. Refs NOAA-EMC#2913
Per a request from the NCO SPA (Diane Stokes) assigned to the GFSv16.3.20 implementation, the sfcprep block that was added to `config.resources.emc.dyn` for dev mode is now also added to `config.resources.nco.static.` This makes both resource configs consistent with each other for the emcsfc_sfc_prep job. This also removes a non-fatal error from the sourcing of `config.resources` at runtime (due to the "sfcprep" job not being in the resource config at runtime). Refs #2913
|
PlanetIQ GPSRO data is now switched on for active assimilation (GSI PR #803). The gfsda.v16.3.20 tag was updated to reflect this change. |
Update Release Notes documenting active assimilation of PlanetIQ GPSRO data. Refs #2913
|
Recut hand-off tag (EMC-v16.3.20) after merging PR #3070. |
- Increase memory request for emcsfc_sfc_prep jobs - Increase walltime for wafs_blending_0p25 job Refs NOAA-EMC#2913
Fold in local changes made by NCO in the `gfs.v16.3.20` para install. These changes are already known, were made in prior ops versions manually, and are now being pulled into the current release package. The changes are: - Increase memory request for emcsfc_sfc_prep jobs - Increase walltime for wafs_blending_0p25 job Refs #2913
|
Recut hand-off tag (EMC-v16.3.20) after merging PR #3072. |
KateFriedman-NOAA
changed the title
KateFriedman-NOAA
changed the title
KateFriedman-NOAA
changed the title
|
@ADCollard I believe we need a new GSI tag for the saildrone changes now that it was separated from the PlanetIQ tag. I am building a new release branch for this upgrade so that it includes the WAFS removal upgrade that is now going in before this. Let me know when you have a new GSI tag for this upgrade and we can get it into the new release branch ( |
|
@RussTreadon-NOAA In reference to @KateFriedman-NOAA 's message above, can you tag the head of release/gfsda.v16 as Thanks. |
|
@ADCollard and @KateFriedman-NOAA : |
The order of this upgrade was moved back and thus the release branch needed to be remade. Includes all updates for the GFS upgrade to obsproc/v1.3 and the new global AFWA data file. Refs NOAA-EMC#2913
|
Thanks! @RussTreadon-NOAA |
|
Thanks @RussTreadon-NOAA ! I have added the new tag name to PR #3182, which remakes the release branch for this upgrade. @ADCollard and @RussTreadon-NOAA please review when able, thanks! Once approved, I will merge my fork branch into the auth branch, recut the hand-off tag, and coordinate with NCO to get the para install updated. |
|
@KateFriedman-NOAA I checked out your branch and ensured that the GSI tag was checked out as expected. |
|
Awesome, thanks @ADCollard ! |
The order of the upgrade to obsproc/v1.3 and the new AFWA global file was moved back and thus the release branch needed to be remade. This PR includes all updates for the GFS upgrade to obsproc/v1.3 and the new global AFWA data file: - new UFS_UTILS tag (`ops-gfsv16.3.20`) to support new global AFWA file - new GSI tag (`gfsda.v16.3.22`) to support obsproc/v1.3 and saildrone - workflow changes to support obsproc/v1.3 (and prepobs/v1.2 internal to obsproc) and AFWA global file - also workflow changes to allow developers to run the emcsfc_sfc_prep job within the rocoto mesh via `DO_SFCPREP=YES` in config.base This PR is a repeat of prior ones to get this package in place. Refs #2913
|
Hand-off tag recut: https://github.com/NOAA-EMC/global-workflow/releases/tag/EMC-v16.3.22 FYI @DianeStokes-NCO |
NCO provided increase in ncpus to avoid ncpu burst warnings. Refs #2913
|
Added small adjustment to resource settings for the |
Description
The snow data file provided by the USAF has changed names and the new name will go into affect with
obsproc.v1.3. The GFS will need to update to use the newobsproc.v1.3and the new snow filename. Additionally, the GSI will require a change in the GSI code (read_prepbufr.f) for the saildrone data.The prepobs package is also updating to
v1.2.0withobsproc/v1.3.0. This version is internal to the obsproc package but we'll want to update both obsproc and prepobs versions indevelopfor GFSv17. Will handle that separately.FYI @ilianagenkova @GeorgeGayno-NOAA @ADCollard
Update 10/21/24: NCO pulled the new CO2 fix files for 2025 into the gfs.v16.3.20 para install. Part of issue #2558 will be resolved via this issue.Now going in ahead of this as the new v16.3.20.Update 11/5/24: PlanetIQ GPSRO data is now switched on for active assimilation (NOAA-EMC/GSI#803). The gfsda.v16.3.20 tag was updated to reflect this changes.Went in v16.3.20Target version
v16.3.22 (previously v16.3.21 (previously v16.3.20))
Expected workflow changes
obsproc_ver=v1.3.and PlanetIQ GPSROchangesThe updated UFS_UTILS release tag is being worked under: Issue #973
The test branch is here: release/ops-gfsv16.3.1
Will need to coordinate to pass in the global afwa file from the JJOB to ./scripts/exemcsfc_global_sfc_prep.sh
The text was updated successfully, but these errors were encountered: