Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WCOSS2 GFS ops updates to address two issues (anal_calc & gfs_forecast) #727

Conversation

KateFriedman-NOAA
Copy link
Member

@KateFriedman-NOAA KateFriedman-NOAA commented Apr 12, 2022

Description

This PR includes changes to address two open issues with the GFS in ops on WCOSS2:

  1. gdas_atmos_analysis_calc runtime variability (set hyper=true)
  2. gfs_forecast initialization and output frequency timing issues (adjusted resource configuration)

These changes have been tested and vetted by team investigating issues on WCOSS2. NCO/@WeiWei-NCO is making these changes in ops.

Type of change

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)

How Has This Been Tested?

@RussTreadon-NOAA and @JamesAbeles-NOAA tested/vetted the hyper-true setting for the analysis_calc job on WCOSS2. This job will continue to be watched and investigated as more runtime samples on Cactus become available.

@GeorgeVandenberghe-NOAA and @KateFriedman-NOAA tested/vetted the gfs_forecast resource configuration on WCOSS2.

- Based on optimization work done by EIB on WCOSS2.
- Adjust the C768 gfs layout, thread #, I/O groups, and mpiprocs to a
more optimized and consistent configuration.
- This configuration has a faster initialization (~7mins) and more
consistent output frequency to benefit downstream users.
- This configuration runs in approximately 6260s (~104mins) and is under
the max core # compared to WCOSS1.

Refs: NOAA-EMC#399
- Job encountered significant runtime variability in ops
- Investigation team recommended setting hyper=true to help

Refs: NOAA-EMC#399
@KateFriedman-NOAA KateFriedman-NOAA added the production update Processing update in production label Apr 12, 2022
@KateFriedman-NOAA KateFriedman-NOAA added this to the WCOSS2 - GFSv16.2.0 milestone Apr 12, 2022
@KateFriedman-NOAA KateFriedman-NOAA self-assigned this Apr 12, 2022
@KateFriedman-NOAA
Copy link
Member Author

This PR takes care of the ecflow side of things. Will need to make a corresponding update to add hyper=true for the rocoto side. Will submit that change in another PR.

@KateFriedman-NOAA KateFriedman-NOAA merged commit 7404a9b into NOAA-EMC:feature/ops-wcoss2 Apr 12, 2022
kayeekayee pushed a commit to kayeekayee/global-workflow that referenced this pull request May 30, 2024
* Code update for HR4_roughness
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
production update Processing update in production
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants