Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Orog gsl improvements #718

Merged

Conversation

mdtoyNOAA
Copy link
Contributor

@mdtoyNOAA mdtoyNOAA commented Dec 2, 2022

OA3_fixes.pdf

DESCRIPTION OF CHANGES:

The orographic asymmetry (OA) fields generated by orog_gsl have a negative bias, especially for high resolution grids. The issue is that with higher-resolution grids, there are fewer fine-grid (5km spacing for large-scale fields, and 1km for small-scale fields) topographic data points within each model grid cell to use for sampling and determining the statistical properties, such as OA. Songyou Hong (NOAA/PSL) discovered that the cause of the negative bias is due to the case when there are an odd number of fine-grid points along a cardinal direction relative to the model grid cell. The limits of the "do-loops" for OA calculation cause fewer points to be sampled in one-half of the grid cell than the other. Songyou found a fix to this problem, which is to modify the limits of the "do-loops" when there are an odd number of fine-grid points along a cardinal direction so that the number of points in each half of the grid are the same. Details of the fix are described in issue #716.
Plots of the orographic asymmetry in the South-West direction (OA3) are shown here. The old baseline fields show a negative bias (too much blue shading), especially for the "large-scale" field, which uses a coarser sub-grid topographic data set and results in larger sampling error. The new fields display a more random field, which varies between -1 and 1, which is the desired result.

TESTS CONDUCTED:

Contingency tests were run on Hera with the Intel compiler. The tests were run with the script UFS_UTILS/reg_tests/grid_gen/driver.hera.sh. All tests passed except for the "REGIONAL GSL GWD TEST", which is expected because this PR changes the baseline results. The test log "consistency.log05" is on Hera at:
/scratch1/BMC/wrfruc/mtoy/git_local/UFS_UTILS/reg_tests/grid_gen

The differences from the baseline were only due to the "OA1,OA2,OA3,OA4" variables, as expected. The following lines from "consistency.log05 show this:

  • /scratch2/NCEPDEV/nwprod/hpc-stack/libs/hpc-stack/intel-2022.1.2/nccmp/1.8.9.0/bin/nccmp -dmfqS C772_oro_data_ls.tile7.halo0.nc /scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/grid_gen/baseline_data/regional.gsl.gwd/C772_oro_data_ls.tile7.halo0.nc
    Variable Group Count Sum AbsSum Min Max Range Mean StdDev
    oa1 / 21981 8205.24 8205.24 0.0357143 1 0.964286 0.373288 0.165789
    oa2 / 37232 13395.9 13395.9 0.047619 1 0.952381 0.359795 0.153006
    oa3 / 49106 42914.1 42914.1 0.178571 2 1.82143 0.873908 0.268177
    oa4 / 47601 18064.9 18064.9 0.0357143 1 0.964286 0.379508 0.179291

  • /scratch2/NCEPDEV/nwprod/hpc-stack/libs/hpc-stack/intel-2022.1.2/nccmp/1.8.9.0/bin/nccmp -dmfqS C772_oro_data_ss.tile7.halo0.nc /scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/grid_gen/baseline_data/regional.gsl.gwd/C772_oro_data_ss.tile7.halo0.nc
    Variable Group Count Sum AbsSum Min Max Range Mean StdDev
    oa1 / 21914 1305.27 1305.27 0.000137746 0.236949 0.236811 0.0595634 0.0332465
    oa2 / 794 62.2958 62.2958 0.000238895 0.198674 0.198435 0.0784582 0.0375766
    oa3 / 48203 10020.6 10020.6 0.000925064 0.675325 0.6744 0.207883 0.0718323
    oa4 / 48157 3474 3474 0.000163794 0.302521 0.302357 0.072139 0.0354685

The new baselines are on Hera at:
/scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/grid_gen/baseline_data/regional.gsl.gwd/C772_oro_data_ls.tile7.halo0.nc
and
/scratch1/NCEPDEV/nems/role.ufsutils/ufs_utils/reg_tests/grid_gen/baseline_data/regional.gsl.gwd/C772_oro_data_ss.tile7.halo0.nc

DEPENDENCIES:

None

DOCUMENTATION:

N/A

ISSUE:

This PR fixes issue #716.

CONTRIBUTORS:

Thank you to Songyou Hong (songyou.hong@noaa.gov) (NOAA/PSL) for contributing the code fix.

@GeorgeGayno-NOAA
Copy link
Collaborator

@mdtoyNOAA - In the PR description, you say, "Plots of the orographic asymmetry in the South-West direction (OA3) are shown on the attached plot." Can you link to the plot or the pdf containing the plot? Or say something like, "See the Mike Toy presentation in issue #716."

@mdtoyNOAA
Copy link
Contributor Author

@GeorgeGayno-NOAA Will do. I attached it using the generic "add file" button at the bottom of the edit page. It put the link at the top. I was afraid folks would miss it.

@GeorgeGayno-NOAA
Copy link
Collaborator

Checked out the branch at 17d39be on Jet and Orion. The branch was compiled and the grid_gen regression tests were run. The REGIONAL GSL GWD TEST failed as expected. The differences from the baseline were the same as on Hera. All other grid_gen tests passed. Will test on WCOSS2 when that machine is out of maintenance.

@GeorgeGayno-NOAA
Copy link
Collaborator

Checked out the branch at 17d39be on Jet and Orion. The branch was compiled and the grid_gen regression tests were run. The REGIONAL GSL GWD TEST failed as expected. The differences from the baseline were the same as on Hera. All other grid_gen tests passed. Will test on WCOSS2 when that machine is out of maintenance.

The above was repeated on Hera and WCOSS2. The same test failed. The difference from the baseline on both machines matched that documented by @mdtoyNOAA.

Will merge to 'develop'.

@GeorgeGayno-NOAA GeorgeGayno-NOAA merged commit 2c88329 into ufs-community:develop Dec 7, 2022
bluefinweiwei added a commit to DTC-phytne/UFS_UTILS that referenced this pull request Mar 27, 2023
ufs-community#718
	modified:   module_gsl_oro_data_lg_scale.f90
	modified:   module_gsl_oro_data_sm_scale.f90
AnnetteGibbs-NOAA added a commit to AnnetteGibbs-NOAA/UFS_UTILS that referenced this pull request Jul 3, 2023
* origin/develop:
  Update ccpp submodule (ufs-community#827)
  Change length of character variable "mosaic_name" in "make_solo_mosaic.c" (ufs-community#824)
  Update GDAS INIT utility for GFS COM reorganization (ufs-community#820)
  Add backup calculation for orography and mask generation (ufs-community#713)
  Improve repository build script (ufs-community#819)
  Use latest wgrib2 executable on Jet. (ufs-community#816)
  chgres_cube - Minor update for high-resolution grids . (ufs-community#814)
  Update PR template (ufs-community#813)
  global_cycle - Add soil moisture nudging for NoahMP option (ufs-community#809)
  Release v1.10.0 (ufs-community#807)
  Run sfc_climo_gen utility on Hera (ufs-community#791)
  Fix bug in chgres_cube subroutine search_many (ufs-community#808)
  sfc_climo_gen - Output fractions of each vegetation/soil type category (ufs-community#748)
  Replace w3nco library with w3emc (ufs-community#802)
  Fix Debug compilation (ufs-community#800)
  Update WCOSS2 build module to use new ESMF v8.4.1 library. (ufs-community#799)
  Update chgres_cube documentation for duplicate grib2 records (ufs-community#795)
  Use latest Cray modules on WCOSS2 (ufs-community#792)
  Remove checksum attribute from global_cycle restart files (ufs-community#794)
  Remove goto statements from chgres_cube (ufs-community#775)
  FVCOM_TOOLS - Remove dependency on module_nwp_base.f90 (ufs-community#790)
  Remove "gcovr" step from the 'developer' workflow (ufs-community#785)
  Update build module for Cheyenne (ufs-community#783)
  GDAS Init utility - consolidate the copy of coldstart files (ufs-community#773)
  Remove support for ODIN machine (ufs-community#782)
  Update GDAS INIT utility to optionally use fracoro data (ufs-community#741)
  Option to build only application specific utilities (e.g. GFS) (ufs-community#777)
  Use combined IP/IP2 library (ufs-community#695)
  Initial updates to global_cycle for Noah-MP land model (ufs-community#774)
  New resolution options for the cpld_gridgen utility (ufs-community#769)
  Use new EPIC-maintained hpc-stack on Jet  (ufs-community#771)
  Update GDAS initialization scripts for the new ENKF directory (ufs-community#764)
  Reduce memory usage in chgres_cube (ufs-community#766)
  Detect duplicate vertical levels in chgres_cube. (ufs-community#767)
  Point to new input orography directory. (ufs-community#758)
  Release version 1.9 (ufs-community#754)
  HAFSv1 grid nesting updates (ufs-community#752)
  Remove compiler warnings from chgres_cube (ufs-community#747)
  chgres_cube: Split input_data module into to 3 separate modules (ufs-community#744)
  More work on CI, checking with different versions of ESMF (ufs-community#742)
  Add processing of soil color to sfc_climo_gen (ufs-community#721)
  more work on CI - added Linux_versions workflow (ufs-community#739)
  Add TEST_FILE_DIR option to CMake build, where test data files can be found instead of using FTP.  (ufs-community#732)
  adding developer workflow (ufs-community#724)
  Update GDAS INIT utility for v16.3. (ufs-community#723)
  OROG_GSL - Remove negative bias in orographic asymmetery (OA) fields (ufs-community#718)
  Incorporate BNU soil type data (ufs-community#717)
  High-resolution MODIS and STATSGO veg/soil data. (ufs-community#703)
  Run WCOSS2 consistency tests under role account (ufs-community#711)
  Fix macOS CI workflow (ufs-community#715)
  Add utility codes to create BNU soil texture data (ufs-community#707)
  Update chgres_cube to output netcdf4 file. (ufs-community#704)
  Incorporate high-res global VIIRS vegetation data. (ufs-community#699)
  Run grid_gen consistency tests in parallel. (ufs-community#697)
  Fix error handling in "link_fixdirs.sh". Add -L to the copy command. (ufs-community#701)
  Update for new fixed data directory structure (ufs-community#688)
  Add WCOSS2 support for tests (ufs-community#693)
  Increase test data pull timeout (ufs-community#692)
  Option to install binaries to any directory. (ufs-community#685)
  Update global_cycle to use the latest CCPP version of sfcsub.F (ufs-community#671)
  Incorporate weight_gen program. (ufs-community#677)
  Add install of jpeg-turbo to macos workflows (ufs-community#684)
  Improve logic in regression test driver script (ufs-community#681)
  Release v1.8 (ufs-community#679)
  Update link_fixdirs.sh for new data directories (ufs-community#672)
  Update default ice climatology in ./ush/global_cycle.sh. (ufs-community#664)
  Remove all references to WCOSS 1 from UFS_UTILS (ufs-community#667)
  Update workflows to use latest macOS and ubuntu (ufs-community#675)
  Update GDAS Initialization utility for recent HPSS tarball name change (ufs-community#666)
  Port UFS_UTILS to WCOSS2 (ufs-community#642)
  Fix chgres_cube to process GEFS GRIB2 data (ufs-community#658)
  Update global_cycle_driver.sh for GFS OPS directory convention  (ufs-community#655)
  Update documentation for SRW App (ufs-community#656)
  New coupled model utility (ufs-community#647)
  Update support for S4 and enable regression testing (ufs-community#654)
  global_cycle - Link to CCPP version of sfcsub.F (ufs-community#636)
  Add processing of new global AFWA snow data to emcsfc_snow2mdl. (ufs-community#648)
  Update build module on Cheyenne (ufs-community#646)
  Move to Intel 2022 on Jet, Hera and Orion (ufs-community#650)
  Host doxygen documentation for multiple releases (ufs-community#644)
  Download unit test data as part of the CMake build (ufs-community#630)
  chgres_cube - Complete removal of wgrib2 library (ufs-community#641)
  Eliminate circular dependency in chgres_cube
  Update workflow files to pull netcdf-c library from GitHub
  chgres_cube - Remove the wgrib2 library from the GRIB2 data read routines.
  Undefined symbols on macOS with Intel compiler (ufs-community#628)
  Update FVCOM code to handle sub-domain restart files using multiple cores. (ufs-community#624)
  chgres_cube - Run routine 'convert_omega' on all tasks. (ufs-community#627)
  Use ESMF 8.2.0 library
  Automate update of consistency test baseline data. (ufs-community#603)
  Update workflow files to use newer versions of ESMF and NCEPLIBS. (ufs-community#617)
  Update build modules to be lua compliant (ufs-community#614)
  Allow FVCOM tools to Update Ice Surface Roughness Length (ufs-community#604)
  Update the requested memory in the Orion chgres_cube consistency test script (ufs-community#611)
  Use copy of grib_util under Jet role account. (ufs-community#608)
  Run consistency tests on Orion using role account (ufs-community#606)
  Run consistency tests on Hera using role account (ufs-community#605)
  Run consistency tests on Jet using role account. (ufs-community#607)
  Update more documentation after move to ufs-community (ufs-community#597)
  fvcom_tools - Add option to process 'cold' or 'warm' restart files (ufs-community#595)
  Update documentation after move to ufs-community (ufs-community#594)
  chgres_cube - Eliminate segmentation fault in input_data.F90 (ufs-community#585)
  Update to language of unit test README to match that in unit test.
  chgres_cube - Simplify surface processing using field bundles (ufs-community#572)
  Add compiler flags for GNU Fortran v10 or newer compilers. (ufs-community#583)
  Move verbose output from example unit test to be commented to streamline test output.
  Updates to test README to add instructions for use of example unit test.
  Add Findwgrib2.cmake (ufs-community#578)
  Added unit test to be used as an instructional example for new users.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants