Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change #996

Merged
merged 18 commits into from
Jan 10, 2022

Conversation

SMoorthi-emc
Copy link
Contributor

@SMoorthi-emc SMoorthi-emc commented Jan 5, 2022

PR Checklist

  • Ths PR is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR. Please consult the ufs-weather-model wiki if you are unsure how to do this.

  • This PR has been tested using a branch which is up-to-date with the top of all sub-component repositories except for those sub-components which are the subject of this PR

  • An Issue describing the work contained in this PR has been created either in the subcomponent(s) or in the ufs-weather-model. The Issue should be created in the repository that is most relevant to the changes in contained in the PR. The Issue and the dependent sub-component PR
    are specified below.

  • Results for one or more of the regression tests change and the reasons for the changes are understood and explained below.

  • New or updated input data is required by this PR. If checked, please work with the code managers to update input data sets on all platforms.

Instructions: All subsequent sections of text should be filled in as appropriate.

The information provided below allows the code managers to understand the changes relevant to this PR, whether those changes are in the ufs-weather-model repository or in a subcomponent repository. Ufs-weather-model code managers will use the information provided to add any applicable labels, assign reviewers and place it in the Commit Queue. Once the PR is in the Commit Queue, it is the PR owner's responsiblity to keep the PR up-to-date with the develop branch of ufs-weather-model.

Description

Provide a detailed description of what this PR does. What bug does it fix, or what feature does it add? Is a change of answers expected from this PR? Are any library updates included in this PR (modulefiles etc.)?
The PR fixes issues associated with initializing snow over fractional ice; sets z0ice in atmos_model.F90 to 1cm and removes some code in GFS_surface_composite code that can cause errors as they are no more needed.

The changes will change baseline results.

Issue(s) addressed

Link the issues to be closed with this PR, whether in this repository, or in another repository.
(Remember, issues must always be created before starting work on a PR branch!)

fixes fv3atm issue #460

Testing

How were these changes tested? What compilers / HPCs was it tested with? Are the changes covered by regression tests? (If not, why? Do new tests need to be added?) Have regression tests and unit tests (utests) been run? On which platforms and with which compilers? (Note that unit tests can only be run on tier-1 platforms)

  • hera.intel
  • hera.gnu
  • orion.intel
  • cheyenne.intel
  • cheyenne.gnu
  • gaea.intel
  • jet.intel
  • wcoss_cray
  • wcoss_dell_p3
  • opnReqTest for newly added/changed feature
  • CI: 2934aa7

No test has been made except a coupled restart test with one SDF on wcoss_dell_p3

Dependencies

If testing this branch requires non-default branches in other repositories, list them. Those branches should have matching names (ideally).

Do PRs in upstream repositories need to be merged first?
If so add the "waiting for other repos" label and list the upstream PRs

@junwang-noaa junwang-noaa changed the title This PR fixes/updates some issues in fv3atm and ccpp-physics as described in PR#460 and #824 fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change Jan 5, 2022
@junwang-noaa junwang-noaa added Baseline Updates Current baselines will be updated. hera-gnu-RT labels Jan 5, 2022
@BrianCurtis-NOAA
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: gnu
Job: RT
Repo location: /scratch1/NCEPDEV/nems/emc.nemspara/autort/pr/814304577/20220105183012/ufs-weather-model
Please manually delete: /scratch1/NCEPDEV/stmp2/emc.nemspara/FV3_RT/rt_14355
Test control 001 failed in check_result failed
Test control 001 failed in run_test failed
Test control_c48 003 failed in check_result failed
Test control_c48 003 failed in run_test failed
Test control_stochy 004 failed in check_result failed
Test control_stochy 004 failed in run_test failed
Test control_flake 005 failed in check_result failed
Test control_flake 005 failed in run_test failed
Test control_rrtmgp 006 failed in check_result failed
Test control_rrtmgp 006 failed in run_test failed
Test control_thompson 007 failed in check_result failed
Test control_thompson 007 failed in run_test failed
Test control_thompson_no_aero 008 failed in check_result failed
Test control_thompson_no_aero 008 failed in run_test failed
Test control_ras 009 failed in check_result failed
Test control_ras 009 failed in run_test failed
Test control_p7 010 failed in check_result failed
Test control_p7 010 failed in run_test failed
Test rap_control 011 failed in check_result failed
Test rap_control 011 failed in run_test failed
Test rap_2threads 012 failed in check_result failed
Test rap_2threads 012 failed in run_test failed
Test rap_sfcdiff 013 failed in check_result failed
Test rap_sfcdiff 013 failed in run_test failed
Test hrrr_control 015 failed in check_result failed
Test hrrr_control 015 failed in run_test failed
Test rrfs_v1beta 016 failed in check_result failed
Test rrfs_v1beta 016 failed in run_test failed
Test control_debug 017 failed in check_result failed
Test control_debug 017 failed in run_test failed
Test control_diag_debug 018 failed in check_result failed
Test control_diag_debug 018 failed in run_test failed
Test regional_debug 019 failed in check_result failed
Test regional_debug 019 failed in run_test failed
Test rap_control_debug 020 failed in check_result failed
Test rap_control_debug 020 failed in run_test failed
Test rap_diag_debug 021 failed in check_result failed
Test rap_diag_debug 021 failed in run_test failed
Test rap_noah_sfcdiff_cires_ugwp_debug 022 failed in check_result failed
Test rap_noah_sfcdiff_cires_ugwp_debug 022 failed in run_test failed
Test rrfs_v1beta_debug 023 failed in check_result failed
Test rrfs_v1beta_debug 023 failed in run_test failed
Test control_thompson_debug 024 failed in check_result failed
Test control_thompson_debug 024 failed in run_test failed
Test control_thompson_no_aero_debug 025 failed in check_result failed
Test control_thompson_no_aero_debug 025 failed in run_test failed
Test control_thompson_extdiag_debug 026 failed in check_result failed
Test control_thompson_extdiag_debug 026 failed in run_test failed
Test control_rrtmgp_debug 027 failed in check_result failed
Test control_rrtmgp_debug 027 failed in run_test failed
Test control_ras_debug 028 failed in check_result failed
Test control_ras_debug 028 failed in run_test failed
Test control_stochy_debug 029 failed in check_result failed
Test control_stochy_debug 029 failed in run_test failed
Test control_debug_p7 030 failed in check_result failed
Test control_debug_p7 030 failed in run_test failed
Test control_wam_debug 031 failed in check_result failed
Test control_wam_debug 031 failed in run_test failed
Test cpld_control_c96_p7 032 failed in check_result failed
Test cpld_control_c96_p7 032 failed in run_test failed
Test cpld_debug_p7 033 failed in run_test failed
Please make changes and add the following label back:
hera-gnu-RT

@BrianCurtis-NOAA
Copy link
Collaborator

Automated RT Failure Notification
Machine: hera
Compiler: intel
Job: RT
Repo location: /scratch1/NCEPDEV/nems/emc.nemspara/autort/pr/814304577/20220105181511/ufs-weather-model
Please manually delete: /scratch1/NCEPDEV/stmp2/emc.nemspara/FV3_RT/rt_29801
Test cpld_control_p7 001 failed in check_result failed
Test cpld_control_p7 001 failed in run_test failed
Test cpld_control_p7_rrtmgp 002 failed in check_result failed
Test cpld_control_p7_rrtmgp 002 failed in run_test failed
Test cpld_2threads_p7 003 failed in check_result failed
Test cpld_2threads_p7 003 failed in run_test failed
Test cpld_decomp_p7 004 failed in check_result failed
Test cpld_decomp_p7 004 failed in run_test failed
Test cpld_mpi_p7 005 failed in check_result failed
Test cpld_mpi_p7 005 failed in run_test failed
Test cpld_bmark_p7 006 failed in check_result failed
Test cpld_bmark_p7 006 failed in run_test failed
Test cpld_bmark_mpi_p7 007 failed in check_result failed
Test cpld_bmark_mpi_p7 007 failed in run_test failed
Test cpld_control_c96_p7 008 failed in check_result failed
Test cpld_control_c96_p7 008 failed in run_test failed
Test cpld_control_c192_p7 010 failed in check_result failed
Test cpld_control_c192_p7 010 failed in run_test failed
Test cpld_control_c384_p7 012 failed in check_result failed
Test cpld_control_c384_p7 012 failed in run_test failed
Test cpld_debug_p7 014 failed in run_test failed
Test control 015 failed in check_result failed
Test control 015 failed in run_test failed
Test control_decomp 016 failed in check_result failed
Test control_decomp 016 failed in run_test failed
Test control_2threads 017 failed in check_result failed
Test control_2threads 017 failed in run_test failed
Test control_fhzero 019 failed in check_result failed
Test control_fhzero 019 failed in run_test failed
Test control_CubedSphereGrid 020 failed in check_result failed
Test control_CubedSphereGrid 020 failed in run_test failed
Test control_latlon 021 failed in check_result failed
Test control_latlon 021 failed in run_test failed
Test control_wrtGauss_netcdf_parallel 022 failed in check_result failed
Test control_wrtGauss_netcdf_parallel 022 failed in run_test failed
Test control_c48 023 failed in check_result failed
Test control_c48 023 failed in run_test failed
Test control_c192 024 failed in check_result failed
Test control_c192 024 failed in run_test failed
Test control_c384 025 failed in check_result failed
Test control_c384 025 failed in run_test failed
Test control_c384gdas 026 failed in check_result failed
Test control_c384gdas 026 failed in run_test failed
Test control_stochy 027 failed in check_result failed
Test control_stochy 027 failed in run_test failed
Test control_lndp 029 failed in check_result failed
Test control_lndp 029 failed in run_test failed
Test control_p7 030 failed in check_result failed
Test control_p7 030 failed in run_test failed
Test control_p7_rrtmgp 031 failed in check_result failed
Test control_p7_rrtmgp 031 failed in run_test failed
Test control_decomp_p7 033 failed in check_result failed
Test control_decomp_p7 033 failed in run_test failed
Test control_2threads_p7 034 failed in check_result failed
Test control_2threads_p7 034 failed in run_test failed
Test regional_control 035 failed in check_result failed
Test regional_control 035 failed in run_test failed
Test regional_noquilt 037 failed in check_result failed
Test regional_noquilt 037 failed in run_test failed
Test regional_2threads 038 failed in check_result failed
Test regional_2threads 038 failed in run_test failed
Test regional_hafs 039 failed in check_result failed
Test regional_hafs 039 failed in run_test failed
Test regional_netcdf_parallel 040 failed in check_result failed
Test regional_netcdf_parallel 040 failed in run_test failed
Test regional_RRTMGP 041 failed in check_result failed
Test regional_RRTMGP 041 failed in run_test failed
Test rap_control 042 failed in check_result failed
Test rap_control 042 failed in run_test failed
Test rap_2threads 043 failed in check_result failed
Test rap_2threads 043 failed in run_test failed
Test rap_sfcdiff 044 failed in check_result failed
Test rap_sfcdiff 044 failed in run_test failed
Test hrrr_control 046 failed in check_result failed
Test hrrr_control 046 failed in run_test failed
Test rrfs_v1beta 047 failed in check_result failed
Test rrfs_v1beta 047 failed in run_test failed
Test control_rrtmgp 048 failed in check_result failed
Test control_rrtmgp 048 failed in run_test failed
Test control_rrtmgp_c192 049 failed in check_result failed
Test control_rrtmgp_c192 049 failed in run_test failed
Test control_csawmg 050 failed in check_result failed
Test control_csawmg 050 failed in run_test failed
Test control_csawmgt 051 failed in check_result failed
Test control_csawmgt 051 failed in run_test failed
Test control_flake 052 failed in check_result failed
Test control_flake 052 failed in run_test failed
Test control_ras 053 failed in check_result failed
Test control_ras 053 failed in run_test failed
Test control_thompson 054 failed in check_result failed
Test control_thompson 054 failed in run_test failed
Test control_thompson_no_aero 055 failed in check_result failed
Test control_thompson_no_aero 055 failed in run_test failed
Test control_wam 056 failed in check_result failed
Test control_wam 056 failed in run_test failed
Test control_debug 057 failed in check_result failed
Test control_debug 057 failed in run_test failed
Test control_2threads_debug 058 failed in check_result failed
Test control_2threads_debug 058 failed in run_test failed
Test control_CubedSphereGrid_debug 059 failed in check_result failed
Test control_CubedSphereGrid_debug 059 failed in run_test failed
Test control_wrtGauss_netcdf_parallel_debug 060 failed in check_result failed
Test control_wrtGauss_netcdf_parallel_debug 060 failed in run_test failed
Test control_stochy_debug 061 failed in check_result failed
Test control_stochy_debug 061 failed in run_test failed
Test control_lndp_debug 062 failed in check_result failed
Test control_lndp_debug 062 failed in run_test failed
Test control_rrtmgp_debug 063 failed in check_result failed
Test control_rrtmgp_debug 063 failed in run_test failed
Test control_csawmg_debug 064 failed in check_result failed
Test control_csawmg_debug 064 failed in run_test failed
Test control_csawmgt_debug 065 failed in check_result failed
Test control_csawmgt_debug 065 failed in run_test failed
Test control_ras_debug 066 failed in check_result failed
Test control_ras_debug 066 failed in run_test failed
Test control_diag_debug 067 failed in check_result failed
Test control_diag_debug 067 failed in run_test failed
Test control_debug_p7 068 failed in check_result failed
Test control_debug_p7 068 failed in run_test failed
Test control_thompson_debug 069 failed in check_result failed
Test control_thompson_debug 069 failed in run_test failed
Test control_thompson_no_aero_debug 070 failed in check_result failed
Test control_thompson_no_aero_debug 070 failed in run_test failed
Test control_thompson_extdiag_debug 071 failed in check_result failed
Test control_thompson_extdiag_debug 071 failed in run_test failed
Test regional_debug 072 failed in check_result failed
Test regional_debug 072 failed in run_test failed
Test rap_control_debug 073 failed in check_result failed
Test rap_control_debug 073 failed in run_test failed
Test rap_unified_drag_suite_debug 074 failed in check_result failed
Test rap_unified_drag_suite_debug 074 failed in run_test failed
Test rap_diag_debug 075 failed in check_result failed
Test rap_diag_debug 075 failed in run_test failed
Test rap_cires_ugwp_debug 076 failed in check_result failed
Test rap_cires_ugwp_debug 076 failed in run_test failed
Test rap_unified_ugwp_debug 077 failed in check_result failed
Test rap_unified_ugwp_debug 077 failed in run_test failed
Test rap_noah_debug 078 failed in check_result failed
Test rap_noah_debug 078 failed in run_test failed
Test rap_rrtmgp_debug 079 failed in check_result failed
Test rap_rrtmgp_debug 079 failed in run_test failed
Test rap_lndp_debug 080 failed in check_result failed
Test rap_lndp_debug 080 failed in run_test failed
Test rap_sfcdiff_debug 081 failed in check_result failed
Test rap_sfcdiff_debug 081 failed in run_test failed
Test rap_flake_debug 082 failed in check_result failed
Test rap_flake_debug 082 failed in run_test failed
Test rap_noah_sfcdiff_cires_ugwp_debug 083 failed in check_result failed
Test rap_noah_sfcdiff_cires_ugwp_debug 083 failed in run_test failed
Test rrfs_v1beta_debug 084 failed in check_result failed
Test rrfs_v1beta_debug 084 failed in run_test failed
Test control_wam_debug 085 failed in check_result failed
Test control_wam_debug 085 failed in run_test failed
Test hafs_regional_atm 086 failed in check_result failed
Test hafs_regional_atm 086 failed in run_test failed
Test hafs_regional_atm_ocn 087 failed in check_result failed
Test hafs_regional_atm_ocn 087 failed in run_test failed
Test hafs_regional_atm_wav 088 failed in check_result failed
Test hafs_regional_atm_wav 088 failed in run_test failed
Test hafs_regional_atm_ocn_wav 089 failed in check_result failed
Test hafs_regional_atm_ocn_wav 089 failed in run_test failed
Test hafs_regional_1nest_atm 090 failed in check_result failed
Test hafs_regional_1nest_atm 090 failed in run_test failed
Test hafs_regional_telescopic_2nests_atm 091 failed in check_result failed
Test hafs_regional_telescopic_2nests_atm 091 failed in run_test failed
Test hafs_global_1nest_atm 092 failed in check_result failed
Test hafs_global_1nest_atm 092 failed in run_test failed
Test hafs_regional_docn 094 failed in check_result failed
Test hafs_regional_docn 094 failed in run_test failed
Test hafs_regional_docn_oisst 095 failed in check_result failed
Test hafs_regional_docn_oisst 095 failed in run_test failed
Test control_atmwav 108 failed in check_result failed
Test control_atmwav 108 failed in run_test failed
Test control_c384gdas_wav 109 failed in check_result failed
Test control_c384gdas_wav 109 failed in run_test failed
Test control_atm_aerosols 110 failed in check_result failed
Test control_atm_aerosols 110 failed in run_test failed
Please make changes and add the following label back:
hera-intel-RT

@junwang-noaa
Copy link
Collaborator

junwang-noaa commented Jan 5, 2022

On hera, all the tests (gnu and intel) run to completion. All gnu tests have results change. DATM tests and hafs_global_multiple_4nests_atm test does not change results for INTEL compiler and all other tests changed results. With this we will create new baselines

@junwang-noaa
Copy link
Collaborator

@SMoorthi-emc would you please change BL_DATE to 20220105 in tests/rt.sh? Thanks

@SMoorthi-emc
Copy link
Contributor Author

SMoorthi-emc commented Jan 5, 2022 via email

@github-actions github-actions bot removed the run-ci label Jan 8, 2022
@junwang-noaa junwang-noaa added the Waiting for Reviews The PR is waiting for reviews from associated component PR's. label Jan 9, 2022
@junwang-noaa junwang-noaa added the Ready for Commit Queue The PR is ready for the Commit Queue. All checkboxes in PR template have been checked. label Jan 10, 2022
@junwang-noaa
Copy link
Collaborator

@SMoorthi-emc Please update your ufs-weather-model branch to point to fv3 develop branch.

@SMoorthi-emc
Copy link
Contributor Author

SMoorthi-emc commented Jan 10, 2022 via email

@MinsukJi-NOAA
Copy link
Contributor

Done. I had merge conflict in wcoss_dell_p3 log; hopefully it is ok Morthi

Looks like the wcoss dell p3 regression test log has been over-written.

@SMoorthi-emc
Copy link
Contributor Author

SMoorthi-emc commented Jan 10, 2022 via email

@MinsukJi-NOAA
Copy link
Contributor

I replaced it. Hopefully it is ok. Moorthi

Looks good. Thanks, Moorthi.

@MinsukJi-NOAA MinsukJi-NOAA merged commit afa30f3 into ufs-community:develop Jan 10, 2022
SamuelTrahanNOAA added a commit to NOAA-GSL/ufs-weather-model that referenced this pull request Mar 8, 2022
* Add ufs driver. Remove NEMS submodule. Update CMEPS. Update CDEPS. Feature/ort addition.  (ufs-community#931)

* Add UFS driver, a copy of two fortran files from the NEMS repository. Remove NEMS submodule.

* Update CMEPS for current escomp/master. Implement the ability to write mediator history files for ATM on tiles rather than mesh

* Update CDEPS component. The updated CDEPS includes code updates for GFS v16 data mode.

* Operation requirement test (ORT) for:
  - cpld_control_p7 thread and decomposition tests
  - cpld_bmark_p7 thread and decomposition tests
  - Due to the wave component in these tests, restart and debug do not work

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>

* fv3atm cap cleanup (ufs-community#954)

FV3 nuopc cap code cleanup. Remove used code/variables. Fix minor inconsistencies.

* CCPP cloud cover change for Thompson MP associated with Xu Randall, several bug fixes for regression testing scripts (ufs-community#962)

This PR contains code changes 1) to remove old comments in GFS_typedefs.F90, increase cloud cover for Thompson MP by passing convective cloud water mixing ratio to progcld6. 2) Updates for auto fixes

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>

* ccpp-physics ufs-community#806, #807, ufs-community#813, and ort modifications (ufs-community#970)

- CCPP Physics changes: see Wrapper for ccpp-physics ufs-community#806, #807, ufs-community#813, NOAA-EMC/fv3atm#447.
- UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion ufs-community#965

* Wrapper for ccpp-physics ufs-community#808 and 816 (roughness length over ice and NoahMP tsurf bugfix) (ufs-community#971)

* update submodule pointer for regression testing for ccpp-physics ufs-community#808,816: roughness length over ice and NoahMP tsurf bugfix
* Reduce time step from 600s to 450s for tests control_csawmg and control_csawmg_debug

Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>

* Use 'model set run clock' routine in FV3 NUOPC cap. (ufs-community#967)

* Update FV3 cap by adding 'model set run clock' specialization routine. Because FV3 cap does not modify 'Earth clock' anymore in case of a restarted run, that adjustment is now done in the UFS driver.
* Fix model_configure file for two tests to define `fhrot` parameter.

* Revert iovr=4 (exponential cloud overlap method) in RRTMG (ufs-community#963)

Revert/cleanup iovr=4 in RRTMG per developer's request. The current exponential cloud overlapping method used in RRTMG represents the method used in the pre-2018 operational HWRF model.

* Add fhzero ort test (ufs-community#977)

* Fhzero ORT applies to the two tests `control` and `control_p7`
* Test can be run by invoking, for example, `./opnReqTest -n control -c fhz`

* Add a new CDEPS test to use GSFv16 data mode in CDEPS ,update rt_weekly.conf and update MOM6 to main branch (20211220) (ufs-community#976)

* add a new cdeps test using GFS data mode
* update rt_weekly.conf to include cpld_bmark_p7_35d tests
* update MOM6

Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Bug fixes for WAM physics and regression tests, remove duplicate modules from ccpp-physics CMakeLists.txt (ufs-community#947)

*adds a new regression test control_wam_debug and fixes problems with the existing control_wam test (e.g. IAER was not set as intended).

* Update global inline post for outputting foundation temperature (ufs-community#968)

Update upp submodule in fv3atm with latest UPP version for outputting foundation temperature and fixing land-sea mask issue in global inline post.

* Regression test bug fixes for running on Jet or with Rocoto (ufs-community#981)

* Bug fixes for running on jet or with rocoto
1. Correctly detect Jet when deciding build job runtimes
2. Do not delete out and err files in compile & test jobs
3. Correct dependencies for WW3 in Rocoto
4. Do not hard-code ACCNR to h-nems
This PR also contains fv3/ccpp physics (CCPP PR#812) updates that implements a vertically-integrated formula to properly compute tracer column mass and ensure mass conservation for all tracers except TKE. See issue NCAR/ccpp-physics#811 for details

* MYNN sfclay (RAP suite) restart reproducibility (ufs-community#984)

*This PR turns on the rap_restart tests. Bit-for-bit reproducibility is achieved with the bug fixes for MYNN sfclay in the associated fv3atm and ccpp-physics PRs.

* fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change (ufs-community#996)

* Radar-derived microphysics temperature tendencies similar to operational HRRR (ufs-community#986)

This PR implements a feature of the operational HRRR, radar-derived microphysics temperature tendencies applied in the first N minutes of the forecast to improve clouds in the first few hours. Two regression tests are added.

* Turn on CICE albedo use by ATM for coupled model; update Prototype test suite to initial P8 configuration;  (ufs-community#944)

* add updates for suites, tests for initial P8 configuration
* add IOPT_SFC=3 as default; set IOPT_SFC=1 in p7 tests
* change min_seaice to 1e-6; set to 1e-11 in p7 tests
* set dddmp=0.1 in both P7 and P8. This matches the final
P7 configuration. It will change P7 baselines.
* set cdmbwd in both P7 and P8 to the final P7 configuration.
(1.0,2.2,1.0,1.0) for all resolutions. It will change P7 baselines.
* add dusan's ecflow fix for wcoss2
* update FV3 with Moorthis' snod fix
* update rt_weekly to use p8 tests
* change integration length to 5 days

* Thompson MP cloud tuning (ufs-community#1005)

* improves cloud fraction when using Thompson MP. See NCAR/ccpp-physics#809 for more details.

* Add a new HAFS regression test with Thompson MP and GFDL surface layer schemes and Corrected S4 template regression testing job card (ufs-community#995)

* Added a new regression test for HAFS. 
* Fixed the S4 RT template job card.

Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>

* CCPP: Update consistency checks and effective radii calculation for Thompson MP (ufs-community#1000)

This PR contains changes in ccpp-physics (Update consistency checks and effective radii calculation for Thompson MP) and adds two new regression tests for both Intel and GNU that use the new prognostic cloud scheme progcld_thompson with GFS v16 and with RAP. The new cloud scheme is activated by setting icloud == 3 in input.nml.

* Rremove nems_datm related code, update CDEPS, and remove run directories that are no longer needed by other tests (ufs-community#1008)

* Add fhzero ort to coupled tests (ufs-community#1009)

* Add fhz ort to cpld tests
* Set ACCNR in rt.sh, not detect_machine.sh. Add some comments explaining where the variable should not be set or used.

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Unified write_netcdf, add single file 'cubed_sphere_grid' output (ufs-community#1011)

* Unify write_netcdf and write_netcdf_parallel modules.
* Add support for writing 'cubed_sphere_grid' history files in a single netcdf file.

* Change standard name and unit of CCPP error flag variable in CCPP framework and physics (ufs-community#1013)

* updates the submodule pointers for fv3atm, ccpp-framework and ccpp-physics for:  Change standard name and unit of CCPP error flag variable in CCPP framework and physics.

* ESMF managed threading (ufs-community#1018)

Add code updates to enable the ESMF managed threading in UFS.


Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >

* sync-ww3 (ufs-community#1026)

* sync with ww3 develop branch

* Revisions to repair iovr=5 cloud overlap option (ufs-community#1025)

* This PR addresses part 2 of issue ufs-community#748 to activate the exponential-random cloud overlap method (iovr=5) in RRTMG. RT tests were added for  iovr=4 and iovr=5 options
* change iovr to use the environment variable in control.nml.IN; modify all tests that use control.nml.IN to set env. var. iovr=3 (except for new tests); remove restart files from new tests

* 2D decomposition on write grid, bug fix in FV3GFS_IO.F90, and quad precision in stochastic physics (ufs-community#1028)

- The 2D decomposition is enabled on write grid component.
- FV3atm PR NOAA-EMC/fv3atm#468 from @MicroTed 
- stochastic physics PR NOAA-PSL/stochastic_physics#53 from Dom.

Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>

* Update CMEPS for wave coupling (ufs-community#1034)


* add run phases to allow waves to run in the slow loop
* re-order hafs wave test
* update aliases in fd_nems.yaml
* update CMEPS to prevent advertise conflicts when s2sw is
still using connectors
* add correct masking variables to hafs nems.configure files

* 4DIAU bug fix when iau_filter_increments=T (ufs-community#990)

* Add lsm_cold_start variable for RUC LSM SCM support and gwdps bugfix (combined) (ufs-community#1037)

Co-authored-by: @SMoorthi-emc

* Update esmf 821b04 (ufs-community#1041)

* Update the version of ESMF library to 8.2.1b04
* Add the write group lon info for upp 2d decomposition test.

* Multiple output (nested) grids from fv3atm (ufs-community#1044)

Update fv3atm to support writing multiple history files for parent and nested domains.
Nested HAFS regression tests were updated to write out history files from all nested domains.

Co-authored-by: Bin Liu <bin.liu@noaa.gov>

* GPU-enabled version of Grell-Freitas convection in ccpp-physics (ufs-community#1043)

* Enable Thompson microphysics with UFS-Aerosols and update GOCART (ufs-community#1049)

This update allows the Thompson microphysics scheme to be used with prognostic aerosols (UFS-Aerosols) and updates GOCART to version 2.0.2.

* Add support for Stochastically Perturbed Parameterizations (SPP) in FV3 (ufs-community#982)

* Update CICE; add support for restart test when running single RT (was PR 1058); update MOM6 (was PR 1060) (ufs-community#1045)


* update cice
* (1) pointing MOM6 to testing branch (MOM6 main repo PR: mom-ocean/MOM6#1556 (comment))
    (2) add three new files in mom_cmake file
            core/MOM_porous_barriers.F90
            external/drifters/MOM_particles.F90
            external/drifters/MOM_particles_types.F90
    (3) explicitly set in MOM_input for all resolutions to reflect the default value changes in code to retain answer
        EPBL_MLD_BISECTION = True (default changed from T to F in this MOM6 PR)
        INTERNAL_WAVE_SPEED_BETTER_EST = False (default changed from F to T in this MOM6 PR)
        note BBL_USE_EOS now set to use the value of USE_EOS in this MOM6 PR,
        but we set BBL_USE_EOS explicit so it has no impact

* remove duplicated CHL input setting in MOM_input_template_050
* add support for restart tests while running single RT

* lateral boundary fix for regional runs (ufs-community#1050)

This PR fixes a transient increase in noise caused by incorrect processing of winds along the lateral boundary on the final acoustic time step before fresh boundary information is ingested into the model.

* Update pointer to FV3

* Point to Christina's branches.

* Update RT log for Hera Intel.

* Adding RT log for Hera GNU tests.

* Updating RT log for Jet Intel tests.

* Latest regression tests on Jet.

* Adding regression logs.

* Updating regression test date stamp.

* Point to GSL repositories for FV3 and FV3/ccpp/physics

Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Grant Firl <grant.firl@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: mzhangw <mzhangw@gmail.com>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: Samuel Trahan (NOAA contractor) <39415369+SamuelTrahanNOAA@users.noreply.github.com>
Co-authored-by: SMoorthi-emc <47667426+SMoorthi-emc@users.noreply.github.com>
Co-authored-by: ChunxiZhang-NOAA <49283036+ChunxiZhang-NOAA@users.noreply.github.com>
Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>
Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>
Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >
Co-authored-by: Ali.Abdolali <37336972+aliabdolali@users.noreply.github.com>
Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>
Co-authored-by: Jeff Whitaker <jswhit@fastmail.fm>
Co-authored-by: DomHeinzeller <58610420+DomHeinzeller@users.noreply.github.com>
Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: JeffBeck-NOAA <55201531+JeffBeck-NOAA@users.noreply.github.com>
Co-authored-by: MatthewPyle-NOAA <48285220+MatthewPyle-NOAA@users.noreply.github.com>
SamuelTrahanNOAA added a commit to NOAA-GSL/ufs-weather-model that referenced this pull request Mar 15, 2022
* Merge ufs-community develop into gsl/develop (#119)

* Add ufs driver. Remove NEMS submodule. Update CMEPS. Update CDEPS. Feature/ort addition.  (ufs-community#931)

* Add UFS driver, a copy of two fortran files from the NEMS repository. Remove NEMS submodule.

* Update CMEPS for current escomp/master. Implement the ability to write mediator history files for ATM on tiles rather than mesh

* Update CDEPS component. The updated CDEPS includes code updates for GFS v16 data mode.

* Operation requirement test (ORT) for:
  - cpld_control_p7 thread and decomposition tests
  - cpld_bmark_p7 thread and decomposition tests
  - Due to the wave component in these tests, restart and debug do not work

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>

* fv3atm cap cleanup (ufs-community#954)

FV3 nuopc cap code cleanup. Remove used code/variables. Fix minor inconsistencies.

* CCPP cloud cover change for Thompson MP associated with Xu Randall, several bug fixes for regression testing scripts (ufs-community#962)

This PR contains code changes 1) to remove old comments in GFS_typedefs.F90, increase cloud cover for Thompson MP by passing convective cloud water mixing ratio to progcld6. 2) Updates for auto fixes

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>

* ccpp-physics ufs-community#806, #807, ufs-community#813, and ort modifications (ufs-community#970)

- CCPP Physics changes: see Wrapper for ccpp-physics ufs-community#806, #807, ufs-community#813, NOAA-EMC/fv3atm#447.
- UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion ufs-community#965

* Wrapper for ccpp-physics ufs-community#808 and 816 (roughness length over ice and NoahMP tsurf bugfix) (ufs-community#971)

* update submodule pointer for regression testing for ccpp-physics ufs-community#808,816: roughness length over ice and NoahMP tsurf bugfix
* Reduce time step from 600s to 450s for tests control_csawmg and control_csawmg_debug

Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>

* Use 'model set run clock' routine in FV3 NUOPC cap. (ufs-community#967)

* Update FV3 cap by adding 'model set run clock' specialization routine. Because FV3 cap does not modify 'Earth clock' anymore in case of a restarted run, that adjustment is now done in the UFS driver.
* Fix model_configure file for two tests to define `fhrot` parameter.

* Revert iovr=4 (exponential cloud overlap method) in RRTMG (ufs-community#963)

Revert/cleanup iovr=4 in RRTMG per developer's request. The current exponential cloud overlapping method used in RRTMG represents the method used in the pre-2018 operational HWRF model.

* Add fhzero ort test (ufs-community#977)

* Fhzero ORT applies to the two tests `control` and `control_p7`
* Test can be run by invoking, for example, `./opnReqTest -n control -c fhz`

* Add a new CDEPS test to use GSFv16 data mode in CDEPS ,update rt_weekly.conf and update MOM6 to main branch (20211220) (ufs-community#976)

* add a new cdeps test using GFS data mode
* update rt_weekly.conf to include cpld_bmark_p7_35d tests
* update MOM6

Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Bug fixes for WAM physics and regression tests, remove duplicate modules from ccpp-physics CMakeLists.txt (ufs-community#947)

*adds a new regression test control_wam_debug and fixes problems with the existing control_wam test (e.g. IAER was not set as intended).

* Update global inline post for outputting foundation temperature (ufs-community#968)

Update upp submodule in fv3atm with latest UPP version for outputting foundation temperature and fixing land-sea mask issue in global inline post.

* Regression test bug fixes for running on Jet or with Rocoto (ufs-community#981)

* Bug fixes for running on jet or with rocoto
1. Correctly detect Jet when deciding build job runtimes
2. Do not delete out and err files in compile & test jobs
3. Correct dependencies for WW3 in Rocoto
4. Do not hard-code ACCNR to h-nems
This PR also contains fv3/ccpp physics (CCPP PR#812) updates that implements a vertically-integrated formula to properly compute tracer column mass and ensure mass conservation for all tracers except TKE. See issue NCAR/ccpp-physics#811 for details

* MYNN sfclay (RAP suite) restart reproducibility (ufs-community#984)

*This PR turns on the rap_restart tests. Bit-for-bit reproducibility is achieved with the bug fixes for MYNN sfclay in the associated fv3atm and ccpp-physics PRs.

* fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change (ufs-community#996)

* Radar-derived microphysics temperature tendencies similar to operational HRRR (ufs-community#986)

This PR implements a feature of the operational HRRR, radar-derived microphysics temperature tendencies applied in the first N minutes of the forecast to improve clouds in the first few hours. Two regression tests are added.

* Turn on CICE albedo use by ATM for coupled model; update Prototype test suite to initial P8 configuration;  (ufs-community#944)

* add updates for suites, tests for initial P8 configuration
* add IOPT_SFC=3 as default; set IOPT_SFC=1 in p7 tests
* change min_seaice to 1e-6; set to 1e-11 in p7 tests
* set dddmp=0.1 in both P7 and P8. This matches the final
P7 configuration. It will change P7 baselines.
* set cdmbwd in both P7 and P8 to the final P7 configuration.
(1.0,2.2,1.0,1.0) for all resolutions. It will change P7 baselines.
* add dusan's ecflow fix for wcoss2
* update FV3 with Moorthis' snod fix
* update rt_weekly to use p8 tests
* change integration length to 5 days

* Thompson MP cloud tuning (ufs-community#1005)

* improves cloud fraction when using Thompson MP. See NCAR/ccpp-physics#809 for more details.

* Add a new HAFS regression test with Thompson MP and GFDL surface layer schemes and Corrected S4 template regression testing job card (ufs-community#995)

* Added a new regression test for HAFS. 
* Fixed the S4 RT template job card.

Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>

* CCPP: Update consistency checks and effective radii calculation for Thompson MP (ufs-community#1000)

This PR contains changes in ccpp-physics (Update consistency checks and effective radii calculation for Thompson MP) and adds two new regression tests for both Intel and GNU that use the new prognostic cloud scheme progcld_thompson with GFS v16 and with RAP. The new cloud scheme is activated by setting icloud == 3 in input.nml.

* Rremove nems_datm related code, update CDEPS, and remove run directories that are no longer needed by other tests (ufs-community#1008)

* Add fhzero ort to coupled tests (ufs-community#1009)

* Add fhz ort to cpld tests
* Set ACCNR in rt.sh, not detect_machine.sh. Add some comments explaining where the variable should not be set or used.

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Unified write_netcdf, add single file 'cubed_sphere_grid' output (ufs-community#1011)

* Unify write_netcdf and write_netcdf_parallel modules.
* Add support for writing 'cubed_sphere_grid' history files in a single netcdf file.

* Change standard name and unit of CCPP error flag variable in CCPP framework and physics (ufs-community#1013)

* updates the submodule pointers for fv3atm, ccpp-framework and ccpp-physics for:  Change standard name and unit of CCPP error flag variable in CCPP framework and physics.

* ESMF managed threading (ufs-community#1018)

Add code updates to enable the ESMF managed threading in UFS.


Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >

* sync-ww3 (ufs-community#1026)

* sync with ww3 develop branch

* Revisions to repair iovr=5 cloud overlap option (ufs-community#1025)

* This PR addresses part 2 of issue ufs-community#748 to activate the exponential-random cloud overlap method (iovr=5) in RRTMG. RT tests were added for  iovr=4 and iovr=5 options
* change iovr to use the environment variable in control.nml.IN; modify all tests that use control.nml.IN to set env. var. iovr=3 (except for new tests); remove restart files from new tests

* 2D decomposition on write grid, bug fix in FV3GFS_IO.F90, and quad precision in stochastic physics (ufs-community#1028)

- The 2D decomposition is enabled on write grid component.
- FV3atm PR NOAA-EMC/fv3atm#468 from @MicroTed 
- stochastic physics PR NOAA-PSL/stochastic_physics#53 from Dom.

Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>

* Update CMEPS for wave coupling (ufs-community#1034)


* add run phases to allow waves to run in the slow loop
* re-order hafs wave test
* update aliases in fd_nems.yaml
* update CMEPS to prevent advertise conflicts when s2sw is
still using connectors
* add correct masking variables to hafs nems.configure files

* 4DIAU bug fix when iau_filter_increments=T (ufs-community#990)

* Add lsm_cold_start variable for RUC LSM SCM support and gwdps bugfix (combined) (ufs-community#1037)

Co-authored-by: @SMoorthi-emc

* Update esmf 821b04 (ufs-community#1041)

* Update the version of ESMF library to 8.2.1b04
* Add the write group lon info for upp 2d decomposition test.

* Multiple output (nested) grids from fv3atm (ufs-community#1044)

Update fv3atm to support writing multiple history files for parent and nested domains.
Nested HAFS regression tests were updated to write out history files from all nested domains.

Co-authored-by: Bin Liu <bin.liu@noaa.gov>

* GPU-enabled version of Grell-Freitas convection in ccpp-physics (ufs-community#1043)

* Enable Thompson microphysics with UFS-Aerosols and update GOCART (ufs-community#1049)

This update allows the Thompson microphysics scheme to be used with prognostic aerosols (UFS-Aerosols) and updates GOCART to version 2.0.2.

* Add support for Stochastically Perturbed Parameterizations (SPP) in FV3 (ufs-community#982)

* Update CICE; add support for restart test when running single RT (was PR 1058); update MOM6 (was PR 1060) (ufs-community#1045)


* update cice
* (1) pointing MOM6 to testing branch (MOM6 main repo PR: mom-ocean/MOM6#1556 (comment))
    (2) add three new files in mom_cmake file
            core/MOM_porous_barriers.F90
            external/drifters/MOM_particles.F90
            external/drifters/MOM_particles_types.F90
    (3) explicitly set in MOM_input for all resolutions to reflect the default value changes in code to retain answer
        EPBL_MLD_BISECTION = True (default changed from T to F in this MOM6 PR)
        INTERNAL_WAVE_SPEED_BETTER_EST = False (default changed from F to T in this MOM6 PR)
        note BBL_USE_EOS now set to use the value of USE_EOS in this MOM6 PR,
        but we set BBL_USE_EOS explicit so it has no impact

* remove duplicated CHL input setting in MOM_input_template_050
* add support for restart tests while running single RT

* lateral boundary fix for regional runs (ufs-community#1050)

This PR fixes a transient increase in noise caused by incorrect processing of winds along the lateral boundary on the final acoustic time step before fresh boundary information is ingested into the model.

* Update pointer to FV3

* Point to Christina's branches.

* Update RT log for Hera Intel.

* Adding RT log for Hera GNU tests.

* Updating RT log for Jet Intel tests.

* Latest regression tests on Jet.

* Adding regression logs.

* Updating regression test date stamp.

* Point to GSL repositories for FV3 and FV3/ccpp/physics

Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Grant Firl <grant.firl@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: mzhangw <mzhangw@gmail.com>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: Samuel Trahan (NOAA contractor) <39415369+SamuelTrahanNOAA@users.noreply.github.com>
Co-authored-by: SMoorthi-emc <47667426+SMoorthi-emc@users.noreply.github.com>
Co-authored-by: ChunxiZhang-NOAA <49283036+ChunxiZhang-NOAA@users.noreply.github.com>
Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>
Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>
Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >
Co-authored-by: Ali.Abdolali <37336972+aliabdolali@users.noreply.github.com>
Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>
Co-authored-by: Jeff Whitaker <jswhit@fastmail.fm>
Co-authored-by: DomHeinzeller <58610420+DomHeinzeller@users.noreply.github.com>
Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: JeffBeck-NOAA <55201531+JeffBeck-NOAA@users.noreply.github.com>
Co-authored-by: MatthewPyle-NOAA <48285220+MatthewPyle-NOAA@users.noreply.github.com>

* Remove GF Consistency Check & Add SDFs - V2 (#120)

* - Removes consistency check in GF, allows GF to run with different or no shallow scheme
- Add additional RAP based SDF

* - Add regression test logs

* jet intel test

* point to gsl/develop for FV3

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Update to top of FV3 to get latest ccpp-physics codeowners (#123)

* FV3 submodule: merge gsl/develop into RRFS_dev

* Hera gnu tests passed.

* Hera intel tests passed.

* jet tests passed

* Put a comment back in the FV3/ccpp/physics submodule.

* point to head of FV3 RRFS_dev branch

Co-authored-by: Christina Holt <56881914+christinaholtNOAA@users.noreply.github.com>
Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Grant Firl <grant.firl@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: mzhangw <mzhangw@gmail.com>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: SMoorthi-emc <47667426+SMoorthi-emc@users.noreply.github.com>
Co-authored-by: ChunxiZhang-NOAA <49283036+ChunxiZhang-NOAA@users.noreply.github.com>
Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>
Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >
Co-authored-by: Ali.Abdolali <37336972+aliabdolali@users.noreply.github.com>
Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>
Co-authored-by: Jeff Whitaker <jswhit@fastmail.fm>
Co-authored-by: DomHeinzeller <58610420+DomHeinzeller@users.noreply.github.com>
Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: JeffBeck-NOAA <55201531+JeffBeck-NOAA@users.noreply.github.com>
Co-authored-by: MatthewPyle-NOAA <48285220+MatthewPyle-NOAA@users.noreply.github.com>
Co-authored-by: Hannah C Barnes <38660891+hannahcbarnes@users.noreply.github.com>
SamuelTrahanNOAA added a commit to NOAA-GSL/ufs-weather-model that referenced this pull request May 19, 2022
* Add ufs driver. Remove NEMS submodule. Update CMEPS. Update CDEPS. Feature/ort addition.  (ufs-community#931)

* Add UFS driver, a copy of two fortran files from the NEMS repository. Remove NEMS submodule.

* Update CMEPS for current escomp/master. Implement the ability to write mediator history files for ATM on tiles rather than mesh

* Update CDEPS component. The updated CDEPS includes code updates for GFS v16 data mode.

* Operation requirement test (ORT) for:
  - cpld_control_p7 thread and decomposition tests
  - cpld_bmark_p7 thread and decomposition tests
  - Due to the wave component in these tests, restart and debug do not work

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>

* fv3atm cap cleanup (ufs-community#954)

FV3 nuopc cap code cleanup. Remove used code/variables. Fix minor inconsistencies.

* CCPP cloud cover change for Thompson MP associated with Xu Randall, several bug fixes for regression testing scripts (ufs-community#962)

This PR contains code changes 1) to remove old comments in GFS_typedefs.F90, increase cloud cover for Thompson MP by passing convective cloud water mixing ratio to progcld6. 2) Updates for auto fixes

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>

* ccpp-physics ufs-community#806, #807, ufs-community#813, and ort modifications (ufs-community#970)

- CCPP Physics changes: see Wrapper for ccpp-physics ufs-community#806, #807, ufs-community#813, NOAA-EMC/fv3atm#447.
- UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion ufs-community#965

* Wrapper for ccpp-physics ufs-community#808 and 816 (roughness length over ice and NoahMP tsurf bugfix) (ufs-community#971)

* update submodule pointer for regression testing for ccpp-physics ufs-community#808,816: roughness length over ice and NoahMP tsurf bugfix
* Reduce time step from 600s to 450s for tests control_csawmg and control_csawmg_debug

Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>

* Use 'model set run clock' routine in FV3 NUOPC cap. (ufs-community#967)

* Update FV3 cap by adding 'model set run clock' specialization routine. Because FV3 cap does not modify 'Earth clock' anymore in case of a restarted run, that adjustment is now done in the UFS driver.
* Fix model_configure file for two tests to define `fhrot` parameter.

* Revert iovr=4 (exponential cloud overlap method) in RRTMG (ufs-community#963)

Revert/cleanup iovr=4 in RRTMG per developer's request. The current exponential cloud overlapping method used in RRTMG represents the method used in the pre-2018 operational HWRF model.

* Add fhzero ort test (ufs-community#977)

* Fhzero ORT applies to the two tests `control` and `control_p7`
* Test can be run by invoking, for example, `./opnReqTest -n control -c fhz`

* Add a new CDEPS test to use GSFv16 data mode in CDEPS ,update rt_weekly.conf and update MOM6 to main branch (20211220) (ufs-community#976)

* add a new cdeps test using GFS data mode
* update rt_weekly.conf to include cpld_bmark_p7_35d tests
* update MOM6

Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Bug fixes for WAM physics and regression tests, remove duplicate modules from ccpp-physics CMakeLists.txt (ufs-community#947)

*adds a new regression test control_wam_debug and fixes problems with the existing control_wam test (e.g. IAER was not set as intended).

* Update global inline post for outputting foundation temperature (ufs-community#968)

Update upp submodule in fv3atm with latest UPP version for outputting foundation temperature and fixing land-sea mask issue in global inline post.

* Regression test bug fixes for running on Jet or with Rocoto (ufs-community#981)

* Bug fixes for running on jet or with rocoto
1. Correctly detect Jet when deciding build job runtimes
2. Do not delete out and err files in compile & test jobs
3. Correct dependencies for WW3 in Rocoto
4. Do not hard-code ACCNR to h-nems
This PR also contains fv3/ccpp physics (CCPP PR#812) updates that implements a vertically-integrated formula to properly compute tracer column mass and ensure mass conservation for all tracers except TKE. See issue NCAR/ccpp-physics#811 for details

* MYNN sfclay (RAP suite) restart reproducibility (ufs-community#984)

*This PR turns on the rap_restart tests. Bit-for-bit reproducibility is achieved with the bug fixes for MYNN sfclay in the associated fv3atm and ccpp-physics PRs.

* fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change (ufs-community#996)

* Radar-derived microphysics temperature tendencies similar to operational HRRR (ufs-community#986)

This PR implements a feature of the operational HRRR, radar-derived microphysics temperature tendencies applied in the first N minutes of the forecast to improve clouds in the first few hours. Two regression tests are added.

* Turn on CICE albedo use by ATM for coupled model; update Prototype test suite to initial P8 configuration;  (ufs-community#944)

* add updates for suites, tests for initial P8 configuration
* add IOPT_SFC=3 as default; set IOPT_SFC=1 in p7 tests
* change min_seaice to 1e-6; set to 1e-11 in p7 tests
* set dddmp=0.1 in both P7 and P8. This matches the final
P7 configuration. It will change P7 baselines.
* set cdmbwd in both P7 and P8 to the final P7 configuration.
(1.0,2.2,1.0,1.0) for all resolutions. It will change P7 baselines.
* add dusan's ecflow fix for wcoss2
* update FV3 with Moorthis' snod fix
* update rt_weekly to use p8 tests
* change integration length to 5 days

* Thompson MP cloud tuning (ufs-community#1005)

* improves cloud fraction when using Thompson MP. See NCAR/ccpp-physics#809 for more details.

* Add a new HAFS regression test with Thompson MP and GFDL surface layer schemes and Corrected S4 template regression testing job card (ufs-community#995)

* Added a new regression test for HAFS. 
* Fixed the S4 RT template job card.

Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>

* CCPP: Update consistency checks and effective radii calculation for Thompson MP (ufs-community#1000)

This PR contains changes in ccpp-physics (Update consistency checks and effective radii calculation for Thompson MP) and adds two new regression tests for both Intel and GNU that use the new prognostic cloud scheme progcld_thompson with GFS v16 and with RAP. The new cloud scheme is activated by setting icloud == 3 in input.nml.

* Rremove nems_datm related code, update CDEPS, and remove run directories that are no longer needed by other tests (ufs-community#1008)

* Add fhzero ort to coupled tests (ufs-community#1009)

* Add fhz ort to cpld tests
* Set ACCNR in rt.sh, not detect_machine.sh. Add some comments explaining where the variable should not be set or used.

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Unified write_netcdf, add single file 'cubed_sphere_grid' output (ufs-community#1011)

* Unify write_netcdf and write_netcdf_parallel modules.
* Add support for writing 'cubed_sphere_grid' history files in a single netcdf file.

* Change standard name and unit of CCPP error flag variable in CCPP framework and physics (ufs-community#1013)

* updates the submodule pointers for fv3atm, ccpp-framework and ccpp-physics for:  Change standard name and unit of CCPP error flag variable in CCPP framework and physics.

* ESMF managed threading (ufs-community#1018)

Add code updates to enable the ESMF managed threading in UFS.


Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >

* sync-ww3 (ufs-community#1026)

* sync with ww3 develop branch

* Revisions to repair iovr=5 cloud overlap option (ufs-community#1025)

* This PR addresses part 2 of issue ufs-community#748 to activate the exponential-random cloud overlap method (iovr=5) in RRTMG. RT tests were added for  iovr=4 and iovr=5 options
* change iovr to use the environment variable in control.nml.IN; modify all tests that use control.nml.IN to set env. var. iovr=3 (except for new tests); remove restart files from new tests

* 2D decomposition on write grid, bug fix in FV3GFS_IO.F90, and quad precision in stochastic physics (ufs-community#1028)

- The 2D decomposition is enabled on write grid component.
- FV3atm PR NOAA-EMC/fv3atm#468 from @MicroTed 
- stochastic physics PR NOAA-PSL/stochastic_physics#53 from Dom.

Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>

* Update CMEPS for wave coupling (ufs-community#1034)


* add run phases to allow waves to run in the slow loop
* re-order hafs wave test
* update aliases in fd_nems.yaml
* update CMEPS to prevent advertise conflicts when s2sw is
still using connectors
* add correct masking variables to hafs nems.configure files

* 4DIAU bug fix when iau_filter_increments=T (ufs-community#990)

* Add lsm_cold_start variable for RUC LSM SCM support and gwdps bugfix (combined) (ufs-community#1037)

Co-authored-by: @SMoorthi-emc

* Update esmf 821b04 (ufs-community#1041)

* Update the version of ESMF library to 8.2.1b04
* Add the write group lon info for upp 2d decomposition test.

* Multiple output (nested) grids from fv3atm (ufs-community#1044)

Update fv3atm to support writing multiple history files for parent and nested domains.
Nested HAFS regression tests were updated to write out history files from all nested domains.

Co-authored-by: Bin Liu <bin.liu@noaa.gov>

* GPU-enabled version of Grell-Freitas convection in ccpp-physics (ufs-community#1043)

* Enable Thompson microphysics with UFS-Aerosols and update GOCART (ufs-community#1049)

This update allows the Thompson microphysics scheme to be used with prognostic aerosols (UFS-Aerosols) and updates GOCART to version 2.0.2.

* Add support for Stochastically Perturbed Parameterizations (SPP) in FV3 (ufs-community#982)

* Update CICE; add support for restart test when running single RT (was PR 1058); update MOM6 (was PR 1060) (ufs-community#1045)


* update cice
* (1) pointing MOM6 to testing branch (MOM6 main repo PR: mom-ocean/MOM6#1556 (comment))
    (2) add three new files in mom_cmake file
            core/MOM_porous_barriers.F90
            external/drifters/MOM_particles.F90
            external/drifters/MOM_particles_types.F90
    (3) explicitly set in MOM_input for all resolutions to reflect the default value changes in code to retain answer
        EPBL_MLD_BISECTION = True (default changed from T to F in this MOM6 PR)
        INTERNAL_WAVE_SPEED_BETTER_EST = False (default changed from F to T in this MOM6 PR)
        note BBL_USE_EOS now set to use the value of USE_EOS in this MOM6 PR,
        but we set BBL_USE_EOS explicit so it has no impact

* remove duplicated CHL input setting in MOM_input_template_050
* add support for restart tests while running single RT

* lateral boundary fix for regional runs (ufs-community#1050)

This PR fixes a transient increase in noise caused by incorrect processing of winds along the lateral boundary on the final acoustic time step before fresh boundary information is ingested into the model.

* Feature: NSSL Microphysics support (ufs-community#1032)

* add new RT that uses NSSL MP; add new NSSL vars to default_vars.sh and rap.nml.IN; add new field table for using NSSL MP with hail on

* p8b (with aerosols)  (ufs-community#1071)


updates all p8 tests to the p8b settings, which includes GOCART

Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>

* Split CCPP finalize into physics_finalize and (framework) finalize, fix CCPP's metadata2html.py (ufs-community#1061)

* add a cdeps test using GFSv16 input data (ufs-community#1070)

* CMAKE for WW3  (ufs-community#1089)


* Use WW3 CMake build

Co-authored-by: kgerheiser <kgerheiser@icloud.com>

* Add 'valid time' variable using ISO string format (ufs-community#1073)

* Require cmake version 3.19
* Update FV3:
   - Add 'valid time' variable using ISO string format to netcdf history files.
   - Use double precision variable to set value of 'time' attribute in wrt comp import state
   - Update ccpp/physics (setting surface-related interstitial variables for SCM prescribed-surface-flux mode)
   - Update inline_post_stub.F90 subroutine interfaces to match inline_post.F90

* Add hi-res regional test on small domain (ufs-community#1084)


* Add hi-res regional test on small domain

* Fix Lambert Conformal Conic mapping in the write component on the southern hemisphere (ufs-community#1087)

* Subroutine `lambert` in the FV3 write component has been fixed to do the mapping on the southern hemisphere correctly.
* CI fix
  - Docker container library updated. CI input data updated. Add chm_petlist_bounds.
  - Change gocart output file name for debug test
  - Changes for opnReqTest to also scan rt_gnu.conf
  - Change CI tests to noaero

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>

* Rectify total number of Thompson MP species and add UFS-Aerosols to S2S and S2SW (ufs-community#1118)

* Rectify total number of Thompson MP species
* Implement S2SWA/S2SA build app as the only one enabling prognostic aerosols in fully coupled model.
* Update output_fh documentation.

* Add a cdeps test and update mom6, fv3, and weekly tests (ufs-community#1136)

Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: DusanJovic-NOAA <dusan.jovic@noaa.gov>

* update submodule pointer for fv3atm

* Update fms to 2021.04 (ufs-community#1135)

* Update fms to 2021.04
* Add RT for ocean IAU
* Update documentation

Co-authored-by: Phil Pegion <38869668+pjpegion@users.noreply.github.com>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>

* land surface upgrades for p8 (ufs-community#1095)

* reset the Noah-MP default options for those well tested

* P8c: Added capability for cdmbgwd(1) to scale GSL blocking drag (ufs-community#1110)

* Update ESMF to version 8.3.0bs09 (ufs-community#1146)

* Update ESMF to version 8.3.0b09
* Increase wall clock limit for tests/regional_3km to 15 min
* Update AutoRT to use tfe01 ecflow node on Jet
* Updated Cheyenne baseline epicufsrt path
* Updated Cheyenne epicufsrt hpc-stack build

Co-authored-by: JONG KIM <jong.kim@noaa.gov>
Co-authored-by: Brian Curtis <brian.curtis@noaa.gov>

* Update rrfs conus regression tests to compute fluxes.

* Remove nst_anl and a comment from the rrfs_conus13km_hrrr.nml.IN namelist template

* release/p8c: updated the TKE-EDMF PBL and saSAS cumulus scheme plus bug fix for the Thompson scheme (issue ufs-community#881) (ufs-community#1120)

* release/p8c: it is related to ccpp-physics PBL and cumulus updates plus a bug fix to the Thompson scheme

* Bring AQM model into UFS & Update MOM6 mixed FMS (ufs-community#1137)

* Add AQM submodule to integrate NOAA's Air Quality Model embedding
the U.S. EPA Community Multiscale Air Quality Model (CMAQ).

* MOM6: An alternate fix to class(*) issues with FMS 2022-01

Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Radiation changes for prototype 8 (ufs-community#1090)

* New feature in RRTMGP enabled ccpp-physics.
* Updated physics. New FV3 interstitials.
* Cleanup of RRTMGP regression tests.
* Replaced cld_mynn_ naming convention with cld_pbl_
* Some more cleanup of cloud-fraction...
* Pulled in Qingfu's changes to ccpp-physics
* New RT's for RRTMGP p8. Revert change in ccpp-physics
* Changed arguments to implied shape. in ccpp-physics
* Updated RRTMGP regression tests
* Changes to FV3/ccpp-physics.
* RRTMGP RT cleanup, again. Bug-fix in FV3/ccpp-physics
* Revert changes to names in FV3/ccpp-physics
* Cleanup p8 tests.
* More RT cleanup for p8.
* Add GP setting to non-coupled p8 tests.
* Added bounding to temperature at layer-interface used by RRTMGP.
* Reorder loop
* Combined gp sw and lw aerosol routines. Modest speedup (~4%). Add GP setting to test setup.
* Add GP settings to cpld_control_c96_noaero_p8 test.
* update test resources default_vars.sh

* HAFS moving-nesting related developments (ufs-community#1104)

* Add the storm-following or specified moving-nesting capability for both the regional and global configuration.
* Expand the UFS/HAFS FV3ATM-HYCOM ocean coupling to support the static and moving nesting configuration.
* Expand the write grid component to support outputting the moving nest domain properly.
* Five HAFS related moving-nesting regression tests are added to test these newly added features. The regional_hafs RT was removed.

Co-authored-by: Daniel Rosen <daniel.rosen@noaa.gov>
Co-authored-by: Ufuk Turuncoglu <ufuk.turuncoglu@noaa.gov>
Co-authored-by: uturuncoglu <turuncu@ucar.edu>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: William Ramstrom <William.Ramstrom@noaa.gov>
Co-authored-by: A-Kyle <kyle.ahern@noaa.gov>

* fv3atm: Split GFS_typedefs.F90, rename CCPP_interstitial, import ccpp_t from ccpp_types; contains bug fix for WW3 debug (ufs-community#1130)


Co-authored-by: Jessica Meixner <Jessica.Meixner@noaa.gov>

* Close MOM6 1deg at j=1; Update input-data for P8c (ufs-community#909)


* update all tests using 1deg MOM6/CICE6
* pre-pend ufs to existing topo edits filename when
creating the new file
* update input-data directory

* Fix uninitialized min_rand variable in Thompson MP when using SPP (ufs-community#1152)

* Updates to stochastic_physics and fv3 and CI

* A bug fix for wet scavenging of aerosols and a minor modification for moisture property calculation (ufs-community#1176)

* point to one_scheme_to_one_file PR branch (ufs-community#1175)

* merge ufs-community develop

* Point to gsl/merge-develop for FV3

* Changes missing from prior commit

* use community version of hafs_regional_atm

* merge rt.sh changes

* Point to gsl/merge-develop-to-community branch for FV3

* Revert gsl-specific changes to rt.sh

* Corrections to prior merge

* corrections to FV3_HRRR tests

* Add rrfs_smoke_conus13km_hrrr_warm test

* Add FV3_HRRR_smoke to rt builds

* Correct nst and domains_stack_size in rrfs_conus13km_hrrr.nml.IN

* Set SFCLAY_COMPUTE_FLUX=.true. for rrfs_smoke tests

* hera.gnu tests passed

* Hera BUILD_WALLTIME of 1 hour due to occasional extreme contention for intel licenses

* hera intel tests passed

* Jet tests passed

* Revert gsl-specific change to rt.sh

* Point FV3/.gitmodules to Sam's fork

* Correct issues found by reviewers in ccpp-physics and fv3atm

* Rename mynnpbl to mynnedmf in fv3atm and ccpp-physics

* FV3: Remove some empty _init and _finalize routines and update a comment in sgscloud_radpre

* Feature/lndp noahmp2 : add land perturbation scheme for Noah-MP fractional veg (ufs-community#1143)

Updates to allow land perturbation scheme to be applied for Noah-MP. Currently, for Noah-MP model parameters can perturb only vegetation fraction.

Main code changes:
-added lsm_noahmp model option to lndp_type==2 land perturbation scheme (fv3-atm, stochastic_physics)
-updated comments
-cleaned up the namelists to make the different options clearer. Removed misleading lndp_each_step variable from gfs_physics_nml, and replaced it with "lndp_model_type" in the nam_sfcperts namelist for the different forecast types (cycling DA, short forecasts, perturbing only initial conditions) (fv3-atm, stochastic_physics, ufs-weather-model)
NOTE: see note below, re: specification of smc perturbation for RAP/HRRR/etc (lndp_model_type==2)
-revised code in stochastic_physics_wrapper to only allocate arrays that will be used when passed into lndp_apply_perts (fv3-atm)
-deleted unused albedo arrays in stochastic_physics_wrapper and lndp_apply_perts (fv3-atm, stochastic_physics)
-fixed bug causing precision errors when calculating the soil moisture ice content (often ~0.0; stochastic_physics)
-fixed bug in which lndp_apply_perts wasn't called for nscyc = 0. (fv3-atm)
-increased max_nvar_lndp at Jeff Ator's request (fv3-atm)
-added a new test for the Noah-MP and lndp==2 combination (ufs-weather-model)

* Add \file to smoke files

* Update CDEPS component, add hailcast code in FV3/atmos_cubed_sphere and reduce wall clock time used for the cpld_control_c192_p8 test on Jet (ufs-community#1156)

Co-authored-by: Yunheng Wang

* Update CMEPS; Add gocart userguide (was ufs-community#1182) (ufs-community#1189)


* Update CMEPS submodule
* Add GOCART documentation

Co-authored-by: Li Pan <Li.Pan@noaa.gov>

* Combine PROD and REPRO build options into 'Release' build type (ufs-community#1171)

Combined PROD and REPRO build modes into 'Release' build type. Now only 'Debug' and 'Release' build type are supported.
Both build types must produce bit-for-bit reproducible outputs using different number of threads, mpi tasks, different domain decomposition, have reproducible restarts etc.

* Unify inline post interfaces (ufs-community#1181)

* replace pwatclm to pwat in the all diag tables under tests/parm/diag_table.

* adding bug fix from jili dong and removing U* averaging

* adding bug fix from jili dong and removing U* averaging

* Hera tests passed.

* Remove some commented-out code from cu_gf_driver in ccpp-physics.

* In FV3, turn rrtmg smoke band 10 into a model namelist variable

* Switch ccpp-physics smoke arguments to implied shape

* Remove some stops and gotos from ccpp-physics rrfs-smoke

* In FV3, remove some hard-coded constants and rename some meta entries

* In FV3, rename some standard_names, change a unit, and remove a "use physcons"

* Updated settings for NoahMP, Thompson and RRTMGP in RTs (ufs-community#1196)

* add NoahMP opt_trs to namelist
* Updated namelist settings related to NoahMP scheme, Thompson scheme and RRTMGP (issue ufs-community#1173 and ufs-community#1185)
* Updated some namelist settings and add/remove some RTs related to RRTMGP

* Compute petlist bounds for each subcomponent from number of tasks. Update CICE (ufs-community#1200)

* Instead of specifying petlist bounds (lower and upper bound), compute them using the number of tasks for each component. The function that computes petlist bounds assumes that the mediator always runs on the same tasks as ATM component, and that the Chemistry component also always runs on the same tasks as ATM.
* Update CICE submodule (@DeniseWorthen)

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>

* NSSL ccpp-physics bugfixes and new ccpp-framework debugging feature (ufs-community#1202)

* Merge develop

* hera.gnu tests passed

* hera.intel tests passed

* jet intel tests passed

* hera.gnu tests passed.

* fv3atm: Only add cnv_3d_ud_mf to the restart files when needed

* More warnings not to change the conus13km tests

* adjust BL_DATE in rt.sh to 20220516

* WCOSS Cray tests passed

* fv3atm: pass some chemistry varibles to mynn_bl_driver correctly

* [AutoRT] hera.gnu Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] hera.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] cheyenne.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* WCOSS Dell P3 tests passed

* Correct argument passing within mynn edmf

* [AutoRT] gaea.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] cheyenne.gnu Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* Orion RT Passed

* [AutoRT] jet.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* Point to NOAA-EMC develop for FV3

* merge gsl institutional fork (ufs-community#1195)

Merge in GSL institutional fork.

* update FV3 to top of gsl/merge-community-to-develop

* FV3: point to sam's repo

* Point to GSL baseline areas

* FV3/ccpp/physics: Change to GSL CODEOWNERS

* hera.gnu tests passed

* hera.intel passed

* jet.intel tests passed

* Set regression test path to GSL areas on Hera

* FV3: Returned the comments on soil resistance back.

Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Grant Firl <grant.firl@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: mzhangw <mzhangw@gmail.com>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: SMoorthi-emc <47667426+SMoorthi-emc@users.noreply.github.com>
Co-authored-by: ChunxiZhang-NOAA <49283036+ChunxiZhang-NOAA@users.noreply.github.com>
Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>
Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >
Co-authored-by: Ali.Abdolali <37336972+aliabdolali@users.noreply.github.com>
Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>
Co-authored-by: Jeff Whitaker <jswhit@fastmail.fm>
Co-authored-by: DomHeinzeller <58610420+DomHeinzeller@users.noreply.github.com>
Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: JeffBeck-NOAA <55201531+JeffBeck-NOAA@users.noreply.github.com>
Co-authored-by: MatthewPyle-NOAA <48285220+MatthewPyle-NOAA@users.noreply.github.com>
Co-authored-by: Jessica Meixner <jessica.meixner@noaa.gov>
Co-authored-by: kgerheiser <kgerheiser@icloud.com>
Co-authored-by: RatkoVasic-NOAA <37597874+RatkoVasic-NOAA@users.noreply.github.com>
Co-authored-by: joeolson42 <Joseph.B.Olson@noaa.gov>
Co-authored-by: Phil Pegion <38869668+pjpegion@users.noreply.github.com>
Co-authored-by: HelinWei-NOAA <48133472+HelinWei-NOAA@users.noreply.github.com>
Co-authored-by: mdtoyNOAA <73618848+mdtoyNOAA@users.noreply.github.com>
Co-authored-by: JONG KIM <jong.kim@noaa.gov>
Co-authored-by: Brian Curtis <brian.curtis@noaa.gov>
Co-authored-by: Brian Curtis <64433609+BrianCurtis-NOAA@users.noreply.github.com>
Co-authored-by: dustinswales <dustin.swales@noaa.gov>
Co-authored-by: Daniel Rosen <daniel.rosen@noaa.gov>
Co-authored-by: Ufuk Turuncoglu <ufuk.turuncoglu@noaa.gov>
Co-authored-by: uturuncoglu <turuncu@ucar.edu>
Co-authored-by: William Ramstrom <William.Ramstrom@noaa.gov>
Co-authored-by: A-Kyle <kyle.ahern@noaa.gov>
Co-authored-by: ClaraDraper-NOAA <33430543+ClaraDraper-NOAA@users.noreply.github.com>
Co-authored-by: Li Pan <Li.Pan@noaa.gov>
SamuelTrahanNOAA added a commit to NOAA-GSL/ufs-weather-model that referenced this pull request Jun 27, 2022
* Add ufs driver. Remove NEMS submodule. Update CMEPS. Update CDEPS. Feature/ort addition.  (#931)

* Add UFS driver, a copy of two fortran files from the NEMS repository. Remove NEMS submodule.

* Update CMEPS for current escomp/master. Implement the ability to write mediator history files for ATM on tiles rather than mesh

* Update CDEPS component. The updated CDEPS includes code updates for GFS v16 data mode.

* Operation requirement test (ORT) for:
  - cpld_control_p7 thread and decomposition tests
  - cpld_bmark_p7 thread and decomposition tests
  - Due to the wave component in these tests, restart and debug do not work

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>

* fv3atm cap cleanup (#954)

FV3 nuopc cap code cleanup. Remove used code/variables. Fix minor inconsistencies.

* CCPP cloud cover change for Thompson MP associated with Xu Randall, several bug fixes for regression testing scripts (#962)

This PR contains code changes 1) to remove old comments in GFS_typedefs.F90, increase cloud cover for Thompson MP by passing convective cloud water mixing ratio to progcld6. 2) Updates for auto fixes

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>

* ccpp-physics #806, #807, #813, and ort modifications (#970)

- CCPP Physics changes: see Wrapper for ccpp-physics #806, #807, #813, NOAA-EMC/fv3atm#447.
- UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion #965

* Wrapper for ccpp-physics #808 and 816 (roughness length over ice and NoahMP tsurf bugfix) (#971)

* update submodule pointer for regression testing for ccpp-physics #808,816: roughness length over ice and NoahMP tsurf bugfix
* Reduce time step from 600s to 450s for tests control_csawmg and control_csawmg_debug

Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>

* Use 'model set run clock' routine in FV3 NUOPC cap. (#967)

* Update FV3 cap by adding 'model set run clock' specialization routine. Because FV3 cap does not modify 'Earth clock' anymore in case of a restarted run, that adjustment is now done in the UFS driver.
* Fix model_configure file for two tests to define `fhrot` parameter.

* Revert iovr=4 (exponential cloud overlap method) in RRTMG (#963)

Revert/cleanup iovr=4 in RRTMG per developer's request. The current exponential cloud overlapping method used in RRTMG represents the method used in the pre-2018 operational HWRF model.

* Add fhzero ort test (#977)

* Fhzero ORT applies to the two tests `control` and `control_p7`
* Test can be run by invoking, for example, `./opnReqTest -n control -c fhz`

* Add a new CDEPS test to use GSFv16 data mode in CDEPS ,update rt_weekly.conf and update MOM6 to main branch (20211220) (#976)

* add a new cdeps test using GFS data mode
* update rt_weekly.conf to include cpld_bmark_p7_35d tests
* update MOM6

Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Bug fixes for WAM physics and regression tests, remove duplicate modules from ccpp-physics CMakeLists.txt (#947)

*adds a new regression test control_wam_debug and fixes problems with the existing control_wam test (e.g. IAER was not set as intended).

* Update global inline post for outputting foundation temperature (#968)

Update upp submodule in fv3atm with latest UPP version for outputting foundation temperature and fixing land-sea mask issue in global inline post.

* Regression test bug fixes for running on Jet or with Rocoto (#981)

* Bug fixes for running on jet or with rocoto
1. Correctly detect Jet when deciding build job runtimes
2. Do not delete out and err files in compile & test jobs
3. Correct dependencies for WW3 in Rocoto
4. Do not hard-code ACCNR to h-nems
This PR also contains fv3/ccpp physics (CCPP PR#812) updates that implements a vertically-integrated formula to properly compute tracer column mass and ensure mass conservation for all tracers except TKE. See issue NCAR/ccpp-physics#811 for details

* MYNN sfclay (RAP suite) restart reproducibility (#984)

*This PR turns on the rap_restart tests. Bit-for-bit reproducibility is achieved with the bug fixes for MYNN sfclay in the associated fv3atm and ccpp-physics PRs.

* fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change (#996)

* Radar-derived microphysics temperature tendencies similar to operational HRRR (#986)

This PR implements a feature of the operational HRRR, radar-derived microphysics temperature tendencies applied in the first N minutes of the forecast to improve clouds in the first few hours. Two regression tests are added.

* Turn on CICE albedo use by ATM for coupled model; update Prototype test suite to initial P8 configuration;  (#944)

* add updates for suites, tests for initial P8 configuration
* add IOPT_SFC=3 as default; set IOPT_SFC=1 in p7 tests
* change min_seaice to 1e-6; set to 1e-11 in p7 tests
* set dddmp=0.1 in both P7 and P8. This matches the final
P7 configuration. It will change P7 baselines.
* set cdmbwd in both P7 and P8 to the final P7 configuration.
(1.0,2.2,1.0,1.0) for all resolutions. It will change P7 baselines.
* add dusan's ecflow fix for wcoss2
* update FV3 with Moorthis' snod fix
* update rt_weekly to use p8 tests
* change integration length to 5 days

* Thompson MP cloud tuning (#1005)

* improves cloud fraction when using Thompson MP. See NCAR/ccpp-physics#809 for more details.

* Add a new HAFS regression test with Thompson MP and GFDL surface layer schemes and Corrected S4 template regression testing job card (#995)

* Added a new regression test for HAFS. 
* Fixed the S4 RT template job card.

Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>

* CCPP: Update consistency checks and effective radii calculation for Thompson MP (#1000)

This PR contains changes in ccpp-physics (Update consistency checks and effective radii calculation for Thompson MP) and adds two new regression tests for both Intel and GNU that use the new prognostic cloud scheme progcld_thompson with GFS v16 and with RAP. The new cloud scheme is activated by setting icloud == 3 in input.nml.

* Rremove nems_datm related code, update CDEPS, and remove run directories that are no longer needed by other tests (#1008)

* Add fhzero ort to coupled tests (#1009)

* Add fhz ort to cpld tests
* Set ACCNR in rt.sh, not detect_machine.sh. Add some comments explaining where the variable should not be set or used.

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Unified write_netcdf, add single file 'cubed_sphere_grid' output (#1011)

* Unify write_netcdf and write_netcdf_parallel modules.
* Add support for writing 'cubed_sphere_grid' history files in a single netcdf file.

* Change standard name and unit of CCPP error flag variable in CCPP framework and physics (#1013)

* updates the submodule pointers for fv3atm, ccpp-framework and ccpp-physics for:  Change standard name and unit of CCPP error flag variable in CCPP framework and physics.

* ESMF managed threading (#1018)

Add code updates to enable the ESMF managed threading in UFS.


Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >

* sync-ww3 (#1026)

* sync with ww3 develop branch

* Revisions to repair iovr=5 cloud overlap option (#1025)

* This PR addresses part 2 of issue #748 to activate the exponential-random cloud overlap method (iovr=5) in RRTMG. RT tests were added for  iovr=4 and iovr=5 options
* change iovr to use the environment variable in control.nml.IN; modify all tests that use control.nml.IN to set env. var. iovr=3 (except for new tests); remove restart files from new tests

* 2D decomposition on write grid, bug fix in FV3GFS_IO.F90, and quad precision in stochastic physics (#1028)

- The 2D decomposition is enabled on write grid component.
- FV3atm PR NOAA-EMC/fv3atm#468 from @MicroTed 
- stochastic physics PR noaa-psd/stochastic_physics#53 from Dom.

Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>

* Update CMEPS for wave coupling (#1034)


* add run phases to allow waves to run in the slow loop
* re-order hafs wave test
* update aliases in fd_nems.yaml
* update CMEPS to prevent advertise conflicts when s2sw is
still using connectors
* add correct masking variables to hafs nems.configure files

* 4DIAU bug fix when iau_filter_increments=T (#990)

* Add lsm_cold_start variable for RUC LSM SCM support and gwdps bugfix (combined) (#1037)

Co-authored-by: @SMoorthi-emc

* Update esmf 821b04 (#1041)

* Update the version of ESMF library to 8.2.1b04
* Add the write group lon info for upp 2d decomposition test.

* Multiple output (nested) grids from fv3atm (#1044)

Update fv3atm to support writing multiple history files for parent and nested domains.
Nested HAFS regression tests were updated to write out history files from all nested domains.

Co-authored-by: Bin Liu <bin.liu@noaa.gov>

* GPU-enabled version of Grell-Freitas convection in ccpp-physics (#1043)

* Enable Thompson microphysics with UFS-Aerosols and update GOCART (#1049)

This update allows the Thompson microphysics scheme to be used with prognostic aerosols (UFS-Aerosols) and updates GOCART to version 2.0.2.

* Add support for Stochastically Perturbed Parameterizations (SPP) in FV3 (#982)

* Update CICE; add support for restart test when running single RT (was PR 1058); update MOM6 (was PR 1060) (#1045)


* update cice
* (1) pointing MOM6 to testing branch (MOM6 main repo PR: https://github.com/mom-ocean/MOM6/pull/1556#issuecomment-1043374317)
    (2) add three new files in mom_cmake file
            core/MOM_porous_barriers.F90
            external/drifters/MOM_particles.F90
            external/drifters/MOM_particles_types.F90
    (3) explicitly set in MOM_input for all resolutions to reflect the default value changes in code to retain answer
        EPBL_MLD_BISECTION = True (default changed from T to F in this MOM6 PR)
        INTERNAL_WAVE_SPEED_BETTER_EST = False (default changed from F to T in this MOM6 PR)
        note BBL_USE_EOS now set to use the value of USE_EOS in this MOM6 PR,
        but we set BBL_USE_EOS explicit so it has no impact

* remove duplicated CHL input setting in MOM_input_template_050
* add support for restart tests while running single RT

* lateral boundary fix for regional runs (#1050)

This PR fixes a transient increase in noise caused by incorrect processing of winds along the lateral boundary on the final acoustic time step before fresh boundary information is ingested into the model.

* Feature: NSSL Microphysics support (#1032)

* add new RT that uses NSSL MP; add new NSSL vars to default_vars.sh and rap.nml.IN; add new field table for using NSSL MP with hail on

* Merge ufs-community develop into gsl/develop (#119)

* Add ufs driver. Remove NEMS submodule. Update CMEPS. Update CDEPS. Feature/ort addition.  (#931)

* Add UFS driver, a copy of two fortran files from the NEMS repository. Remove NEMS submodule.

* Update CMEPS for current escomp/master. Implement the ability to write mediator history files for ATM on tiles rather than mesh

* Update CDEPS component. The updated CDEPS includes code updates for GFS v16 data mode.

* Operation requirement test (ORT) for:
  - cpld_control_p7 thread and decomposition tests
  - cpld_bmark_p7 thread and decomposition tests
  - Due to the wave component in these tests, restart and debug do not work

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>

* fv3atm cap cleanup (#954)

FV3 nuopc cap code cleanup. Remove used code/variables. Fix minor inconsistencies.

* CCPP cloud cover change for Thompson MP associated with Xu Randall, several bug fixes for regression testing scripts (#962)

This PR contains code changes 1) to remove old comments in GFS_typedefs.F90, increase cloud cover for Thompson MP by passing convective cloud water mixing ratio to progcld6. 2) Updates for auto fixes

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>

* ccpp-physics #806, #807, #813, and ort modifications (#970)

- CCPP Physics changes: see Wrapper for ccpp-physics #806, #807, #813, NOAA-EMC/fv3atm#447.
- UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion #965

* Wrapper for ccpp-physics #808 and 816 (roughness length over ice and NoahMP tsurf bugfix) (#971)

* update submodule pointer for regression testing for ccpp-physics #808,816: roughness length over ice and NoahMP tsurf bugfix
* Reduce time step from 600s to 450s for tests control_csawmg and control_csawmg_debug

Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>

* Use 'model set run clock' routine in FV3 NUOPC cap. (#967)

* Update FV3 cap by adding 'model set run clock' specialization routine. Because FV3 cap does not modify 'Earth clock' anymore in case of a restarted run, that adjustment is now done in the UFS driver.
* Fix model_configure file for two tests to define `fhrot` parameter.

* Revert iovr=4 (exponential cloud overlap method) in RRTMG (#963)

Revert/cleanup iovr=4 in RRTMG per developer's request. The current exponential cloud overlapping method used in RRTMG represents the method used in the pre-2018 operational HWRF model.

* Add fhzero ort test (#977)

* Fhzero ORT applies to the two tests `control` and `control_p7`
* Test can be run by invoking, for example, `./opnReqTest -n control -c fhz`

* Add a new CDEPS test to use GSFv16 data mode in CDEPS ,update rt_weekly.conf and update MOM6 to main branch (20211220) (#976)

* add a new cdeps test using GFS data mode
* update rt_weekly.conf to include cpld_bmark_p7_35d tests
* update MOM6

Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Bug fixes for WAM physics and regression tests, remove duplicate modules from ccpp-physics CMakeLists.txt (#947)

*adds a new regression test control_wam_debug and fixes problems with the existing control_wam test (e.g. IAER was not set as intended).

* Update global inline post for outputting foundation temperature (#968)

Update upp submodule in fv3atm with latest UPP version for outputting foundation temperature and fixing land-sea mask issue in global inline post.

* Regression test bug fixes for running on Jet or with Rocoto (#981)

* Bug fixes for running on jet or with rocoto
1. Correctly detect Jet when deciding build job runtimes
2. Do not delete out and err files in compile & test jobs
3. Correct dependencies for WW3 in Rocoto
4. Do not hard-code ACCNR to h-nems
This PR also contains fv3/ccpp physics (CCPP PR#812) updates that implements a vertically-integrated formula to properly compute tracer column mass and ensure mass conservation for all tracers except TKE. See issue NCAR/ccpp-physics#811 for details

* MYNN sfclay (RAP suite) restart reproducibility (#984)

*This PR turns on the rap_restart tests. Bit-for-bit reproducibility is achieved with the bug fixes for MYNN sfclay in the associated fv3atm and ccpp-physics PRs.

* fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change (#996)

* Radar-derived microphysics temperature tendencies similar to operational HRRR (#986)

This PR implements a feature of the operational HRRR, radar-derived microphysics temperature tendencies applied in the first N minutes of the forecast to improve clouds in the first few hours. Two regression tests are added.

* Turn on CICE albedo use by ATM for coupled model; update Prototype test suite to initial P8 configuration;  (#944)

* add updates for suites, tests for initial P8 configuration
* add IOPT_SFC=3 as default; set IOPT_SFC=1 in p7 tests
* change min_seaice to 1e-6; set to 1e-11 in p7 tests
* set dddmp=0.1 in both P7 and P8. This matches the final
P7 configuration. It will change P7 baselines.
* set cdmbwd in both P7 and P8 to the final P7 configuration.
(1.0,2.2,1.0,1.0) for all resolutions. It will change P7 baselines.
* add dusan's ecflow fix for wcoss2
* update FV3 with Moorthis' snod fix
* update rt_weekly to use p8 tests
* change integration length to 5 days

* Thompson MP cloud tuning (#1005)

* improves cloud fraction when using Thompson MP. See NCAR/ccpp-physics#809 for more details.

* Add a new HAFS regression test with Thompson MP and GFDL surface layer schemes and Corrected S4 template regression testing job card (#995)

* Added a new regression test for HAFS. 
* Fixed the S4 RT template job card.

Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>

* CCPP: Update consistency checks and effective radii calculation for Thompson MP (#1000)

This PR contains changes in ccpp-physics (Update consistency checks and effective radii calculation for Thompson MP) and adds two new regression tests for both Intel and GNU that use the new prognostic cloud scheme progcld_thompson with GFS v16 and with RAP. The new cloud scheme is activated by setting icloud == 3 in input.nml.

* Rremove nems_datm related code, update CDEPS, and remove run directories that are no longer needed by other tests (#1008)

* Add fhzero ort to coupled tests (#1009)

* Add fhz ort to cpld tests
* Set ACCNR in rt.sh, not detect_machine.sh. Add some comments explaining where the variable should not be set or used.

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Unified write_netcdf, add single file 'cubed_sphere_grid' output (#1011)

* Unify write_netcdf and write_netcdf_parallel modules.
* Add support for writing 'cubed_sphere_grid' history files in a single netcdf file.

* Change standard name and unit of CCPP error flag variable in CCPP framework and physics (#1013)

* updates the submodule pointers for fv3atm, ccpp-framework and ccpp-physics for:  Change standard name and unit of CCPP error flag variable in CCPP framework and physics.

* ESMF managed threading (#1018)

Add code updates to enable the ESMF managed threading in UFS.


Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >

* sync-ww3 (#1026)

* sync with ww3 develop branch

* Revisions to repair iovr=5 cloud overlap option (#1025)

* This PR addresses part 2 of issue #748 to activate the exponential-random cloud overlap method (iovr=5) in RRTMG. RT tests were added for  iovr=4 and iovr=5 options
* change iovr to use the environment variable in control.nml.IN; modify all tests that use control.nml.IN to set env. var. iovr=3 (except for new tests); remove restart files from new tests

* 2D decomposition on write grid, bug fix in FV3GFS_IO.F90, and quad precision in stochastic physics (#1028)

- The 2D decomposition is enabled on write grid component.
- FV3atm PR NOAA-EMC/fv3atm#468 from @MicroTed 
- stochastic physics PR noaa-psd/stochastic_physics#53 from Dom.

Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>

* Update CMEPS for wave coupling (#1034)


* add run phases to allow waves to run in the slow loop
* re-order hafs wave test
* update aliases in fd_nems.yaml
* update CMEPS to prevent advertise conflicts when s2sw is
still using connectors
* add correct masking variables to hafs nems.configure files

* 4DIAU bug fix when iau_filter_increments=T (#990)

* Add lsm_cold_start variable for RUC LSM SCM support and gwdps bugfix (combined) (#1037)

Co-authored-by: @SMoorthi-emc

* Update esmf 821b04 (#1041)

* Update the version of ESMF library to 8.2.1b04
* Add the write group lon info for upp 2d decomposition test.

* Multiple output (nested) grids from fv3atm (#1044)

Update fv3atm to support writing multiple history files for parent and nested domains.
Nested HAFS regression tests were updated to write out history files from all nested domains.

Co-authored-by: Bin Liu <bin.liu@noaa.gov>

* GPU-enabled version of Grell-Freitas convection in ccpp-physics (#1043)

* Enable Thompson microphysics with UFS-Aerosols and update GOCART (#1049)

This update allows the Thompson microphysics scheme to be used with prognostic aerosols (UFS-Aerosols) and updates GOCART to version 2.0.2.

* Add support for Stochastically Perturbed Parameterizations (SPP) in FV3 (#982)

* Update CICE; add support for restart test when running single RT (was PR 1058); update MOM6 (was PR 1060) (#1045)


* update cice
* (1) pointing MOM6 to testing branch (MOM6 main repo PR: https://github.com/mom-ocean/MOM6/pull/1556#issuecomment-1043374317)
    (2) add three new files in mom_cmake file
            core/MOM_porous_barriers.F90
            external/drifters/MOM_particles.F90
            external/drifters/MOM_particles_types.F90
    (3) explicitly set in MOM_input for all resolutions to reflect the default value changes in code to retain answer
        EPBL_MLD_BISECTION = True (default changed from T to F in this MOM6 PR)
        INTERNAL_WAVE_SPEED_BETTER_EST = False (default changed from F to T in this MOM6 PR)
        note BBL_USE_EOS now set to use the value of USE_EOS in this MOM6 PR,
        but we set BBL_USE_EOS explicit so it has no impact

* remove duplicated CHL input setting in MOM_input_template_050
* add support for restart tests while running single RT

* lateral boundary fix for regional runs (#1050)

This PR fixes a transient increase in noise caused by incorrect processing of winds along the lateral boundary on the final acoustic time step before fresh boundary information is ingested into the model.

* Update pointer to FV3

* Point to Christina's branches.

* Update RT log for Hera Intel.

* Adding RT log for Hera GNU tests.

* Updating RT log for Jet Intel tests.

* Latest regression tests on Jet.

* Adding regression logs.

* Updating regression test date stamp.

* Point to GSL repositories for FV3 and FV3/ccpp/physics

Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Grant Firl <grant.firl@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: mzhangw <mzhangw@gmail.com>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: Samuel Trahan (NOAA contractor) <39415369+SamuelTrahanNOAA@users.noreply.github.com>
Co-authored-by: SMoorthi-emc <47667426+SMoorthi-emc@users.noreply.github.com>
Co-authored-by: ChunxiZhang-NOAA <49283036+ChunxiZhang-NOAA@users.noreply.github.com>
Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>
Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>
Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >
Co-authored-by: Ali.Abdolali <37336972+aliabdolali@users.noreply.github.com>
Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>
Co-authored-by: Jeff Whitaker <jswhit@fastmail.fm>
Co-authored-by: DomHeinzeller <58610420+DomHeinzeller@users.noreply.github.com>
Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: JeffBeck-NOAA <55201531+JeffBeck-NOAA@users.noreply.github.com>
Co-authored-by: MatthewPyle-NOAA <48285220+MatthewPyle-NOAA@users.noreply.github.com>

* Remove GF Consistency Check & Add SDFs - V2 (#120)

* - Removes consistency check in GF, allows GF to run with different or no shallow scheme
- Add additional RAP based SDF

* - Add regression test logs

* jet intel test

* point to gsl/develop for FV3

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* p8b (with aerosols)  (#1071)


updates all p8 tests to the p8b settings, which includes GOCART

Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>

* Update to top of FV3 to get latest ccpp-physics codeowners (#123)

* Split CCPP finalize into physics_finalize and (framework) finalize, fix CCPP's metadata2html.py (#1061)

* add a cdeps test using GFSv16 input data (#1070)

* CMAKE for WW3  (#1089)


* Use WW3 CMake build

Co-authored-by: kgerheiser <kgerheiser@icloud.com>

* Add 'valid time' variable using ISO string format (#1073)

* Require cmake version 3.19
* Update FV3:
   - Add 'valid time' variable using ISO string format to netcdf history files.
   - Use double precision variable to set value of 'time' attribute in wrt comp import state
   - Update ccpp/physics (setting surface-related interstitial variables for SCM prescribed-surface-flux mode)
   - Update inline_post_stub.F90 subroutine interfaces to match inline_post.F90

* Add hi-res regional test on small domain (#1084)


* Add hi-res regional test on small domain

* Fix Lambert Conformal Conic mapping in the write component on the southern hemisphere (#1087)

* Subroutine `lambert` in the FV3 write component has been fixed to do the mapping on the southern hemisphere correctly.
* CI fix
  - Docker container library updated. CI input data updated. Add chm_petlist_bounds.
  - Change gocart output file name for debug test
  - Changes for opnReqTest to also scan rt_gnu.conf
  - Change CI tests to noaero

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>

* Rectify total number of Thompson MP species and add UFS-Aerosols to S2S and S2SW (#1118)

* Rectify total number of Thompson MP species
* Implement S2SWA/S2SA build app as the only one enabling prognostic aerosols in fully coupled model.
* Update output_fh documentation.

* Add a cdeps test and update mom6, fv3, and weekly tests (#1136)

Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: DusanJovic-NOAA <dusan.jovic@noaa.gov>

* Updates to the MYNN-EDMF (#129)

* update submodule pointer for fv3atm

* Fault tolerance in rt.sh usage of rocoto.

* Update baseline date.

* Bug fixes to rocoto changes.

* Hera gnu tests passed.

* Sleep 60 seconds betwen calls to rocotorun to avoid seeing submitted jobs in an inconsistent state when the batch scheduler is overwhelmed.

* Hera intel tests passed.

* Jet intel tests passed.

* Corrections to Rocoto reliability changes

* Point to gsl/develop for FV3

Co-authored-by: samuel.trahan <Samuel.Trahan@noaa.gov>

* GWD, LSM and MYNN physics updates from RRFS_dev branch (#130)

* GWD, LSM and MYNN physics updates from RRFS_dev branch

* Temporary push to fork for transfer to Jet.

* Added regression test logs required for PR

* Reverting back to original rt.sh

* hera.gnu tests passed

* Jet intel tests passed.

* Hera intel tests passed

* Point to gsl/develop for FV3

Co-authored-by: samuel.trahan <Samuel.Trahan@noaa.gov>

* update submodule pointer for fv3atm

* Update fms to 2021.04 (#1135)

* Update fms to 2021.04
* Add RT for ocean IAU
* Update documentation

Co-authored-by: Phil Pegion <38869668+pjpegion@users.noreply.github.com>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>

* Point to top of gsl/develop for ccpp-physics

* land surface upgrades for p8 (#1095)

* reset the Noah-MP default options for those well tested

* P8c: Added capability for cdmbgwd(1) to scale GSL blocking drag (#1110)

* Update ESMF to version 8.3.0bs09 (#1146)

* Update ESMF to version 8.3.0b09
* Increase wall clock limit for tests/regional_3km to 15 min
* Update AutoRT to use tfe01 ecflow node on Jet
* Updated Cheyenne baseline epicufsrt path
* Updated Cheyenne epicufsrt hpc-stack build

Co-authored-by: JONG KIM <jong.kim@noaa.gov>
Co-authored-by: Brian Curtis <brian.curtis@noaa.gov>

* Update rrfs conus regression tests to compute fluxes.

* Remove nst_anl and a comment from the rrfs_conus13km_hrrr.nml.IN namelist template

* release/p8c: updated the TKE-EDMF PBL and saSAS cumulus scheme plus bug fix for the Thompson scheme (issue #881) (#1120)

* release/p8c: it is related to ccpp-physics PBL and cumulus updates plus a bug fix to the Thompson scheme

* Bring AQM model into UFS & Update MOM6 mixed FMS (#1137)

* Add AQM submodule to integrate NOAA's Air Quality Model embedding
the U.S. EPA Community Multiscale Air Quality Model (CMAQ).

* MOM6: An alternate fix to class(*) issues with FMS 2022-01

Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Radiation changes for prototype 8 (#1090)

* New feature in RRTMGP enabled ccpp-physics.
* Updated physics. New FV3 interstitials.
* Cleanup of RRTMGP regression tests.
* Replaced cld_mynn_ naming convention with cld_pbl_
* Some more cleanup of cloud-fraction...
* Pulled in Qingfu's changes to ccpp-physics
* New RT's for RRTMGP p8. Revert change in ccpp-physics
* Changed arguments to implied shape. in ccpp-physics
* Updated RRTMGP regression tests
* Changes to FV3/ccpp-physics.
* RRTMGP RT cleanup, again. Bug-fix in FV3/ccpp-physics
* Revert changes to names in FV3/ccpp-physics
* Cleanup p8 tests.
* More RT cleanup for p8.
* Add GP setting to non-coupled p8 tests.
* Added bounding to temperature at layer-interface used by RRTMGP.
* Reorder loop
* Combined gp sw and lw aerosol routines. Modest speedup (~4%). Add GP setting to test setup.
* Add GP settings to cpld_control_c96_noaero_p8 test.
* update test resources default_vars.sh

* HAFS moving-nesting related developments (#1104)

* Add the storm-following or specified moving-nesting capability for both the regional and global configuration.
* Expand the UFS/HAFS FV3ATM-HYCOM ocean coupling to support the static and moving nesting configuration.
* Expand the write grid component to support outputting the moving nest domain properly.
* Five HAFS related moving-nesting regression tests are added to test these newly added features. The regional_hafs RT was removed.

Co-authored-by: Daniel Rosen <daniel.rosen@noaa.gov>
Co-authored-by: Ufuk Turuncoglu <ufuk.turuncoglu@noaa.gov>
Co-authored-by: uturuncoglu <turuncu@ucar.edu>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: William Ramstrom <William.Ramstrom@noaa.gov>
Co-authored-by: A-Kyle <kyle.ahern@noaa.gov>

* fv3atm: Split GFS_typedefs.F90, rename CCPP_interstitial, import ccpp_t from ccpp_types; contains bug fix for WW3 debug (#1130)


Co-authored-by: Jessica Meixner <Jessica.Meixner@noaa.gov>

* Close MOM6 1deg at j=1; Update input-data for P8c (#909)


* update all tests using 1deg MOM6/CICE6
* pre-pend ufs to existing topo edits filename when
creating the new file
* update input-data directory

* Fix uninitialized min_rand variable in Thompson MP when using SPP (#1152)

* Updates to stochastic_physics and fv3 and CI

* Add RRFS-Smoke and regression tests.

* "update .gitmodules to point to the gsl/develop-smoke"

* "push tests/tests/rrfs_smoke_conus13km_hrrr_warm"

* Point to gsl/develop-smoke for ccpp-physics

* "update .gitmodules"

* "point to gsl/develop-smoke branch"

* "point to gsl/develop-smoke with active flag updates"

* "upload the hera.intel and hera.gnu regression test log files"

* Add the rrfs_smoke_conus13km_hrrr_warm regression test.

* Remove an extra read that went out of bounds

* hera.gnu tests passed

* hera.intel tests passed

* jet.intel tests passed

* Point to gsl/develop for FV3

* Point .gitmodules to NOAA-GSL

Co-authored-by: samuel.trahan <Samuel.Trahan@noaa.gov>

* A bug fix for wet scavenging of aerosols and a minor modification for moisture property calculation (#1176)

* point to one_scheme_to_one_file PR branch (#1175)

* merge ufs-community develop

* Point to gsl/merge-develop for FV3

* Changes missing from prior commit

* use community version of hafs_regional_atm

* merge rt.sh changes

* Point to gsl/merge-develop-to-community branch for FV3

* Revert gsl-specific changes to rt.sh

* Corrections to prior merge

* corrections to FV3_HRRR tests

* Add rrfs_smoke_conus13km_hrrr_warm test

* Add FV3_HRRR_smoke to rt builds

* Correct nst and domains_stack_size in rrfs_conus13km_hrrr.nml.IN

* Set SFCLAY_COMPUTE_FLUX=.true. for rrfs_smoke tests

* hera.gnu tests passed

* Hera BUILD_WALLTIME of 1 hour due to occasional extreme contention for intel licenses

* hera intel tests passed

* Jet tests passed

* Revert gsl-specific change to rt.sh

* Point FV3/.gitmodules to Sam's fork

* Correct issues found by reviewers in ccpp-physics and fv3atm

* Rename mynnpbl to mynnedmf in fv3atm and ccpp-physics

* FV3: Remove some empty _init and _finalize routines and update a comment in sgscloud_radpre

* Feature/lndp noahmp2 : add land perturbation scheme for Noah-MP fractional veg (#1143)

Updates to allow land perturbation scheme to be applied for Noah-MP. Currently, for Noah-MP model parameters can perturb only vegetation fraction.

Main code changes:
-added lsm_noahmp model option to lndp_type==2 land perturbation scheme (fv3-atm, stochastic_physics)
-updated comments
-cleaned up the namelists to make the different options clearer. Removed misleading lndp_each_step variable from gfs_physics_nml, and replaced it with "lndp_model_type" in the nam_sfcperts namelist for the different forecast types (cycling DA, short forecasts, perturbing only initial conditions) (fv3-atm, stochastic_physics, ufs-weather-model)
NOTE: see note below, re: specification of smc perturbation for RAP/HRRR/etc (lndp_model_type==2)
-revised code in stochastic_physics_wrapper to only allocate arrays that will be used when passed into lndp_apply_perts (fv3-atm)
-deleted unused albedo arrays in stochastic_physics_wrapper and lndp_apply_perts (fv3-atm, stochastic_physics)
-fixed bug causing precision errors when calculating the soil moisture ice content (often ~0.0; stochastic_physics)
-fixed bug in which lndp_apply_perts wasn't called for nscyc = 0. (fv3-atm)
-increased max_nvar_lndp at Jeff Ator's request (fv3-atm)
-added a new test for the Noah-MP and lndp==2 combination (ufs-weather-model)

* Add \file to smoke files

* Update CDEPS component, add hailcast code in FV3/atmos_cubed_sphere and reduce wall clock time used for the cpld_control_c192_p8 test on Jet (#1156)

Co-authored-by: Yunheng Wang

* Update CMEPS; Add gocart userguide (was #1182) (#1189)


* Update CMEPS submodule
* Add GOCART documentation

Co-authored-by: Li Pan <Li.Pan@noaa.gov>

* Combine PROD and REPRO build options into 'Release' build type (#1171)

Combined PROD and REPRO build modes into 'Release' build type. Now only 'Debug' and 'Release' build type are supported.
Both build types must produce bit-for-bit reproducible outputs using different number of threads, mpi tasks, different domain decomposition, have reproducible restarts etc.

* Unify inline post interfaces (#1181)

* replace pwatclm to pwat in the all diag tables under tests/parm/diag_table.

* adding bug fix from jili dong and removing U* averaging

* adding bug fix from jili dong and removing U* averaging

* Hera tests passed.

* Remove some commented-out code from cu_gf_driver in ccpp-physics.

* In FV3, turn rrtmg smoke band 10 into a model namelist variable

* Switch ccpp-physics smoke arguments to implied shape

* Remove some stops and gotos from ccpp-physics rrfs-smoke

* In FV3, remove some hard-coded constants and rename some meta entries

* In FV3, rename some standard_names, change a unit, and remove a "use physcons"

* Updated settings for NoahMP, Thompson and RRTMGP in RTs (#1196)

* add NoahMP opt_trs to namelist
* Updated namelist settings related to NoahMP scheme, Thompson scheme and RRTMGP (issue #1173 and #1185)
* Updated some namelist settings and add/remove some RTs related to RRTMGP

* Compute petlist bounds for each subcomponent from number of tasks. Update CICE (#1200)

* Instead of specifying petlist bounds (lower and upper bound), compute them using the number of tasks for each component. The function that computes petlist bounds assumes that the mediator always runs on the same tasks as ATM component, and that the Chemistry component also always runs on the same tasks as ATM.
* Update CICE submodule (@DeniseWorthen)

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>

* NSSL ccpp-physics bugfixes and new ccpp-framework debugging feature (#1202)

* Merge develop

* hera.gnu tests passed

* hera.intel tests passed

* jet intel tests passed

* hera.gnu tests passed.

* fv3atm: Only add cnv_3d_ud_mf to the restart files when needed

* More warnings not to change the conus13km tests

* adjust BL_DATE in rt.sh to 20220516

* WCOSS Cray tests passed

* fv3atm: pass some chemistry varibles to mynn_bl_driver correctly

* [AutoRT] hera.gnu Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] hera.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] cheyenne.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* WCOSS Dell P3 tests passed

* Correct argument passing within mynn edmf

* [AutoRT] gaea.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] cheyenne.gnu Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* Orion RT Passed

* [AutoRT] jet.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* Point to NOAA-EMC develop for FV3

* merge gsl institutional fork (#1195)

Merge in GSL institutional fork.

* update FV3 to top of gsl/merge-community-to-develop

* FV3: point to sam's repo

* Point to GSL baseline areas

* FV3/ccpp/physics: Change to GSL CODEOWNERS

* hera.gnu tests passed

* hera.intel passed

* jet.intel tests passed

* Set regression test path to GSL areas on Hera

* FV3: Returned the comments on soil resistance back.

* point to gsl/develop for fv3atm

* Merge May 16 ufs-community develop to gsl/develop (#138)

* Add ufs driver. Remove NEMS submodule. Update CMEPS. Update CDEPS. Feature/ort addition.  (#931)

* Add UFS driver, a copy of two fortran files from the NEMS repository. Remove NEMS submodule.

* Update CMEPS for current escomp/master. Implement the ability to write mediator history files for ATM on tiles rather than mesh

* Update CDEPS component. The updated CDEPS includes code updates for GFS v16 data mode.

* Operation requirement test (ORT) for:
  - cpld_control_p7 thread and decomposition tests
  - cpld_bmark_p7 thread and decomposition tests
  - Due to the wave component in these tests, restart and debug do not work

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>

* fv3atm cap cleanup (#954)

FV3 nuopc cap code cleanup. Remove used code/variables. Fix minor inconsistencies.

* CCPP cloud cover change for Thompson MP associated with Xu Randall, several bug fixes for regression testing scripts (#962)

This PR contains code changes 1) to remove old comments in GFS_typedefs.F90, increase cloud cover for Thompson MP by passing convective cloud water mixing ratio to progcld6. 2) Updates for auto fixes

Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>

* ccpp-physics #806, #807, #813, and ort modifications (#970)

- CCPP Physics changes: see Wrapper for ccpp-physics #806, #807, #813, NOAA-EMC/fv3atm#447.
- UFS weather model changes for ORT updates following changes in Fix Auto-RT on Gaea, Jet and Orion #965

* Wrapper for ccpp-physics #808 and 816 (roughness length over ice and NoahMP tsurf bugfix) (#971)

* update submodule pointer for regression testing for ccpp-physics #808,816: roughness length over ice and NoahMP tsurf bugfix
* Reduce time step from 600s to 450s for tests control_csawmg and control_csawmg_debug

Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: climbfuji <dom.heinzeller@icloud.com>

* Use 'model set run clock' routine in FV3 NUOPC cap. (#967)

* Update FV3 cap by adding 'model set run clock' specialization routine. Because FV3 cap does not modify 'Earth clock' anymore in case of a restarted run, that adjustment is now done in the UFS driver.
* Fix model_configure file for two tests to define `fhrot` parameter.

* Revert iovr=4 (exponential cloud overlap method) in RRTMG (#963)

Revert/cleanup iovr=4 in RRTMG per developer's request. The current exponential cloud overlapping method used in RRTMG represents the method used in the pre-2018 operational HWRF model.

* Add fhzero ort test (#977)

* Fhzero ORT applies to the two tests `control` and `control_p7`
* Test can be run by invoking, for example, `./opnReqTest -n control -c fhz`

* Add a new CDEPS test to use GSFv16 data mode in CDEPS ,update rt_weekly.conf and update MOM6 to main branch (20211220) (#976)

* add a new cdeps test using GFS data mode
* update rt_weekly.conf to include cpld_bmark_p7_35d tests
* update MOM6

Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Bug fixes for WAM physics and regression tests, remove duplicate modules from ccpp-physics CMakeLists.txt (#947)

*adds a new regression test control_wam_debug and fixes problems with the existing control_wam test (e.g. IAER was not set as intended).

* Update global inline post for outputting foundation temperature (#968)

Update upp submodule in fv3atm with latest UPP version for outputting foundation temperature and fixing land-sea mask issue in global inline post.

* Regression test bug fixes for running on Jet or with Rocoto (#981)

* Bug fixes for running on jet or with rocoto
1. Correctly detect Jet when deciding build job runtimes
2. Do not delete out and err files in compile & test jobs
3. Correct dependencies for WW3 in Rocoto
4. Do not hard-code ACCNR to h-nems
This PR also contains fv3/ccpp physics (CCPP PR#812) updates that implements a vertically-integrated formula to properly compute tracer column mass and ensure mass conservation for all tracers except TKE. See issue NCAR/ccpp-physics#811 for details

* MYNN sfclay (RAP suite) restart reproducibility (#984)

*This PR turns on the rap_restart tests. Bit-for-bit reproducibility is achieved with the bug fixes for MYNN sfclay in the associated fv3atm and ccpp-physics PRs.

* fixes on initializing snow over fractional ice and GFS_surface_composite and z0ice value change (#996)

* Radar-derived microphysics temperature tendencies similar to operational HRRR (#986)

This PR implements a feature of the operational HRRR, radar-derived microphysics temperature tendencies applied in the first N minutes of the forecast to improve clouds in the first few hours. Two regression tests are added.

* Turn on CICE albedo use by ATM for coupled model; update Prototype test suite to initial P8 configuration;  (#944)

* add updates for suites, tests for initial P8 configuration
* add IOPT_SFC=3 as default; set IOPT_SFC=1 in p7 tests
* change min_seaice to 1e-6; set to 1e-11 in p7 tests
* set dddmp=0.1 in both P7 and P8. This matches the final
P7 configuration. It will change P7 baselines.
* set cdmbwd in both P7 and P8 to the final P7 configuration.
(1.0,2.2,1.0,1.0) for all resolutions. It will change P7 baselines.
* add dusan's ecflow fix for wcoss2
* update FV3 with Moorthis' snod fix
* update rt_weekly to use p8 tests
* change integration length to 5 days

* Thompson MP cloud tuning (#1005)

* improves cloud fraction when using Thompson MP. See NCAR/ccpp-physics#809 for more details.

* Add a new HAFS regression test with Thompson MP and GFDL surface layer schemes and Corrected S4 template regression testing job card (#995)

* Added a new regression test for HAFS. 
* Fixed the S4 RT template job card.

Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>

* CCPP: Update consistency checks and effective radii calculation for Thompson MP (#1000)

This PR contains changes in ccpp-physics (Update consistency checks and effective radii calculation for Thompson MP) and adds two new regression tests for both Intel and GNU that use the new prognostic cloud scheme progcld_thompson with GFS v16 and with RAP. The new cloud scheme is activated by setting icloud == 3 in input.nml.

* Rremove nems_datm related code, update CDEPS, and remove run directories that are no longer needed by other tests (#1008)

* Add fhzero ort to coupled tests (#1009)

* Add fhz ort to cpld tests
* Set ACCNR in rt.sh, not detect_machine.sh. Add some comments explaining where the variable should not be set or used.

Co-authored-by: Samuel Trahan <Samuel.Trahan@noaa.gov>

* Unified write_netcdf, add single file 'cubed_sphere_grid' output (#1011)

* Unify write_netcdf and write_netcdf_parallel modules.
* Add support for writing 'cubed_sphere_grid' history files in a single netcdf file.

* Change standard name and unit of CCPP error flag variable in CCPP framework and physics (#1013)

* updates the submodule pointers for fv3atm, ccpp-framework and ccpp-physics for:  Change standard name and unit of CCPP error flag variable in CCPP framework and physics.

* ESMF managed threading (#1018)

Add code updates to enable the ESMF managed threading in UFS.


Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >

* sync-ww3 (#1026)

* sync with ww3 develop branch

* Revisions to repair iovr=5 cloud overlap option (#1025)

* This PR addresses part 2 of issue #748 to activate the exponential-random cloud overlap method (iovr=5) in RRTMG. RT tests were added for  iovr=4 and iovr=5 options
* change iovr to use the environment variable in control.nml.IN; modify all tests that use control.nml.IN to set env. var. iovr=3 (except for new tests); remove restart files from new tests

* 2D decomposition on write grid, bug fix in FV3GFS_IO.F90, and quad precision in stochastic physics (#1028)

- The 2D decomposition is enabled on write grid component.
- FV3atm PR NOAA-EMC/fv3atm#468 from @MicroTed 
- stochastic physics PR noaa-psd/stochastic_physics#53 from Dom.

Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>

* Update CMEPS for wave coupling (#1034)


* add run phases to allow waves to run in the slow loop
* re-order hafs wave test
* update aliases in fd_nems.yaml
* update CMEPS to prevent advertise conflicts when s2sw is
still using connectors
* add correct masking variables to hafs nems.configure files

* 4DIAU bug fix when iau_filter_increments=T (#990)

* Add lsm_cold_start variable for RUC LSM SCM support and gwdps bugfix (combined) (#1037)

Co-authored-by: @SMoorthi-emc

* Update esmf 821b04 (#1041)

* Update the version of ESMF library to 8.2.1b04
* Add the write group lon info for upp 2d decomposition test.

* Multiple output (nested) grids from fv3atm (#1044)

Update fv3atm to support writing multiple history files for parent and nested domains.
Nested HAFS regression tests were updated to write out history files from all nested domains.

Co-authored-by: Bin Liu <bin.liu@noaa.gov>

* GPU-enabled version of Grell-Freitas convection in ccpp-physics (#1043)

* Enable Thompson microphysics with UFS-Aerosols and update GOCART (#1049)

This update allows the Thompson microphysics scheme to be used with prognostic aerosols (UFS-Aerosols) and updates GOCART to version 2.0.2.

* Add support for Stochastically Perturbed Parameterizations (SPP) in FV3 (#982)

* Update CICE; add support for restart test when running single RT (was PR 1058); update MOM6 (was PR 1060) (#1045)


* update cice
* (1) pointing MOM6 to testing branch (MOM6 main repo PR: https://github.com/mom-ocean/MOM6/pull/1556#issuecomment-1043374317)
    (2) add three new files in mom_cmake file
            core/MOM_porous_barriers.F90
            external/drifters/MOM_particles.F90
            external/drifters/MOM_particles_types.F90
    (3) explicitly set in MOM_input for all resolutions to reflect the default value changes in code to retain answer
        EPBL_MLD_BISECTION = True (default changed from T to F in this MOM6 PR)
        INTERNAL_WAVE_SPEED_BETTER_EST = False (default changed from F to T in this MOM6 PR)
        note BBL_USE_EOS now set to use the value of USE_EOS in this MOM6 PR,
        but we set BBL_USE_EOS explicit so it has no impact

* remove duplicated CHL input setting in MOM_input_template_050
* add support for restart tests while running single RT

* lateral boundary fix for regional runs (#1050)

This PR fixes a transient increase in noise caused by incorrect processing of winds along the lateral boundary on the final acoustic time step before fresh boundary information is ingested into the model.

* Feature: NSSL Microphysics support (#1032)

* add new RT that uses NSSL MP; add new NSSL vars to default_vars.sh and rap.nml.IN; add new field table for using NSSL MP with hail on

* p8b (with aerosols)  (#1071)


updates all p8 tests to the p8b settings, which includes GOCART

Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>

* Split CCPP finalize into physics_finalize and (framework) finalize, fix CCPP's metadata2html.py (#1061)

* add a cdeps test using GFSv16 input data (#1070)

* CMAKE for WW3  (#1089)


* Use WW3 CMake build

Co-authored-by: kgerheiser <kgerheiser@icloud.com>

* Add 'valid time' variable using ISO string format (#1073)

* Require cmake version 3.19
* Update FV3:
   - Add 'valid time' variable using ISO string format to netcdf history files.
   - Use double precision variable to set value of 'time' attribute in wrt comp import state
   - Update ccpp/physics (setting surface-related interstitial variables for SCM prescribed-surface-flux mode)
   - Update inline_post_stub.F90 subroutine interfaces to match inline_post.F90

* Add hi-res regional test on small domain (#1084)


* Add hi-res regional test on small domain

* Fix Lambert Conformal Conic mapping in the write component on the southern hemisphere (#1087)

* Subroutine `lambert` in the FV3 write component has been fixed to do the mapping on the southern hemisphere correctly.
* CI fix
  - Docker container library updated. CI input data updated. Add chm_petlist_bounds.
  - Change gocart output file name for debug test
  - Changes for opnReqTest to also scan rt_gnu.conf
  - Change CI tests to noaero

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>

* Rectify total number of Thompson MP species and add UFS-Aerosols to S2S and S2SW (#1118)

* Rectify total number of Thompson MP species
* Implement S2SWA/S2SA build app as the only one enabling prognostic aerosols in fully coupled model.
* Update output_fh documentation.

* Add a cdeps test and update mom6, fv3, and weekly tests (#1136)

Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: DusanJovic-NOAA <dusan.jovic@noaa.gov>

* update submodule pointer for fv3atm

* Update fms to 2021.04 (#1135)

* Update fms to 2021.04
* Add RT for ocean IAU
* Update documentation

Co-authored-by: Phil Pegion <38869668+pjpegion@users.noreply.github.com>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>

* land surface upgrades for p8 (#1095)

* reset the Noah-MP default options for those well tested

* P8c: Added capability for cdmbgwd(1) to scale GSL blocking drag (#1110)

* Update ESMF to version 8.3.0bs09 (#1146)

* Update ESMF to version 8.3.0b09
* Increase wall clock limit for tests/regional_3km to 15 min
* Update AutoRT to use tfe01 ecflow node on Jet
* Updated Cheyenne baseline epicufsrt path
* Updated Cheyenne epicufsrt hpc-stack build

Co-authored-by: JONG KIM <jong.kim@noaa.gov>
Co-authored-by: Brian Curtis <brian.curtis@noaa.gov>

* Update rrfs conus regression tests to compute fluxes.

* Remove nst_anl and a comment from the rrfs_conus13km_hrrr.nml.IN namelist template

* release/p8c: updated the TKE-EDMF PBL and saSAS cumulus scheme plus bug fix for the Thompson scheme (issue #881) (#1120)

* release/p8c: it is related to ccpp-physics PBL and cumulus updates plus a bug fix to the Thompson scheme

* Bring AQM model into UFS & Update MOM6 mixed FMS (#1137)

* Add AQM submodule to integrate NOAA's Air Quality Model embedding
the U.S. EPA Community Multiscale Air Quality Model (CMAQ).

* MOM6: An alternate fix to class(*) issues with FMS 2022-01

Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>

* Radiation changes for prototype 8 (#1090)

* New feature in RRTMGP enabled ccpp-physics.
* Updated physics. New FV3 interstitials.
* Cleanup of RRTMGP regression tests.
* Replaced cld_mynn_ naming convention with cld_pbl_
* Some more cleanup of cloud-fraction...
* Pulled in Qingfu's changes to ccpp-physics
* New RT's for RRTMGP p8. Revert change in ccpp-physics
* Changed arguments to implied shape. in ccpp-physics
* Updated RRTMGP regression tests
* Changes to FV3/ccpp-physics.
* RRTMGP RT cleanup, again. Bug-fix in FV3/ccpp-physics
* Revert changes to names in FV3/ccpp-physics
* Cleanup p8 tests.
* More RT cleanup for p8.
* Add GP setting to non-coupled p8 tests.
* Added bounding to temperature at layer-interface used by RRTMGP.
* Reorder loop
* Combined gp sw and lw aerosol routines. Modest speedup (~4%). Add GP setting to test setup.
* Add GP settings to cpld_control_c96_noaero_p8 test.
* update test resources default_vars.sh

* HAFS moving-nesting related developments (#1104)

* Add the storm-following or specified moving-nesting capability for both the regional and global configuration.
* Expand the UFS/HAFS FV3ATM-HYCOM ocean coupling to support the static and moving nesting configuration.
* Expand the write grid component to support outputting the moving nest domain properly.
* Five HAFS related moving-nesting regression tests are added to test these newly added features. The regional_hafs RT was removed.

Co-authored-by: Daniel Rosen <daniel.rosen@noaa.gov>
Co-authored-by: Ufuk Turuncoglu <ufuk.turuncoglu@noaa.gov>
Co-authored-by: uturuncoglu <turuncu@ucar.edu>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: William Ramstrom <William.Ramstrom@noaa.gov>
Co-authored-by: A-Kyle <kyle.ahern@noaa.gov>

* fv3atm: Split GFS_typedefs.F90, rename CCPP_interstitial, import ccpp_t from ccpp_types; contains bug fix for WW3 debug (#1130)


Co-authored-by: Jessica Meixner <Jessica.Meixner@noaa.gov>

* Close MOM6 1deg at j=1; Update input-data for P8c (#909)


* update all tests using 1deg MOM6/CICE6
* pre-pend ufs to existing topo edits filename when
creating the new file
* update input-data directory

* Fix uninitialized min_rand variable in Thompson MP when using SPP (#1152)

* Updates to stochastic_physics and fv3 and CI

* A bug fix for wet scavenging of aerosols and a minor modification for moisture property calculation (#1176)

* point to one_scheme_to_one_file PR branch (#1175)

* merge ufs-community develop

* Point to gsl/merge-develop for FV3

* Changes missing from prior commit

* use community version of hafs_regional_atm

* merge rt.sh changes

* Point to gsl/merge-develop-to-community branch for FV3

* Revert gsl-specific changes to rt.sh

* Corrections to prior merge

* corrections to FV3_HRRR tests

* Add rrfs_smoke_conus13km_hrrr_warm test

* Add FV3_HRRR_smoke to rt builds

* Correct nst and domains_stack_size in rrfs_conus13km_hrrr.nml.IN

* Set SFCLAY_COMPUTE_FLUX=.true. for rrfs_smoke tests

* hera.gnu tests passed

* Hera BUILD_WALLTIME of 1 hour due to occasional extreme contention for intel licenses

* hera intel tests passed

* Jet tests passed

* Revert gsl-specific change to rt.sh

* Point FV3/.gitmodules to Sam's fork

* Correct issues found by reviewers in ccpp-physics and fv3atm

* Rename mynnpbl to mynnedmf in fv3atm and ccpp-physics

* FV3: Remove some empty _init and _finalize routines and update a comment in sgscloud_radpre

* Feature/lndp noahmp2 : add land perturbation scheme for Noah-MP fractional veg (#1143)

Updates to allow land perturbation scheme to be applied for Noah-MP. Currently, for Noah-MP model parameters can perturb only vegetation fraction.

Main code changes:
-added lsm_noahmp model option to lndp_type==2 land perturbation scheme (fv3-atm, stochastic_physics)
-updated comments
-cleaned up the namelists to make the different options clearer. Removed misleading lndp_each_step variable from gfs_physics_nml, and replaced it with "lndp_model_type" in the nam_sfcperts namelist for the different forecast types (cycling DA, short forecasts, perturbing only initial conditions) (fv3-atm, stochastic_physics, ufs-weather-model)
NOTE: see note below, re: specification of smc perturbation for RAP/HRRR/etc (lndp_model_type==2)
-revised code in stochastic_physics_wrapper to only allocate arrays that will be used when passed into lndp_apply_perts (fv3-atm)
-deleted unused albedo arrays in stochastic_physics_wrapper and lndp_apply_perts (fv3-atm, stochastic_physics)
-fixed bug causing precision errors when calculating the soil moisture ice content (often ~0.0; stochastic_physics)
-fixed bug in which lndp_apply_perts wasn't called for nscyc = 0. (fv3-atm)
-increased max_nvar_lndp at Jeff Ator's request (fv3-atm)
-added a new test for the Noah-MP and lndp==2 combination (ufs-weather-model)

* Add \file to smoke files

* Update CDEPS component, add hailcast code in FV3/atmos_cubed_sphere and reduce wall clock time used for the cpld_control_c192_p8 test on Jet (#1156)

Co-authored-by: Yunheng Wang

* Update CMEPS; Add gocart userguide (was #1182) (#1189)


* Update CMEPS submodule
* Add GOCART documentation

Co-authored-by: Li Pan <Li.Pan@noaa.gov>

* Combine PROD and REPRO build options into 'Release' build type (#1171)

Combined PROD and REPRO build modes into 'Release' build type. Now only 'Debug' and 'Release' build type are supported.
Both build types must produce bit-for-bit reproducible outputs using different number of threads, mpi tasks, different domain decomposition, have reproducible restarts etc.

* Unify inline post interfaces (#1181)

* replace pwatclm to pwat in the all diag tables under tests/parm/diag_table.

* adding bug fix from jili dong and removing U* averaging

* adding bug fix from jili dong and removing U* averaging

* Hera tests passed.

* Remove some commented-out code from cu_gf_driver in ccpp-physics.

* In FV3, turn rrtmg smoke band 10 into a model namelist variable

* Switch ccpp-physics smoke arguments to implied shape

* Remove some stops and gotos from ccpp-physics rrfs-smoke

* In FV3, remove some hard-coded constants and rename some meta entries

* In FV3, rename some standard_names, change a unit, and remove a "use physcons"

* Updated settings for NoahMP, Thompson and RRTMGP in RTs (#1196)

* add NoahMP opt_trs to namelist
* Updated namelist settings related to NoahMP scheme, Thompson scheme and RRTMGP (issue #1173 and #1185)
* Updated some namelist settings and add/remove some RTs related to RRTMGP

* Compute petlist bounds for each subcomponent from number of tasks. Update CICE (#1200)

* Instead of specifying petlist bounds (lower and upper bound), compute them using the number of tasks for each component. The function that computes petlist bounds assumes that the mediator always runs on the same tasks as ATM component, and that the Chemistry component also always runs on the same tasks as ATM.
* Update CICE submodule (@DeniseWorthen)

Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>

* NSSL ccpp-physics bugfixes and new ccpp-framework debugging feature (#1202)

* Merge develop

* hera.gnu tests passed

* hera.intel tests passed

* jet intel tests passed

* hera.gnu tests passed.

* fv3atm: Only add cnv_3d_ud_mf to the restart files when needed

* More warnings not to change the conus13km tests

* adjust BL_DATE in rt.sh to 20220516

* WCOSS Cray tests passed

* fv3atm: pass some chemistry varibles to mynn_bl_driver correctly

* [AutoRT] hera.gnu Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] hera.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] cheyenne.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* WCOSS Dell P3 tests passed

* Correct argument passing within mynn edmf

* [AutoRT] gaea.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* [AutoRT] cheyenne.gnu Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* Orion RT Passed

* [AutoRT] jet.intel Job Completed.

on-behalf-of @ufs-community <brian.curtis@noaa.gov>

* Point to NOAA-EMC develop for FV3

* merge gsl institutional fork (#1195)

Merge in GSL institutional fork.

* update FV3 to top of gsl/merge-community-to-develop

* FV3: point to sam's repo

* Point to GSL baseline areas

* FV3/ccpp/physics: Change to GSL CODEOWNERS

* hera.gnu tests passed

* hera.intel passed

* jet.intel tests passed

* Set regression test path to GSL areas on Hera

* FV3: Returned the comments on soil resistance back.

Co-authored-by: Dusan Jovic <48258889+DusanJovic-NOAA@users.noreply.github.com>
Co-authored-by: Minsuk Ji <57227195+MinsukJi-NOAA@users.noreply.github.com>
Co-authored-by: Denise Worthen <denise.worthen@noaa.gov>
Co-authored-by: BinLi-NOAA <bin.li@noaa.gov>
Co-authored-by: Dom Heinzeller <dom.heinzeller@icloud.com>
Co-authored-by: Dusan Jovic <dusan.jovic@noaa.gov>
Co-authored-by: Grant Firl <grant.firl@noaa.gov>
Co-authored-by: Dom Heinzeller <climbfuji@ymail.com>
Co-authored-by: mzhangw <mzhangw@gmail.com>
Co-authored-by: jiandewang <jiande.wang@noaa.gov>
Co-authored-by: WenMeng-NOAA <48260754+WenMeng-NOAA@users.noreply.github.com>
Co-authored-by: SMoorthi-emc <47667426+SMoorthi-emc@users.noreply.github.com>
Co-authored-by: ChunxiZhang-NOAA <49283036+ChunxiZhang-NOAA@users.noreply.github.com>
Co-authored-by: David Huber <david.huber@noaa.gov>
Co-authored-by: Bin Liu <Bin.Liu@noaa.gov>
Co-authored-by: Jun Wang <37633869+junwang-noaa@users.noreply.github.com>
Co-authored-by: Gerhard Theurich <gerhard.j.theurich@noaa.gov >
Co-authored-by: Ali.Abdolali <37336972+aliabdolali@users.noreply.github.com>
Co-authored-by: Ted Mansell <ted.mansell@noaa.gov>
Co-authored-by: Dom Heinzeller <heinzell@ucar.edu>
Co-authored-by: Jeff Whitaker <jswhit@fastmail.fm>
Co-authored-by: DomHeinzeller <58610420+DomHeinzeller@users.noreply.github.com>
Co-authored-by: Raffaele Montuoro <raffaele.montuoro@noaa.gov>
Co-authored-by: JeffBeck-NOAA <55201531+JeffBeck-NOAA@users.noreply.github.com>
Co-authored-by: MatthewPyle-NOAA <48285220+MatthewPyle-NOAA@users.noreply.github.com>
Co-authored-by: Jessica Meixner <jessica.meixner@noaa.gov>
Co-authored-by: kgerheiser <kgerheiser@icloud.com>
Co-authored-by: RatkoVasic-NOAA <37597874+RatkoVasic-NOAA@users.noreply.github.com>
Co-authored-by: joeolson42 <Joseph.B.Olson@noaa.gov>
Co-authored-by: Phil Pegion <38869668+pjpegion@users.noreply.github.com>
Co-authored-by: HelinWei-NOAA <48133472+HelinWei-NOAA@users.noreply.github.com>
Co-authored-by: mdtoyNOAA <73618848+mdtoyNOAA@users.noreply.github.com>
Co-authored-by: JONG KIM <jong.kim@noaa.gov>
Co-authored-by: Brian Curtis <brian.curtis@noaa.gov>
Co-authored-by: Brian Curtis <64433609+BrianCurtis-NOAA@users.noreply.github.com>
Co-authored-by: dustinswales <dustin.swales@noaa.gov>
Co-authored-by: Daniel Rosen <daniel.rosen@noaa.gov>
Co-authored-by: Ufuk Turuncoglu <ufuk.turuncoglu@noaa.gov>
Co-authored-by: uturuncoglu <turuncu@ucar.edu>
Co-authored-by: William Ramstrom <William.Ramstrom@noaa.gov>
Co-authored-by: A-Kyle <kyle.ahern@noaa.gov>
Co-authored-by: ClaraDraper-NOAA <33430543+ClaraDraper-NOAA@users.noreply.github.com>
Co-authored-by: Li Pan <Li.Pan@noaa.gov>

* Correct .gitmodules

* Gsl/may16 followup pr (#139)

* new tests

* point to gsl/may16-followup-pr branch of fv3

* Change suite_FV3_GFS_v15_thompson_mynn to not use mynn surface layer scheme (from T…
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Baseline Updates Current baselines will be updated. Ready for Commit Queue The PR is ready for the Commit Queue. All checkboxes in PR template have been checked. Waiting for Reviews The PR is waiting for reviews from associated component PR's.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants