Generate graphics plots as part of WE2E test

[BruceKropp-Raytheon]

The tutorial describes how to manually generate plots, and in order to automate this, we would need a simple way to enable it to happen with a workflow E2E test run.
https://srw-ug.readthedocs.io/en/text-tutorial/Tutorial.html#tutorials

[EdwardSnyder-NOAA]

Good morning Bruce!

We have one WE2E test that tests the plotting task. Are there specific WE2E tests you would like to have the plotting task enabled for?

In @mkavulich issue #587 on overhauling and consolidating WE2E tests, he mentioned that plotting might not be suitable for WE2E testing. Maybe he can chime in on how to automate the WE2E plotting task.

In the meantime, you could use the sed command to insert the plotting task into the WE2E test config files found under the ufs-srweather-app/tests/WE2E/test_configs/grids_extrn_mdls_suites_(community|nco) directories.
sed -i '<line number>i rocoto:' /path/to/config yaml
sed -i '<line number>i \ \ tasks:' /path/to/config yaml
sed -i '<line number>i \ \ \ \ taskgroups: '\''{{ ["parm/wflow/prep.yaml", "parm/wflow/coldstart.yaml", "parm/wflow/post.yaml", "parm/wflow/plot.yaml"]|include }}'\''' /path/to/config yaml

Thanks!

Eddie Snyder | Advanced User Support (AUS) Team

[EdwardSnyder-NOAA]

@mkavulich - my apologies for misinterpreting your comments in #587, which is why I suggested doing sed as I thought we weren't going to modify any WE2E tests. Given that's not the case, should we go ahead and add plotting capabilities to a number of commonly used WE2E tests?

[mkavulich]

I think that would be a good idea. It would be really nice if we could support plotting for all/arbitrary domains, but I'm not super familiar with the state of the plotting capability right now, so I'm not sure how much work it would be to implement that. So maybe just the CONUS domains for now?

[EdwardSnyder-NOAA]

The plot_allvars task does plotting for CONUS and regional domains. The regional domain is defined by the latitude and longitude found in the post-processed prslev and natlev grib2 files.

The workflow defaults to the CONUS domain. To enable it for the regional domain, add the below code to the end of the config WE2E yaml. Make sure the rocoto step we mentioned earlier is in the config WE2E yaml as well.

task_plot_allvars:
  PLOT_DOMAINS: ["regional"]

I looked through our WE2E tests and think that we should add plotting capabilities to the config yamls listed below. Each one of these files are in one or more coverage, comprehensive, or fundamental list, meaning that each testing suite will have at least one experiment that runs the plot_allvars task.

grid_RRFS_CONUS_13km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v16
grid_RRFS_NA_13km_ics_FV3GFS_lbcs_FV3GFS_suite_RRFS_v1beta
grid_RRFS_CONUScompact_25km_ics_HRRR_lbcs_HRRR_suite_HRRR
grid_RRFS_CONUS_25km_ics_FV3GFS_lbcs_FV3GFS_suite_GFS_v15p2
grid_RRFS_CONUS_25km_ics_GSMGFS_lbcs_GSMGFS_suite_GFS_2017_gfdlmp
grid_SUBCONUS_Ind_3km_ics_HRRR_lbcs_RAP_suite_WoFS_v0

Let me know what you think, and I can open a PR for these changes.

[BruceKropp-Raytheon]

Great! Let's add this.

Would the default configs be ready-to-go with rocoto for the usual WE2E coverage tests that CM runs?

[EdwardSnyder-NOAA]

I created a draft PR that adds plotting capabilities to a few WE2E tests. Now every comprehensive, coverage, and fundamental suite will have at least one experiment that tests the graphics plotting capabilities. I did end up using a whole different list of tests. To answer your question, yes the selected configs have been renamed and the rocoto section has been added to them.

[gspetro-NOAA]

PR #777 solved this problem.