-
Notifications
You must be signed in to change notification settings - Fork 24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature #2633 seeps default p1 threshold #2634
Feature #2633 seeps default p1 threshold #2634
Conversation
Co-authored-by: John Halley Gotway <johnhg@ucar.edu> Co-authored-by: Seth Linden <linden@seneca.rap.ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu> Co-authored-by: John and Cindy <halleygotway@Halleys-Mac-mini.local> Co-authored-by: Howard Soh <hsoh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: hsoh-u <hsoh@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu> Co-authored-by: Seth Linden <linden@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: davidalbo <dave@ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: metplus-bot <97135045+metplus-bot@users.noreply.github.com> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Fix Python environment issue (#2407) fix definitions of G172 and G220 based on comments in NOAA-EMC/NCEPLIBS-w3emc#157. (#2406) fix #2380 develop override (#2382) fix #2408 develop empty config (#2410) fix #2390 develop compile zlib (#2404) fix #2412 develop climo (#2422) fix #2437 develop convert (#2439) fix for develop, for #2437, forgot one reference to the search_parent for a dictionary lookup. fix #2452 develop airnow (#2454) fix #2449 develop pdf (#2464) fix #2402 develop sonarqube (#2468) fix #2426 develop buoy (#2475) fix 2518 dtypes appf docs (#2519) fix 2531 compilation errors (#2533) fix #2531 compilation_errors_configure (#2535)
@hsoh-u , the destination branch for this pull request should be main_v11.1, not main_v11.0 |
I branched this from develop. I will redo (branch from main_v11.1). |
Thank you John! John already did it exept one file (internal/test_unit/xml/unit_grid_stat.xml). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I approve of this PR. I updated the destination branch to be main_v11.1, added labels, and made some minor edits to the docs. I reviewed the changes and all are desired. Note that no seeps diffs were flagged in the output because while the default config files changed, the ones used in the unit tests did not.
The tests do produce an additional output file, as seen here:
ERROR: folder /data/output/met_test_truth missing 1 files
plot_tc/plot_tc_TCMPR_data.tcst
This is expected based on the update to the test.
Co-authored-by: John Halley Gotway <johnhg@ucar.edu> Co-authored-by: Seth Linden <linden@seneca.rap.ucar.edu> Co-authored-by: jprestop <jpresto@ucar.edu> Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu> Co-authored-by: John and Cindy <halleygotway@Halleys-Mac-mini.local> Co-authored-by: Howard Soh <hsoh@seneca.rap.ucar.edu> Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com> Co-authored-by: hsoh-u <hsoh@ucar.edu> Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu> Co-authored-by: Seth Linden <linden@ucar.edu> Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com> Co-authored-by: davidalbo <dave@ucar.edu> Co-authored-by: Lisa Goodrich <lisag@ucar.edu> Co-authored-by: metplus-bot <97135045+metplus-bot@users.noreply.github.com> Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: Jonathan Vigh <jvigh@ucar.edu> Co-authored-by: David Albo <dave@ucar.edu> Co-authored-by: Tracy Hertneky <39317287+hertneky@users.noreply.github.com> Co-authored-by: Dan Adriaansen <dadriaan@ucar.edu> Fix Python environment issue (#2407) fix definitions of G172 and G220 based on comments in NOAA-EMC/NCEPLIBS-w3emc#157. (#2406) fix #2380 develop override (#2382) fix #2408 develop empty config (#2410) fix #2390 develop compile zlib (#2404) fix #2412 develop climo (#2422) fix #2437 develop convert (#2439) fix for develop, for #2437, forgot one reference to the search_parent for a dictionary lookup. fix #2452 develop airnow (#2454) fix #2449 develop pdf (#2464) fix #2402 develop sonarqube (#2468) fix #2426 develop buoy (#2475) fix 2518 dtypes appf docs (#2519) fix 2531 compilation errors (#2533) fix #2531 compilation_errors_configure (#2535) fix 2596 main v11.1 rpath compilation (#2614) fix #2514 main_v11.1 clang (#2628)
Expected Differences
The default p1 threshold was set to >=0.1&&<=0.85 (was NA). The point SEEPS climo was filtered already, but not gridded SEEPS climo.
Do these changes introduce new tools, command line arguments, or configuration file options? [No]
If yes, please describe:
Do these changes modify the structure of existing or add new output data types (e.g. statistic line types or NetCDF variables)? [No]
If yes, please describe:
Pull Request Testing
/d1/personal/hsoh/git/pull_request/MET_feature_2633_SEEPS_default_p1_threshold/bin/grid_stat /d1/personal/hsoh/data/MET-1943/gpm_2021120100_2021120200_trmmgrid.nc /d1/personal/hsoh/data/MET-1943/prods_op_gl-mn_2021120100_f024_A24_trmmgrid.nc /d1/personal/hsoh/data/config/GridStatConfig_SEEPS_fixed_p1_thresh -outdir out_grid_stat -v 7 > log_grid_stat_seeps.log
grep "filtered by threshold p1" log_grid_stat_seeps.log | wc -w
1290704
/d1/personal/hsoh/git/pull_request/MET_feature_2633_SEEPS_default_p1_threshold/bin/point_stat /d1/projects/MET/MET_test_data/unit_test/model_data/grib1/nam/nam_2012040900_F012.grib /d1/personal/hsoh/MET/test_output/feature_1942_seeps/ascii2nc/trmm_2012040912_3hr.nc /d1/personal/hsoh/data/config/PointStatConfig_APCP_hardcoded_p1_thresh -outdir point_stat -v 7 > log_point_stat_seeps.log
grep "filtered by threshold p1" log_point_stat_seeps.log | wc -w
0
Note: The SEEPS score for the point data are not filtered because the filtered values are saved at the point Climo.
Note: The SEEPS score for the point data are filtered by other criteria (density weighted averaging, density_radius = 0.75).
Recommend testing for the reviewer(s) to perform, including the location of input datasets, and any additional instructions:
Do these changes include sufficient documentation updates, ensuring that no errors or warnings exist in the build of the documentation? [Yes]
Do these changes include sufficient testing updates? [No]
Will this PR result in changes to the test suite? [Yes]
If yes, describe the new output and/or changes to the existing output:
The setting at unit test, grid_stat_UK_SEEPS, "SEEPS_P1_THRESH" is changed to ge0.1&&le0.85 (was NA).
The grid_stat output will be changed because of filtering by p1 threshold. The out "grid_stat/grid_stat_SEEPS_000000L_20211202_000000V*" will be different.
Note:
Pull Request Checklist
See the METplus Workflow for details.
Select: Reviewer(s)
Select: Organization level software support Project or Repository level development cycle Project
Select: Milestone as the version that will include these changes