Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature #2633 seeps default p1 threshold #2634

Merged
merged 7 commits into from
Jul 31, 2023

Conversation

hsoh-u
Copy link
Collaborator

@hsoh-u hsoh-u commented Jul 31, 2023

Expected Differences

The default p1 threshold was set to >=0.1&&<=0.85 (was NA). The point SEEPS climo was filtered already, but not gridded SEEPS climo.

  • Do these changes introduce new tools, command line arguments, or configuration file options? [No]

    If yes, please describe:

  • Do these changes modify the structure of existing or add new output data types (e.g. statistic line types or NetCDF variables)? [No]

    If yes, please describe:

Pull Request Testing

  • Describe testing already performed for these changes:

/d1/personal/hsoh/git/pull_request/MET_feature_2633_SEEPS_default_p1_threshold/bin/grid_stat /d1/personal/hsoh/data/MET-1943/gpm_2021120100_2021120200_trmmgrid.nc /d1/personal/hsoh/data/MET-1943/prods_op_gl-mn_2021120100_f024_A24_trmmgrid.nc /d1/personal/hsoh/data/config/GridStatConfig_SEEPS_fixed_p1_thresh -outdir out_grid_stat -v 7 > log_grid_stat_seeps.log

grep "filtered by threshold p1" log_grid_stat_seeps.log | wc -w
1290704

/d1/personal/hsoh/git/pull_request/MET_feature_2633_SEEPS_default_p1_threshold/bin/point_stat /d1/projects/MET/MET_test_data/unit_test/model_data/grib1/nam/nam_2012040900_F012.grib /d1/personal/hsoh/MET/test_output/feature_1942_seeps/ascii2nc/trmm_2012040912_3hr.nc /d1/personal/hsoh/data/config/PointStatConfig_APCP_hardcoded_p1_thresh -outdir point_stat -v 7 > log_point_stat_seeps.log
grep "filtered by threshold p1" log_point_stat_seeps.log | wc -w
0

Note: The SEEPS score for the point data are not filtered because the filtered values are saved at the point Climo.
Note: The SEEPS score for the point data are filtered by other criteria (density weighted averaging, density_radius = 0.75).

  • Recommend testing for the reviewer(s) to perform, including the location of input datasets, and any additional instructions:

  • Do these changes include sufficient documentation updates, ensuring that no errors or warnings exist in the build of the documentation? [Yes]

  • Do these changes include sufficient testing updates? [No]

  • Will this PR result in changes to the test suite? [Yes]

    If yes, describe the new output and/or changes to the existing output:

The setting at unit test, grid_stat_UK_SEEPS, "SEEPS_P1_THRESH" is changed to ge0.1&&le0.85 (was NA).
The grid_stat output will be changed because of filtering by p1 threshold. The out "grid_stat/grid_stat_SEEPS_000000L_20211202_000000V*" will be different.

Note:

  • Please complete this pull request review by [7/31/2023].

Pull Request Checklist

See the METplus Workflow for details.

  • Review the source issue metadata (required labels, projects, and milestone).
  • Complete the PR definition above.
  • Ensure the PR title matches the feature or bugfix branch name.
  • Define the PR metadata, as permissions allow.
    Select: Reviewer(s)
    Select: Organization level software support Project or Repository level development cycle Project
    Select: Milestone as the version that will include these changes
  • After submitting the PR, select Development issue with the original issue number.
  • After the PR is approved, merge your changes. If permissions do not allow this, request that the reviewer do the merge.
  • Close the linked issue and delete your feature or bugfix branch from GitHub.

github-actions bot and others added 6 commits June 12, 2023 08:17
Co-authored-by: John Halley Gotway <johnhg@ucar.edu>
Co-authored-by: Seth Linden <linden@seneca.rap.ucar.edu>
Co-authored-by: jprestop <jpresto@ucar.edu>
Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu>
Co-authored-by: John and Cindy <halleygotway@Halleys-Mac-mini.local>
Co-authored-by: Howard Soh <hsoh@seneca.rap.ucar.edu>
Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com>
Co-authored-by: hsoh-u <hsoh@ucar.edu>
Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu>
Co-authored-by: Seth Linden <linden@ucar.edu>
Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com>
Co-authored-by: davidalbo <dave@ucar.edu>
Co-authored-by: Lisa Goodrich <lisag@ucar.edu>
Co-authored-by: metplus-bot <97135045+metplus-bot@users.noreply.github.com>
Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com>
Fix Python environment issue (#2407)
fix definitions of G172 and G220 based on comments in NOAA-EMC/NCEPLIBS-w3emc#157. (#2406)
fix #2380 develop override (#2382)
fix #2408 develop empty config (#2410)
fix #2390 develop compile zlib (#2404)
fix #2412 develop climo (#2422)
fix #2437 develop convert (#2439)
fix for develop, for #2437, forgot one reference to the search_parent for a dictionary lookup.
fix #2452 develop airnow (#2454)
fix #2449 develop pdf (#2464)
fix #2402 develop sonarqube (#2468)
fix #2426 develop buoy (#2475)
fix 2518 dtypes appf docs (#2519)
fix 2531 compilation errors (#2533)
fix #2531 compilation_errors_configure (#2535)
@hsoh-u hsoh-u requested a review from JohnHalleyGotway July 31, 2023 19:22
@georgemccabe
Copy link
Collaborator

@hsoh-u , the destination branch for this pull request should be main_v11.1, not main_v11.0

@JohnHalleyGotway JohnHalleyGotway changed the base branch from main_v11.0 to main_v11.1 July 31, 2023 21:27
@JohnHalleyGotway JohnHalleyGotway added this to the MET 11.1.0 milestone Jul 31, 2023
@JohnHalleyGotway JohnHalleyGotway linked an issue Jul 31, 2023 that may be closed by this pull request
21 tasks
@JohnHalleyGotway JohnHalleyGotway changed the title Feature 2633 seeps default p1 threshold Feature #2633 seeps default p1 threshold Jul 31, 2023
@hsoh-u
Copy link
Collaborator Author

hsoh-u commented Jul 31, 2023

@hsoh-u , the destination branch for this pull request should be main_v11.1, not main_v11.0

I branched this from develop. I will redo (branch from main_v11.1).

@hsoh-u
Copy link
Collaborator Author

hsoh-u commented Jul 31, 2023

@hsoh-u , the destination branch for this pull request should be main_v11.1, not main_v11.0

I branched this from develop. I will redo (branch from main_v11.1).

Thank you John! John already did it exept one file (internal/test_unit/xml/unit_grid_stat.xml).
The output of unit test will be the same.

Copy link
Collaborator

@JohnHalleyGotway JohnHalleyGotway left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I approve of this PR. I updated the destination branch to be main_v11.1, added labels, and made some minor edits to the docs. I reviewed the changes and all are desired. Note that no seeps diffs were flagged in the output because while the default config files changed, the ones used in the unit tests did not.

The tests do produce an additional output file, as seen here:
ERROR: folder /data/output/met_test_truth missing 1 files
plot_tc/plot_tc_TCMPR_data.tcst

This is expected based on the update to the test.

@JohnHalleyGotway JohnHalleyGotway merged commit 4137ccb into main_v11.1 Jul 31, 2023
JohnHalleyGotway added a commit that referenced this pull request Jul 31, 2023
Co-authored-by: John Halley Gotway <johnhg@ucar.edu>
Co-authored-by: Seth Linden <linden@seneca.rap.ucar.edu>
Co-authored-by: jprestop <jpresto@ucar.edu>
Co-authored-by: Daniel Adriaansen <dadriaan@ucar.edu>
Co-authored-by: John and Cindy <halleygotway@Halleys-Mac-mini.local>
Co-authored-by: Howard Soh <hsoh@seneca.rap.ucar.edu>
Co-authored-by: George McCabe <23407799+georgemccabe@users.noreply.github.com>
Co-authored-by: hsoh-u <hsoh@ucar.edu>
Co-authored-by: MET Tools Test Account <met_test@seneca.rap.ucar.edu>
Co-authored-by: Seth Linden <linden@ucar.edu>
Co-authored-by: lisagoodrich <33230218+lisagoodrich@users.noreply.github.com>
Co-authored-by: davidalbo <dave@ucar.edu>
Co-authored-by: Lisa Goodrich <lisag@ucar.edu>
Co-authored-by: metplus-bot <97135045+metplus-bot@users.noreply.github.com>
Co-authored-by: j-opatz <59586397+j-opatz@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jonathan Vigh <jvigh@ucar.edu>
Co-authored-by: David Albo <dave@ucar.edu>
Co-authored-by: Tracy Hertneky <39317287+hertneky@users.noreply.github.com>
Co-authored-by: Dan Adriaansen <dadriaan@ucar.edu>
Fix Python environment issue (#2407)
fix definitions of G172 and G220 based on comments in NOAA-EMC/NCEPLIBS-w3emc#157. (#2406)
fix #2380 develop override (#2382)
fix #2408 develop empty config (#2410)
fix #2390 develop compile zlib (#2404)
fix #2412 develop climo (#2422)
fix #2437 develop convert (#2439)
fix for develop, for #2437, forgot one reference to the search_parent for a dictionary lookup.
fix #2452 develop airnow (#2454)
fix #2449 develop pdf (#2464)
fix #2402 develop sonarqube (#2468)
fix #2426 develop buoy (#2475)
fix 2518 dtypes appf docs (#2519)
fix 2531 compilation errors (#2533)
fix #2531 compilation_errors_configure (#2535)
fix 2596 main v11.1 rpath compilation (#2614)
fix #2514 main_v11.1 clang (#2628)
@hsoh-u hsoh-u deleted the feature_2633_SEEPS_default_p1_threshold branch February 20, 2024 22:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
No open projects
Status: Done
Development

Successfully merging this pull request may close these issues.

Set the SEEPS p1_thresold to >=0.1&&<=0.85
5 participants