Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: Use scikit-hep-testdata to provide probability models for regression tests #1711

Merged
merged 7 commits into from
Nov 24, 2021

Conversation

matthewfeickert
Copy link
Member

@matthewfeickert matthewfeickert commented Nov 24, 2021

Description

With scikit-hep/scikit-hep-testdata#67, the sbottom probability models that are used for regression tests are added to scikit-hep-testdata. This provides stability in testing that is independent of HEPData's availability and doesn't abuse HEPData either as we currently ping them a lot with our test suite.

This also simplifies the tests a bit by removing the need for a fixture to provide the tarfile archive.

Checklist Before Requesting Reviewer

  • Tests are passing
  • "WIP" removed from the title of the pull request
  • Selected an Assignee for the PR to be responsible for the log summary

Before Merging

For the PR Assignees:

  • Summarize commit messages into a comprehensive review of the PR
* Add scikit-hep-testdata to the 'test' extra
* Use scikit-hep-testdata to provide the file path to the tar.gz that
contains the sbottom probability models used for regression tests
(pyhf-ins1748602-probability-models.tar.gz)
   - File added in release scikit-hep-testdata v0.4.11
* Refactor get_json_from_tarfile pytest fixture to open the tarfile archive
* Remove sbottom_likelihoods_download pytest fixture as no longer needed

@matthewfeickert matthewfeickert added tests pytest refactor A code change that neither fixes a bug nor adds a feature labels Nov 24, 2021
@matthewfeickert matthewfeickert self-assigned this Nov 24, 2021
setup.py Outdated Show resolved Hide resolved
@matthewfeickert matthewfeickert marked this pull request as ready for review November 24, 2021 17:13
@codecov
Copy link

codecov bot commented Nov 24, 2021

Codecov Report

Merging #1711 (13fbe14) into master (34dd45c) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #1711   +/-   ##
=======================================
  Coverage   98.12%   98.12%           
=======================================
  Files          64       64           
  Lines        4267     4267           
  Branches      593      593           
=======================================
  Hits         4187     4187           
  Misses         46       46           
  Partials       34       34           
Flag Coverage Δ
contrib 26.27% <ø> (ø)
doctest 60.83% <ø> (ø)
unittests 96.17% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 34dd45c...13fbe14. Read the comment docs.

@matthewfeickert matthewfeickert merged commit b9af390 into master Nov 24, 2021
@matthewfeickert matthewfeickert deleted the tests/use-skhep_testdata-for-regression-tests branch November 24, 2021 17:33
@matthewfeickert matthewfeickert added the dependencies Pull requests that update a dependency file label Nov 30, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
dependencies Pull requests that update a dependency file refactor A code change that neither fixes a bug nor adds a feature tests pytest
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants