Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed num_sanity_val_steps affecting reproducibility of training data shuffling #7014

Merged
merged 26 commits into from
Apr 27, 2021

Conversation

awaelchli
Copy link
Contributor

@awaelchli awaelchli commented Apr 14, 2021

What does this PR do?

Fixes #6988

Test fails on master

Important note
This fix will impact reproducibility from one version to the next as the trainer runs a number of sanity validation steps by default.

Before submitting

  • Was this discussed/approved via a GitHub issue? (not for typos and docs)
  • Did you read the contributor guideline, Pull Request section?
  • Did you make sure your PR does only one thing, instead of bundling different changes together?
  • Did you make sure to update the documentation with your changes? (if necessary)
  • Did you write any new necessary tests? (not for typos and docs)
  • Did you verify new and existing tests pass locally with your changes?
  • Did you update the CHANGELOG? (not for typos, docs, test updates, or internal minor changes/refactorings)

PR review

Anyone in the community is free to review the PR once the tests have passed.
Before you start reviewing make sure you have read Review guidelines. In short, see the following bullet-list:

  • Is this pull request ready for review? (if not, please submit in draft mode)
  • Check that all items from Before submitting are resolved
  • Make sure the title is self-explanatory and the description concisely explains the PR
  • Add labels and milestones (and optionally projects) to the PR so it can be classified

Did you have fun?

Make sure you had fun coding 🙃

@awaelchli awaelchli added bug Something isn't working priority: 0 High priority task labels Apr 14, 2021
@awaelchli awaelchli added this to the 1.3 milestone Apr 14, 2021
@codecov
Copy link

codecov bot commented Apr 14, 2021

Codecov Report

Merging #7014 (89fa68e) into master (6be0a85) will decrease coverage by 1%.
The diff coverage is 83%.

@@           Coverage Diff           @@
##           master   #7014    +/-   ##
=======================================
- Coverage      91%     91%    -1%     
=======================================
  Files         198     198            
  Lines       12634   12790   +156     
=======================================
+ Hits        11541   11598    +57     
- Misses       1093    1192    +99     

awaelchli and others added 3 commits April 15, 2021 16:59
Co-authored-by: Carlos Mocholí <carlossmocholi@gmail.com>
@carmocca carmocca changed the title Fixed num_sanity_val_steps affecting reproducibility of training data shuffling Fixed num_sanity_val_steps affecting reproducibility of training data shuffling Apr 19, 2021
@mergify mergify bot removed the has conflicts label Apr 20, 2021
@awaelchli
Copy link
Contributor Author

windows problems and macOS timing out :)

@awaelchli awaelchli added the ready PRs ready to be merged label Apr 20, 2021
@mergify mergify bot removed the has conflicts label Apr 22, 2021
Copy link
Contributor

@tchaton tchaton left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM !

Copy link
Contributor

@kaushikb11 kaushikb11 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! But there seems to be a failing test

@mergify mergify bot removed the has conflicts label Apr 24, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working priority: 0 High priority task ready PRs ready to be merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Val sanity steps affect seed reproducibility of train shuffling
6 participants