Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: increase nondeterminism tries per seed by 1 #15883

Merged
merged 2 commits into from
Apr 19, 2023

Conversation

mark-rushakoff
Copy link
Member

Description

It used to be set to 5 tries, but that was taking over an hour. After some improvements (particularly #15875 and #15862), it's running much faster due to reduced allocations.

Since the nondeterminism tests are no longer the bottleneck, increase the tries per seed by 1 so that it is still no longer the bottleneck, but so that we also get more confidence that results are deterministic.


Author Checklist

All items are required. Please add a note to the item if the item is not applicable and
please add links to any relevant follow up issues.

I have...

  • included the correct type prefix in the PR title
  • targeted the correct branch (see PR Targeting)
  • provided a link to the relevant issue or specification
  • reviewed "Files changed" and left comments if necessary
  • confirmed all CI checks have passed

Reviewers Checklist

All items are required. Please add a note if the item is not applicable and please add
your handle next to the items reviewed if you only reviewed selected items.

I have...

  • confirmed the correct type prefix in the PR title
  • confirmed all author checklist items have been addressed
  • confirmed that this PR does not change production code

It used to be set to 5 tries, but that was taking over an hour. After
some improvements (particularly #15875 and #15862), it's running much
faster due to reduced allocations.

Since the nondeterminism tests are no longer the bottleneck, increase
the tries per seed by 1 so that it is still no longer the bottleneck,
but so that we also get more confidence that results are deterministic.
@mark-rushakoff mark-rushakoff requested a review from a team as a code owner April 19, 2023 14:11
Copy link
Member

@julienrbrt julienrbrt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ack.

@mark-rushakoff mark-rushakoff added this pull request to the merge queue Apr 19, 2023
Merged via the queue into main with commit 8fb4a6d Apr 19, 2023
@mark-rushakoff mark-rushakoff deleted the mr/increase-nondeterminism-tries branch April 19, 2023 15:38
cool-develope pushed a commit that referenced this pull request Apr 26, 2023
Co-authored-by: Marko <marbar3778@yahoo.com>
larry0x pushed a commit to larry0x/cosmos-sdk that referenced this pull request May 22, 2023
Co-authored-by: Marko <marbar3778@yahoo.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants