Skip to content
This repository has been archived by the owner on Jun 6, 2023. It is now read-only.

Continuous determinism tests #1483

Open
ZenGround0 opened this issue Sep 20, 2021 · 0 comments
Open

Continuous determinism tests #1483

ZenGround0 opened this issue Sep 20, 2021 · 0 comments

Comments

@ZenGround0
Copy link
Contributor

Catching non-determinism bugs might benefit from lots of runs. With the current flow we get a new chance to find a non-determinism bug every time CI runs a VM integration test. If we run these tests more we will get more chances. We could do this with a persistent background CI job running actors tests on the main branch, say every hour.

This might not do much if test runs are very similar to each other. A nice extension would be to investigate the go runtime and its entropy. A good place to start is understanding the non-determinism bug that halted mainnet last year and understanding if there is a way to configure CI/go runtime/tests to catch this particular bug. This could then give us ideas on generalizing this process as well as ensuring that this particular type of bug will be caught quickly. This also gives us a concrete case for checking if this whole approach is feasible.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant