Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pytest: Remove 3 stress-tests #5056

Merged
merged 1 commit into from
Feb 26, 2022

Conversation

cdecker
Copy link
Member

@cdecker cdecker commented Feb 25, 2022

These tests have proven to be:

  • very expensive, as they spin up many nodes, and perform long setup
  • are not testing anything specific, they just fuzz functionality
    that is already tested otherwise
  • have not helped pinpoint any issues in living memory
  • are very flaky, making for really bad signal-to-noise, so much
    that devs usually just restart without even looking at the logs
  • even if we were to look at the logs, we'd be unable to reproduce
    due to the inherent randomness involved in these tests
  • are really noisy neighbors, causing other tests to flake as well,
    further muddying the water

All in all, these tests are a waste of time, and source of
frustration.

Changelog-None

These tests have proven to be:

 a) very expensive, as they spin up many nodes, and perform long setup
 b) are not testing anything specific, they just fuzz functionality
    that is already tested otherwise
 c) have not helped pinpoint any issues in living memory
 d) are very flaky, making for really bad signal-to-noise, so much
    that devs usually just restart without even looking at the logs
 e) even if we were to look at the logs, we'd be unable to reproduce
    due to the inherent randomness involved in these tests
 f) are really noisy neighbors, causing other tests to flake as well,
    further muddying the water

All in all, these tests are a waste of time, and source of
frustration.

[ Cleaned up python unused imports --RR ]
Changelog-None
@rustyrussell
Copy link
Contributor

Trivial line removal to make flake8 happy...

Ack 5d570d1

@rustyrussell rustyrussell merged commit 86b83e4 into ElementsProject:master Feb 26, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants