-
Notifications
You must be signed in to change notification settings - Fork 306
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
DAOS-16016 test: Coverity 2555785 fix and run test_rebuild_35 #14619
Conversation
Errors are Unable to load ticket data |
src/tests/ftest/daos_test/rebuild.py
Outdated
Use cases: | ||
Core tests for daos_test rebuild | ||
|
||
:avocado: tags=all,pr,daily_regression |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@phender and @daltonbohning I'm working on this separate patch due to DAOS-16016. The issue of extra time expenditure for new tests like this has come up in another PR #14584
This one I estimate will run in about 2 minutes of execution time (based only on running with tmpfs on a local developer cluster, not functional hw testing in CI). Is it worth adding that to per-pr testing? I can see an argument for covering the new rebuild tests (particularly any that are very lengthy) to be tested only as part of daily_regression (not pr). It's still better than what we have now, which is no regular coverage for a few of these recently-developed tests. What do you think for this one (pr,daily_regression or just daily_regression)? We can take a look at how the hw functional testing shakes out too, to confirm my time estimate.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's not just the test time of a single test that's the issue. It's when we add 2 minutes here, 2 minutes there, ... and suddenly we have several hours of PR testing. For rebuild specifically, this is a huge issue. Last I checked, there is something like 6-8 hours of rebuild pr testing. Which means even if a PR doesn't affect rebuild in any way, it still spends 6-8 hours running rebuild testing. (this is terrible for CI time and one of the contributors to slow turnaround times)
I can't tell you whether this test should be pr or daily or weekly because I don't know how likely it is to be affected by code changes. So instead, ask yourself
- When pushing a PR, can you generally tell based on the code changes made that THIS test needs to be ran? And would using
Features: rebuild
be sensible? - How critical is this test? If this test fails, does it mean rebuild is effectively unusable? Or is it some edge case?
Realistically, we can't run everything in PR, so the idea is to mostly tag critical, quick tests with pr
. Then, PRs should use Features
to pull in additional test areas as needed. But at the same time, we don't have a perfect code <-> test mapping, so we don't always know whether we need to run a test.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah I think this one is a bit specific to reintegration and can be run in daily_regression, and in Features: rebuild in certain PRs, so we catch any inadvertent regressions in a fairly timely manner
35aff04
to
ccdbc01
Compare
src/tests/ftest/daos_test/rebuild.py
Outdated
|
||
:avocado: tags=all,daily_regression | ||
:avocado: tags=hw,medium | ||
:avocado: tags=unittest |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Recommend rebuild tag here, so it's ran with Features: rebuild
:avocado: tags=unittest | |
:avocado: tags=unittest,rebuild |
Check return code of daos_cont_destroy() call in the test rebuild_cont_destroy_and_reintegrate(). Also make sure that test is actually executed at least in daily_regression CI. Skip-unit-tests: true Skip-fault-injection-test: true Skip-func-hw-test-medium-md-on-ssd: false Test-tag: test_rebuild_35 Test-repeat: 10 Signed-off-by: Kenneth Cain <kenneth.c.cain@intel.com>
ccdbc01
to
56ebdba
Compare
20 loops passed in CI functional hw testing (10 loops in functional HW medium, 10 loops in functional HW medium MD on SSD configuration). https://build.hpdd.intel.com/job/daos-stack/job/daos/job/PR-14619/3/ Ready for review |
Check return code of daos_cont_destroy() call in the test rebuild_cont_destroy_and_reintegrate(). Also make sure that test is actually executed at least in daily_regression CI. Skip-unit-tests: true Skip-fault-injection-test: true Skip-func-hw-test-medium-md-on-ssd: false Test-tag: test_rebuild_35 Test-repeat: 10 Signed-off-by: Kenneth Cain <kenneth.c.cain@intel.com>
#14642) Check return code of daos_cont_destroy() call in the test rebuild_cont_destroy_and_reintegrate(). Also make sure that test is actually executed at least in daily_regression CI. Signed-off-by: Kenneth Cain <kenneth.c.cain@intel.com>
…tack#14619) Check return code of daos_cont_destroy() call in the test rebuild_cont_destroy_and_reintegrate(). Also make sure that test is actually executed at least in daily_regression CI. Signed-off-by: Kenneth Cain <kenneth.c.cain@intel.com>
Check return code of daos_cont_destroy() call in the test
rebuild_cont_destroy_and_reintegrate(). Also make sure that
test is actually executed at least in daily_regression CI.
Skip-unit-tests: true
Skip-fault-injection-test: true
Skip-func-hw-test-medium-md-on-ssd: false
Test-tag: test_rebuild_35
Test-repeat: 10
Before requesting gatekeeper:
Features:
(orTest-tag*
) commit pragma was used or there is a reason documented that there are no appropriate tags for this PR.Gatekeeper: