Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Config test ignoreFailures via system property #1524

Merged
merged 3 commits into from
May 4, 2021

Conversation

bondolo
Copy link
Contributor

@bondolo bondolo commented May 3, 2021

Motivation:
The default behaviour of Gradle is to stop the build with an error in
the first module with a test failure. In some cases it is useful to
run all tests to get a survey of which tests are failing. It can also
be annoying if flaky tests are stopping the build from completing.

Modifications:
This change allows configuration of the Gradle test ignoreFailures
option to continue the build after test failures. The ignoreFailures
test configuration is initialized from the system property
servicetalk.test.ignoreFailures allowing for command line
configuration. ./gradlew -Dservicetalk.test.ignoreFailures=true build

Result:
Dynamically configurable ignoreFailures. This feature should not be
used for CI builds as it will mask build failures. Build results
should always be manually examined for test failures if this option
is used.

Motivation:
The default behaviour of Gradle is to stop the build with an error in
the first module with a test failure. In some cases it is useful to
run all tests to get a survey of which tests are failing. It can also
be annoying if flaky tests are stopping the build from completing. This
change allows configuration of the Gradle test `ignoreFailures` option
to continue the build after test failures.

Modifications:
The `ignoreFailures` test configuration is initialized from the system
property `servicetalk.test.ignoreFailures` allowing for command line
configuration. `./gradlew -Dservicetalk.test.ignoreFailures=true build`

Result:
Dynamically configurable ignoreFailures. This feature should not be
used for CI builds as it will mask build failures. Build results
should always be manually examined for test failures if this option
is used.
@bondolo bondolo self-assigned this May 4, 2021
Copy link
Member

@idelpivnitskiy idelpivnitskiy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Useful for development, thanks!

move ignoreFailures to the correct block
@bondolo bondolo merged commit ad7e8e1 into apple:main May 4, 2021
hbelmiro pushed a commit to hbelmiro/servicetalk that referenced this pull request May 23, 2021
Motivation:
The default behaviour of Gradle is to stop the build with an error in
the first module with a test failure. In some cases it is useful to
run all tests to get a survey of which tests are failing. It can also
be annoying if flaky tests are stopping the build from completing.

Modifications:
This change allows configuration of the Gradle test `ignoreFailures`
option to continue the build after test failures. The `ignoreFailures`
test configuration is initialized from the system property 
`servicetalk.test.ignoreFailures` allowing for command line
configuration. `./gradlew -Dservicetalk.test.ignoreFailures=true build`

Result:
Dynamically configurable `ignoreFailures`. This feature should not be
used for CI builds as it will mask build failures. Build results
should always be manually examined for test failures if this option
is used.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants