Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

Allow Skipping Benchmark Errors #9699

Merged
5 commits merged into from
Sep 6, 2021
Merged

Allow Skipping Benchmark Errors #9699

5 commits merged into from
Sep 6, 2021

Conversation

shawntabrizi
Copy link
Member

This PR introduces yet another BenchmarkError type which can allow the benchmarking pipeline to skip a benchmark when it returns an error, but continue the rest of the benchmarking pipeline. Not really great for pallet benchmarks, but can be helpful when skipping XCM features which are not enabled on the chain.

@shawntabrizi shawntabrizi added B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders. D3-trivial 🧸 PR contains trivial changes in a runtime directory that do not require an audit labels Sep 5, 2021
@shawntabrizi
Copy link
Member Author

bot merge

@ghost
Copy link

ghost commented Sep 6, 2021

Waiting for commit status.

@ghost
Copy link

ghost commented Sep 6, 2021

Merge failed: "Required status check "continuous-integration/gitlab-check-polkadot-companion-build" is failing."

@shawntabrizi
Copy link
Member Author

failing CI is a flaky test

@shawntabrizi
Copy link
Member Author

bot force merge

@shawntabrizi
Copy link
Member Author

bot merge force

@ghost
Copy link

ghost commented Sep 6, 2021

Trying merge.

@ghost
Copy link

ghost commented Sep 6, 2021

Merge failed: "3 of 8 required status checks have not succeeded: 1 expected, 1 failing, and 1 pending."

@shawntabrizi
Copy link
Member Author

bot merge force

@ghost
Copy link

ghost commented Sep 6, 2021

Trying merge.

@ghost
Copy link

ghost commented Sep 6, 2021

Merge failed: "Required status check "continuous-integration/gitlab-check-polkadot-companion-build" is failing."

@bkchr
Copy link
Member

bkchr commented Sep 6, 2021

bot merge

@ghost
Copy link

ghost commented Sep 6, 2021

Trying merge.

@shawntabrizi
Copy link
Member Author

bot merge

@ghost
Copy link

ghost commented Sep 6, 2021

Trying merge.

@ghost ghost merged commit 5e93ac7 into master Sep 6, 2021
@ghost ghost deleted the shawntabrizi-benchmark-skip branch September 6, 2021 23:25
This pull request was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
B0-silent Changes should not be mentioned in any release notes C1-low PR touches the given topic and has a low impact on builders. D3-trivial 🧸 PR contains trivial changes in a runtime directory that do not require an audit
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants