Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

stop turning on runtime-benchmarks in tests #1360

Closed

Conversation

gilescope
Copy link
Contributor

@gilescope gilescope commented Sep 2, 2023

Fixes https://github.com/paritytech/ci_cd/issues/864

The runtime-benchmarks is not just additive. As well as adding some additional useful benchmarking types, it also turns off certain functionality used in production:

#[cfg(feature = "runtime-benchmarks")]

It is safer not to have this feature enabled for our main test runs. Not enabling this feature means that the code we are testing is closer to the code that production runs.

(Associated: There are tests that only run if the runtime-benchmarks feature is turned off: #1247 - we could have peppered the tests with different assertions as to what to assert for depending on whether runtime-benchmarks was turned on or not but did not seem that maintainable)

@gilescope
Copy link
Contributor Author

Given that this is changing the CI do we have to do anything special to make the CI use the CI defined in this PR rather than master @alvicsam ?

@gilescope gilescope added the T10-tests This PR/Issue is related to tests. label Sep 2, 2023
@gilescope
Copy link
Contributor Author

We'll make the changes in this PR: #1335

@gilescope gilescope closed this Sep 2, 2023
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 8, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 8, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 8, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 8, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 9, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 9, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 9, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 9, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 9, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 9, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 10, 2024
serban300 pushed a commit to serban300/polkadot-sdk that referenced this pull request Apr 10, 2024
bkchr pushed a commit that referenced this pull request Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
T10-tests This PR/Issue is related to tests.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant