feat(baseline): Allow force creating fresh baseline #2124

richardwerkman · 2022-08-05T16:05:15Z

resolves #1560
resolves #2823
resolves #2847

Add command for baseline
Add sub command for baseline recreate
Remove the --target option and replace with an extra argument for baseline command

The new commands now work as follows:
dotnet stryker with-baseline main
dotnet stryker with-baseline main recreate
or
dotnet stryker baseline main
dotnet stryker baseline main recreate

…/stryker-net into baseline-command

…references - Full baseline is never generated because since filter marks mutations as ignored due to not being unchanged compared to target #1803 - stryker-mutator/stryker-net#1803 (comment) - feat(baseline): Allow force creating fresh baseline #2124 - stryker-mutator/stryker-net#2124

… into baseline-command

* chore(deps): update dependency buildalyzer to v5.0.1 (#2665) * chore(deps): update dependency buildalyzer to v5.0.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: fix page links for site * fix: Don't fail the test run if restoring test assemblies fails (#2664) * chore(deps): update xunit-dotnet monorepo to v2.5.1 (#2673) * chore(deps): update xunit-dotnet monorepo to v2.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.4.0 (#2677) * chore(deps): update dependency yamldotnet to v13.4.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: F# range math (#2679) * F# range math * Windows x Linux * Up * chore: Passing Stryker options to F# project components (#2680) Co-authored-by: Rouke Broersma <mobrockers@gmail.com> * fix: Use solution file when it's available (#2690) * Use solution file when it's available * fix unit test * sonarqube * chore(compilation): Improve Error and Trace Logging (#2688) Add logs Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: Remove usings from MutantControl (#2694) chore: remove usings from MutantControl Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Code quality improvements (#2696) * Use string builder in loop * Use find & handle other platform newlines * Use find * Fix duplicate message * Add more range tests * Improve range code * docs: add SAS configuration (#2676) (#2701) docs: add SAS configuration * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 (#2702) * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.0 (#2703) * chore(deps): update dependency yamldotnet to v13.5.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.1 (#2704) * chore(deps): update dependency yamldotnet to v13.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.7.0 (#2705) * chore(deps): update dependency yamldotnet to v13.7.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update xunit-dotnet monorepo (#2711) * chore(deps): update xunit-dotnet monorepo * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: Breaking down FilePattern (#2681) * Simplifying DiffIgnoreChangesInput * Update FilePattern.cs * Up * up * Rename the class * up --------- Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Splitting some C# related extensions in a separate file (#2697) Splitting some C# related extensions in a separate file Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: tests for `OpenReportEnabledInput` help text * fix: typo in re(c)reate * add: tests for baseline target input. change: target input default to 'master' to stay consistent with since target input. --------- Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> Co-authored-by: Rouke Broersma <mobrockers@gmail.com> Co-authored-by: Pent Ploompuu <kaalikas@gmail.com> Co-authored-by: Petr <psfinaki@users.noreply.github.com> Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> Co-authored-by: Jack Steel <jacksteel@jacksteel.co.uk> Co-authored-by: Cyrille DUPUYDAUBY <dupdob@gmail.com> Co-authored-by: Max S <max.schwerdtner@gmail.com>

* chore(deps): update dependency buildalyzer to v5.0.1 (#2665) * chore(deps): update dependency buildalyzer to v5.0.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: fix page links for site * fix: Don't fail the test run if restoring test assemblies fails (#2664) * chore(deps): update xunit-dotnet monorepo to v2.5.1 (#2673) * chore(deps): update xunit-dotnet monorepo to v2.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.4.0 (#2677) * chore(deps): update dependency yamldotnet to v13.4.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: F# range math (#2679) * F# range math * Windows x Linux * Up * chore: Passing Stryker options to F# project components (#2680) Co-authored-by: Rouke Broersma <mobrockers@gmail.com> * fix: Use solution file when it's available (#2690) * Use solution file when it's available * fix unit test * sonarqube * chore(compilation): Improve Error and Trace Logging (#2688) Add logs Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: Remove usings from MutantControl (#2694) chore: remove usings from MutantControl Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Code quality improvements (#2696) * Use string builder in loop * Use find & handle other platform newlines * Use find * Fix duplicate message * Add more range tests * Improve range code * docs: add SAS configuration (#2676) (#2701) docs: add SAS configuration * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 (#2702) * chore(deps): update dependency launchdarkly.eventsource to v5.1.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.0 (#2703) * chore(deps): update dependency yamldotnet to v13.5.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.5.1 (#2704) * chore(deps): update dependency yamldotnet to v13.5.1 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update dependency yamldotnet to v13.7.0 (#2705) * chore(deps): update dependency yamldotnet to v13.7.0 * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore(deps): update xunit-dotnet monorepo (#2711) * chore(deps): update xunit-dotnet monorepo * Update package lock files --------- Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> * chore: Breaking down FilePattern (#2681) * Simplifying DiffIgnoreChangesInput * Update FilePattern.cs * Up * up * Rename the class * up --------- Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * chore: Splitting some C# related extensions in a separate file (#2697) Splitting some C# related extensions in a separate file Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> * fix: tests for `OpenReportEnabledInput` help text * fix: typo in re(c)reate * add: tests for baseline target input. change: target input default to 'master' to stay consistent with since target input. * fix: cli info text test * also check if WithBaselineInput is true --------- Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com> Co-authored-by: Renovatebot <renovatebot@stryker-mutator.io> Co-authored-by: Rouke Broersma <mobrockers@gmail.com> Co-authored-by: Pent Ploompuu <kaalikas@gmail.com> Co-authored-by: Petr <psfinaki@users.noreply.github.com> Co-authored-by: Rouke Broersma <rouke.broersma@infosupport.com> Co-authored-by: Jack Steel <jacksteel@jacksteel.co.uk> Co-authored-by: Cyrille DUPUYDAUBY <dupdob@gmail.com> Co-authored-by: Max S <max.schwerdtner@gmail.com>

…/stryker-net into baseline-command

sonarqubecloud · 2023-10-13T15:18:59Z

Kudos, SonarCloud Quality Gate passed!

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

93.3% Coverage
0.0% Duplication

* fix: tests for `OpenReportEnabledInput` help text * fix: typo in re(c)reate * add: tests for baseline target input. change: target input default to 'master' to stay consistent with since target input. * fix: cli info text test * also check if WithBaselineInput is true * re-add all options to baseline and recreate commands

docs/configuration.md

src/Stryker.Core/Stryker.Core/Mutators/NullCoalescingExpressionMutator.cs

docs/configuration.md

rouke-broersma · 2024-02-16T11:30:01Z

src/Stryker.Core/Stryker.Core/Options/StrykerOptions.cs

+        /// <summary>
+        /// When true, a new baseline should be created.
+        /// </summary>
+        public bool BaselineRecreateEnabled { get; init; }


Suggested change

public bool BaselineRecreateEnabled { get; init; }

public bool RecreateBaseline { get; init; }

…/stryker-net into baseline-command

sonarqubecloud · 2024-03-15T10:15:03Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
95.4% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

rouke-broersma · 2024-03-15T10:55:20Z

docs/configuration.md


-Enabling `with-baseline` saves the mutation report to a storage location such as the filesystem. The mutation report is loaded at the start of the next mutation run. Any changed source code or unit test results in a reset of the mutants affected by the change. For unchanged mutants the previous result is reused. This feature expands on the [since](#since-flag-committish) feature by providing you with a full report after a partial mutation testrun.
+Enabling `baseline`, alias `with-baseline`, saves the mutation report to a storage location such as the filesystem. The mutation report is loaded at the start of the next mutation run. Any changed source code or unit test results in a reset of the mutants affected by the change. For unchanged mutants the previous result is reused. This feature expands on the [since](#since-flag-committish) feature by providing you with a full report after a partial mutation testrun. The target of the baseline is a `committish` passed as an extra argument. The target determines which committish is used to establish or locate a baseline.


Why does not still need to be a committish? We are trying to move away from git for baseline.

rouke-broersma · 2024-03-15T10:55:37Z

docs/configuration.md

@@ -492,33 +492,26 @@ Use [globbing syntax](https://en.wikipedia.org/wiki/Glob_(programming)) for wild

 ## Baseline

-### `baseline` &lt;`command`&gt;
+### `with-baseline` &lt;`committish`&gt;


Suggested change

### `with-baseline` <`committish`>

### `baseline` <`target-version`>

rouke-broersma · 2024-03-15T10:57:28Z

docs/configuration.md


-When [with-baseline](#with-baseline-flag-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.
+When [with-baseline](#with-baseline-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.


Suggested change

When [with-baseline](#with-baseline-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.

When [baseline](#baseline-target-version) is enabled and Stryker cannot find an existing report for the current version the fallback version is used. When Stryker is still unable to find a baseline with either the current version or the fallback version a complete testrun is performed. The complete testrun will then be saved as the new baseline for the next mutation testrun.

rouke-broersma · 2024-03-15T10:59:31Z

docs/configuration.md

+Default: `false`  
+Command line: `with-baseline feat-2`  
+Config file: `"baseline": { }`  


Suggested change

Default: `false`

Command line: `with-baseline feat-2`

Config file: `"baseline": { }`

Default: `false`

Command: `baseline feat-2`

Command Alias: `with-baseline feat-2`

Config file: `"baseline": { }`

rouke-broersma · 2024-03-15T11:02:35Z

src/Stryker.CLI/Stryker.CLI/CommandLineConfig/CommandLineConfigReader.cs

                RegisterCliInputs(baselineCmd);

+                var committishArg = baselineCmd.Argument("committish", "The committish to compare with the current HEAD. This can be a branch, tag or commit id.");
+                committishArg.IsRequired(true);


Are we not using a default target version anymore?

sonarqubecloud · 2024-06-21T08:56:19Z

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
95.4% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

Richard Werkman and others added 2 commits August 5, 2022 17:07

init

853cbd9

Merge branch 'master' into baseline-command

dc5686f

richardwerkman closed this Aug 5, 2022

richardwerkman reopened this Aug 5, 2022

richardwerkman marked this pull request as draft August 5, 2022 16:07

Richard Werkman added 2 commits August 5, 2022 18:11

Fix unit tests

e986e68

Merge branch 'baseline-command' of https://github.com/stryker-mutator…

89b9cb6

…/stryker-net into baseline-command

rouke-broersma changed the title ~~feat(Create baseline): Add baseline create command~~ feat(baseline): Allow force creating fresh baseline Aug 5, 2022

Richard Werkman and others added 11 commits May 26, 2023 14:41

Merge branch 'master' of https://github.com/stryker-mutator/stryker-net…

5c7705d

… into baseline-command

Baseline recreate added

68d4e39

merge main

67db04d

fix merge

4871f39

try to enable baseline by command

36a4ce9

Fixed command

e180534

Fix mutation level

f1f6cf3

merged master

7dd8a89

Remove using

e44bb01

merged master

9ebf7f7

Update docs + try to add target option to command

e1b4d14

rouke-broersma mentioned this pull request Oct 13, 2023

dotnet stryker since command #2554

Open

danihengeveld and others added 5 commits October 13, 2023 15:12

fix using

60d6d41

Merge branch 'master' into baseline-command

02193a7

Merge branch 'baseline-command' of https://github.com/stryker-mutator…

938920d

…/stryker-net into baseline-command

danihengeveld mentioned this pull request Oct 14, 2023

Validate since and with-baseline mutually exclusive #2721

Closed

danihengeveld and others added 2 commits October 14, 2023 14:49

merged master

4d5303b

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

docs/configuration.md Outdated Show resolved Hide resolved

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

src/Stryker.Core/Stryker.Core/Mutators/NullCoalescingExpressionMutator.cs Outdated Show resolved Hide resolved

Richard Werkman added 5 commits February 16, 2024 09:46

Merged master

4f6c3cc

Fix commands

a02f5c9

Reset mutation level

548d06b

Update docs

ef6392f

Remove "with-baseline.enabled"

552c9a3

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

docs/configuration.md Outdated Show resolved Hide resolved

rouke-broersma reviewed Feb 16, 2024

View reviewed changes

Richard Werkman and others added 11 commits February 16, 2024 14:09

Update docs and add help text for commands

0d62dda

Update pipeline docs

e51eebd

merged master

937f26f

.

d0fa85a

Fix tests

d7ac653

Merge branch 'master' into baseline-command

079311a

Fix sonar

e87f5bb

Merge branch 'baseline-command' of https://github.com/stryker-mutator…

4c21604

…/stryker-net into baseline-command

merged master

1202182

Fix docs

0380d09

Fix unit tests

0ba1d08

richardwerkman marked this pull request as ready for review March 15, 2024 10:25

rouke-broersma reviewed Mar 15, 2024

View reviewed changes

merged

0dc89f4

Remove double logging and refactor

20cab04

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

feat(baseline): Allow force creating fresh baseline #2124

feat(baseline): Allow force creating fresh baseline #2124

richardwerkman commented Aug 5, 2022 •

edited by rouke-broersma

Loading

sonarqubecloud bot commented Oct 13, 2023

rouke-broersma Feb 16, 2024

sonarqubecloud bot commented Mar 15, 2024

rouke-broersma Mar 15, 2024

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

sonarqubecloud bot commented Jun 21, 2024

	public bool BaselineRecreateEnabled { get; init; }
	public bool RecreateBaseline { get; init; }


		Enabling `with-baseline` saves the mutation report to a storage location such as the filesystem. The mutation report is loaded at the start of the next mutation run. Any changed source code or unit test results in a reset of the mutants affected by the change. For unchanged mutants the previous result is reused. This feature expands on the [since](#since-flag-committish) feature by providing you with a full report after a partial mutation testrun.
		Enabling `baseline`, alias `with-baseline`, saves the mutation report to a storage location such as the filesystem. The mutation report is loaded at the start of the next mutation run. Any changed source code or unit test results in a reset of the mutants affected by the change. For unchanged mutants the previous result is reused. This feature expands on the [since](#since-flag-committish) feature by providing you with a full report after a partial mutation testrun. The target of the baseline is a `committish` passed as an extra argument. The target determines which committish is used to establish or locate a baseline.

	### `with-baseline` <`committish`>
	### `baseline` <`target-version`>


		When [with-baseline](#with-baseline-flag-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.
		When [with-baseline](#with-baseline-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.

	When [with-baseline](#with-baseline-committish) is enabled and Stryker cannot find an existing report for the current branch the fallback version is used. When Stryker is still unable to find a baseline we will do a complete instead of partial testrun. The complete testrun will then be saved as the new baseline for the next mutation testrun.
	When [baseline](#baseline-target-version) is enabled and Stryker cannot find an existing report for the current version the fallback version is used. When Stryker is still unable to find a baseline with either the current version or the fallback version a complete testrun is performed. The complete testrun will then be saved as the new baseline for the next mutation testrun.

feat(baseline): Allow force creating fresh baseline #2124

Are you sure you want to change the base?

feat(baseline): Allow force creating fresh baseline #2124

Conversation

richardwerkman commented Aug 5, 2022 • edited by rouke-broersma Loading

sonarqubecloud bot commented Oct 13, 2023

rouke-broersma Feb 16, 2024

Choose a reason for hiding this comment

sonarqubecloud bot commented Mar 15, 2024

Quality Gate passed

rouke-broersma Mar 15, 2024

Choose a reason for hiding this comment

rouke-broersma Mar 15, 2024 • edited Loading

Choose a reason for hiding this comment

rouke-broersma Mar 15, 2024 • edited Loading

Choose a reason for hiding this comment

rouke-broersma Mar 15, 2024 • edited Loading

Choose a reason for hiding this comment

rouke-broersma Mar 15, 2024 • edited Loading

Choose a reason for hiding this comment

sonarqubecloud bot commented Jun 21, 2024

Quality Gate passed

richardwerkman commented Aug 5, 2022 •

edited by rouke-broersma

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading

rouke-broersma Mar 15, 2024 •

edited

Loading