Continuous run for ONLY selected tests

[matepek]

Currently all the explored tests are rerun when one of them are changed.
My users would like to run a set of tests only sometime. Currently there are o option for that.
There is a plan for adding that to the UI.
Would be great to see that feature soon. Thanks.

(First maybe just the filtering could work. That's probably smaller change, then an advanced UI with advanced configuration would be the final solution.)

[connor4312]

First pass:

Kapture.2023-04-04.at.16.15.13.mp4

This will be in the next Insiders. Open questions:

1. Something I'm not sure about is pinning watched tests to the top. It's kind of handy to see the "working set", but also having it jump around may be disruptive.
2. Currently it only continuously run the "run" profiles, eventually we probably want debug profiles. We'd want to make sure we avoid auto-opening the debug view and console in this scenario.
3. Currently it uses (only) the default selected profiles. Would any users want a different continuous profile than the one they've selected to run tests?

[connor4312]

Closing this to mark as done. Please let me know if anyone has additional feedback.

[connor4312]

You can verify at an API or UI level starting with the selfhost test provider.

Verify continuous runs are requested and cancelled as you enable and disable continuous test running for specific tests in the vscode repo. If continuous test run is enabled for its tests, the icon should be always show and the test should be pinned as in my demo video above. Continuous test run cannot be toggled for subtests of a parent test.

[roblourens]

1. I think I'm not a fan of the fact that setting the top level test file to continuous run pins it to the top and shows the 👁️ but if I do that on a child item and collapse the parent, it is not pinned to the top and there is no way to tell that there is another continuous run item there. It feels inconsistent to be setting aside some 👁️ items, but only some of them.
2. That should be easy with the extra options I added for Jupyter Run By Line, if you add debugging