Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[ci][playwright] Solidify flaky Playwright tests
This is an attempt at solidifying the playwright test suite, that has had testcases intermitently failing. I have been lucky to be able to observe some race conditions rather consistently locally, and so be able to debug them and solidify against them. The race conditions are very slight - the Playwright test suite takes a screenshot at every failure, and consistently I see the correct state on those, meaning that the state is what it should be, by the time the screenshot is taken. In consequence, I wound that, for a given flaky scenario, addressing one race consition would often mask a second one, present in the same scenario. It's possible that under a different execution context, more race conditions would occur. Here are the race coditions I have found: - When the Theia explorer view is created (at frontend reload or when explicitly closed and then re-opened in a test case), it can take some time for its file nodes to appear in the UI. Some tests were assuming that once the view was visible, they would be too. - Similarly, it can take some time for the Explorer's view tab to be created, after the view is. Some test cases were checking immediately for the view tab being visible, and failing when it was not. - Also related to the explorer view, in at least one testcase, method "selectTreeNode" was used to select a file node and assumed that it would be selected immediately after clicking on it. closes #12063 Signed-off-by: Marc Dumais <marc.dumais@ericsson.com>
- Loading branch information