Fix planning conflict e2e test errors #3310
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
wdio e2e test were failing randomly. I have continuously run the tests on BrowserStack in order to observe the problem. After detailed investigation it turns out that
createReportWithPlanningConflict
tests were suffering from timeout because this particular suit took 4-5 minutes (on BrowserStack) to run on average. Particularly"Should create second draft report with conflicts"
spec was intermittently taking more than 90 seconds to run. I made changes to element queries in order to reduce run time and increased the timeout duration for test runner. As a result timeout related failures almost disappeared.As can be seen in the screenshot above out of 1315 spec (~77 runs for whole suit) runs only 1 failure happened. And that particular failure is also happened due to a timeout but as can be seen in the raw webdriver logs in the following screenshot and BrowserStack logs on the latter secreenshot, webdriver waits for more than 60 seconds between two consecutive requests for querying an element. I couldn't figure out the reason for that as it is almost impossible to reproduce and debug any further.
Consequnetly
createReportWithPlanningConflict
suit's run time has decreased to ~3-3.5 minutes and"Should create second draft report with conflicts"
specs run time has decreased by ~20 seconds. Even though there was an intermittent test failure, this PR will significantly reduce the timeout related issues, hopefully.I also had to tweak
editLocations
andeditPositions
specs because they were also suffering from anunexpected alert open
error on BrowserStack.UPDATE:
I have merged these changes into my local keycloak-integration branch and wdio-tests have been running on BrowserStack for almost 24 hours. All wdio-tests ran more than 100 times without any failures. Last two sessions in the following screenshot doesn't have any failures. (Both sessions are timed out by BrowserStack btw 🙂 hence the yellow warning icons).
Closes #
User changes
Super User changes
Admin changes
System admin changes
Checklist
repo#issue: Title
title format and these 7 rules