Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

4.x io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest.test intermittent failure #6653

Open
barchetta opened this issue Apr 19, 2023 · 7 comments
Assignees

Comments

@barchetta
Copy link
Member

barchetta commented Apr 19, 2023

Intermittently seen on PR validation (#6572).

[INFO] -------------------------------------------------------
[INFO]  T E S T S
[INFO] -------------------------------------------------------
[INFO] Running io.helidon.microprofile.metrics.TestMetricsOnOwnSocket
[INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.634 s - in io.helidon.microprofile.metrics.TestMetricsOnOwnSocket
[INFO] Running io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest
Error:  Tests run: 4, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 16.199 s <<< FAILURE! - in io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest
Error:  io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest.test  Time elapsed: 7.519 s  <<< FAILURE!
java.lang.AssertionError: 
Change in count for explicit SimpleTimer
Expected: is <1L>
     but: was <2L>
	at io.helidon.common.testing.junit5.MatcherWithRetry.assertThatWithRetry(MatcherWithRetry.java:68)
	at io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest.test(HelloWorldAsyncResponseTest.java:120)
	at io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest$Proxy$_$$_WeldClientProxy.test(Unknown Source)
	at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
@romain-grecourt
Copy link
Contributor

@barchetta
Copy link
Member Author

And 2.x:

Error:  io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest.test  Time elapsed: 2.014 s  <<< FAILURE!
java.lang.AssertionError: 
Change in count for explicit SimpleTimer
Expected: is <1L>
     but: was <2L>
	at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
	at io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest.test(HelloWorldAsyncResponseTest.java:120)
	at io.helidon.microprofile.metrics.HelloWorldAsyncResponseTest$Proxy$_$$_WeldClientProxy.test(Unknown Source)

@barchetta
Copy link
Member Author

assigning to @tjquinno as we are seeing this fairly often during PR validation.

@tjquinno
Copy link
Member

tjquinno commented Jun 8, 2023

Sigh. This test uses explicit synchronization between the test client and the service precisely to avoid such problems, but obviously it's not working all the time.

I'll take a look.

@tjquinno
Copy link
Member

tjquinno commented Jun 9, 2023

I have disabled the offending test temporarily until I get time to dig into the root cause of the failures.

@barchetta
Copy link
Member Author

barchetta commented Jul 10, 2023

Still seeing this pretty often in 3.x and 2.x

@romain-grecourt
Copy link
Contributor

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: In Progress
Development

No branches or pull requests

3 participants