Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Flaky: product tests hung in Environment start and stop #6799

Open
kokosing opened this issue Feb 2, 2021 · 2 comments
Open

Flaky: product tests hung in Environment start and stop #6799

kokosing opened this issue Feb 2, 2021 · 2 comments
Labels
bug Something isn't working

Comments

@kokosing
Copy link
Member

kokosing commented Feb 2, 2021

See https://github.com/trinodb/trino/pull/6761/checks?check_run_id=1806778279 (pt (config-default, suite-5))

It looks like product tests blocked on something. Tempto should dump threads if test is not finished within some timeot.

2021-02-01T16:34:13.6888459Z tests               | 2021-02-01 22:19:13 INFO: [97 of 52] io.trino.tests.hive.TestHiveStorageFormats.testStructTimestamps [StorageFormat{name=TEXTFILE, properties={textfile_field_separator=F, textfile_field_separator_escape=E}, sessionProperties={}}] (Groups: storage_formats)
2021-02-01T16:34:13.7177720Z presto-master       | 2021-02-01T22:19:13.707+0545	INFO	dispatcher-query-247	io.trino.event.QueryMonitor	TIMELINE: Query 20210201_163413_00494_pzhbn :: Transaction:[d0830f24-45f0-452d-8f59-16793903dc72] :: elapsed 1ms :: planning 0ms :: waiting 0ms :: scheduling 1ms :: running 0ms :: finishing 1ms :: begin 2021-02-01T22:19:13.694+05:45 :: end 2021-02-01T22:19:13.695+05:45
2021-02-01T16:34:31.5498562Z presto-master       | 2021-02-01T22:19:31.548+0545	INFO	dispatcher-query-249	io.trino.event.QueryMonitor	TIMELINE: Query 20210201_163431_00495_pzhbn :: Transaction:[6568b5e2-fa7c-45ca-84d4-1c9115e656b8] :: elapsed 486ms :: planning 0ms :: waiting 0ms :: scheduling 486ms :: running 0ms :: finishing 486ms :: begin 2021-02-01T22:19:31.061+05:45 :: end 2021-02-01T22:19:31.547+05:45
2021-02-01T16:34:33.9273302Z 2021-02-01T16:34:33.704Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:34:34.3313494Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:34:34.3319664Z |       container |     cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:34:34.3333220Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:34:34.3351361Z |   hadoop-master | 114.50% | 6.79GB |  2.05GB | 30.14% |   2.20GB |  897 | 42.55MB | 63.43MB |
2021-02-01T16:34:34.3352515Z |   presto-master |   1.02% | 6.79GB |  0.83GB | 12.16% |   1.51GB |  261 | 78.67MB | 66.68MB |
2021-02-01T16:34:34.3369691Z | presto-worker-0 |   1.11% | 6.79GB |  1.39GB | 20.52% |   1.60GB |  289 | 77.44MB | 85.56MB |
2021-02-01T16:34:34.3370983Z | presto-worker-1 |   0.95% | 6.79GB |  1.05GB | 15.41% |   1.45GB |  285 | 62.29MB | 63.57MB |
2021-02-01T16:34:34.3371748Z |           tests |   0.08% | 6.79GB |  0.51GB |  7.48% |   0.59GB |   18 | 25.47MB |  7.19MB |
2021-02-01T16:34:34.3385999Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:35:03.7060020Z 2021-02-01T16:35:03.704Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:35:03.7070227Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:35:03.7074904Z |       container |     cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:35:03.7088890Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:35:03.7094125Z |   hadoop-master |  11.28% | 6.79GB |  2.00GB | 29.50% |   2.20GB |  871 | 42.55MB | 63.43MB |
2021-02-01T16:35:03.7096151Z |   presto-master |   0.88% | 6.79GB |  0.83GB | 12.16% |   1.51GB |  260 | 78.75MB | 66.76MB |
2021-02-01T16:35:03.7103037Z | presto-worker-0 |   0.93% | 6.79GB |  1.39GB | 20.52% |   1.60GB |  288 | 77.49MB | 85.60MB |
2021-02-01T16:35:03.7104409Z | presto-worker-1 | 111.88% | 6.79GB |  1.05GB | 15.41% |   1.45GB |  285 | 62.33MB | 63.61MB |
2021-02-01T16:35:03.7105187Z |           tests |   0.05% | 6.79GB |  0.51GB |  7.48% |   0.59GB |   18 | 25.47MB |  7.19MB |
2021-02-01T16:35:03.7106249Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:35:33.7073057Z 2021-02-01T16:35:33.705Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:35:33.7077949Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:35:33.7084693Z |       container |     cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:35:33.7086040Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:35:33.7089483Z |   hadoop-master | 176.81% | 6.79GB |  2.17GB | 31.93% |   2.20GB |  946 | 42.56MB | 63.43MB |
2021-02-01T16:35:33.7095686Z |   presto-master |   0.63% | 6.79GB |  0.82GB | 12.09% |   1.51GB |  221 | 78.85MB | 66.83MB |
2021-02-01T16:35:33.7096853Z | presto-worker-0 |   0.97% | 6.79GB |  1.39GB | 20.45% |   1.60GB |  263 | 77.53MB | 85.66MB |
2021-02-01T16:35:33.7097876Z | presto-worker-1 |   0.93% | 6.79GB |  1.04GB | 15.33% |   1.45GB |  263 | 62.38MB | 63.66MB |
2021-02-01T16:35:33.7101109Z |           tests |   0.07% | 6.79GB |  0.51GB |  7.47% |   0.59GB |   17 | 25.47MB |  7.19MB |
2021-02-01T16:35:33.7102228Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:36:03.7069945Z 2021-02-01T16:36:03.706Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:36:03.7076904Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:36:03.7087114Z |       container |     cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:36:03.7089371Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:36:03.7116703Z |   hadoop-master | 140.16% | 6.79GB |  2.05GB | 30.16% |   2.20GB |  945 | 42.56MB | 63.44MB |
2021-02-01T16:36:03.7118143Z |   presto-master |   0.78% | 6.79GB |  0.82GB | 12.09% |   1.51GB |  220 | 78.95MB | 66.91MB |
2021-02-01T16:36:03.7124645Z | presto-worker-0 |   1.11% | 6.79GB |  1.39GB | 20.45% |   1.60GB |  263 | 77.57MB | 85.71MB |
2021-02-01T16:36:03.7126271Z | presto-worker-1 |   1.19% | 6.79GB |  1.04GB | 15.33% |   1.45GB |  263 | 62.42MB | 63.72MB |
2021-02-01T16:36:03.7133353Z |           tests |   0.06% | 6.79GB |  0.51GB |  7.47% |   0.59GB |   16 | 25.47MB |  7.19MB |
2021-02-01T16:36:03.7135023Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:36:33.7079151Z 2021-02-01T16:36:33.707Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:36:33.7086335Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:36:33.7087232Z |       container |     cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:36:33.7094117Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:36:33.7095461Z |   hadoop-master | 145.87% | 6.79GB |  1.93GB | 28.45% |   2.20GB |  931 | 42.56MB | 63.44MB |
2021-02-01T16:36:33.7096509Z |   presto-master |   0.78% | 6.79GB |  0.82GB | 12.07% |   1.51GB |  220 | 79.03MB | 66.98MB |
2021-02-01T16:36:33.7097654Z | presto-worker-0 |   1.15% | 6.79GB |  1.38GB | 20.36% |   1.60GB |  262 | 77.61MB | 85.75MB |
2021-02-01T16:36:33.7108947Z | presto-worker-1 |   1.12% | 6.79GB |  1.03GB | 15.22% |   1.45GB |  262 | 62.46MB | 63.76MB |
2021-02-01T16:36:33.7109742Z |           tests |   0.10% | 6.79GB |  0.51GB |  7.47% |   0.59GB |   16 | 25.48MB |  7.20MB |
2021-02-01T16:36:33.7115345Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:03.7080549Z 2021-02-01T16:37:03.707Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:37:03.7087593Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:03.7091915Z |       container |     cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:37:03.7093314Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:03.7102142Z |   hadoop-master | 168.65% | 6.79GB |  2.07GB | 30.55% |   2.20GB |  904 | 42.57MB | 63.44MB |
2021-02-01T16:37:03.7106646Z |   presto-master |   0.94% | 6.79GB |  0.82GB | 12.07% |   1.51GB |  220 | 79.13MB | 67.05MB |
2021-02-01T16:37:03.7116259Z | presto-worker-0 |   1.17% | 6.79GB |  1.38GB | 20.29% |   1.60GB |  262 | 77.65MB | 85.81MB |
2021-02-01T16:37:03.7119522Z | presto-worker-1 |   0.86% | 6.79GB |  1.03GB | 15.22% |   1.45GB |  262 | 62.50MB | 63.81MB |
2021-02-01T16:37:03.7120368Z |           tests |   0.07% | 6.79GB |  0.51GB |  7.47% |   0.59GB |   16 | 25.48MB |  7.20MB |
2021-02-01T16:37:03.7124994Z +-----------------+---------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:33.7088485Z 2021-02-01T16:37:33.708Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-01T16:37:33.7097898Z +-----------------+--------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:33.7105619Z |       container |    cpu |    mem | max mem |  mem % | peak mem | pids |  net in | net out |
2021-02-01T16:37:33.7111584Z +-----------------+--------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:33.7117369Z |   hadoop-master | 75.72% | 6.79GB |  2.02GB | 29.74% |   2.20GB |  921 | 42.57MB | 63.44MB |
2021-02-01T16:37:33.7118978Z |   presto-master | 19.80% | 6.79GB |  0.82GB | 12.05% |   1.51GB |  220 | 79.21MB | 67.13MB |
2021-02-01T16:37:33.7126440Z | presto-worker-0 |  1.04% | 6.79GB |  1.38GB | 20.25% |   1.60GB |  261 | 77.69MB | 85.85MB |
2021-02-01T16:37:33.7130555Z | presto-worker-1 |  1.18% | 6.79GB |  1.03GB | 15.16% |   1.45GB |  261 | 62.54MB | 63.86MB |
2021-02-01T16:37:33.7137778Z |           tests |  0.11% | 6.79GB |  0.51GB |  7.47% |   0.59GB |   16 | 25.48MB |  7.20MB |
2021-02-01T16:37:33.7142496Z +-----------------+--------+--------+---------+--------+----------+------+---------+---------+
2021-02-01T16:37:41.0181677Z 2021-02-01T16:37:41.009Z	WARN	TestRun-diagnostic	io.trino.tests.product.launcher.cli.SuiteRun	Test execution is not finished yet, a deadlock or hang is suspected. Thread dump will follow.
2021-02-01T16:37:41.5908314Z 2021-02-01T16:37:41.556Z	WARN	TestRun-diagnostic	io.trino.tests.product.launcher.cli.SuiteRun	Full Thread Dump:
2021-02-01T16:37:41.5909973Z "main" prio=5 Id=1 TIMED_WAITING
2021-02-01T16:37:41.5917879Z 	at java.base@11.0.10/java.lang.Thread.sleep(Native Method)
2021-02-01T16:37:41.5923051Z 	at app//io.trino.tests.product.launcher.env.Environment.awaitTestsCompletion(Environment.java:221)
2021-02-01T16:37:41.5942847Z 	at app//io.trino.tests.product.launcher.cli.TestRun$Execution.tryExecuteTests(TestRun.java:206)
2021-02-01T16:37:41.5944931Z 	at app//io.trino.tests.product.launcher.cli.TestRun$Execution$$Lambda$318/0x000000010028e840.get(Unknown Source)
2021-02-01T16:37:41.5949493Z 	at app//net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)
2021-02-01T16:37:41.5953984Z 	at app//net.jodah.failsafe.Functions$$Lambda$320/0x000000010028e040.get(Unknown Source)
2021-02-01T16:37:41.5967345Z 	at app//net.jodah.failsafe.TimeoutExecutor.lambda$supply$2(TimeoutExecutor.java:91)
2021-02-01T16:37:41.5970144Z 	at app//net.jodah.failsafe.TimeoutExecutor$$Lambda$321/0x000000010028e440.get(Unknown Source)
2021-02-01T16:37:41.5971086Z 	...
2021-02-01T16:37:41.5971372Z 
2021-02-01T16:37:41.5976992Z 
2021-02-01T16:37:41.5979564Z "Reference Handler" daemon prio=10 Id=2 RUNNABLE
2021-02-01T16:37:41.5981068Z 	at java.base@11.0.10/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
2021-02-01T16:37:41.5985835Z 	at java.base@11.0.10/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2021-02-01T16:37:41.5987607Z 	at java.base@11.0.10/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2021-02-01T16:37:41.5988428Z 
2021-02-01T16:37:41.5988639Z 
2021-02-01T16:37:41.5997081Z "Finalizer" daemon prio=8 Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@601b628b
2021-02-01T16:37:41.5999028Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-01T16:37:41.6000551Z 	-  waiting on java.lang.ref.ReferenceQueue$Lock@601b628b
2021-02-01T16:37:41.6010097Z 	at java.base@11.0.10/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2021-02-01T16:37:41.6011992Z 	at java.base@11.0.10/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2021-02-01T16:37:41.6013713Z 	at java.base@11.0.10/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2021-02-01T16:37:41.6017541Z 
2021-02-01T16:37:41.6017870Z 
2021-02-01T16:37:41.6018530Z "Signal Dispatcher" daemon prio=9 Id=4 RUNNABLE
2021-02-01T16:37:41.6019001Z 
2021-02-01T16:37:41.6019208Z 
2021-02-01T16:37:41.6024792Z "Common-Cleaner" daemon prio=8 Id=9 TIMED_WAITING on java.lang.ref.ReferenceQueue$Lock@2d3a94f7
2021-02-01T16:37:41.6025999Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-01T16:37:41.6038435Z 	-  waiting on java.lang.ref.ReferenceQueue$Lock@2d3a94f7
2021-02-01T16:37:41.6040023Z 	at java.base@11.0.10/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2021-02-01T16:37:41.6044580Z 	at java.base@11.0.10/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2021-02-01T16:37:41.6048536Z 	at java.base@11.0.10/java.lang.Thread.run(Thread.java:834)
2021-02-01T16:37:41.6049930Z 	at java.base@11.0.10/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2021-02-01T16:37:41.6052877Z 
2021-02-01T16:37:41.6105328Z 
2021-02-01T16:37:41.6106425Z "TestRun-diagnostic" daemon prio=5 Id=13 RUNNABLE
2021-02-01T16:37:41.6108308Z 	at java.management@11.0.10/sun.management.ThreadImpl.dumpThreads0(Native Method)
2021-02-01T16:37:41.6113289Z 	at java.management@11.0.10/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:521)
2021-02-01T16:37:41.6118236Z 	at java.management@11.0.10/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:509)
2021-02-01T16:37:41.6121039Z 	at app//io.trino.tests.product.launcher.cli.SuiteRun$Execution.reportSuspectedTimeout(SuiteRun.java:338)
2021-02-01T16:37:41.6126773Z 	at app//io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$call$0(SuiteRun.java:180)
2021-02-01T16:37:41.6128799Z 	at app//io.trino.tests.product.launcher.cli.SuiteRun$Execution$$Lambda$294/0x0000000100253440.run(Unknown Source)
2021-02-01T16:37:41.6130663Z 	at java.base@11.0.10/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
2021-02-01T16:37:41.6136633Z 	at java.base@11.0.10/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2021-02-01T16:37:41.6137510Z 	...
2021-02-01T16:37:41.6137793Z 
2021-02-01T16:37:41.6150409Z 	Number of locked synchronizers = 1
2021-02-01T16:37:41.6151799Z 	- java.util.concurrent.ThreadPoolExecutor$Worker@5003041b
2021-02-01T16:37:41.6152578Z 
2021-02-01T16:37:41.6152781Z 
2021-02-01T16:37:41.6165264Z "FailsafeDelayScheduler" daemon prio=5 Id=14 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4ad4b2f9
2021-02-01T16:37:41.6167447Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-01T16:37:41.6173101Z 	-  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@4ad4b2f9
2021-02-01T16:37:41.6175787Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-01T16:37:41.6178452Z 	at java.base@11.0.10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2021-02-01T16:37:41.6185137Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
2021-02-01T16:37:41.6187907Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
2021-02-01T16:37:41.6190719Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2021-02-01T16:37:41.6200177Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-01T16:37:41.6202921Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-01T16:37:41.6210918Z 	...
2021-02-01T16:37:41.6211276Z 
2021-02-01T16:37:41.6211492Z 
2021-02-01T16:37:41.6217725Z "OkHttp ConnectionPool" daemon prio=5 Id=17 TIMED_WAITING on org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool@26d475de
2021-02-01T16:37:41.6220105Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-01T16:37:41.6226068Z 	-  waiting on org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool@26d475de
2021-02-01T16:37:41.6228883Z 	at java.base@11.0.10/java.lang.Object.wait(Object.java:462)
2021-02-01T16:37:41.6237302Z 	at app//org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool.lambda$new$0(RealConnectionPool.java:62)
2021-02-01T16:37:41.6241394Z 	at app//org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool$$Lambda$385/0x00000001002e9840.run(Unknown Source)
2021-02-01T16:37:41.6244474Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2021-02-01T16:37:41.6272421Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-01T16:37:41.6274054Z 	at java.base@11.0.10/java.lang.Thread.run(Thread.java:834)
2021-02-01T16:37:41.6274555Z 
2021-02-01T16:37:41.6278313Z 	Number of locked synchronizers = 1
2021-02-01T16:37:41.6279751Z 	- java.util.concurrent.ThreadPoolExecutor$Worker@92683
2021-02-01T16:37:41.6280771Z 
2021-02-01T16:37:41.6282468Z 
2021-02-01T16:37:41.6286277Z "Okio Watchdog" daemon prio=5 Id=18 TIMED_WAITING on java.lang.Class@6a8f7fe6
2021-02-01T16:37:41.6287357Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-01T16:37:41.6288520Z 	-  waiting on java.lang.Class@6a8f7fe6
2021-02-01T16:37:41.6293193Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout.awaitTimeout(AsyncTimeout.java:348)
2021-02-01T16:37:41.6295456Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$Watchdog.run(AsyncTimeout.java:313)
2021-02-01T16:37:41.6296520Z 
2021-02-01T16:37:41.6300282Z 
2021-02-01T16:37:41.6304725Z "testcontainers-ryuk" daemon prio=5 Id=22 TIMED_WAITING on java.util.ArrayList@1de044b5
2021-02-01T16:37:41.6308475Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-01T16:37:41.6309740Z 	-  waiting on java.util.ArrayList@1de044b5
2021-02-01T16:37:41.6311307Z 	at app//org.testcontainers.utility.ResourceReaper.lambda$null$1(ResourceReaper.java:167)
2021-02-01T16:37:41.6319032Z 	at app//org.testcontainers.utility.ResourceReaper$$Lambda$453/0x000000010040ac40.run(Unknown Source)
2021-02-01T16:37:41.6321080Z 	at app//org.rnorth.ducttape.ratelimits.RateLimiter.doWhenReady(RateLimiter.java:27)
2021-02-01T16:37:41.6323265Z 	at app//org.testcontainers.utility.ResourceReaper.lambda$start$2(ResourceReaper.java:158)
2021-02-01T16:37:41.6338233Z 	at app//org.testcontainers.utility.ResourceReaper$$Lambda$452/0x000000010040a840.run(Unknown Source)
2021-02-01T16:37:41.6387614Z 	at java.base@11.0.10/java.lang.Thread.run(Thread.java:834)
2021-02-01T16:37:41.6388114Z 
2021-02-01T16:37:41.6388387Z 
2021-02-01T16:37:41.6391826Z "docker-java-stream--136008890" daemon prio=5 Id=188 RUNNABLE (in native)
2021-02-01T16:37:41.6394197Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6403141Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6405866Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6408267Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6414226Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6416093Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6418246Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6429343Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6433746Z 	...
2021-02-01T16:37:41.6434022Z 
2021-02-01T16:37:41.6434223Z 
2021-02-01T16:37:41.6439327Z "docker-java-stream-767066392" daemon prio=5 Id=193 RUNNABLE (in native)
2021-02-01T16:37:41.6441935Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6449052Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6451843Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6456084Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6461531Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6463330Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6465741Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6468641Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6473239Z 	...
2021-02-01T16:37:41.6473885Z 
2021-02-01T16:37:41.6482312Z 
2021-02-01T16:37:41.6483521Z "docker-java-stream--1895766549" daemon prio=5 Id=196 RUNNABLE (in native)
2021-02-01T16:37:41.6500990Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6531095Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6534151Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6539432Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6541859Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6549393Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6551615Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6557272Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6558966Z 	...
2021-02-01T16:37:41.6559239Z 
2021-02-01T16:37:41.6564516Z 
2021-02-01T16:37:41.6565678Z "docker-java-stream--745634877" daemon prio=5 Id=200 RUNNABLE (in native)
2021-02-01T16:37:41.6568339Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6574941Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6577747Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6580560Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6585788Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6587468Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6603817Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6606708Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6608210Z 	...
2021-02-01T16:37:41.6608497Z 
2021-02-01T16:37:41.6608950Z 
2021-02-01T16:37:41.6614121Z "docker-java-stream--1838518016" daemon prio=5 Id=257 RUNNABLE (in native)
2021-02-01T16:37:41.6620863Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6628200Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6635231Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6638165Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6643130Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6644719Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6649624Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6652399Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6659432Z 	...
2021-02-01T16:37:41.6659731Z 
2021-02-01T16:37:41.6660245Z 
2021-02-01T16:37:41.6661494Z "docker-java-stream--2010040360" daemon prio=5 Id=259 RUNNABLE (in native)
2021-02-01T16:37:41.6666924Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6670734Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6673322Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6679690Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6687376Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6692220Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6700265Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6702892Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6717068Z 	...
2021-02-01T16:37:41.6733458Z 
2021-02-01T16:37:41.6733768Z 
2021-02-01T16:37:41.6738959Z "docker-java-stream-1747095901" daemon prio=5 Id=260 RUNNABLE (in native)
2021-02-01T16:37:41.6741588Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6745672Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6752657Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6755303Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6758258Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6796089Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6798821Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6804311Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6805904Z 	...
2021-02-01T16:37:41.6806190Z 
2021-02-01T16:37:41.6806399Z 
2021-02-01T16:37:41.6810492Z "docker-java-stream-1223385803" daemon prio=5 Id=261 RUNNABLE (in native)
2021-02-01T16:37:41.6813614Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6817890Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6820912Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6828496Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6831104Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6835346Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6840304Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6847446Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6852559Z 	...
2021-02-01T16:37:41.6852956Z 
2021-02-01T16:37:41.6853192Z 
2021-02-01T16:37:41.6857508Z "docker-java-stream-1487027993" daemon prio=5 Id=265 RUNNABLE (in native)
2021-02-01T16:37:41.6863191Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6875183Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6879873Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6882578Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6888597Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6890874Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6893164Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6901304Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6902765Z 	...
2021-02-01T16:37:41.6903041Z 
2021-02-01T16:37:41.6905834Z 
2021-02-01T16:37:41.6908263Z "docker-java-stream--362899606" daemon prio=5 Id=266 RUNNABLE (in native)
2021-02-01T16:37:41.6911289Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-01T16:37:41.6918808Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-01T16:37:41.6921596Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-01T16:37:41.6924089Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-01T16:37:41.6934081Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-01T16:37:41.6936042Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-01T16:37:41.6944155Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-01T16:37:41.6949766Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-01T16:37:41.6955563Z 	...
2021-02-01T16:37:41.6955819Z 
2021-02-01T16:37:41.6956096Z 
2021-02-01T16:37:41.6960882Z "container-stats-0" daemon prio=5 Id=267 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6484f6d2
2021-02-01T16:37:41.6973816Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-01T16:37:41.6979050Z 	-  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6484f6d2
2021-02-01T16:37:41.6985789Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-01T16:37:41.6991353Z 	at java.base@11.0.10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2021-02-01T16:37:41.6996846Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
2021-02-01T16:37:41.6999768Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
2021-02-01T16:37:41.7006419Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2021-02-01T16:37:41.7008897Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-01T16:37:41.7013765Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-01T16:37:41.7015181Z 	...
2021-02-01T16:37:41.7015453Z 
2021-02-01T16:37:41.7015713Z 
2021-02-01T16:37:41.7020575Z "container-stats-1" daemon prio=5 Id=268 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6484f6d2
2021-02-01T16:37:41.7023049Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-01T16:37:41.7027741Z 	-  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6484f6d2
2021-02-01T16:37:41.7032560Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2021-02-01T16:37:41.7035623Z 	at java.base@11.0.10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2021-02-01T16:37:41.7041191Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
2021-02-01T16:37:41.7080378Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
2021-02-01T16:37:41.7082799Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2021-02-01T16:37:41.7086982Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-01T16:37:41.7096217Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-01T16:37:41.7101150Z 	...
2021-02-01T16:37:41.7101506Z 
2021-02-01T16:37:41.7101834Z 
2021-02-01T16:37:51.0816602Z 2021-02-01T16:37:51.079Z	INFO	environment-listener-2	io.trino.tests.product.launcher.env.EnvironmentListener	Environment stopping: multinode-hive-caching
2021-02-01T16:37:51.0847970Z 2021-02-01T16:37:51.079Z	WARN	main	io.trino.tests.product.launcher.env.Environment	Exception occurred while closing environment
2021-02-01T16:37:51.0850158Z java.lang.RuntimeException: java.lang.InterruptedException
2021-02-01T16:37:51.0853019Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:84)
2021-02-01T16:37:51.0856971Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-01T16:37:51.0863533Z 	at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658)
2021-02-01T16:37:51.0871906Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.tryInvokeListener(EnvironmentListener.java:78)
2021-02-01T16:37:51.0921648Z 	at io.trino.tests.product.launcher.env.EnvironmentListener$1.environmentStopping(EnvironmentListener.java:115)
2021-02-01T16:37:51.0924143Z 	at io.trino.tests.product.launcher.env.Environment.lambda$stop$6(Environment.java:164)
2021-02-01T16:37:51.0925907Z 	at java.base/java.util.Optional.ifPresent(Optional.java:183)
2021-02-01T16:37:51.0927655Z 	at io.trino.tests.product.launcher.env.Environment.stop(Environment.java:164)
2021-02-01T16:37:51.0930839Z 	at io.trino.tests.product.launcher.env.Environment.close(Environment.java:276)
2021-02-01T16:37:51.0933218Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.tryExecuteTests(TestRun.java:205)
2021-02-01T16:37:51.0934894Z 	at net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)
2021-02-01T16:37:51.0936426Z 	at net.jodah.failsafe.TimeoutExecutor.lambda$supply$2(TimeoutExecutor.java:91)
2021-02-01T16:37:51.0938478Z 	at net.jodah.failsafe.Execution.executeSync(Execution.java:129)
2021-02-01T16:37:51.0940186Z 	at net.jodah.failsafe.FailsafeExecutor.call(FailsafeExecutor.java:376)
2021-02-01T16:37:51.0942353Z 	at net.jodah.failsafe.FailsafeExecutor.get(FailsafeExecutor.java:67)
2021-02-01T16:37:51.0944254Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.call(TestRun.java:188)
2021-02-01T16:37:51.0946388Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runTest(SuiteRun.java:290)
2021-02-01T16:37:51.0948428Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.executeSuiteTestRun(SuiteRun.java:275)
2021-02-01T16:37:51.0950464Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$2(SuiteRun.java:209)
2021-02-01T16:37:51.0952267Z 	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
2021-02-01T16:37:51.0954243Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-01T16:37:51.1027325Z 	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
2021-02-01T16:37:51.1030270Z 	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
2021-02-01T16:37:51.1032913Z 	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
2021-02-01T16:37:51.1035995Z 	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
2021-02-01T16:37:51.1039404Z 	at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
2021-02-01T16:37:51.1041726Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$3(SuiteRun.java:210)
2021-02-01T16:37:51.1043552Z 	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
2021-02-01T16:37:51.1045047Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runSuites(SuiteRun.java:196)
2021-02-01T16:37:51.1046878Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:182)
2021-02-01T16:37:51.1048655Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:139)
2021-02-01T16:37:51.1050907Z 	at io.trino.tests.product.launcher.cli.Commands.runCommand(Commands.java:42)
2021-02-01T16:37:51.1055034Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:104)
2021-02-01T16:37:51.1057455Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:72)
2021-02-01T16:37:51.1060486Z 	at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
2021-02-01T16:37:51.1062158Z 	at picocli.CommandLine.access$1300(CommandLine.java:145)
2021-02-01T16:37:51.1064645Z 	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
2021-02-01T16:37:51.1066711Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
2021-02-01T16:37:51.1068168Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
2021-02-01T16:37:51.1069662Z 	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
2021-02-01T16:37:51.1071332Z 	at picocli.CommandLine.execute(CommandLine.java:2078)
2021-02-01T16:37:51.1073458Z 	at io.trino.tests.product.launcher.cli.Launcher.run(Launcher.java:74)
2021-02-01T16:37:51.1075301Z 	at io.trino.tests.product.launcher.cli.Launcher.main(Launcher.java:64)
2021-02-01T16:37:51.1119602Z Caused by: java.lang.InterruptedException
2021-02-01T16:37:51.1121525Z 	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:385)
2021-02-01T16:37:51.1123596Z 	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
2021-02-01T16:37:51.1126937Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:80)
2021-02-01T16:37:51.1128704Z 	... 42 more
2021-02-01T16:37:51.1128947Z 
2021-02-01T16:37:51.1129176Z 
2021-02-01T16:37:51.1130860Z 2021-02-01T16:37:51.084Z	WARN	main	io.trino.tests.product.launcher.cli.TestRun	Failed to execute tests
2021-02-01T16:37:51.1132382Z java.lang.RuntimeException: java.lang.InterruptedException
2021-02-01T16:37:51.1134725Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:84)
2021-02-01T16:37:51.1137780Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-01T16:37:51.1140028Z 	at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658)
2021-02-01T16:37:51.1142966Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.tryInvokeListener(EnvironmentListener.java:78)
2021-02-01T16:37:51.1146254Z 	at io.trino.tests.product.launcher.env.EnvironmentListener$1.environmentStopping(EnvironmentListener.java:115)
2021-02-01T16:37:51.1148699Z 	at io.trino.tests.product.launcher.env.Environment.lambda$stop$6(Environment.java:164)
2021-02-01T16:37:51.1150334Z 	at java.base/java.util.Optional.ifPresent(Optional.java:183)
2021-02-01T16:37:51.1152142Z 	at io.trino.tests.product.launcher.env.Environment.stop(Environment.java:164)
2021-02-01T16:37:51.1154639Z 	at io.trino.tests.product.launcher.env.Environment.awaitTestsCompletion(Environment.java:240)
2021-02-01T16:37:51.1157117Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.tryExecuteTests(TestRun.java:206)
2021-02-01T16:37:51.1294674Z 	at net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)
2021-02-01T16:37:51.1296989Z 	at net.jodah.failsafe.TimeoutExecutor.lambda$supply$2(TimeoutExecutor.java:91)
2021-02-01T16:37:51.1298619Z 	at net.jodah.failsafe.Execution.executeSync(Execution.java:129)
2021-02-01T16:37:51.1300275Z 	at net.jodah.failsafe.FailsafeExecutor.call(FailsafeExecutor.java:376)
2021-02-01T16:37:51.1304023Z 	at net.jodah.failsafe.FailsafeExecutor.get(FailsafeExecutor.java:67)
2021-02-01T16:37:51.1305706Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.call(TestRun.java:188)
2021-02-01T16:37:51.1307983Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runTest(SuiteRun.java:290)
2021-02-01T16:37:51.1310029Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.executeSuiteTestRun(SuiteRun.java:275)
2021-02-01T16:37:51.1312084Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$2(SuiteRun.java:209)
2021-02-01T16:37:51.1313852Z 	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
2021-02-01T16:37:51.1315850Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-01T16:37:51.1358772Z 	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
2021-02-01T16:37:51.1362167Z 	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
2021-02-01T16:37:51.1364088Z 	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
2021-02-01T16:37:51.1365842Z 	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
2021-02-01T16:37:51.1368135Z 	at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
2021-02-01T16:37:51.1370425Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$3(SuiteRun.java:210)
2021-02-01T16:37:51.1372461Z 	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
2021-02-01T16:37:51.1375026Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runSuites(SuiteRun.java:196)
2021-02-01T16:37:51.1377030Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:182)
2021-02-01T16:37:51.1379284Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:139)
2021-02-01T16:37:51.1381148Z 	at io.trino.tests.product.launcher.cli.Commands.runCommand(Commands.java:42)
2021-02-01T16:37:51.1383126Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:104)
2021-02-01T16:37:51.1384869Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:72)
2021-02-01T16:37:51.1387234Z 	at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
2021-02-01T16:37:51.1388902Z 	at picocli.CommandLine.access$1300(CommandLine.java:145)
2021-02-01T16:37:51.1390960Z 	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
2021-02-01T16:37:51.1392993Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
2021-02-01T16:37:51.1394037Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
2021-02-01T16:37:51.1395416Z 	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
2021-02-01T16:37:51.1396919Z 	at picocli.CommandLine.execute(CommandLine.java:2078)
2021-02-01T16:37:51.1494456Z 	at io.trino.tests.product.launcher.cli.Launcher.run(Launcher.java:74)
2021-02-01T16:37:51.1498136Z 	at io.trino.tests.product.launcher.cli.Launcher.main(Launcher.java:64)
2021-02-01T16:37:51.1499664Z Caused by: java.lang.InterruptedException
2021-02-01T16:37:51.1505794Z 	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:385)
2021-02-01T16:37:51.1508119Z 	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
2021-02-01T16:37:51.1510606Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:80)
2021-02-01T16:37:51.1512306Z 	... 42 more
2021-02-01T16:37:51.1512575Z 
2021-02-01T16:37:51.1512806Z 
2021-02-01T16:37:51.1514716Z 2021-02-01T16:37:51.097Z	ERROR	main	io.trino.tests.product.launcher.cli.TestRun	Test execution exceeded timeout of 41.43m
2021-02-01T16:37:51.1516967Z 2021-02-01T16:37:51.097Z	INFO	main	io.trino.tests.product.launcher.cli.SuiteRun	Test run c48cdbdb508a4086ab39f538a427f947 finished
2021-02-01T16:37:51.1553519Z 2021-02-01T16:37:51.102Z	INFO	environment-listener-2	io.trino.tests.product.launcher.env.EnvironmentListener	Environment stopping: multinode-hive-caching
2021-02-01T16:37:51.1557166Z 2021-02-01T16:37:51.117Z	INFO	main	io.trino.tests.product.launcher.cli.SuiteRun	Suite tests results:
2021-02-01T16:37:51.1559147Z +----------------------------------+---------+----------------------------------------+----------------+---------+---------+--------------------------+
2021-02-01T16:37:51.1560581Z |                               id |   suite |                            environment |         config |  status | elapsed |                    error |
2021-02-01T16:37:51.1561938Z +----------------------------------+---------+----------------------------------------+----------------+---------+---------+--------------------------+
2021-02-01T16:37:51.1563916Z | 65d22c93f605457484dcb50dcf4e14b7 | suite-5 |          singlenode-hive-impersonation | config-default | SUCCESS |  37.27m |                        - |
2021-02-01T16:37:51.1566079Z | f96f2dddfd8741ecab00e9ed6582102c | suite-5 | singlenode-kerberos-hive-impersonation | config-default | SUCCESS |  41.30m |                        - |
2021-02-01T16:37:51.1568576Z | c48cdbdb508a4086ab39f538a427f947 | suite-5 |                 multinode-hive-caching | config-default |  FAILED |  41.43m | Tests exited with code 1 |
2021-02-01T16:37:51.1570696Z +----------------------------------+---------+----------------------------------------+----------------+---------+---------+--------------------------+
2021-02-01T16:37:51.2102972Z 2021-02-01T16:37:51.209Z	INFO	environment-listener-2	io.trino.tests.product.launcher.env.StatisticsFetcher	Stopped listening for container hadoop-master stats
2021-02-01T16:37:51.2244222Z 2021-02-01T16:37:51.175Z	INFO	Thread-1	io.airlift.bootstrap.LifeCycleManager	JVM is shutting down, cleaning up
2021-02-01T16:37:51.2258650Z 2021-02-01T16:37:51.225Z	INFO	environment-listener-3	io.trino.tests.product.launcher.env.StatisticsFetcher	Stopped listening for container presto-master stats
2021-02-01T16:37:51.8629673Z ##[error]Process completed with exit code 1.
@kokosing kokosing added the bug Something isn't working label Feb 2, 2021
@kokosing kokosing mentioned this issue Feb 2, 2021
Merged
@findepi findepi changed the title Flaky: product tests hung Flaky: product tests hung in Environment.stop Feb 2, 2021
@kokosing
Copy link
Member Author

kokosing commented Feb 3, 2021

It looks like it can also hung during the start:

2021-02-03T17:38:48.6872228Z tests               | 2021-02-03 23:23:48 INFO: Starting tests
2021-02-03T17:38:54.2722168Z 2021-02-03T17:38:54.271Z	INFO	container-stats-0	io.trino.tests.product.launcher.env.EnvironmentListener	Container stats:
2021-02-03T17:38:54.2724290Z +---------------+---------+--------+---------+--------+----------+------+--------+---------+
2021-02-03T17:38:54.2725712Z |     container |     cpu |    mem | max mem |  mem % | peak mem | pids | net in | net out |
2021-02-03T17:38:54.2726832Z +---------------+---------+--------+---------+--------+----------+------+--------+---------+
2021-02-03T17:38:54.2727764Z | hadoop-master | 175.73% | 6.79GB |  1.31GB | 19.31% |   1.31GB |  436 | 5.57kB |  5.37kB |
2021-02-03T17:38:54.2728612Z | presto-master |   0.54% | 6.79GB |  1.91GB | 28.14% |   1.94GB |  141 | 1.37kB |      0B |
2021-02-03T17:38:54.2729159Z |         tests |   0.06% | 6.79GB |  0.40GB |  5.92% |   0.40GB |   16 | 5.80kB |  3.93kB |
2021-02-03T17:38:54.2729986Z +---------------+---------+--------+---------+--------+----------+------+--------+---------+
2021-02-03T17:39:02.5401882Z 2021-02-03T17:39:02.539Z	WARN	TestRun-diagnostic	io.trino.tests.product.launcher.cli.SuiteRun	Test execution is not finished yet, a deadlock or hang is suspected. Thread dump will follow.
2021-02-03T17:39:02.6733803Z 2021-02-03T17:39:02.671Z	WARN	TestRun-diagnostic	io.trino.tests.product.launcher.cli.SuiteRun	Full Thread Dump:
2021-02-03T17:39:02.6735585Z "main" prio=5 Id=1 TIMED_WAITING
2021-02-03T17:39:02.6736419Z 	at java.base@11.0.10/java.lang.Thread.sleep(Native Method)
2021-02-03T17:39:02.6738403Z 	at app//io.trino.tests.product.launcher.env.Environment.awaitTestsCompletion(Environment.java:221)
2021-02-03T17:39:02.6740889Z 	at app//io.trino.tests.product.launcher.cli.TestRun$Execution.tryExecuteTests(TestRun.java:206)
2021-02-03T17:39:02.6742763Z 	at app//io.trino.tests.product.launcher.cli.TestRun$Execution$$Lambda$318/0x000000010028e840.get(Unknown Source)
2021-02-03T17:39:02.6744332Z 	at app//net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)
2021-02-03T17:39:02.6753229Z 	at app//net.jodah.failsafe.Functions$$Lambda$320/0x000000010028e040.get(Unknown Source)
2021-02-03T17:39:02.6754800Z 	at app//net.jodah.failsafe.TimeoutExecutor.lambda$supply$2(TimeoutExecutor.java:91)
2021-02-03T17:39:02.6756391Z 	at app//net.jodah.failsafe.TimeoutExecutor$$Lambda$321/0x000000010028e440.get(Unknown Source)
2021-02-03T17:39:02.6757304Z 	...
2021-02-03T17:39:02.6757648Z 
2021-02-03T17:39:02.6757984Z 
2021-02-03T17:39:02.6758578Z "Reference Handler" daemon prio=10 Id=2 RUNNABLE
2021-02-03T17:39:02.6760322Z 	at java.base@11.0.10/java.lang.ref.Reference.waitForReferencePendingList(Native Method)
2021-02-03T17:39:02.6776370Z 	at java.base@11.0.10/java.lang.ref.Reference.processPendingReferences(Reference.java:241)
2021-02-03T17:39:02.6777926Z 	at java.base@11.0.10/java.lang.ref.Reference$ReferenceHandler.run(Reference.java:213)
2021-02-03T17:39:02.6778607Z 
2021-02-03T17:39:02.6778803Z 
2021-02-03T17:39:02.6779527Z "Finalizer" daemon prio=8 Id=3 WAITING on java.lang.ref.ReferenceQueue$Lock@25aebec3
2021-02-03T17:39:02.6780504Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-03T17:39:02.6781733Z 	-  waiting on java.lang.ref.ReferenceQueue$Lock@25aebec3
2021-02-03T17:39:02.6782905Z 	at java.base@11.0.10/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2021-02-03T17:39:02.6784310Z 	at java.base@11.0.10/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:176)
2021-02-03T17:39:02.6785585Z 	at java.base@11.0.10/java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:170)
2021-02-03T17:39:02.6786239Z 
2021-02-03T17:39:02.6786448Z 
2021-02-03T17:39:02.6786902Z "Signal Dispatcher" daemon prio=9 Id=4 RUNNABLE
2021-02-03T17:39:02.6787281Z 
2021-02-03T17:39:02.6787490Z 
2021-02-03T17:39:02.6788499Z "Common-Cleaner" daemon prio=8 Id=9 TIMED_WAITING on java.lang.ref.ReferenceQueue$Lock@b2bcc1c
2021-02-03T17:39:02.6789520Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-03T17:39:02.6790573Z 	-  waiting on java.lang.ref.ReferenceQueue$Lock@b2bcc1c
2021-02-03T17:39:02.6791966Z 	at java.base@11.0.10/java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:155)
2021-02-03T17:39:02.6793281Z 	at java.base@11.0.10/jdk.internal.ref.CleanerImpl.run(CleanerImpl.java:148)
2021-02-03T17:39:02.6794269Z 	at java.base@11.0.10/java.lang.Thread.run(Thread.java:834)
2021-02-03T17:39:02.6795389Z 	at java.base@11.0.10/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:134)
2021-02-03T17:39:02.6796185Z 
2021-02-03T17:39:02.6796381Z 
2021-02-03T17:39:02.6797121Z "TestRun-diagnostic" daemon prio=5 Id=13 RUNNABLE
2021-02-03T17:39:02.6798215Z 	at java.management@11.0.10/sun.management.ThreadImpl.dumpThreads0(Native Method)
2021-02-03T17:39:02.6799756Z 	at java.management@11.0.10/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:521)
2021-02-03T17:39:02.6801354Z 	at java.management@11.0.10/sun.management.ThreadImpl.dumpAllThreads(ThreadImpl.java:509)
2021-02-03T17:39:02.6803235Z 	at app//io.trino.tests.product.launcher.cli.SuiteRun$Execution.reportSuspectedTimeout(SuiteRun.java:338)
2021-02-03T17:39:02.6805168Z 	at app//io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$call$0(SuiteRun.java:180)
2021-02-03T17:39:02.6806874Z 	at app//io.trino.tests.product.launcher.cli.SuiteRun$Execution$$Lambda$294/0x0000000100253440.run(Unknown Source)
2021-02-03T17:39:02.6808394Z 	at java.base@11.0.10/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
2021-02-03T17:39:02.6809731Z 	at java.base@11.0.10/java.util.concurrent.FutureTask.run(FutureTask.java:264)
2021-02-03T17:39:02.6810505Z 	...
2021-02-03T17:39:02.6810717Z 
2021-02-03T17:39:02.6811132Z 	Number of locked synchronizers = 1
2021-02-03T17:39:02.6812240Z 	- java.util.concurrent.ThreadPoolExecutor$Worker@5003041b
2021-02-03T17:39:02.6812905Z 
2021-02-03T17:39:02.6813111Z 
2021-02-03T17:39:02.6814546Z "FailsafeDelayScheduler" daemon prio=5 Id=14 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@fc41e3b
2021-02-03T17:39:02.6816498Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.6818421Z 	-  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@fc41e3b
2021-02-03T17:39:02.6820449Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.6822838Z 	at java.base@11.0.10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2021-02-03T17:39:02.6825618Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
2021-02-03T17:39:02.6862051Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
2021-02-03T17:39:02.6864397Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2021-02-03T17:39:02.6866433Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.6868333Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.6869349Z 	...
2021-02-03T17:39:02.6869565Z 
2021-02-03T17:39:02.6869758Z 
2021-02-03T17:39:02.6871582Z "OkHttp ConnectionPool" daemon prio=5 Id=17 TIMED_WAITING on org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool@4ab186e
2021-02-03T17:39:02.6873643Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-03T17:39:02.6875924Z 	-  waiting on org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool@4ab186e
2021-02-03T17:39:02.6877816Z 	at java.base@11.0.10/java.lang.Object.wait(Object.java:462)
2021-02-03T17:39:02.6880115Z 	at app//org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool.lambda$new$0(RealConnectionPool.java:62)
2021-02-03T17:39:02.6883572Z 	at app//org.testcontainers.shaded.okhttp3.internal.connection.RealConnectionPool$$Lambda$384/0x00000001002e9440.run(Unknown Source)
2021-02-03T17:39:02.6886324Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
2021-02-03T17:39:02.6888208Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.6889467Z 	at java.base@11.0.10/java.lang.Thread.run(Thread.java:834)
2021-02-03T17:39:02.6889909Z 
2021-02-03T17:39:02.6890339Z 	Number of locked synchronizers = 1
2021-02-03T17:39:02.6891861Z 	- java.util.concurrent.ThreadPoolExecutor$Worker@6351bbd5
2021-02-03T17:39:02.6892814Z 
2021-02-03T17:39:02.6893268Z 
2021-02-03T17:39:02.6894239Z "docker-java-stream-1058260322" daemon prio=5 Id=21 RUNNABLE (in native)
2021-02-03T17:39:02.6897032Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.6900503Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.6902975Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.6905259Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.6907478Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.6908862Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.6910894Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.6913306Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.6914648Z 	...
2021-02-03T17:39:02.6914863Z 
2021-02-03T17:39:02.6915069Z 
2021-02-03T17:39:02.6916057Z "testcontainers-ryuk" daemon prio=5 Id=22 TIMED_WAITING on java.util.ArrayList@5423f69e
2021-02-03T17:39:02.6917001Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-03T17:39:02.6917903Z 	-  waiting on java.util.ArrayList@5423f69e
2021-02-03T17:39:02.6919196Z 	at app//org.testcontainers.utility.ResourceReaper.lambda$null$1(ResourceReaper.java:167)
2021-02-03T17:39:02.6920921Z 	at app//org.testcontainers.utility.ResourceReaper$$Lambda$452/0x000000010040a040.run(Unknown Source)
2021-02-03T17:39:02.6922746Z 	at app//org.rnorth.ducttape.ratelimits.RateLimiter.doWhenReady(RateLimiter.java:27)
2021-02-03T17:39:02.6924737Z 	at app//org.testcontainers.utility.ResourceReaper.lambda$start$2(ResourceReaper.java:158)
2021-02-03T17:39:02.6926645Z 	at app//org.testcontainers.utility.ResourceReaper$$Lambda$451/0x000000010040ac40.run(Unknown Source)
2021-02-03T17:39:02.6927827Z 	at java.base@11.0.10/java.lang.Thread.run(Thread.java:834)
2021-02-03T17:39:02.6928284Z 
2021-02-03T17:39:02.6928496Z 
2021-02-03T17:39:02.6929045Z "Okio Watchdog" daemon prio=5 Id=71 TIMED_WAITING on java.lang.Class@75047fe8
2021-02-03T17:39:02.6930153Z 	at java.base@11.0.10/java.lang.Object.wait(Native Method)
2021-02-03T17:39:02.6931119Z 	-  waiting on java.lang.Class@75047fe8
2021-02-03T17:39:02.6932500Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout.awaitTimeout(AsyncTimeout.java:348)
2021-02-03T17:39:02.7017555Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$Watchdog.run(AsyncTimeout.java:313)
2021-02-03T17:39:02.7018903Z 
2021-02-03T17:39:02.7019112Z 
2021-02-03T17:39:02.7020689Z "testcontainers-lifecycle-13" daemon prio=5 Id=370 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@1bd9b2a
2021-02-03T17:39:02.7022187Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7023592Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@1bd9b2a
2021-02-03T17:39:02.7025178Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7027391Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7029477Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7031240Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7033064Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7035091Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7036980Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7038000Z 	...
2021-02-03T17:39:02.7038207Z 
2021-02-03T17:39:02.7038416Z 
2021-02-03T17:39:02.7040506Z "testcontainers-lifecycle-14" daemon prio=5 Id=371 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@1bd9b2a
2021-02-03T17:39:02.7042042Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7043501Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@1bd9b2a
2021-02-03T17:39:02.7045093Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7047307Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7049186Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7050950Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7052785Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7054953Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7056851Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7057869Z 	...
2021-02-03T17:39:02.7058090Z 
2021-02-03T17:39:02.7058285Z 
2021-02-03T17:39:02.7059264Z "docker-java-stream--1052981380" daemon prio=5 Id=372 RUNNABLE (in native)
2021-02-03T17:39:02.7061422Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7064872Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7067315Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7069761Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7071986Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7073386Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7075405Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7077836Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7079185Z 	...
2021-02-03T17:39:02.7079398Z 
2021-02-03T17:39:02.7079590Z 
2021-02-03T17:39:02.7080976Z "environment-listener-0" daemon prio=5 Id=374 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@2e2778e0
2021-02-03T17:39:02.7082660Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7084186Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@2e2778e0
2021-02-03T17:39:02.7085781Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7087675Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7089542Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7091301Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7093291Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7215762Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7217728Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7218749Z 	...
2021-02-03T17:39:02.7218951Z 
2021-02-03T17:39:02.7219160Z 
2021-02-03T17:39:02.7220185Z "docker-java-stream-1453319877" daemon prio=5 Id=375 RUNNABLE (in native)
2021-02-03T17:39:02.7222493Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7225958Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7228408Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7230711Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7232910Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7234290Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7236324Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7238736Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7240094Z 	...
2021-02-03T17:39:02.7240309Z 
2021-02-03T17:39:02.7240501Z 
2021-02-03T17:39:02.7241917Z "environment-listener-1" daemon prio=5 Id=376 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@72937d22
2021-02-03T17:39:02.7243329Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7244713Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@72937d22
2021-02-03T17:39:02.7246290Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7248183Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7250058Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7251816Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7253819Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7358957Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7360962Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7362032Z 	...
2021-02-03T17:39:02.7362264Z 
2021-02-03T17:39:02.7362487Z 
2021-02-03T17:39:02.7363961Z "ducttape-16" daemon prio=5 Id=377 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@394ff2e8
2021-02-03T17:39:02.7365361Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7366807Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@394ff2e8
2021-02-03T17:39:02.7368475Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7370433Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7372406Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7374228Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7376417Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7378783Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7380772Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7381819Z 	...
2021-02-03T17:39:02.7382047Z 
2021-02-03T17:39:02.7382271Z 
2021-02-03T17:39:02.7383614Z "ducttape-17" daemon prio=5 Id=378 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@394ff2e8
2021-02-03T17:39:02.7385006Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7386447Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@394ff2e8
2021-02-03T17:39:02.7388110Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7390057Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7392021Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7393846Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7395748Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7397910Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7399886Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7400942Z 	...
2021-02-03T17:39:02.7401176Z 
2021-02-03T17:39:02.7401386Z 
2021-02-03T17:39:02.7402673Z "ducttape-18" daemon prio=5 Id=379 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@394ff2e8
2021-02-03T17:39:02.7404051Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7405496Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@394ff2e8
2021-02-03T17:39:02.7407149Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7409112Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7411058Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7412887Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7415123Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7417275Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7419252Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7420312Z 	...
2021-02-03T17:39:02.7420528Z 
2021-02-03T17:39:02.7420760Z 
2021-02-03T17:39:02.7421749Z "docker-java-stream-1453319877" daemon prio=5 Id=380 RUNNABLE (in native)
2021-02-03T17:39:02.7423997Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7427534Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7430076Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7432450Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7434751Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7436196Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7438300Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7440916Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7442322Z 	...
2021-02-03T17:39:02.7442534Z 
2021-02-03T17:39:02.7442758Z 
2021-02-03T17:39:02.7443742Z "docker-java-stream--2042977561" daemon prio=5 Id=419 RUNNABLE (in native)
2021-02-03T17:39:02.7445981Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7449531Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7452071Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7454448Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7537126Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7538549Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7540589Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7543000Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7544364Z 	...
2021-02-03T17:39:02.7544579Z 
2021-02-03T17:39:02.7544775Z 
2021-02-03T17:39:02.7545822Z "docker-java-stream--337554626" daemon prio=5 Id=420 RUNNABLE (in native)
2021-02-03T17:39:02.7547972Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7551429Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7553878Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7556308Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7558529Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7559929Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7561944Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7564364Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7565707Z 	...
2021-02-03T17:39:02.7565920Z 
2021-02-03T17:39:02.7566123Z 
2021-02-03T17:39:02.7567748Z "testcontainers-lifecycle-15" daemon prio=5 Id=421 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@1bd9b2a
2021-02-03T17:39:02.7569276Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7570688Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@1bd9b2a
2021-02-03T17:39:02.7572269Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7574173Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7576183Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7577946Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7579773Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7581806Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7583696Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7584711Z 	...
2021-02-03T17:39:02.7584923Z 
2021-02-03T17:39:02.7585117Z 
2021-02-03T17:39:02.7586421Z "docker-container-25" daemon prio=5 Id=422 TIMED_WAITING on java.util.concurrent.SynchronousQueue$TransferStack@54464a20
2021-02-03T17:39:02.7587930Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7589338Z 	-  waiting on java.util.concurrent.SynchronousQueue$TransferStack@54464a20
2021-02-03T17:39:02.7590904Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7592792Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:462)
2021-02-03T17:39:02.7594703Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:361)
2021-02-03T17:39:02.7596471Z 	at java.base@11.0.10/java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:937)
2021-02-03T17:39:02.7598297Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1053)
2021-02-03T17:39:02.7600324Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7602214Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7603211Z 	...
2021-02-03T17:39:02.7603422Z 
2021-02-03T17:39:02.7603629Z 
2021-02-03T17:39:02.7604504Z "docker-java-stream--1301285425" daemon prio=5 Id=424 RUNNABLE (in native)
2021-02-03T17:39:02.7606672Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7610100Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7612571Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7615323Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7617572Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7618953Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7620994Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7623403Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7624757Z 	...
2021-02-03T17:39:02.7624957Z 
2021-02-03T17:39:02.7625166Z 
2021-02-03T17:39:02.7626128Z "docker-java-stream--1834049932" daemon prio=5 Id=425 RUNNABLE (in native)
2021-02-03T17:39:02.7628274Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket.recv(Native Method)
2021-02-03T17:39:02.7631854Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixDomainSocket$UnixSocketInputStream.read(UnixDomainSocket.java:246)
2021-02-03T17:39:02.7634313Z 	at java.base@11.0.10/java.io.FilterInputStream.read(FilterInputStream.java:133)
2021-02-03T17:39:02.7636976Z 	at app//org.testcontainers.shaded.com.github.dockerjava.okhttp.UnixSocketFactory$1$1.read(UnixSocketFactory.java:45)
2021-02-03T17:39:02.7639576Z 	at app//org.testcontainers.shaded.okio.Okio$2.read(Okio.java:140)
2021-02-03T17:39:02.7641722Z 	at app//org.testcontainers.shaded.okio.AsyncTimeout$2.read(AsyncTimeout.java:237)
2021-02-03T17:39:02.7643759Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.request(RealBufferedSource.java:72)
2021-02-03T17:39:02.7646172Z 	at app//org.testcontainers.shaded.okio.RealBufferedSource.require(RealBufferedSource.java:65)
2021-02-03T17:39:02.7647528Z 	...
2021-02-03T17:39:02.7647742Z 
2021-02-03T17:39:02.7647934Z 
2021-02-03T17:39:02.7649703Z "container-stats-0" daemon prio=5 Id=426 TIMED_WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@41b3c830
2021-02-03T17:39:02.7651419Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7653177Z 	-  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@41b3c830
2021-02-03T17:39:02.7655278Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
2021-02-03T17:39:02.7657858Z 	at java.base@11.0.10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2123)
2021-02-03T17:39:02.7660637Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1182)
2021-02-03T17:39:02.7664058Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
2021-02-03T17:39:02.7667120Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2021-02-03T17:39:02.7669682Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7671617Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7672633Z 	...
2021-02-03T17:39:02.7672833Z 
2021-02-03T17:39:02.7673054Z 
2021-02-03T17:39:02.7674785Z "container-stats-1" daemon prio=5 Id=427 WAITING on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@41b3c830
2021-02-03T17:39:02.7676483Z 	at java.base@11.0.10/jdk.internal.misc.Unsafe.park(Native Method)
2021-02-03T17:39:02.7678224Z 	-  waiting on java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@41b3c830
2021-02-03T17:39:02.7680373Z 	at java.base@11.0.10/java.util.concurrent.locks.LockSupport.park(LockSupport.java:194)
2021-02-03T17:39:02.7683557Z 	at java.base@11.0.10/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2081)
2021-02-03T17:39:02.7686327Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1177)
2021-02-03T17:39:02.7688969Z 	at java.base@11.0.10/java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:899)
2021-02-03T17:39:02.7691294Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1054)
2021-02-03T17:39:02.7693305Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1114)
2021-02-03T17:39:02.7695381Z 	at java.base@11.0.10/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
2021-02-03T17:39:02.7696419Z 	...
2021-02-03T17:39:02.7696635Z 
2021-02-03T17:39:02.7696844Z 
2021-02-03T17:39:03.2645195Z tests               | 2021-02-03 23:24:03 INFO: [1 of 1] io.trino.tests.hive.TestExternalHiveTable.testCreateExternalTableWithInaccessibleSchemaLocation (Groups: profile_specific_tests, hive_with_external_writes)
2021-02-03T17:39:06.2754745Z presto-master       | 2021-02-03T23:24:06.273+0545	INFO	dispatcher-query-0	io.trino.event.QueryMonitor	TIMELINE: Query 20210203_173903_00000_e6hta :: Transaction:[31e86a70-cdcd-4330-8827-4059afb71af9] :: elapsed 2117ms :: planning 0ms :: waiting 3ms :: scheduling 2117ms :: running 0ms :: finishing 2117ms :: begin 2021-02-03T23:24:04.147+05:45 :: end 2021-02-03T23:24:06.264+05:45
2021-02-03T17:39:12.5483849Z 2021-02-03T17:39:12.534Z	INFO	environment-listener-0	io.trino.tests.product.launcher.env.EnvironmentListener	Environment stopping: singlenode
2021-02-03T17:39:12.5487393Z 2021-02-03T17:39:12.534Z	WARN	main	io.trino.tests.product.launcher.env.Environment	Exception occurred while closing environment
2021-02-03T17:39:12.5489480Z java.lang.RuntimeException: java.lang.InterruptedException
2021-02-03T17:39:12.5494053Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:84)
2021-02-03T17:39:12.5499788Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-03T17:39:12.5501749Z 	at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658)
2021-02-03T17:39:12.5504188Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.tryInvokeListener(EnvironmentListener.java:78)
2021-02-03T17:39:12.5507469Z 	at io.trino.tests.product.launcher.env.EnvironmentListener$1.environmentStopping(EnvironmentListener.java:115)
2021-02-03T17:39:12.5509882Z 	at io.trino.tests.product.launcher.env.Environment.lambda$stop$6(Environment.java:164)
2021-02-03T17:39:12.5511407Z 	at java.base/java.util.Optional.ifPresent(Optional.java:183)
2021-02-03T17:39:12.5512844Z 	at io.trino.tests.product.launcher.env.Environment.stop(Environment.java:164)
2021-02-03T17:39:12.5514738Z 	at io.trino.tests.product.launcher.env.Environment.close(Environment.java:276)
2021-02-03T17:39:12.5516607Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.tryExecuteTests(TestRun.java:205)
2021-02-03T17:39:12.5518116Z 	at net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)
2021-02-03T17:39:12.5519480Z 	at net.jodah.failsafe.TimeoutExecutor.lambda$supply$2(TimeoutExecutor.java:91)
2021-02-03T17:39:12.5520951Z 	at net.jodah.failsafe.Execution.executeSync(Execution.java:129)
2021-02-03T17:39:12.5522377Z 	at net.jodah.failsafe.FailsafeExecutor.call(FailsafeExecutor.java:376)
2021-02-03T17:39:12.5523884Z 	at net.jodah.failsafe.FailsafeExecutor.get(FailsafeExecutor.java:67)
2021-02-03T17:39:12.5525386Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.call(TestRun.java:188)
2021-02-03T17:39:12.5527000Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runTest(SuiteRun.java:290)
2021-02-03T17:39:12.5528945Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.executeSuiteTestRun(SuiteRun.java:275)
2021-02-03T17:39:12.5530821Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$2(SuiteRun.java:209)
2021-02-03T17:39:12.5532467Z 	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
2021-02-03T17:39:12.5534028Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-03T17:39:12.5576795Z 	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
2021-02-03T17:39:12.5578678Z 	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
2021-02-03T17:39:12.5580470Z 	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
2021-02-03T17:39:12.5582051Z 	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
2021-02-03T17:39:12.5583832Z 	at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
2021-02-03T17:39:12.5585582Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$3(SuiteRun.java:210)
2021-02-03T17:39:12.5586961Z 	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
2021-02-03T17:39:12.5588599Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runSuites(SuiteRun.java:196)
2021-02-03T17:39:12.5590309Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:182)
2021-02-03T17:39:12.5591921Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:139)
2021-02-03T17:39:12.5593706Z 	at io.trino.tests.product.launcher.cli.Commands.runCommand(Commands.java:42)
2021-02-03T17:39:12.5595509Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:104)
2021-02-03T17:39:12.5597173Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:72)
2021-02-03T17:39:12.5598691Z 	at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
2021-02-03T17:39:12.5599837Z 	at picocli.CommandLine.access$1300(CommandLine.java:145)
2021-02-03T17:39:12.5601571Z 	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
2021-02-03T17:39:12.5603292Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
2021-02-03T17:39:12.5604245Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
2021-02-03T17:39:12.5605475Z 	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
2021-02-03T17:39:12.5606741Z 	at picocli.CommandLine.execute(CommandLine.java:2078)
2021-02-03T17:39:12.5608860Z 	at io.trino.tests.product.launcher.cli.Launcher.run(Launcher.java:74)
2021-02-03T17:39:12.5610700Z 	at io.trino.tests.product.launcher.cli.Launcher.main(Launcher.java:64)
2021-02-03T17:39:12.5611969Z Caused by: java.lang.InterruptedException
2021-02-03T17:39:12.5613404Z 	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:385)
2021-02-03T17:39:12.5655957Z 	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
2021-02-03T17:39:12.5777575Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:80)
2021-02-03T17:39:12.5779197Z 	... 42 more
2021-02-03T17:39:12.5779468Z 
2021-02-03T17:39:12.5779666Z 
2021-02-03T17:39:12.5781255Z 2021-02-03T17:39:12.536Z	WARN	main	io.trino.tests.product.launcher.cli.TestRun	Failed to execute tests
2021-02-03T17:39:12.5782648Z java.lang.RuntimeException: java.lang.InterruptedException
2021-02-03T17:39:12.5785144Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:84)
2021-02-03T17:39:12.5787656Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-03T17:39:12.5791660Z 	at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:658)
2021-02-03T17:39:12.5794134Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.tryInvokeListener(EnvironmentListener.java:78)
2021-02-03T17:39:12.5797050Z 	at io.trino.tests.product.launcher.env.EnvironmentListener$1.environmentStopping(EnvironmentListener.java:115)
2021-02-03T17:39:12.5799308Z 	at io.trino.tests.product.launcher.env.Environment.lambda$stop$6(Environment.java:164)
2021-02-03T17:39:12.5800826Z 	at java.base/java.util.Optional.ifPresent(Optional.java:183)
2021-02-03T17:39:12.5802255Z 	at io.trino.tests.product.launcher.env.Environment.stop(Environment.java:164)
2021-02-03T17:39:12.5821112Z 	at io.trino.tests.product.launcher.env.Environment.awaitTestsCompletion(Environment.java:240)
2021-02-03T17:39:12.5823497Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.tryExecuteTests(TestRun.java:206)
2021-02-03T17:39:12.5825006Z 	at net.jodah.failsafe.Functions.lambda$get$0(Functions.java:48)
2021-02-03T17:39:12.5826378Z 	at net.jodah.failsafe.TimeoutExecutor.lambda$supply$2(TimeoutExecutor.java:91)
2021-02-03T17:39:12.5827839Z 	at net.jodah.failsafe.Execution.executeSync(Execution.java:129)
2021-02-03T17:39:12.5829281Z 	at net.jodah.failsafe.FailsafeExecutor.call(FailsafeExecutor.java:376)
2021-02-03T17:39:12.5830763Z 	at net.jodah.failsafe.FailsafeExecutor.get(FailsafeExecutor.java:67)
2021-02-03T17:39:12.5832566Z 	at io.trino.tests.product.launcher.cli.TestRun$Execution.call(TestRun.java:188)
2021-02-03T17:39:12.5834365Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runTest(SuiteRun.java:290)
2021-02-03T17:39:12.5836231Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.executeSuiteTestRun(SuiteRun.java:275)
2021-02-03T17:39:12.5838105Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$2(SuiteRun.java:209)
2021-02-03T17:39:12.5839749Z 	at java.base/java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:195)
2021-02-03T17:39:12.5841301Z 	at java.base/java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948)
2021-02-03T17:39:12.5843058Z 	at java.base/java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:484)
2021-02-03T17:39:12.6017075Z 	at java.base/java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:474)
2021-02-03T17:39:12.6018884Z 	at java.base/java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:913)
2021-02-03T17:39:12.6020503Z 	at java.base/java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
2021-02-03T17:39:12.6022227Z 	at java.base/java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:578)
2021-02-03T17:39:12.6023967Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.lambda$runSuites$3(SuiteRun.java:210)
2021-02-03T17:39:12.6025332Z 	at java.base/java.util.ArrayList.forEach(ArrayList.java:1541)
2021-02-03T17:39:12.6027084Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.runSuites(SuiteRun.java:196)
2021-02-03T17:39:12.6028753Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:182)
2021-02-03T17:39:12.6030379Z 	at io.trino.tests.product.launcher.cli.SuiteRun$Execution.call(SuiteRun.java:139)
2021-02-03T17:39:12.6032152Z 	at io.trino.tests.product.launcher.cli.Commands.runCommand(Commands.java:42)
2021-02-03T17:39:12.6033961Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:104)
2021-02-03T17:39:12.6035629Z 	at io.trino.tests.product.launcher.cli.SuiteRun.call(SuiteRun.java:72)
2021-02-03T17:39:12.6037146Z 	at picocli.CommandLine.executeUserObject(CommandLine.java:1953)
2021-02-03T17:39:12.6038294Z 	at picocli.CommandLine.access$1300(CommandLine.java:145)
2021-02-03T17:39:12.6040036Z 	at picocli.CommandLine$RunLast.executeUserObjectOfLastSubcommandWithSameParent(CommandLine.java:2352)
2021-02-03T17:39:12.6041754Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2346)
2021-02-03T17:39:12.6042704Z 	at picocli.CommandLine$RunLast.handle(CommandLine.java:2311)
2021-02-03T17:39:12.6043929Z 	at picocli.CommandLine$AbstractParseResultHandler.execute(CommandLine.java:2179)
2021-02-03T17:39:12.6045311Z 	at picocli.CommandLine.execute(CommandLine.java:2078)
2021-02-03T17:39:12.6046629Z 	at io.trino.tests.product.launcher.cli.Launcher.run(Launcher.java:74)
2021-02-03T17:39:12.6048255Z 	at io.trino.tests.product.launcher.cli.Launcher.main(Launcher.java:64)
2021-02-03T17:39:12.6049533Z Caused by: java.lang.InterruptedException
2021-02-03T17:39:12.6050970Z 	at java.base/java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:385)
2021-02-03T17:39:12.6052836Z 	at java.base/java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1999)
2021-02-03T17:39:12.6062071Z 	at io.trino.tests.product.launcher.env.EnvironmentListener.lambda$tryInvokeListener$1(EnvironmentListener.java:80)
2021-02-03T17:39:12.6064092Z 	... 42 more
2021-02-03T17:39:12.6064321Z 
2021-02-03T17:39:12.6064533Z 
2021-02-03T17:39:12.6066924Z 2021-02-03T17:39:12.536Z	INFO	environment-listener-1	io.trino.tests.product.launcher.env.EnvironmentListener	Environment stopping: singlenode
2021-02-03T17:39:12.6069400Z 2021-02-03T17:39

@kokosing kokosing mentioned this issue Feb 3, 2021
Closed
@findepi findepi changed the title Flaky: product tests hung in Environment.stop Flaky: product tests hung in Environment start and stop Feb 16, 2021
@findepi findepi mentioned this issue Feb 21, 2021
Merged
This was referenced Sep 7, 2022
Closed
Merged
@aczajkowski
Copy link
Member

Another hit:
https://github.com/trinodb/trino/actions/runs/3145610715/jobs/5115365010

@aczajkowski aczajkowski mentioned this issue Sep 30, 2022
Merged
@nevillelyh nevillelyh mentioned this issue Oct 18, 2022
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kokosing @aczajkowski