Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd #84006

Open
v-wenyuxu opened this issue Mar 28, 2023 · 11 comments
Assignees
Labels
area-System.Threading blocking-clean-ci-optional Blocking optional rolling runs disabled-test The test is disabled in source code against the issue GCStress JitStress CLR JIT issues involving JIT internal stress modes os-windows
Milestone

Comments

@v-wenyuxu
Copy link

Run: runtime-coreclr gcstress-extra 20230326.1

Failed test:

coreclr windows arm64 Checked gcstress0xc_jitstress1 @ Windows.11.Arm64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x64 Checked gcstress0xc_zapdisable @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x64 Checked gcstress0xc_jitstress1 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_tailcallstress @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_jitstress2 @ Windows.11.Arm64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_jitstress1 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_zapdisable @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_jitminopts_heapverify1 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

Error message:

cmdLine:C:hwA05C0952wACDA0907e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 3/26/2023 11:30:07 PM, end: 3/27/2023 1:00:07 AM)

Return code:      -100
Raw output file:      C:hwA05C0952wACDA0907uploads
egressions2164oreground-shutdownoutput.txt
Raw output:
BEGIN EXECUTION
"C:hwA05C0952pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  foreground-shutdown.dll

cmdLine:C:hwA05C0952wACDA0907e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 3/26/2023 11:30:07 PM, end: 3/27/2023 1:00:07 AM)
Test Harness Exitcode is : -100
To run the test:
Set up CORE_ROOT and run.

C:hwA05C0952wACDA0907e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd
Expected: True
Actual:   False


Stack trace
   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String basePath, String assemblyPath)
   at Program.<<Main>$>g__TestExecutor2|0_1(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
@v-wenyuxu v-wenyuxu added arch-arm64 arch-x86 os-windows GCStress JitStress CLR JIT issues involving JIT internal stress modes labels Mar 28, 2023
@dotnet-issue-labeler dotnet-issue-labeler bot added the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Mar 28, 2023
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Mar 28, 2023
@ghost
Copy link

ghost commented Mar 28, 2023

Tagging subscribers to this area: @mangod9
See info in area-owners.md if you want to be subscribed.

Issue Details

Run: runtime-coreclr gcstress-extra 20230326.1

Failed test:

coreclr windows arm64 Checked gcstress0xc_jitstress1 @ Windows.11.Arm64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x64 Checked gcstress0xc_zapdisable @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x64 Checked gcstress0xc_jitstress1 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_tailcallstress @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_jitstress2 @ Windows.11.Arm64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_jitstress1 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_zapdisable @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_jitminopts_heapverify1 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

Error message:

cmdLine:C:hwA05C0952wACDA0907e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 3/26/2023 11:30:07 PM, end: 3/27/2023 1:00:07 AM)

Return code:      -100
Raw output file:      C:hwA05C0952wACDA0907uploads
egressions2164oreground-shutdownoutput.txt
Raw output:
BEGIN EXECUTION
"C:hwA05C0952pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  foreground-shutdown.dll

cmdLine:C:hwA05C0952wACDA0907e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 3/26/2023 11:30:07 PM, end: 3/27/2023 1:00:07 AM)
Test Harness Exitcode is : -100
To run the test:
Set up CORE_ROOT and run.

C:hwA05C0952wACDA0907e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd
Expected: True
Actual:   False


Stack trace
   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String basePath, String assemblyPath)
   at Program.<<Main>$>g__TestExecutor2|0_1(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Author: v-wenyuxu
Assignees: -
Labels:

arch-arm64, arch-x86, area-System.Threading, os-windows, GCStress, JitStress, untriaged, needs-area-label

Milestone: -

@danmoseley danmoseley removed the needs-area-label An area label is needed to ensure this gets routed to the appropriate area owners label Mar 29, 2023
@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr gcstress-extra 20230402.1

Failed test:

coreclr windows arm64 Checked gcstress0xc_jitminopts_heapverify1 @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_tailcallstress @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x64 Checked gcstress0xc_jitminopts_heapverify1 @ Windows.10.Amd64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x64 Checked gcstress0xc_zapdisable_jitstress2 @ Windows.10.Amd64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_jitminopts_heapverify1 @ Windows.10.Amd64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_zapdisable @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_zapdisable_jitstress2 @ Windows.10.Amd64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_zapdisable_heapverify1 @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

Error message:

cmdLine:C:hwB5E70A07wBF490A41e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/2/2023 11:19:16 PM, end: 4/3/2023 12:49:18 AM)

Return code:      -100
Raw output file:      C:hwB5E70A07wBF490A41uploads
egressions2164oreground-shutdownoutput.txt
Raw output:
BEGIN EXECUTION
"C:hwB5E70A07pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false"  foreground-shutdown.dll

cmdLine:C:hwB5E70A07wBF490A41e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/2/2023 11:19:16 PM, end: 4/3/2023 12:49:18 AM)
Test Harness Exitcode is : -100
To run the test:
Set up CORE_ROOT and run.

C:hwB5E70A07wBF490A41e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd
Expected: True
Actual:   False


Stack trace
   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 116
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String basePath, String assemblyPath)
   at Program.<<Main>$>g__TestExecutor2|0_1(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

@mangod9
Copy link
Member

mangod9 commented Apr 7, 2023

@kouvel could you please take a look?

@v-wenyuxu
Copy link
Author

v-wenyuxu commented Apr 11, 2023

Failed again in: runtime-coreclr gcstress-extra 20230409.1

Failed test:

coreclr windows arm64 Checked gcstress0xc_zapdisable_jitstress2 @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_zapdisable_jitstress2 @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

Error message:

cmdLine:C:hwAA20096AwB6D209CEe�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/9/2023 10:42:38 PM, end: 4/10/2023 12:12:41 AM)

Return code:      -100
Raw output file:      C:hwAA20096AwB6D209CEuploads
egressions2164oreground-shutdownoutput.txt
Raw output:
BEGIN EXECUTION
"C:hwAA20096Apcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  foreground-shutdown.dll

cmdLine:C:hwAA20096AwB6D209CEe�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/9/2023 10:42:38 PM, end: 4/10/2023 12:12:41 AM)
Test Harness Exitcode is : -100
To run the test:
Set up CORE_ROOT and run.
> C:hwAA20096AwB6D209CEe�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd
Expected: True
Actual:   False


Stack trace
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String basePath, String assemblyPath)
   at Program.&lt;&lt;Main&gt;$&gt;g__TestExecutor2|0_1(StreamWriter tempLogSw, StreamWriter statsCsvSw, &lt;&gt;c__DisplayClass0_0&amp;)

@kunalspathak
Copy link
Member

Ping @kouvel

@v-wenyuxu
Copy link
Author

v-wenyuxu commented Apr 18, 2023

Failed again in: runtime-coreclr gcstress-extra 20230416.1

Failed test:

coreclr windows x64 Checked gcstress0xc_zapdisable @ Windows.10.Amd64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows x86 Checked gcstress0xc_jitminopts_heapverify1 @ Windows.10.Amd64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_jitstress1 @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

coreclr windows arm64 Checked gcstress0xc_zapdisable @ Windows.11.Arm64.Open

- baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

Error message:

cmdLine:C:hwA9D209A7wAA480925e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/16/2023 11:09:55 PM, end: 4/17/2023 12:39:57 AM)

Return code:      -100
Raw output file:      C:hwA9D209A7wAA480925uploads
egressions2164oreground-shutdownoutput.txt
Raw output:
BEGIN EXECUTION
"C:hwA9D209A7pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true"  foreground-shutdown.dll

cmdLine:C:hwA9D209A7wAA480925e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 5400000 from variable __TestTimeout, start: 4/16/2023 11:09:55 PM, end: 4/17/2023 12:39:57 AM)
Test Harness Exitcode is : -100
To run the test:
Set up CORE_ROOT and run.
> C:hwA9D209A7wAA480925e�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd
Expected: True
Actual:   False


Stack trace
   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String basePath, String assemblyPath)
   at Program.&lt;&lt;Main&gt;$&gt;g__TestExecutor2|0_1(StreamWriter tempLogSw, StreamWriter statsCsvSw, &lt;&gt;c__DisplayClass0_0&amp;)

@v-wenyuxu
Copy link
Author

Failed again in: runtime-coreclr gcstress0x3-gcstress0xc 20230507.1

Failed tests:

coreclr windows x64 Checked gcstress0xc @ Windows.10.Amd64.Open
    - baseservices/threading/regressions/2164/foreground-shutdown/foreground-shutdown.cmd

Error message:

 
cmdLine:C:hwA8900954wAADF097Ae�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 5/7/2023 3:30:19 PM, end: 5/7/2023 4:30:20 PM)

Return code:      -100
Raw output file:      C:hwA8900954wAADF097Auploads
egressions2164oreground-shutdownoutput.txt
Raw output:
BEGIN EXECUTION
 &quot;C:hwA8900954pcorerun.exe&quot; -p &quot;System.Reflection.Metadata.MetadataUpdater.IsSupported=false&quot; -p &quot;System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true&quot;  foreground-shutdown.dll 

cmdLine:C:hwA8900954wAADF097Ae�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd Timed Out (timeout in milliseconds: 3600000 from variable __TestTimeout, start: 5/7/2023 3:30:19 PM, end: 5/7/2023 4:30:20 PM)
Test Harness Exitcode is : -100
To run the test:
Set up CORE_ROOT and run.
&gt; C:hwA8900954wAADF097Ae�aseservices	hreading	hreading_group1../regressions/2164/foreground-shutdown/foreground-shutdown.cmd
Expected: True
Actual:   False

Stack trace:

    at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/xunit.assert/Asserts/BooleanAsserts.cs:line 132
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String basePath, String assemblyPath)
   at Program.&lt;&lt;Main&gt;$&gt;g__TestExecutor2|0_1(StreamWriter tempLogSw, StreamWriter statsCsvSw, &lt;&gt;c__DisplayClass0_0&amp;)

BruceForstall added a commit to BruceForstall/runtime that referenced this issue May 8, 2023
This test has failed across many configurations, but apparently only
on Windows. Tracked by dotnet#84006,
dotnet#83658.
trylek pushed a commit that referenced this issue May 9, 2023
This test has failed across many configurations, but apparently only
on Windows. Tracked by #84006,
#83658.
@mangod9 mangod9 removed the untriaged New issue has not been triaged by the area owner label Jul 24, 2023
@mangod9 mangod9 added this to the 8.0.0 milestone Jul 24, 2023
@mangod9
Copy link
Member

mangod9 commented Aug 4, 2023

Moving to 9 since this is disabled.

@mangod9 mangod9 modified the milestones: 8.0.0, 9.0.0 Aug 4, 2023
@kouvel kouvel modified the milestones: 9.0.0, 8.0.0 Sep 7, 2023
kouvel added a commit to kouvel/runtime that referenced this issue Sep 7, 2023
…pending on timing with GCs

- On Windows when a thread calls `ExitProcess`, the `TlsDestructionMonitor` for the thread appears to be destructed after all other threads in the process are torn down. It's possible for a GC to be in progress during that time, and the thread cleanup code in `TlsDestructionMonitor` tries to enter cooperative GC mode to fix the frame pointer, leading to a hang. Fixed by deactivating the `TlsDestructionMonitor` for the thread before calling `ExitProcess`.
- Also disabled the relevant test due to a different issue dotnet#83658 occurring in the same test on multiple platforms/architectures that is not understood yet.

Fixes dotnet#84006
@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Sep 7, 2023
@kouvel kouvel modified the milestones: 8.0.0, 9.0.0 Sep 14, 2023
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Sep 14, 2023
@kouvel kouvel added the disabled-test The test is disabled in source code against the issue label Sep 22, 2023
@mangod9
Copy link
Member

mangod9 commented Jul 24, 2024

From what I can see this is no longer disabled.

@kouvel
Copy link
Member

kouvel commented Aug 14, 2024

It looks like it's still disabled here:

<ExcludeList Include="$(XunitTestBinBase)/baseservices/threading/regressions/2164/foreground-shutdown/*">
<Issue>https://github.com/dotnet/runtime/issues/83658</Issue>
</ExcludeList>

@kouvel kouvel modified the milestones: 9.0.0, 10.0.0 Aug 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area-System.Threading blocking-clean-ci-optional Blocking optional rolling runs disabled-test The test is disabled in source code against the issue GCStress JitStress CLR JIT issues involving JIT internal stress modes os-windows
Projects
None yet
7 participants