Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh failed on rolling build #60679

Closed
krwq opened this issue Oct 20, 2021 · 5 comments

Comments

@krwq
Copy link
Member

krwq commented Oct 20, 2021

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1428018&view=results
Leg: Mono minijit Pri0 Runtime Tests Run OSX x64 release

  Starting:    tracing.eventactivityidcontrol.XUnitWrapper (parallel test collections = on, max threads = 8)
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:02:00
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:04:01
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:06:02
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:08:03
Attempting to collect crash dump: /cores/crashdump_73389.dmp
Invoking: sudo /tmp/helix/working/C7080A8C/p/createdump --name "/cores/crashdump_73389.dmp" 73389 --withheap
createdump stdout:
Gathering state for process 73389 

createdump stderr:
CLRDataCreateInstance(ICLRDataEnumMemoryRegions) FAILED 80131c4f

Failed to collect crash dump
    tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh [FAIL]
      
      cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
      
      Return code:      -100
      Raw output file:      /tmp/helix/working/C7080A8C/w/A9B20938/uploads/Reports/tracing.eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.output.txt
      Raw output:
      BEGIN EXECUTION
      /tmp/helix/working/C7080A8C/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false eventactivityidcontrol.dll ''
      
      cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
      Test Harness Exitcode is : -100
      To run the test:
      > set CORE_ROOT=/tmp/helix/working/C7080A8C/p
      > /private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at tracing_eventactivityidcontrol._eventactivityidcontrol_eventactivityidcontrol_._eventactivityidcontrol_eventactivityidcontrol_sh()
      Output:
        
        cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
        
        Return code:      -100
        Raw output file:      /tmp/helix/working/C7080A8C/w/A9B20938/uploads/Reports/tracing.eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.output.txt
        Raw output:
        BEGIN EXECUTION
        /tmp/helix/working/C7080A8C/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false eventactivityidcontrol.dll ''
        
        cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
        Test Harness Exitcode is : -100
        To run the test:
        > set CORE_ROOT=/tmp/helix/working/C7080A8C/p
        > /private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh
  Finished:    tracing.eventactivityidcontrol.XUnitWrapper

Runfo Tracking Issue: tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh failed

Build Definition Kind Run Name Console Core Dump Test Results Run Client
1858712 runtime PR 71567 coreclr Linux arm Checked no_tiered_compilation @ (Ubuntu.1804.Arm32.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7-bfcd90a-20200121150440 console.log core dump runclient.py
1857672 runtime PR 71567 coreclr Linux arm Checked no_tiered_compilation @ (Ubuntu.1804.Arm32.Open)Ubuntu.1804.Armarch.Open@mcr.microsoft.com/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7-bfcd90a-20200121150440 console.log core dump runclient.py

Build Result Summary

Day Hit Count Week Hit Count Month Hit Count
0 2 2
@dotnet-issue-labeler dotnet-issue-labeler bot added area-System.Diagnostics.Tracing untriaged New issue has not been triaged by the area owner labels Oct 20, 2021
@ghost
Copy link

ghost commented Oct 20, 2021

Tagging subscribers to this area: @tarekgh, @tommcdon, @pjanotti
See info in area-owners.md if you want to be subscribed.

Issue Details

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1428018&view=results
Leg: Mono minijit Pri0 Runtime Tests Run OSX x64 release

  Starting:    tracing.eventactivityidcontrol.XUnitWrapper (parallel test collections = on, max threads = 8)
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:02:00
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:04:01
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:06:02
   tracing.eventactivityidcontrol.XUnitWrapper: [Long Running Test] 'tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh', Elapsed: 00:08:03
Attempting to collect crash dump: /cores/crashdump_73389.dmp
Invoking: sudo /tmp/helix/working/C7080A8C/p/createdump --name "/cores/crashdump_73389.dmp" 73389 --withheap
createdump stdout:
Gathering state for process 73389 

createdump stderr:
CLRDataCreateInstance(ICLRDataEnumMemoryRegions) FAILED 80131c4f

Failed to collect crash dump
    tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh [FAIL]
      
      cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
      
      Return code:      -100
      Raw output file:      /tmp/helix/working/C7080A8C/w/A9B20938/uploads/Reports/tracing.eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.output.txt
      Raw output:
      BEGIN EXECUTION
      /tmp/helix/working/C7080A8C/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false eventactivityidcontrol.dll ''
      
      cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
      Test Harness Exitcode is : -100
      To run the test:
      > set CORE_ROOT=/tmp/helix/working/C7080A8C/p
      > /private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh
      Expected: True
      Actual:   False
      Stack Trace:
           at tracing_eventactivityidcontrol._eventactivityidcontrol_eventactivityidcontrol_._eventactivityidcontrol_eventactivityidcontrol_sh()
      Output:
        
        cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
        
        Return code:      -100
        Raw output file:      /tmp/helix/working/C7080A8C/w/A9B20938/uploads/Reports/tracing.eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.output.txt
        Raw output:
        BEGIN EXECUTION
        /tmp/helix/working/C7080A8C/p/corerun -p System.Reflection.Metadata.MetadataUpdater.IsSupported=false eventactivityidcontrol.dll ''
        
        cmdLine:/private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh Timed Out (timeout in milliseconds: 600000 from variable __TestTimeout, start: 10/18/2021 4:57:40 PM, end: 10/18/2021 5:07:40 PM)
        Test Harness Exitcode is : -100
        To run the test:
        > set CORE_ROOT=/tmp/helix/working/C7080A8C/p
        > /private/tmp/helix/working/C7080A8C/w/A9B20938/e/tracing/eventactivityidcontrol/eventactivityidcontrol/eventactivityidcontrol.sh
  Finished:    tracing.eventactivityidcontrol.XUnitWrapper
Author: krwq
Assignees: -
Labels:

area-System.Diagnostics.Tracing, untriaged

Milestone: -

@krwq
Copy link
Member Author

krwq commented Oct 20, 2021

cc: @josalem

@josalem
Copy link
Contributor

josalem commented Oct 20, 2021

CC @lateralusX since this is Mono. Does this timeout look familiar to you, Johan?

Unfortunately, there isn't much in terms of logging output here to go on.

@lateralusX
Copy link
Member

CC @lateralusX since this is Mono. Does this timeout look familiar to you, Johan?

Unfortunately, there isn't much in terms of logging output here to go on.

Nope, These test uses a very small fraction of the native EventPipe library. Since we can't get stack traces from Mono hangs on CI, it is hard to track very infrequent failures like this. As long as we only see infrequent failures, I guess we can keep test running, and monitor frequency. Will spend some time next week and run some of this local to see if it will repro over many test runs.

@steveisok
Copy link
Member

Closing as this appears to be a flake. Please reopen if you find otherwise.

@ghost ghost removed the untriaged New issue has not been triaged by the area owner label Jul 5, 2022
@ghost ghost locked as resolved and limited conversation to collaborators Aug 4, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

4 participants