Skip to content

Commit

Permalink
[xharness] Try harder to make lldb quit after trying to get a backtra…
Browse files Browse the repository at this point in the history
…ce. (#9119)

When a process times out, we try to print a stack trace for all threads. This
involves executing "lldb --source <script>", where the script contains:

	process attach --pid 1234
	thread list
	thread backtrace all
	detach
	quit

Basically we attach to the project, and ask lldb to print stack traces.

The problem:

    16:09:02.9522580 Printing backtrace for pid=25276
    16:09:02.9528060 /usr/bin/lldb --source /var/folders/q7/mkzwrzcn7bzf3g2v38f3c1cw0000gn/T/tmp58e75d85.tmp
    16:09:04.6127570 (lldb) command source -s 0 '/var/folders/q7/mkzwrzcn7bzf3g2v38f3c1cw0000gn/T/tmp58e75d85.tmp'
    16:09:04.6130020 Executing commands in '/var/folders/q7/mkzwrzcn7bzf3g2v38f3c1cw0000gn/T/tmp58e75d85.tmp'.
    16:09:04.6130200 (lldb) process attach --pid 25276
    16:09:05.6458750 error: attach failed: Error 1
    16:09:05.7529100 25276 Execution timed out after 1200 seconds and the process was killed.
    16:09:05.7588770 Execution timed out after 1200 seconds.

If any of those commands fail, the subsequent commands aren't executed. This
includes the final "quit" command, which means we end up waiting forever for
lldb to do its thing, when lldb doesn't think it needs to do anything at all.

The fix: pass two different scripts. It turns out subsequent scripts are
executed even if previous scripts fail, so we do the equivalent of:

     lldb --source <attach script> --source <quit script>

And now lldb will quit no matter what the attach script does (it still works
even if the attach script succeeds, in which case we'll ask lldb to quit
twice).
  • Loading branch information
rolfbjarne committed Jul 17, 2020
1 parent 3cd9baf commit a4d19da
Showing 1 changed file with 4 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -250,6 +250,7 @@ static async Task KillTreeAsyncInternal (int pid, ILog log, bool? diagnostics =

foreach (var diagnose_pid in pids) {
var template = Path.GetTempFileName ();
var templateQuit = Path.GetTempFileName ();
try {
var commands = new StringBuilder ();
using (var dbg = new Process ()) {
Expand All @@ -259,15 +260,17 @@ static async Task KillTreeAsyncInternal (int pid, ILog log, bool? diagnostics =
commands.AppendLine ("detach");
commands.AppendLine ("quit");
dbg.StartInfo.FileName = "/usr/bin/lldb";
dbg.StartInfo.Arguments = StringUtils.FormatArguments ("--source", template);
dbg.StartInfo.Arguments = StringUtils.FormatArguments ("--source", template, "--source", templateQuit);
File.WriteAllText (template, commands.ToString ());
File.WriteAllText (templateQuit, "quit\n");

log.WriteLine ($"Printing backtrace for pid={pid}");
await RunAsyncInternal (dbg, log, log, log, TimeSpan.FromSeconds (30), diagnostics: false);
}
} finally {
try {
File.Delete (template);
File.Delete (templateQuit);
} catch {
// Don't care
}
Expand Down

5 comments on commit a4d19da

@xamarin-release-manager
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥 Tests failed catastrophically on VSTS: device tests iOS (Cambridge) 🔥

Not enough free space in the host.

Pipeline on Agent XI-SCARLET-WITCH

@xamarin-release-manager
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥 Tests failed catastrophically on VSTS: device tests tvOS (DDFun) 🔥

Not enough free space in the host.

Pipeline on Agent XAMTESTMAC10

@xamarin-release-manager
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Build was (probably) aborted

🔥 Jenkins job (on internal Jenkins) failed in stage(s) 'Package XM tests, Test run' 🔥

Provisioning succeeded
Build succeeded
✅ Packages built successfully

View packages

API Diff (from stable)
API Diff (from PR only) (no change)
Generator Diff (no change)
🔥 Test run failed 🔥

Test results

54 tests failed, 132 tests passed.

Failed tests

  • monotouch-test/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • monotouch-test/watchOS 32-bits - simulator/Debug (LinkSdk): HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • monotouch-test/watchOS 32-bits - simulator/Debug (static registrar): HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • monotouch-test/watchOS 32-bits - simulator/Release (all optimizations): HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • monotouch-test/watchOS 32-bits - simulator/Debug (all optimizations): HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • framework-test/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • interdependent-binding-projects/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • fsharp/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • introspection/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • dont link/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • dont link/watchOS 32-bits - simulator/Release: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • link all/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • link all/watchOS 32-bits - simulator/Release: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • link sdk/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • link sdk/watchOS 32-bits - simulator/Release: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • mono-native-compat/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • mono-native-unified/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • mscorlib Part 1/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • mscorlib Part 2/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • mscorlib Part 3/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [xUnit] Mono SystemCoreXunit Part 1/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [xUnit] Mono SystemCoreXunit Part 2/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [xUnit] Mono SystemXunit/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemCoreTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemNumericsTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemRuntimeSerializationTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemTransactionsTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemXmlTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemXmlLinqTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemComponentModelDataAnnotationsTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemJsonTests/watchOS 32-bits - simulator/Debug: HarnessException (Harness exception for 'Tests for DA091E03-9997-433A-8402-D3539CB9DB63': System.NullReferenceException: Object reference not set to an instance of an object
    at Xharness.TestTasks.RunTest.BuildAsync () [0x00228] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/TestTasks/RunTest.cs:71
    at Xharness.Jenkins.TestTasks.AggregatedRunSimulatorTask.ExecuteAsync () [0x000d9] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Jenkins/TestTasks/AggregatedRunSimulatorTask.cs:46
    at Microsoft.DotNet.XHarness.iOS.Shared.Tasks.TestTasks.RunInternalAsync () [0x00226] in /Users/builder/jenkins/workspace/xamarin-macios/xamarin-macios/tests/xharness/Microsoft.DotNet.XHarness.iOS.Shared/Tasks/TestTask.cs:283 )
  • [NUnit] Mono SystemSe

@xamarin-release-manager
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔥 Tests failed catastrophically on VSTS: device tests iOS (DDFun) (no summary found). 🔥

Result file /Users/xamarinqa/azdo/_work/8/s\Reports\TestSummary\TestSummary.md not found.

Pipeline on Agent XAMTESTMAC02

@xamarin-release-manager
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

❌ Device tests failed on VSTS: device tests tvOS (Cambridge) ❌

Device tests failed on VSTS: device tests tvOS (Cambridge).

Test results

10 tests failed, 140 tests passed.

Failed tests

  • mono-native-compat/tvOS - device/Debug: Failed
  • mono-native-compat/tvOS - device/AssemblyBuildTarget: SDK framework (debug): Failed
  • mono-native-compat/tvOS - device/AssemblyBuildTarget: SDK framework (debug, profiling): Failed
  • mono-native-compat/tvOS - device/Release: Failed
  • mono-native-compat/tvOS - device/AssemblyBuildTarget: SDK framework (release): Failed
  • mono-native-unified/tvOS - device/Debug: Failed
  • mono-native-unified/tvOS - device/AssemblyBuildTarget: SDK framework (debug): Failed
  • mono-native-unified/tvOS - device/AssemblyBuildTarget: SDK framework (debug, profiling): Failed
  • mono-native-unified/tvOS - device/Release: Failed
  • mono-native-unified/tvOS - device/AssemblyBuildTarget: SDK framework (release): Failed

Pipeline on Agent XAMTESTWIN02

Please sign in to comment.