[appkit] Xcode 14.1 Beta 1-3

[chamons]

No description provided.

[chamons]

Introspection tests are legit failures it seems.

[chamons]

MTouch failure:

[17:18:03.3967870] => Xamarin.Linker.SdkTest.NoLLVMFailuresInWatchOS("System.Net.Http.dll")
[17:18:03.3969400] Unable to compile method 'System.Net.Http.HttpMessageHandler System.Net.Http.HttpClient:CreateDefaultHandler ()' due to: 'Could not load file or assembly 'Xamarin.WatchOS, Version=0.0.0.0, Culture=neutral, PublicKeyToken=84e04ff9cfb79065' or one of its dependencies.'.
[17:18:03.3969630] Unable to compile method 'void System.Net.Http.HttpClientHandler:.ctor ()' due to: 'Could not load file or assembly 'Xamarin.WatchOS, Version=0.0.0.0, Culture=neutral, PublicKeyToken=84e04ff9cfb79065' or one of its dependencies.'

Seems unrelated, rest are sim launch failures.

[chamons]

Fixed @rolfbjarne

[vs-mobiletools-engineering-service2]

✅ API diff for current PR / commit

Legacy Xamarin (No breaking changes)

• iOS (no change detected)
• tvOS (no change detected)
• watchOS (no change detected)
• macOS: vsdrops gist (No breaking changes)

.NET (No breaking changes)

• iOS: (empty diff detected)
• tvOS: (empty diff detected)
• MacCatalyst: (empty diff detected)
• macOS: vsdrops gist (No breaking changes)

❗ API diff vs stable (Breaking changes)

Legacy Xamarin (:heavy_exclamation_mark: Breaking changes :heavy_exclamation_mark:)

• iOS: vsdrops gist (:heavy_exclamation_mark: Breaking changes :heavy_exclamation_mark:)
• tvOS: vsdrops gist (No breaking changes)
• watchOS: vsdrops gist (No breaking changes)
• macOS: vsdrops gist (No breaking changes)

.NET (:heavy_exclamation_mark: Breaking changes :heavy_exclamation_mark:)

• iOS: vsdrops gist (:heavy_exclamation_mark: Breaking changes :heavy_exclamation_mark:)
• tvOS: vsdrops gist (No breaking changes)
• MacCatalyst: vsdrops gist (No breaking changes)
• macOS: vsdrops gist (No breaking changes)
• Microsoft.iOS vs Microsoft.MacCatalyst: vsdrops gist

Legacy Xamarin (stable) vs .NET

• iOS: vsdrops gist
• tvOS: vsdrops gist
• macOS: vsdrops gist

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: a32985c8cad8433d7b971b09334ae696559b4805 [PR build]

[vs-mobiletools-engineering-service2]

📚 [PR Build] Artifacts 📚

Packages generated

View packages

• Microsoft.iOS.Bundle.16.1.18-ci.pr.gh16255.pkg
• Microsoft.iOS.Ref.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Runtime.ios-arm.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Runtime.ios-arm64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Runtime.iossimulator-arm64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Runtime.iossimulator-x64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Runtime.iossimulator-x86.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Sdk.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Templates.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.iOS.Windows.Sdk.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.MacCatalyst.Bundle.16.1.18-ci.pr.gh16255.pkg
• Microsoft.MacCatalyst.Ref.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.MacCatalyst.Runtime.maccatalyst-arm64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.MacCatalyst.Runtime.maccatalyst-x64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.MacCatalyst.Sdk.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.MacCatalyst.Templates.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.macOS.Bundle.13.0.573-ci.pr.gh16255.pkg
• Microsoft.macOS.Ref.13.0.573-ci.pr.gh16255.nupkg
• Microsoft.macOS.Runtime.osx-arm64.13.0.573-ci.pr.gh16255.nupkg
• Microsoft.macOS.Runtime.osx-x64.13.0.573-ci.pr.gh16255.nupkg
• Microsoft.macOS.Sdk.13.0.573-ci.pr.gh16255.nupkg
• Microsoft.macOS.Templates.13.0.573-ci.pr.gh16255.nupkg
• Microsoft.NET.Sdk.iOS.Manifest-6.0.400.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.NET.Sdk.MacCatalyst.Manifest-6.0.400.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.NET.Sdk.macOS.Manifest-6.0.400.13.0.573-ci.pr.gh16255.nupkg
• Microsoft.NET.Sdk.tvOS.Manifest-6.0.400.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.NET.Workload.iOS.16.1.18-ci.pr.gh16255.msi
• Microsoft.tvOS.Bundle.16.1.18-ci.pr.gh16255.pkg
• Microsoft.tvOS.Ref.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.tvOS.Runtime.tvos-arm64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.tvOS.Runtime.tvossimulator-arm64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.tvOS.Runtime.tvossimulator-x64.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.tvOS.Sdk.16.1.18-ci.pr.gh16255.nupkg
• Microsoft.tvOS.Templates.16.1.18-ci.pr.gh16255.nupkg
• xamarin.ios-16.1.0.18.pkg
• xamarin.mac-8.99.1.18.pkg

Pipeline on Agent XAMBOT-1176.Monterey'
Hash: a32985c8cad8433d7b971b09334ae696559b4805 [PR build]

[vs-mobiletools-engineering-service2]

❌ [PR Build] Tests on macOS M1 - Mac Big Sur (11.5) failed ❌

Failed tests are:

• monotouch-test

Pipeline on Agent
Hash: a32985c8cad8433d7b971b09334ae696559b4805 [PR build]

[vs-mobiletools-engineering-service2]

🔥 [CI Build] Test results 🔥

Test results

❌ Tests failed on VSTS: simulator tests

0 tests crashed, 8 tests failed, 220 tests passed.

Failures

❌ bcl tests

1 tests failed, 68 tests passed.

• mscorlib Part 1/iOS Unified 64-bits - simulator/Debug: LaunchTimedOut

Html Report (VSDrops) Download

❌ introspection tests

1 tests failed, 12 tests passed.

• introspection/watchOS 32-bits - simulator/Debug (watchOS 6.0): Crashed Known issue: HE0038)

Html Report (VSDrops) Download

❌ linker tests

2 tests failed, 63 tests passed.

• link all/iOS Unified 64-bits - simulator/Debug [dotnet]: LaunchTimedOut
• trimmode copy/iOS Unified 64-bits - simulator/Release [dotnet]: LaunchTimedOut

Html Report (VSDrops) Download

❌ mononative tests

1 tests failed, 11 tests passed.

• mono-native-unified/iOS Unified 64-bits - simulator/Debug: LaunchTimedOut

Html Report (VSDrops) Download

❌ monotouch tests

2 tests failed, 21 tests passed.

• monotouch-test/iOS Unified 64-bits - simulator/Debug: LaunchTimedOut
• monotouch-test/iOS Unified 64-bits - simulator/Debug (static registrar): LaunchTimedOut

Html Report (VSDrops) Download

❌ mtouch tests

1 tests failed, 0 tests passed.

• MTouch tests/NUnit: Failed (Execution failed with exit code 1)

Html Report (VSDrops) Download

Successes

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests: All 1 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 7 tests passed. Html Report (VSDrops) Download
✅ framework: All 8 tests passed. Html Report (VSDrops) Download
✅ generator: All 2 tests passed. Html Report (VSDrops) Download
✅ interdependent_binding_projects: All 7 tests passed. Html Report (VSDrops) Download
✅ install_source: All 1 tests passed. Html Report (VSDrops) Download
✅ mac_binding_project: All 1 tests passed. Html Report (VSDrops) Download
✅ mmp: All 2 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ xammac: All 3 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 8 tests passed. Html Report (VSDrops) Download
✅ xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: [PR build]

[chamons]

Most of the test failures are more timeouts, the one non-timeout was Xamarin.MTouch.HttpClientHandler(null,"NSUrlSessionHandler"): which I do not believe for a second I broke with AppKit bindings. @mandel-macaque FYI.