[Perf] Linux/x64: 23 Regressions on 3/21/2024 5:38:38 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Globalization.Tests.StringSearch

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.75 μs	2.05 μs	1.17	0.08	False
IsPrefix_FirstHalf - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	877.07 ns	982.31 ns	1.12	0.04	False
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.75 μs	2.03 μs	1.16	0.07	False
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.76 μs	2.03 μs	1.16	0.07	False
IsSuffix_SecondHalf - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	885.59 ns	979.66 ns	1.11	0.06	False
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.76 μs	2.04 μs	1.16	0.05	False
IsSuffix_SecondHalf - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	875.59 ns	974.82 ns	1.11	0.08	False
IsPrefix_FirstHalf - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	876.27 ns	976.11 ns	1.11	0.07	False
LastIndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.76 μs	2.03 μs	1.16	0.08	False
IndexOf_Word_NotFound - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.75 μs	2.03 μs	1.16	0.10	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Globalization.Tests.StringSearch*'

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (, None, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IsSuffix_SecondHalf(Options: (en-US, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IsPrefix_FirstHalf(Options: (en-US, IgnoreCase, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, IgnoreNonSpace, False))

ETL Files

Histogram

JIT Disasms

System.Globalization.Tests.StringSearch.IndexOf_Word_NotFound(Options: (en-US, None, False))

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in Benchmark.GetChildKeysTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
AddChainedConfigurationEmpty - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	71.60 ms	86.86 ms	1.21	0.19	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchmark.GetChildKeysTests*'

Benchmark.GetChildKeysTests.AddChainedConfigurationEmpty

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
Max_Vector - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	25.32 μs	43.95 μs	1.74	0.14	True
Max_Vector - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	1.24 μs	1.80 μs	1.45	0.13	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.Max_Vector(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Int32>.Max_Vector(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in BenchmarksGame.FannkuchRedux_9

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
RunBench - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	4.31 secs	4.66 secs	1.08	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'BenchmarksGame.FannkuchRedux_9*'

BenchmarksGame.FannkuchRedux_9.RunBench(n: 11, expectedSum: 556355)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Collections.Tests.Perf_BitArray

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BitArrayLeftShift - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	654.15 ns	746.00 ns	1.14	0.07	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.Tests.Perf_BitArray*'

System.Collections.Tests.Perf_BitArray.BitArrayLeftShift(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in Span.Sorting

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BubbleSortArray - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	529.58 μs	600.69 μs	1.13	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Span.Sorting*'

Span.Sorting.BubbleSortArray(Size: 512)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in Span.IndexerBench

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
KnownSizeCtor - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	2.41 μs	2.95 μs	1.22	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Span.IndexerBench*'

Span.IndexerBench.KnownSizeCtor(length: 1024)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in ByteMark

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
BenchAssignJagged - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	2.85 secs	3.06 secs	1.08	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'ByteMark*'

ByteMark.BenchAssignJagged

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Net.Primitives.Tests.IPAddressPerformanceTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
TryFormat - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	130.46 ns	148.70 ns	1.14	0.27	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Net.Primitives.Tests.IPAddressPerformanceTests*'

System.Net.Primitives.Tests.IPAddressPerformanceTests.TryFormat(address: 143.24.20.36)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Memory.ReadOnlySpan

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexOfString - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	823.56 ns	920.16 ns	1.12	0.05	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySpan*'

System.Memory.ReadOnlySpan.IndexOfString(input: "AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAXAAAAAAAAAAAAAAAAAAAAAAAAAAAAA", value: "x", comparisonType: InvariantCultureIgnoreCase)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
MaxMagnitude_Scalar - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	20.49 μs	22.64 μs	1.10	0.37	False
MaxMagnitude_Scalar - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	436.61 μs	469.53 μs	1.08	0.40	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>*'

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.MaxMagnitude_Scalar(BufferLength: 128)

ETL Files

Histogram

JIT Disasms

System.Numerics.Tensors.Tests.Perf_NumberTensorPrimitives<Double>.MaxMagnitude_Scalar(BufferLength: 3079)

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

---

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	09608dffab3bf15bf05039b95cea66db42b189aa
Compare	af6a9f3dd4bd8d5ac9aad06f35f8242a65888b81
Diff	Diff
Configs	CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
IndexerCheckBoundCheckHoist - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	162.86 ns	191.28 ns	1.17	0.01	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

System.Tests.Perf_String.IndexerCheckBoundCheckHoist

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[radekdoulik]

range is dotnet/runtime@e12e2fa...5e8edc8

@kg, could it be dotnet/runtime#99706?

[kg]

range is dotnet/runtime@e12e2fa...5e8edc8

@kg, could it be dotnet/runtime#99706?

Could be, but that isn't an optimization that would normally regress this. It could be code performance jitter, we sometimes see that an optimization makes firefox faster while chrome gets slower, due to branch prediction or icache residency getting perturbed, etc.