[Perf] Changes at 4/8/2022 8:38:01 PM

[performanceautofiler]

Run Information

Architecture	arm64
OS	Windows 10.0.19041
Baseline	8e8a62156ea459945b1d953c4fbe950d276bbc9b
Compare	d09f42d1075ce9cedd0101df07c6f4861e03901c
Diff	Diff

Regressions in System.Reflection.Attributes

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
GetCustomAttributesClassHitInherit - Duration of single invocation	1.72 μs	1.87 μs	1.09	0.18	False
GetCustomAttributesMethodBaseHitInherit - Duration of single invocation	1.55 μs	1.72 μs	1.11	0.20	False
GetCustomAttributesClassHit - Duration of single invocation	1.51 μs	1.67 μs	1.10	0.21	False
GetCustomAttributesMethodOverrideHit - Duration of single invocation	1.57 μs	1.71 μs	1.09	0.17	False
GetCustomAttributesMethodOverrideMissInherit - Duration of single invocation	1.56 μs	1.78 μs	1.14	0.17	False
GetCustomAttributesMethodOverrideMiss - Duration of single invocation	1.48 μs	1.66 μs	1.12	0.22	False
GetCustomAttributesMethodBaseHit - Duration of single invocation	1.47 μs	1.64 μs	1.11	0.16	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Attributes*'

Payloads

Baseline
Compare

Histogram

System.Reflection.Attributes.GetCustomAttributesClassHitInherit

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.8740401482458247 > 1.8272217808235034.
IsChangePoint: Marked as a change because one of 12/6/2021 9:29:36 PM, 2/1/2022 4:18:38 AM, 4/8/2022 2:40:20 PM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -10.835991030260937 (T) = (0 -1868.3106636275443) / Math.Sqrt((1545.0613601446294 / (25)) + (1510.6710458449816 / (18))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (18) - 2, .025) and -0.07528632506066761 = (1737.5006266560065 - 1868.3106636275443) / 1737.5006266560065 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodBaseHitInherit

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.7178378216471284 > 1.646529202513957.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 4/8/2022 2:40:20 PM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -8.065676716915442 (T) = (0 -1724.6951693008523) / Math.Sqrt((2528.3128115010227 / (25)) + (3296.9247407767793 / (18))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (25) + (18) - 2, .025) and -0.08560195644252133 = (1588.6993930561957 - 1724.6951693008523) / 1588.6993930561957 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesClassHit

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.6680348039215687 > 1.5654193070877562.
IsChangePoint: Marked as a change because one of 12/27/2021 6:47:12 AM, 2/11/2022 11:08:57 PM, 2/19/2022 7:20:29 AM, 3/2/2022 12:55:43 AM, 3/17/2022 6:54:53 PM, 4/8/2022 8:30:12 AM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -12.944430380669937 (T) = (0 -1629.242412155313) / Math.Sqrt((787.5806778583169 / (24)) + (1117.676374139246 / (19))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (19) - 2, .025) and -0.08231842285342342 = (1505.326323338357 - 1629.242412155313) / 1505.326323338357 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideHit

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.7090809521202832 > 1.6294696714518333.
IsChangePoint: Marked as a change because one of 12/27/2021 6:07:34 PM, 3/3/2022 6:12:26 AM, 3/17/2022 6:54:53 PM, 4/10/2022 4:58:35 AM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -9.147186701790773 (T) = (0 -1691.6171454692496) / Math.Sqrt((1829.804333085268 / (31)) + (1418.537774189348 / (12))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (31) + (12) - 2, .025) and -0.07757286482429564 = (1569.840147881858 - 1691.6171454692496) / 1569.840147881858 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideMissInherit

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.780615337750362 > 1.651116760233726.
IsChangePoint: Marked as a change because one of 3/17/2022 6:54:53 PM, 4/8/2022 8:30:12 AM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -9.474826272279177 (T) = (0 -1724.7958224942156) / Math.Sqrt((1688.3412832716106 / (24)) + (2068.00577866574 / (19))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (19) - 2, .025) and -0.07937086135449266 = (1597.9640402092984 - 1724.7958224942156) / 1597.9640402092984 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodOverrideMiss

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.658519838533695 > 1.563281779106543.
IsChangePoint: Marked as a change because one of 12/27/2021 6:47:12 AM, 3/3/2022 4:26:18 PM, 3/17/2022 6:54:53 PM, 4/8/2022 8:30:12 AM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -8.453414174035897 (T) = (0 -1634.5992266312674) / Math.Sqrt((1859.7903812381662 / (24)) + (1883.4185575972717 / (19))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (24) + (19) - 2, .025) and -0.07380110655476432 = (1522.2551147072245 - 1634.5992266312674) / 1522.2551147072245 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Reflection.Attributes.GetCustomAttributesMethodBaseHit

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 1.643754393827551 > 1.575168235460795.
IsChangePoint: Marked as a change because one of 12/27/2021 6:47:12 AM, 3/14/2022 7:02:48 PM, 3/17/2022 6:54:53 PM, 4/9/2022 2:03:45 PM, 4/13/2022 10:02:29 PM falls between 4/5/2022 2:02:34 AM and 4/13/2022 10:02:29 PM.
IsRegressionStdDev: Marked as regression because -10.422074066216387 (T) = (0 -1660.3770827585395) / Math.Sqrt((2829.3202626492966 / (29)) + (646.7422449037113 / (14))) is less than -2.019540970439573 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (29) + (14) - 2, .025) and -0.08138507688374345 = (1535.4170482389982 - 1660.3770827585395) / 1535.4170482389982 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository