[Profiler] Disable flaky check #6367

gleocadie · 2024-11-28T07:08:31Z

Summary of changes

Disable check that causes flakiness.

Reason for change

Flakiness induced by this check might be due to a bug in libunwind. Since we do not use the OldWay anymore, we can skip that check.

Implementation details

Keep the check for documentation
Disable the check

Test coverage

Other details

datadog-ddstaging · 2024-11-28T07:32:44Z

Datadog Report

Branch report: gleocadie/disable-flaky-check
Commit report: dbb73b4
Test service: dd-trace-dotnet

✅ 0 Failed, 452081 Passed, 3215 Skipped, 21h 12m 23.24s Total Time

andrewlock · 2024-11-28T07:38:40Z

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

Welch test with statistical test for significance of 5%
Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6367) - mean (69ms)  : 66, 71
     .   : milestone, 69,
    master - mean (69ms)  : 66, 72
     .   : milestone, 69,

    section CallTarget+Inlining+NGEN
    This PR (6367) - mean (980ms)  : 953, 1008
     .   : milestone, 980,
    master - mean (980ms)  : 954, 1006
     .   : milestone, 980,

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6367) - mean (108ms)  : 105, 110
     .   : milestone, 108,
    master - mean (108ms)  : 106, 110
     .   : milestone, 108,

    section CallTarget+Inlining+NGEN
    This PR (6367) - mean (679ms)  : 663, 695
     .   : milestone, 679,
    master - mean (680ms)  : 667, 694
     .   : milestone, 680,

gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6367) - mean (91ms)  : 89, 93
     .   : milestone, 91,
    master - mean (92ms)  : 90, 94
     .   : milestone, 92,

    section CallTarget+Inlining+NGEN
    This PR (6367) - mean (629ms)  : 609, 649
     .   : milestone, 629,
    master - mean (634ms)  : 618, 650
     .   : milestone, 634,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6367) - mean (191ms)  : 187, 195
     .   : milestone, 191,
    master - mean (190ms)  : 186, 195
     .   : milestone, 190,

    section CallTarget+Inlining+NGEN
    This PR (6367) - mean (1,091ms)  : 1060, 1123
     .   : milestone, 1091,
    master - mean (1,096ms)  : 1054, 1137
     .   : milestone, 1096,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6367) - mean (276ms)  : 272, 280
     .   : milestone, 276,
    master - mean (276ms)  : 272, 280
     .   : milestone, 276,

    section CallTarget+Inlining+NGEN
    This PR (6367) - mean (872ms)  : 840, 904
     .   : milestone, 872,
    master - mean (869ms)  : 842, 895
     .   : milestone, 869,

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6367) - mean (268ms)  : 261, 274
     .   : milestone, 268,
    master - mean (266ms)  : 262, 270
     .   : milestone, 266,

    section CallTarget+Inlining+NGEN
    This PR (6367) - mean (845ms)  : 813, 877
     .   : milestone, 845,
    master - mean (855ms)  : 817, 892
     .   : milestone, 855,

andrewlock · 2024-11-28T08:26:52Z

Benchmarks Report for tracer 🐌

Benchmarks for #6367 compared to master:

2 benchmarks are slower, with geometric mean 1.186
All benchmarks have the same allocations

The following thresholds were used for comparing the benchmark speeds:

Mann–Whitney U test with statistical test for significance of 5%
Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`StartStopWithChild`	net6.0	7.92μs	44.1ns	279ns	0.012	0.00399	0	5.61 KB
master	`StartStopWithChild`	netcoreapp3.1	9.93μs	47.6ns	202ns	0.0196	0.00978	0	5.8 KB
master	`StartStopWithChild`	net472	16.3μs	37.8ns	146ns	1.05	0.322	0.099	6.22 KB
#6367	`StartStopWithChild`	net6.0	7.75μs	40.4ns	232ns	0.0117	0.00389	0	5.61 KB
#6367	`StartStopWithChild`	netcoreapp3.1	9.89μs	54.6ns	341ns	0.0148	0.00493	0	5.8 KB
#6367	`StartStopWithChild`	net472	16.3μs	71.6ns	277ns	1.04	0.297	0.0964	6.2 KB

Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	471μs	328ns	1.23μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	658μs	472ns	1.83μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	net472	835μs	515ns	1.86μs	0.417	3.3 KB
#6367	`WriteAndFlushEnrichedTraces`	net6.0	483μs	390ns	1.51μs	0	2.7 KB
#6367	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	660μs	434ns	1.68μs	0	2.7 KB
#6367	`WriteAndFlushEnrichedTraces`	net472	852μs	527ns	1.97μs	0.425	3.3 KB

Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendRequest`	net6.0	152μs	928ns	9.28μs	0.224	14.47 KB
master	`SendRequest`	netcoreapp3.1	172μs	1.01μs	9.23μs	0.159	17.27 KB
master	`SendRequest`	net472	0.00056ns	0.00032ns	0.0012ns	0	0 b
#6367	`SendRequest`	net6.0	150μs	869ns	8.15μs	0.137	14.47 KB
#6367	`SendRequest`	netcoreapp3.1	170μs	1.1μs	10.7μs	0.161	17.27 KB
#6367	`SendRequest`	net472	0.00138ns	0.000745ns	0.00279ns	0	0 b

Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	557μs	2.61μs	10.4μs	0.551	0	0	41.66 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	698μs	3.54μs	15.4μs	0.334	0	0	41.82 KB
master	`WriteAndFlushEnrichedTraces`	net472	909μs	3.73μs	14.4μs	8.3	2.62	0.437	53.31 KB
#6367	`WriteAndFlushEnrichedTraces`	net6.0	576μs	2.47μs	9.9μs	0.576	0	0	41.66 KB
#6367	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	678μs	3.5μs	16.4μs	0.338	0	0	41.78 KB
#6367	`WriteAndFlushEnrichedTraces`	net472	904μs	3.68μs	13.8μs	8.27	2.3	0.46	53.26 KB

Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`ExecuteNonQuery`	net6.0	1.28μs	1.31ns	5.09ns	0.0141	0	1.02 KB
master	`ExecuteNonQuery`	netcoreapp3.1	1.78μs	1.75ns	6.07ns	0.0135	0	1.02 KB
master	`ExecuteNonQuery`	net472	2.05μs	1.99ns	7.72ns	0.156	0.00103	987 B
#6367	`ExecuteNonQuery`	net6.0	1.34μs	1.54ns	5.96ns	0.0148	0	1.02 KB
#6367	`ExecuteNonQuery`	netcoreapp3.1	1.72μs	0.998ns	3.87ns	0.0129	0	1.02 KB
#6367	`ExecuteNonQuery`	net472	2.09μs	1.49ns	5.77ns	0.156	0.00104	987 B

Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`CallElasticsearch`	net6.0	1.25μs	1.55ns	5.81ns	0.0138	976 B
master	`CallElasticsearch`	netcoreapp3.1	1.58μs	0.53ns	1.91ns	0.0128	976 B
master	`CallElasticsearch`	net472	2.52μs	1.25ns	4.83ns	0.157	995 B
master	`CallElasticsearchAsync`	net6.0	1.34μs	0.399ns	1.49ns	0.0133	952 B
master	`CallElasticsearchAsync`	netcoreapp3.1	1.76μs	0.578ns	2.24ns	0.0137	1.02 KB
master	`CallElasticsearchAsync`	net472	2.69μs	1.46ns	5.66ns	0.167	1.05 KB
#6367	`CallElasticsearch`	net6.0	1.24μs	0.69ns	2.39ns	0.0136	976 B
#6367	`CallElasticsearch`	netcoreapp3.1	1.52μs	1.74ns	6.51ns	0.0128	976 B
#6367	`CallElasticsearch`	net472	2.59μs	1.32ns	5.13ns	0.158	995 B
#6367	`CallElasticsearchAsync`	net6.0	1.3μs	0.746ns	2.89ns	0.0136	952 B
#6367	`CallElasticsearchAsync`	netcoreapp3.1	1.74μs	0.757ns	2.83ns	0.0139	1.02 KB
#6367	`CallElasticsearchAsync`	net472	2.57μs	1.13ns	4.39ns	0.166	1.05 KB

Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`ExecuteAsync`	net6.0	1.24μs	0.792ns	3.07ns	0.0131	952 B
master	`ExecuteAsync`	netcoreapp3.1	1.64μs	1.05ns	3.93ns	0.0123	952 B
master	`ExecuteAsync`	net472	1.81μs	0.825ns	3.19ns	0.145	915 B
#6367	`ExecuteAsync`	net6.0	1.35μs	0.831ns	3.22ns	0.0129	952 B
#6367	`ExecuteAsync`	netcoreapp3.1	1.56μs	1.11ns	4.31ns	0.0124	952 B
#6367	`ExecuteAsync`	net472	1.86μs	0.778ns	3.01ns	0.145	915 B

Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendAsync`	net6.0	4.46μs	2.73ns	10.2ns	0.0333	2.31 KB
master	`SendAsync`	netcoreapp3.1	5.36μs	3.47ns	13.4ns	0.0374	2.85 KB
master	`SendAsync`	net472	7.27μs	1.96ns	7.58ns	0.494	3.12 KB
#6367	`SendAsync`	net6.0	4.4μs	3.46ns	13.4ns	0.0331	2.31 KB
#6367	`SendAsync`	netcoreapp3.1	5.19μs	1.18ns	4.25ns	0.0364	2.85 KB
#6367	`SendAsync`	net472	7.36μs	2.13ns	8.26ns	0.493	3.12 KB

Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	1.59μs	0.655ns	2.45ns	0.0231	1.64 KB
master	`EnrichedLog`	netcoreapp3.1	2.19μs	0.74ns	2.77ns	0.0218	1.64 KB
master	`EnrichedLog`	net472	2.6μs	1.13ns	4.36ns	0.248	1.57 KB
#6367	`EnrichedLog`	net6.0	1.47μs	0.872ns	3.26ns	0.0227	1.64 KB
#6367	`EnrichedLog`	netcoreapp3.1	2.27μs	0.884ns	3.31ns	0.0215	1.64 KB
#6367	`EnrichedLog`	net472	2.45μs	1.55ns	6.01ns	0.249	1.57 KB

Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`EnrichedLog`	net6.0	119μs	151ns	583ns	0.0604	0	4.28 KB
master	`EnrichedLog`	netcoreapp3.1	125μs	124ns	481ns	0	0	4.28 KB
master	`EnrichedLog`	net472	151μs	173ns	671ns	0.681	0.227	4.46 KB
#6367	`EnrichedLog`	net6.0	118μs	157ns	609ns	0	0	4.28 KB
#6367	`EnrichedLog`	netcoreapp3.1	124μs	120ns	467ns	0	0	4.28 KB
#6367	`EnrichedLog`	net472	153μs	101ns	392ns	0.687	0.229	4.46 KB

Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	3.04μs	0.99ns	3.7ns	0.0303	2.2 KB
master	`EnrichedLog`	netcoreapp3.1	4.13μs	5.73ns	22.2ns	0.0289	2.2 KB
master	`EnrichedLog`	net472	5.07μs	4.9ns	18.3ns	0.319	2.02 KB
#6367	`EnrichedLog`	net6.0	3.08μs	1.03ns	4.01ns	0.031	2.2 KB
#6367	`EnrichedLog`	netcoreapp3.1	4.05μs	8.04ns	30.1ns	0.03	2.2 KB
#6367	`EnrichedLog`	net472	4.8μs	0.952ns	3.56ns	0.321	2.02 KB

Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendReceive`	net6.0	1.48μs	1.02ns	3.95ns	0.0161	1.14 KB
master	`SendReceive`	netcoreapp3.1	1.71μs	0.513ns	1.99ns	0.0154	1.14 KB
master	`SendReceive`	net472	2.06μs	1.73ns	6.72ns	0.183	1.16 KB
#6367	`SendReceive`	net6.0	1.45μs	1.21ns	4.67ns	0.016	1.14 KB
#6367	`SendReceive`	netcoreapp3.1	1.79μs	1.3ns	5.05ns	0.0152	1.14 KB
#6367	`SendReceive`	net472	2.1μs	0.955ns	3.7ns	0.183	1.16 KB

Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	2.77μs	4.56ns	17.7ns	0.0223	1.6 KB
master	`EnrichedLog`	netcoreapp3.1	3.89μs	1.35ns	5.05ns	0.0215	1.65 KB
master	`EnrichedLog`	net472	4.3μs	1.98ns	7.67ns	0.322	2.04 KB
#6367	`EnrichedLog`	net6.0	2.7μs	0.956ns	3.7ns	0.0216	1.6 KB
#6367	`EnrichedLog`	netcoreapp3.1	3.81μs	2.12ns	7.94ns	0.0211	1.65 KB
#6367	`EnrichedLog`	net472	4.4μs	1.38ns	5.18ns	0.323	2.04 KB

Benchmarks.Trace.SpanBenchmark - Slower ⚠️ Same allocations ✔️

Slower ⚠️ in #6367

Benchmark	diff/base	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0	1.220	393.88	480.58

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`StartFinishSpan`	net6.0	394ns	0.459ns	1.78ns	0.00807	576 B
master	`StartFinishSpan`	netcoreapp3.1	611ns	1.25ns	4.68ns	0.00761	576 B
master	`StartFinishSpan`	net472	649ns	1.5ns	5.8ns	0.0917	578 B
master	`StartFinishScope`	net6.0	502ns	0.695ns	2.69ns	0.00966	696 B
master	`StartFinishScope`	netcoreapp3.1	758ns	1.67ns	6.24ns	0.00922	696 B
master	`StartFinishScope`	net472	866ns	2.06ns	7.97ns	0.104	658 B
#6367	`StartFinishSpan`	net6.0	482ns	0.866ns	3.35ns	0.00804	576 B
#6367	`StartFinishSpan`	netcoreapp3.1	566ns	0.902ns	3.49ns	0.00761	576 B
#6367	`StartFinishSpan`	net472	648ns	0.834ns	3.23ns	0.0918	578 B
#6367	`StartFinishScope`	net6.0	532ns	1.2ns	4.66ns	0.00961	696 B
#6367	`StartFinishScope`	netcoreapp3.1	685ns	0.93ns	3.6ns	0.00953	696 B
#6367	`StartFinishScope`	net472	891ns	1.79ns	6.92ns	0.104	658 B

Benchmarks.Trace.TraceAnnotationsBenchmark - Slower ⚠️ Same allocations ✔️

Slower ⚠️ in #6367

Benchmark	diff/base	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0	1.153	594.18	684.92

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`RunOnMethodBegin`	net6.0	594ns	0.761ns	2.95ns	0.00961	696 B
master	`RunOnMethodBegin`	netcoreapp3.1	952ns	1.56ns	6.06ns	0.00949	696 B
master	`RunOnMethodBegin`	net472	1.16μs	2.5ns	9.66ns	0.104	658 B
#6367	`RunOnMethodBegin`	net6.0	687ns	2.59ns	10ns	0.00994	696 B
#6367	`RunOnMethodBegin`	netcoreapp3.1	958ns	1.03ns	3.85ns	0.00909	696 B
#6367	`RunOnMethodBegin`	net472	1.1μs	1.72ns	6.67ns	0.104	658 B

andrewlock

Thanks!

chrisnas

LGTM

andrewlock · 2024-11-28T14:33:21Z

Throughput/Crank Report ⚡

Throughput results for AspNetCoreSimpleController comparing the following branches/commits:

Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.

Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!

gantt
    title Throughput Linux x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6367) (11.306M)   : 0, 11305577
    master (11.361M)   : 0, 11361081
    benchmarks/2.9.0 (11.033M)   : 0, 11032866

    section Automatic
    This PR (6367) (7.304M)   : 0, 7304407
    master (7.386M)   : 0, 7386114
    benchmarks/2.9.0 (7.786M)   : 0, 7785853

    section Trace stats
    master (7.662M)   : 0, 7662233

    section Manual
    master (11.190M)   : 0, 11189983

    section Manual + Automatic
    This PR (6367) (6.838M)   : 0, 6838149
    master (6.815M)   : 0, 6814740

    section DD_TRACE_ENABLED=0
    master (10.320M)   : 0, 10319505

gantt
    title Throughput Linux arm64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6367) (9.255M)   : 0, 9254552
    master (9.527M)   : 0, 9527423
    benchmarks/2.9.0 (9.495M)   : 0, 9494821

    section Automatic
    This PR (6367) (6.235M)   : 0, 6234699
    master (6.264M)   : 0, 6263949

    section Trace stats
    master (6.510M)   : 0, 6509886

    section Manual
    master (9.336M)   : 0, 9335765

    section Manual + Automatic
    This PR (6367) (5.825M)   : 0, 5824561
    master (5.881M)   : 0, 5880843

    section DD_TRACE_ENABLED=0
    master (8.790M)   : 0, 8790191

gantt
    title Throughput Windows x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6367) (10.232M)   : 0, 10232317
    master (10.062M)   : 0, 10061771
    benchmarks/2.9.0 (10.020M)   : 0, 10019592

    section Automatic
    This PR (6367) (6.513M)   : 0, 6512696
    master (6.546M)   : 0, 6545951
    benchmarks/2.9.0 (7.255M)   : 0, 7255257

    section Trace stats
    master (7.305M)   : 0, 7305404

    section Manual
    master (10.146M)   : 0, 10146170

    section Manual + Automatic
    This PR (6367) (6.289M)   : 0, 6289280
    master (6.140M)   : 0, 6140263

    section DD_TRACE_ENABLED=0
    master (9.363M)   : 0, 9362965

gleocadie requested a review from a team as a code owner November 28, 2024 07:08

github-actions bot added the area:profiler Issues related to the continous-profiler label Nov 28, 2024

andrewlock approved these changes Nov 28, 2024

View reviewed changes

Disable flaky check

dbb73b4

gleocadie force-pushed the gleocadie/disable-flaky-check branch from 46e9ec3 to dbb73b4 Compare November 28, 2024 10:41

chrisnas approved these changes Nov 28, 2024

View reviewed changes

gleocadie merged commit 0070285 into master Nov 29, 2024
69 of 72 checks passed

gleocadie deleted the gleocadie/disable-flaky-check branch November 29, 2024 16:35

github-actions bot added this to the vNext-v3 milestone Nov 29, 2024

veerbia pushed a commit that referenced this pull request Dec 16, 2024

[Profiler] Disable flaky check (#6367)

4c96771

andrewlock added area:tests unit tests, integration tests and removed area:profiler Issues related to the continous-profiler labels Dec 18, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Profiler] Disable flaky check #6367

[Profiler] Disable flaky check #6367

gleocadie commented Nov 28, 2024

datadog-ddstaging bot commented Nov 28, 2024 •

edited

Loading

andrewlock commented Nov 28, 2024 •

edited

Loading

andrewlock commented Nov 28, 2024 •

edited

Loading

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Slower ⚠️ in #6367

Raw results

Slower ⚠️ in #6367

Raw results

andrewlock left a comment

chrisnas left a comment

andrewlock commented Nov 28, 2024

[Profiler] Disable flaky check #6367

[Profiler] Disable flaky check #6367

Conversation

gleocadie commented Nov 28, 2024

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

datadog-ddstaging bot commented Nov 28, 2024 • edited Loading

Datadog Report

andrewlock commented Nov 28, 2024 • edited Loading

Execution-Time Benchmarks Report ⏱️

andrewlock commented Nov 28, 2024 • edited Loading

Benchmarks Report for tracer 🐌

Benchmark details

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Slower ⚠️ in #6367

Raw results

Slower ⚠️ in #6367

Raw results

andrewlock left a comment

Choose a reason for hiding this comment

chrisnas left a comment

Choose a reason for hiding this comment

andrewlock commented Nov 28, 2024

Throughput/Crank Report ⚡

datadog-ddstaging bot commented Nov 28, 2024 •

edited

Loading

andrewlock commented Nov 28, 2024 •

edited

Loading

andrewlock commented Nov 28, 2024 •

edited

Loading