allow running exploration tests on mac #6474

vandonr · 2024-12-20T09:55:16Z

Summary of changes

platform was not part of the parameters, so it only tried with the default value (x64), which didn't work on mac

Reason for change

I want to be able to run exploration tests locally

Implementation details

Test coverage

Other details

datadog-ddstaging · 2024-12-20T10:16:55Z

Datadog Report

Branch report: vandonr/explo
Commit report: 5c0021c
Test service: dd-trace-dotnet

✅ 0 Failed, 470168 Passed, 3694 Skipped, 33h 1m 53.11s Total Time

andrewlock

Awesome, thanks!

andrewlock · 2024-12-20T10:37:23Z

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing the following branches/commits:

Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:

Welch test with statistical test for significance of 5%
Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6474) - mean (68ms)  : 65, 71
     .   : milestone, 68,
    master - mean (69ms)  : 65, 72
     .   : milestone, 69,

    section CallTarget+Inlining+NGEN
    This PR (6474) - mean (978ms)  : 950, 1005
     .   : milestone, 978,
    master - mean (977ms)  : 950, 1003
     .   : milestone, 977,

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6474) - mean (107ms)  : 104, 109
     .   : milestone, 107,
    master - mean (108ms)  : 104, 112
     .   : milestone, 108,

    section CallTarget+Inlining+NGEN
    This PR (6474) - mean (676ms)  : 662, 691
     .   : milestone, 676,
    master - mean (679ms)  : 665, 692
     .   : milestone, 679,

gantt
    title Execution time (ms) FakeDbCommand (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6474) - mean (91ms)  : 89, 93
     .   : milestone, 91,
    master - mean (91ms)  : 89, 94
     .   : milestone, 91,

    section CallTarget+Inlining+NGEN
    This PR (6474) - mean (635ms)  : 615, 654
     .   : milestone, 635,
    master - mean (636ms)  : 620, 652
     .   : milestone, 636,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6474) - mean (193ms)  : 190, 196
     .   : milestone, 193,
    master - mean (194ms)  : 189, 198
     .   : milestone, 194,

    section CallTarget+Inlining+NGEN
    This PR (6474) - mean (1,101ms)  : 1074, 1128
     .   : milestone, 1101,
    master - mean (1,097ms)  : 1072, 1122
     .   : milestone, 1097,

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6474) - mean (278ms)  : 272, 285
     .   : milestone, 278,
    master - mean (278ms)  : 274, 282
     .   : milestone, 278,

    section CallTarget+Inlining+NGEN
    This PR (6474) - mean (874ms)  : 835, 912
     .   : milestone, 874,
    master - mean (871ms)  : 842, 901
     .   : milestone, 871,

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6) 
    dateFormat  X
    axisFormat %s
    todayMarker off
    section Baseline
    This PR (6474) - mean (266ms)  : 262, 270
     .   : milestone, 266,
    master - mean (266ms)  : 263, 270
     .   : milestone, 266,

    section CallTarget+Inlining+NGEN
    This PR (6474) - mean (847ms)  : 815, 880
     .   : milestone, 847,
    master - mean (850ms)  : 817, 884
     .   : milestone, 850,

andrewlock · 2024-12-20T11:47:23Z

Throughput/Crank Report ⚡

Throughput results for AspNetCoreSimpleController comparing the following branches/commits:

Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.

Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!

gantt
    title Throughput Linux x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6474) (11.139M)   : 0, 11139190
    master (11.166M)   : 0, 11165619
    benchmarks/2.9.0 (11.033M)   : 0, 11032866

    section Automatic
    This PR (6474) (7.304M)   : 0, 7304460
    master (7.232M)   : 0, 7232435
    benchmarks/2.9.0 (7.786M)   : 0, 7785853

    section Trace stats
    master (7.555M)   : 0, 7555239

    section Manual
    master (11.218M)   : 0, 11218357

    section Manual + Automatic
    This PR (6474) (6.731M)   : 0, 6730708
    master (6.695M)   : 0, 6694720

    section DD_TRACE_ENABLED=0
    master (10.195M)   : 0, 10194994

gantt
    title Throughput Linux arm64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6474) (9.436M)   : 0, 9436019
    master (9.350M)   : 0, 9350086
    benchmarks/2.9.0 (9.495M)   : 0, 9494821

    section Automatic
    This PR (6474) (6.392M)   : 0, 6391857
    master (6.223M)   : 0, 6222880

    section Trace stats
    master (6.644M)   : 0, 6644302

    section Manual
    master (9.490M)   : 0, 9490052

    section Manual + Automatic
    This PR (6474) (5.914M)   : 0, 5913586
    master (5.826M)   : 0, 5826117

    section DD_TRACE_ENABLED=0
    master (8.806M)   : 0, 8806093

gantt
    title Throughput Windows x64 (Total requests) 
    dateFormat  X
    axisFormat %s
    section Baseline
    This PR (6474) (9.947M)   : 0, 9947304
    master (10.038M)   : 0, 10038108
    benchmarks/2.9.0 (10.020M)   : 0, 10019592

    section Automatic
    This PR (6474) (6.386M)   : crit ,0, 6385666
    master (6.759M)   : 0, 6759031
    benchmarks/2.9.0 (7.255M)   : 0, 7255257

    section Trace stats
    master (7.327M)   : 0, 7327150

    section Manual
    master (10.148M)   : 0, 10147695

    section Manual + Automatic
    This PR (6474) (5.990M)   : 0, 5990133
    master (6.270M)   : 0, 6270298

    section DD_TRACE_ENABLED=0
    master (9.572M)   : 0, 9571995

andrewlock · 2024-12-20T13:11:44Z

Benchmarks Report for tracer 🐌

Benchmarks for #6474 compared to master:

2 benchmarks are faster, with geometric mean 1.125
3 benchmarks are slower, with geometric mean 1.131
All benchmarks have the same allocations

The following thresholds were used for comparing the benchmark speeds:

Mann–Whitney U test with statistical test for significance of 5%
Only results indicating a difference greater than 10% and 0.3 ns are considered.

Allocation changes below 0.5% are ignored.

Benchmark details

Benchmarks.Trace.ActivityBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`StartStopWithChild`	net6.0	8.24μs	45.6ns	285ns	0.0162	0.00405	0	5.62 KB
master	`StartStopWithChild`	netcoreapp3.1	10.5μs	57.7ns	361ns	0.0262	0.0105	0	5.8 KB
master	`StartStopWithChild`	net472	16.3μs	40.3ns	145ns	1.05	0.317	0.0975	6.2 KB
#6474	`StartStopWithChild`	net6.0	7.89μs	45ns	324ns	0.0158	0.00396	0	5.61 KB
#6474	`StartStopWithChild`	netcoreapp3.1	9.99μs	49.1ns	278ns	0.0191	0.00954	0	5.8 KB
#6474	`StartStopWithChild`	net472	16.4μs	40.5ns	157ns	1.03	0.294	0.0899	6.21 KB

Benchmarks.Trace.AgentWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	481μs	225ns	870ns	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	671μs	362ns	1.4μs	0	2.7 KB
master	`WriteAndFlushEnrichedTraces`	net472	843μs	736ns	2.85μs	0.419	3.3 KB
#6474	`WriteAndFlushEnrichedTraces`	net6.0	482μs	382ns	1.48μs	0	2.7 KB
#6474	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	635μs	257ns	995ns	0	2.7 KB
#6474	`WriteAndFlushEnrichedTraces`	net472	851μs	802ns	2.89μs	0.425	3.3 KB

Benchmarks.Trace.AspNetCoreBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendRequest`	net6.0	158μs	1.05μs	10.4μs	0.155	14.48 KB
master	`SendRequest`	netcoreapp3.1	178μs	1.04μs	9.9μs	0.173	17.27 KB
master	`SendRequest`	net472	0.000798ns	0.000414ns	0.00155ns	0	0 b
#6474	`SendRequest`	net6.0	161μs	1.08μs	10.7μs	0.14	14.47 KB
#6474	`SendRequest`	netcoreapp3.1	176μs	1.04μs	10.2μs	0.158	17.27 KB
#6474	`SendRequest`	net472	0.00237ns	0.000634ns	0.00237ns	0	0 b

Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Gen 2	Allocated
master	`WriteAndFlushEnrichedTraces`	net6.0	583μs	3.04μs	17.2μs	0.601	0	0	41.69 KB
master	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	681μs	3.88μs	30.3μs	0.365	0	0	41.78 KB
master	`WriteAndFlushEnrichedTraces`	net472	848μs	3.59μs	13.9μs	8.5	2.55	0.425	53.25 KB
#6474	`WriteAndFlushEnrichedTraces`	net6.0	586μs	3.21μs	17.9μs	0.541	0	0	41.75 KB
#6474	`WriteAndFlushEnrichedTraces`	netcoreapp3.1	663μs	3.16μs	16.1μs	0.317	0	0	41.87 KB
#6474	`WriteAndFlushEnrichedTraces`	net472	863μs	3.93μs	15.7μs	8.62	2.59	0.431	53.27 KB

Benchmarks.Trace.DbCommandBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`ExecuteNonQuery`	net6.0	1.41μs	0.656ns	2.37ns	0.0144	0	1.02 KB
master	`ExecuteNonQuery`	netcoreapp3.1	1.77μs	2.45ns	9.49ns	0.0133	0	1.02 KB
master	`ExecuteNonQuery`	net472	2.1μs	2.15ns	8.32ns	0.157	0.00105	987 B
#6474	`ExecuteNonQuery`	net6.0	1.42μs	1.22ns	4.74ns	0.0142	0	1.02 KB
#6474	`ExecuteNonQuery`	netcoreapp3.1	1.74μs	1.31ns	5.09ns	0.013	0	1.02 KB
#6474	`ExecuteNonQuery`	net472	2.1μs	1.69ns	6.32ns	0.156	0.00103	987 B

Benchmarks.Trace.ElasticsearchBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`CallElasticsearch`	net6.0	1.27μs	0.716ns	2.77ns	0.0134	976 B
master	`CallElasticsearch`	netcoreapp3.1	1.61μs	1.03ns	3.99ns	0.0129	976 B
master	`CallElasticsearch`	net472	2.53μs	1.11ns	4.28ns	0.157	995 B
master	`CallElasticsearchAsync`	net6.0	1.37μs	0.55ns	2.13ns	0.0137	952 B
master	`CallElasticsearchAsync`	netcoreapp3.1	1.7μs	0.759ns	2.94ns	0.0134	1.02 KB
master	`CallElasticsearchAsync`	net472	2.66μs	0.745ns	2.69ns	0.166	1.05 KB
#6474	`CallElasticsearch`	net6.0	1.2μs	0.437ns	1.69ns	0.0138	976 B
#6474	`CallElasticsearch`	netcoreapp3.1	1.62μs	0.84ns	3.25ns	0.0131	976 B
#6474	`CallElasticsearch`	net472	2.52μs	0.856ns	3.2ns	0.157	995 B
#6474	`CallElasticsearchAsync`	net6.0	1.34μs	1.06ns	3.97ns	0.0135	952 B
#6474	`CallElasticsearchAsync`	netcoreapp3.1	1.62μs	1.5ns	5.2ns	0.0139	1.02 KB
#6474	`CallElasticsearchAsync`	net472	2.57μs	0.951ns	3.56ns	0.167	1.05 KB

Benchmarks.Trace.GraphQLBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`ExecuteAsync`	net6.0	1.22μs	1.12ns	4.21ns	0.0135	952 B
master	`ExecuteAsync`	netcoreapp3.1	1.59μs	0.83ns	3.11ns	0.0127	952 B
master	`ExecuteAsync`	net472	1.82μs	0.745ns	2.89ns	0.145	915 B
#6474	`ExecuteAsync`	net6.0	1.34μs	0.632ns	2.45ns	0.0134	952 B
#6474	`ExecuteAsync`	netcoreapp3.1	1.68μs	0.982ns	3.68ns	0.0126	952 B
#6474	`ExecuteAsync`	net472	1.78μs	1.01ns	3.91ns	0.145	915 B

Benchmarks.Trace.HttpClientBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendAsync`	net6.0	4.39μs	1.8ns	6.73ns	0.033	2.31 KB
master	`SendAsync`	netcoreapp3.1	5.27μs	1.27ns	4.75ns	0.037	2.85 KB
master	`SendAsync`	net472	7.42μs	1.41ns	5.47ns	0.493	3.12 KB
#6474	`SendAsync`	net6.0	4.49μs	4.48ns	17.3ns	0.0313	2.31 KB
#6474	`SendAsync`	netcoreapp3.1	5.3μs	2.59ns	9.69ns	0.0398	2.85 KB
#6474	`SendAsync`	net472	7.37μs	1.35ns	5.06ns	0.496	3.12 KB

Benchmarks.Trace.ILoggerBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	1.47μs	0.344ns	1.29ns	0.0229	1.64 KB
master	`EnrichedLog`	netcoreapp3.1	2.14μs	1.36ns	5.1ns	0.0216	1.64 KB
master	`EnrichedLog`	net472	2.72μs	1.67ns	6.45ns	0.25	1.57 KB
#6474	`EnrichedLog`	net6.0	1.46μs	0.548ns	2.05ns	0.0228	1.64 KB
#6474	`EnrichedLog`	netcoreapp3.1	2.13μs	1.1ns	4.13ns	0.0223	1.64 KB
#6474	`EnrichedLog`	net472	2.7μs	1.61ns	6.02ns	0.249	1.57 KB

Benchmarks.Trace.Log4netBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Gen 1	Allocated
master	`EnrichedLog`	net6.0	116μs	146ns	564ns	0.0583	0	4.28 KB
master	`EnrichedLog`	netcoreapp3.1	121μs	220ns	852ns	0.0605	0	4.28 KB
master	`EnrichedLog`	net472	151μs	307ns	1.19μs	0.678	0.226	4.46 KB
#6474	`EnrichedLog`	net6.0	119μs	182ns	706ns	0.0584	0	4.28 KB
#6474	`EnrichedLog`	netcoreapp3.1	123μs	137ns	493ns	0.0615	0	4.28 KB
#6474	`EnrichedLog`	net472	152μs	170ns	659ns	0.685	0.228	4.46 KB

Benchmarks.Trace.NLogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	3.01μs	1.41ns	5.47ns	0.0301	2.2 KB
master	`EnrichedLog`	netcoreapp3.1	4.25μs	1.49ns	5.59ns	0.0299	2.2 KB
master	`EnrichedLog`	net472	4.99μs	2.55ns	9.87ns	0.32	2.02 KB
#6474	`EnrichedLog`	net6.0	2.91μs	0.528ns	2.04ns	0.0307	2.2 KB
#6474	`EnrichedLog`	netcoreapp3.1	4.38μs	2.44ns	9.43ns	0.0285	2.2 KB
#6474	`EnrichedLog`	net472	4.77μs	1ns	3.87ns	0.32	2.02 KB

Benchmarks.Trace.RedisBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`SendReceive`	net6.0	1.35μs	0.703ns	2.72ns	0.0162	1.14 KB
master	`SendReceive`	netcoreapp3.1	1.82μs	4.22ns	16.3ns	0.0152	1.14 KB
master	`SendReceive`	net472	2.11μs	2.06ns	7.98ns	0.183	1.16 KB
#6474	`SendReceive`	net6.0	1.41μs	1ns	3.87ns	0.0163	1.14 KB
#6474	`SendReceive`	netcoreapp3.1	1.76μs	1.77ns	6.85ns	0.0149	1.14 KB
#6474	`SendReceive`	net472	2.13μs	0.706ns	2.64ns	0.183	1.16 KB

Benchmarks.Trace.SerilogBenchmark - Same speed ✔️ Same allocations ✔️

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`EnrichedLog`	net6.0	2.68μs	1.16ns	4.49ns	0.0216	1.6 KB
master	`EnrichedLog`	netcoreapp3.1	3.99μs	2.39ns	9.24ns	0.0216	1.65 KB
master	`EnrichedLog`	net472	4.52μs	2.72ns	10.5ns	0.324	2.04 KB
#6474	`EnrichedLog`	net6.0	2.82μs	0.806ns	2.9ns	0.0224	1.6 KB
#6474	`EnrichedLog`	netcoreapp3.1	3.95μs	0.968ns	3.75ns	0.0215	1.65 KB
#6474	`EnrichedLog`	net472	4.41μs	1.81ns	6.78ns	0.323	2.04 KB

Benchmarks.Trace.SpanBenchmark - Slower ⚠️ Same allocations ✔️

Slower ⚠️ in #6474

Benchmark	diff/base	Base Median (ns)	Diff Median (ns)
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑net472	1.147	802.84	920.51
Benchmarks.Trace.SpanBenchmark.StartFinishScope‑netcoreapp3.1	1.127	687.59	774.74
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net472	1.119	629.69	704.32

Faster 🎉 in #6474

Benchmark	base/diff	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.SpanBenchmark.StartFinishSpan‑net6.0	1.132	450.26	397.80

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`StartFinishSpan`	net6.0	451ns	0.24ns	0.929ns	0.00815	576 B
master	`StartFinishSpan`	netcoreapp3.1	554ns	0.189ns	0.709ns	0.00776	576 B
master	`StartFinishSpan`	net472	629ns	0.5ns	1.94ns	0.0918	578 B
master	`StartFinishScope`	net6.0	500ns	0.137ns	0.512ns	0.00963	696 B
master	`StartFinishScope`	netcoreapp3.1	688ns	0.927ns	3.59ns	0.00935	696 B
master	`StartFinishScope`	net472	803ns	0.894ns	3.46ns	0.104	658 B
#6474	`StartFinishSpan`	net6.0	399ns	0.593ns	2.3ns	0.0081	576 B
#6474	`StartFinishSpan`	netcoreapp3.1	557ns	0.342ns	1.33ns	0.00781	576 B
#6474	`StartFinishSpan`	net472	704ns	0.659ns	2.47ns	0.0917	578 B
#6474	`StartFinishScope`	net6.0	486ns	0.261ns	0.978ns	0.00983	696 B
#6474	`StartFinishScope`	netcoreapp3.1	775ns	0.603ns	2.33ns	0.00923	696 B
#6474	`StartFinishScope`	net472	920ns	0.885ns	3.43ns	0.105	658 B

Benchmarks.Trace.TraceAnnotationsBenchmark - Faster 🎉 Same allocations ✔️

Faster 🎉 in #6474

Benchmark	base/diff	Base Median (ns)	Diff Median (ns)	Modality
Benchmarks.Trace.TraceAnnotationsBenchmark.RunOnMethodBegin‑net6.0	1.119	670.27	599.13

Raw results

Branch	Method	Toolchain	Mean	StdError	StdDev	Gen 0	Allocated
master	`RunOnMethodBegin`	net6.0	671ns	0.533ns	2.06ns	0.00985	696 B
master	`RunOnMethodBegin`	netcoreapp3.1	922ns	1.12ns	4.32ns	0.00951	696 B
master	`RunOnMethodBegin`	net472	1.14μs	0.66ns	2.38ns	0.104	658 B
#6474	`RunOnMethodBegin`	net6.0	599ns	0.4ns	1.5ns	0.00989	696 B
#6474	`RunOnMethodBegin`	netcoreapp3.1	862ns	0.909ns	3.4ns	0.00928	696 B
#6474	`RunOnMethodBegin`	net472	1.11μs	1.18ns	4.56ns	0.104	658 B

allow running exploration tests on mac

5c0021c

vandonr requested a review from a team as a code owner December 20, 2024 09:55

github-actions bot added the area:builds project files, build scripts, pipelines, versioning, releases, packages label Dec 20, 2024

andrewlock approved these changes Dec 20, 2024

View reviewed changes

vandonr merged commit 0503f1f into master Dec 20, 2024
67 of 68 checks passed

vandonr deleted the vandonr/explo branch December 20, 2024 13:39

github-actions bot added this to the vNext-v3 milestone Dec 20, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

allow running exploration tests on mac #6474

allow running exploration tests on mac #6474

vandonr commented Dec 20, 2024 •

edited

Loading

datadog-ddstaging bot commented Dec 20, 2024 •

edited

Loading

andrewlock left a comment

andrewlock commented Dec 20, 2024

andrewlock commented Dec 20, 2024

andrewlock commented Dec 20, 2024

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Slower ⚠️ in #6474

Faster 🎉 in #6474

Raw results

Faster 🎉 in #6474

Raw results

allow running exploration tests on mac #6474

allow running exploration tests on mac #6474

Conversation

vandonr commented Dec 20, 2024 • edited Loading

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

datadog-ddstaging bot commented Dec 20, 2024 • edited Loading

Datadog Report

andrewlock left a comment

Choose a reason for hiding this comment

andrewlock commented Dec 20, 2024

Execution-Time Benchmarks Report ⏱️

andrewlock commented Dec 20, 2024

Throughput/Crank Report ⚡

andrewlock commented Dec 20, 2024

Benchmarks Report for tracer 🐌

Benchmark details

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Raw results

Slower ⚠️ in #6474

Faster 🎉 in #6474

Raw results

Faster 🎉 in #6474

Raw results

vandonr commented Dec 20, 2024 •

edited

Loading

datadog-ddstaging bot commented Dec 20, 2024 •

edited

Loading