Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow attaching to the sidecar via gdb #687

Merged
merged 1 commit into from
Oct 22, 2024
Merged

Allow attaching to the sidecar via gdb #687

merged 1 commit into from
Oct 22, 2024

Conversation

bwoebi
Copy link
Contributor

@bwoebi bwoebi commented Oct 22, 2024

It worked when DD_SPAWN_WORKER_USE_EXEC=1 was set, but not generally. Having a /proc//X path will tell gdb exactly where to find it, instead of a /proc/self/fd/X which is pointing into gdbs own process from the perspective of gdb.

This also prevented sidecar core dumps from being opened with gdb, which was rather ugly.

(Also updates the Cargo.toml of trace-utils to include the required hyper runtime, otherwise the server feature will fail to compile...)

@bwoebi bwoebi requested review from a team as code owners October 22, 2024 15:55
@bwoebi bwoebi force-pushed the bob/sidecar-proc-fd branch from 8a01bf4 to 549a16d Compare October 22, 2024 15:57
It worked when DD_SPAWN_WORKER_USE_EXEC=1 was set, but not generally. Having a /proc/<pid>/X path will tell gdb exactly where to find it, instead of a /proc/self/fd/X which is pointing into gdbs own process from the perspective of gdb.

This also prevented sidecar core dumps from being opened with gdb, which was rather ugly.

Signed-off-by: Bob Weinand <bob.weinand@datadoghq.com>
@bwoebi bwoebi force-pushed the bob/sidecar-proc-fd branch from 549a16d to 1a7d347 Compare October 22, 2024 16:05
@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 71.82%. Comparing base (7224cd1) to head (1a7d347).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #687      +/-   ##
==========================================
+ Coverage   71.79%   71.82%   +0.03%     
==========================================
  Files         271      271              
  Lines       40982    40982              
==========================================
+ Hits        29422    29435      +13     
+ Misses      11560    11547      -13     
Components Coverage Δ
crashtracker 20.33% <ø> (+0.05%) ⬆️
crashtracker-ffi 9.07% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.85% <ø> (-0.07%) ⬇️
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.73% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 88.86% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.65% <ø> (ø)
profiling 84.30% <ø> (ø)
profiling-ffi 77.46% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 36.09% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.45% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.77% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.49% <ø> (ø)

@pr-commenter
Copy link

pr-commenter bot commented Oct 22, 2024

Benchmarks

Comparison

Benchmark execution time: 2024-10-22 16:16:04

Comparing candidate commit 1a7d347 in PR branch bob/sidecar-proc-fd with baseline commit 7224cd1 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.058ms 9.098ms ± 0.017ms 9.098ms ± 0.010ms 9.108ms 9.120ms 9.127ms 9.221ms 1.36% 1.860 13.732 0.18% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.096ms; 9.100ms] or [-0.025%; +0.025%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.121µs 1.179µs ± 0.024µs 1.180µs ± 0.016µs 1.199µs 1.202µs 1.204µs 1.284µs 8.80% -0.443 1.518 2.04% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.175µs; 1.182µs] or [-0.283%; +0.283%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 623.841µs 624.724µs ± 0.365µs 624.710µs ± 0.257µs 624.965µs 625.317µs 625.475µs 626.217µs 0.24% 0.342 0.554 0.06% 0.026µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1596889.442op/s 1600706.820op/s ± 935.216op/s 1600743.568op/s ± 658.810op/s 1601415.010op/s 1602198.858op/s 1602596.975op/s 1602972.185op/s 0.14% -0.338 0.544 0.06% 66.130op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 460.889µs 462.189µs ± 0.551µs 462.162µs ± 0.331µs 462.517µs 463.078µs 463.612µs 464.857µs 0.58% 0.730 2.518 0.12% 0.039µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2151197.481op/s 2163620.498op/s ± 2578.429op/s 2163741.971op/s ± 1553.001op/s 2165247.162op/s 2167700.177op/s 2169108.286op/s 2169721.311op/s 0.28% -0.716 2.465 0.12% 182.322op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 178.078µs 178.312µs ± 0.104µs 178.307µs ± 0.065µs 178.369µs 178.464µs 178.603µs 178.808µs 0.28% 0.831 2.139 0.06% 0.007µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5592600.090op/s 5608138.605op/s ± 3259.148op/s 5608312.066op/s ± 2047.505op/s 5610396.996op/s 5612614.590op/s 5613997.029op/s 5615506.028op/s 0.13% -0.825 2.115 0.06% 230.457op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.527µs 46.679µs ± 0.061µs 46.676µs ± 0.039µs 46.717µs 46.786µs 46.843µs 46.883µs 0.44% 0.471 0.334 0.13% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21329876.986op/s 21422841.307op/s ± 28100.948op/s 21424115.668op/s ± 18050.425op/s 21442063.146op/s 21463934.754op/s 21478167.198op/s 21493044.028op/s 0.32% -0.463 0.322 0.13% 1987.037op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.442µs 50.155µs ± 0.204µs 50.143µs ± 0.124µs 50.278µs 50.420µs 50.520µs 51.646µs 3.00% 1.733 13.438 0.41% 0.014µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19362527.071op/s 19938445.691op/s ± 80442.323op/s 19943062.559op/s ± 49442.577op/s 19988759.809op/s 20050162.952op/s 20083755.152op/s 20225856.971op/s 1.42% -1.586 12.315 0.40% 5688.131op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [624.674µs; 624.775µs] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1600577.208op/s; 1600836.432op/s] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [462.113µs; 462.265µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2163263.152op/s; 2163977.843op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [178.298µs; 178.327µs] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5607686.919op/s; 5608590.292op/s] or [-0.008%; +0.008%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.671µs; 46.688µs] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21418946.786op/s; 21426735.828op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.127µs; 50.183µs] or [-0.056%; +0.056%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19927297.159op/s; 19949594.223op/s] or [-0.056%; +0.056%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.604µs 4.615µs ± 0.002µs 4.615µs ± 0.001µs 4.616µs 4.618µs 4.619µs 4.626µs 0.25% 0.238 3.807 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 216173981.766op/s 216705768.238op/s ± 106655.226op/s 216706794.414op/s ± 70301.911op/s 216777384.700op/s 216864752.562op/s 216904617.001op/s 217192445.029op/s 0.22% -0.230 3.798 0.05% 7541.663op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 90.201µs 91.095µs ± 0.550µs 91.008µs ± 0.245µs 91.304µs 91.912µs 92.592µs 95.622µs 5.07% 3.257 22.140 0.60% 0.039µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10457802.671op/s 10977965.644op/s ± 65066.622op/s 10988032.385op/s ± 29526.169op/s 11016117.406op/s 11058113.544op/s 11079525.284op/s 11086335.950op/s 0.89% -3.024 19.669 0.59% 4600.905op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 82.779µs 83.879µs ± 0.503µs 83.830µs ± 0.301µs 84.166µs 84.612µs 84.956µs 87.464µs 4.34% 1.941 11.595 0.60% 0.036µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11433261.243op/s 11922376.542op/s ± 70642.907op/s 11928905.630op/s ± 42800.478op/s 11968494.137op/s 12016965.465op/s 12040484.805op/s 12080375.571op/s 1.27% -1.773 10.170 0.59% 4995.208op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.600µs 4.615µs ± 0.003µs 4.614µs ± 0.002µs 4.616µs 4.620µs 4.621µs 4.627µs 0.26% 0.152 4.491 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 216140218.448op/s 216696332.231op/s ± 130184.130op/s 216710315.411op/s ± 77369.415op/s 216785858.040op/s 216849726.078op/s 216901301.584op/s 217381687.233op/s 0.31% -0.141 4.518 0.06% 9205.408op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 79.519µs 80.553µs ± 0.423µs 80.593µs ± 0.335µs 80.875µs 81.197µs 81.347µs 81.490µs 1.11% -0.127 -0.790 0.52% 0.030µs 1 200
credit_card/is_card_number/378282246310005 throughput 12271496.152op/s 12414481.545op/s ± 65206.325op/s 12408074.794op/s ± 51566.451op/s 12464814.997op/s 12524780.601op/s 12556158.126op/s 12575596.943op/s 1.35% 0.146 -0.782 0.52% 4610.783op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 59.264µs 59.521µs ± 0.226µs 59.489µs ± 0.160µs 59.628µs 59.997µs 60.077µs 60.105µs 1.03% 0.826 -0.105 0.38% 0.016µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16637654.756op/s 16800988.995op/s ± 63612.220op/s 16809695.847op/s ± 45271.025op/s 16862596.488op/s 16871539.292op/s 16872253.943op/s 16873582.318op/s 0.38% -0.812 -0.135 0.38% 4498.063op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 7.218µs 7.223µs ± 0.006µs 7.222µs ± 0.002µs 7.224µs 7.227µs 7.230µs 7.293µs 0.98% 9.887 120.834 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 137121177.995op/s 138455772.213op/s ± 106893.632op/s 138468858.354op/s ± 39842.452op/s 138505176.631op/s 138525145.084op/s 138537461.361op/s 138539248.169op/s 0.05% -9.828 119.850 0.08% 7558.521op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.601µs 4.614µs ± 0.003µs 4.614µs ± 0.001µs 4.616µs 4.619µs 4.620µs 4.630µs 0.35% 0.650 8.401 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 215977019.567op/s 216710768.071op/s ± 123355.868op/s 216727667.153op/s ± 65668.331op/s 216786272.010op/s 216851386.191op/s 216887944.823op/s 217353294.547op/s 0.29% -0.633 8.373 0.06% 8722.577op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 73.971µs 74.423µs ± 0.164µs 74.469µs ± 0.094µs 74.527µs 74.641µs 74.765µs 75.027µs 0.75% -0.355 0.646 0.22% 0.012µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13328565.327op/s 13436796.817op/s ± 29550.517op/s 13428439.185op/s ± 16974.858op/s 13453785.252op/s 13490968.330op/s 13514791.304op/s 13518774.875op/s 0.67% 0.372 0.634 0.22% 2089.537op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 66.340µs 66.824µs ± 0.231µs 66.787µs ± 0.172µs 66.987µs 67.251µs 67.361µs 67.533µs 1.12% 0.520 -0.186 0.34% 0.016µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 14807669.109op/s 14964761.647op/s ± 51559.527op/s 14973062.738op/s ± 38404.603op/s 15004603.037op/s 15039466.267op/s 15044057.112op/s 15073939.179op/s 0.67% -0.504 -0.212 0.34% 3645.809op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.604µs 4.615µs ± 0.006µs 4.614µs ± 0.001µs 4.616µs 4.618µs 4.620µs 4.694µs 1.73% 11.575 150.835 0.13% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 213015837.551op/s 216694133.342op/s ± 279045.069op/s 216710563.551op/s ± 67401.554op/s 216780370.538op/s 216855948.838op/s 216896534.793op/s 217187288.373op/s 0.22% -11.501 149.559 0.13% 19731.466op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 62.357µs 62.634µs ± 0.167µs 62.579µs ± 0.088µs 62.719µs 62.956µs 63.066µs 63.322µs 1.19% 1.076 0.920 0.27% 0.012µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15792362.024op/s 15965818.055op/s ± 42382.644op/s 15979920.433op/s ± 22452.545op/s 15998131.820op/s 16008104.904op/s 16032991.843op/s 16036711.239op/s 0.36% -1.062 0.869 0.26% 2996.905op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 59.260µs 59.489µs ± 0.212µs 59.447µs ± 0.160µs 59.614µs 59.903µs 60.075µs 60.103µs 1.10% 0.778 -0.269 0.36% 0.015µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16638202.869op/s 16810156.298op/s ± 59839.719op/s 16821602.946op/s ± 45084.425op/s 16864437.540op/s 16872393.474op/s 16874004.449op/s 16874741.886op/s 0.32% -0.766 -0.300 0.36% 4231.307op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 7.217µs 7.222µs ± 0.003µs 7.222µs ± 0.002µs 7.224µs 7.227µs 7.230µs 7.233µs 0.15% 0.744 0.769 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 138250485.524op/s 138456440.953op/s ± 50853.047op/s 138460434.935op/s ± 35077.811op/s 138496565.285op/s 138524011.059op/s 138539862.215op/s 138566789.192op/s 0.08% -0.742 0.761 0.04% 3595.853op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.614µs; 4.615µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [216690986.849op/s; 216720549.626op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [91.019µs; 91.171µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10968948.036op/s; 10986983.252op/s] or [-0.082%; +0.082%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.809µs; 83.949µs] or [-0.083%; +0.083%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11912586.115op/s; 11932166.970op/s] or [-0.082%; +0.082%] None None None
credit_card/is_card_number/37828224631 execution_time [4.614µs; 4.615µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631 throughput [216678289.963op/s; 216714374.500op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.495µs; 80.612µs] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/378282246310005 throughput [12405444.576op/s; 12423518.515op/s] or [-0.073%; +0.073%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [59.490µs; 59.552µs] or [-0.053%; +0.053%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16792172.953op/s; 16809805.037op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/x371413321323331 execution_time [7.222µs; 7.223µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 throughput [138440957.784op/s; 138470586.642op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.614µs; 4.615µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ throughput [216693672.134op/s; 216727864.008op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [74.400µs; 74.446µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13432701.400op/s; 13440892.235op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [66.792µs; 66.856µs] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [14957615.992op/s; 14971907.301op/s] or [-0.048%; +0.048%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.614µs; 4.616µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [216655460.380op/s; 216732806.305op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [62.611µs; 62.657µs] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [15959944.228op/s; 15971691.881op/s] or [-0.037%; +0.037%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [59.459µs; 59.518µs] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16801863.089op/s; 16818449.508op/s] or [-0.049%; +0.049%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [7.222µs; 7.223µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [138449393.210op/s; 138463488.697op/s] or [-0.005%; +0.005%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 143.060µs 143.908µs ± 0.411µs 143.865µs ± 0.196µs 144.061µs 144.576µs 145.103µs 146.628µs 1.92% 2.092 10.131 0.29% 0.029µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [143.851µs; 143.965µs] or [-0.040%; +0.040%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 188.526µs 192.086µs ± 1.023µs 192.215µs ± 0.685µs 192.793µs 193.456µs 193.988µs 194.418µs 1.15% -0.583 0.551 0.53% 0.072µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5143556.667op/s 5206161.883op/s ± 27808.307op/s 5202506.951op/s ± 18481.175op/s 5224674.046op/s 5250421.893op/s 5289306.413op/s 5304314.082op/s 1.96% 0.619 0.632 0.53% 1966.344op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.202µs 18.241µs ± 0.029µs 18.224µs ± 0.012µs 18.261µs 18.292µs 18.320µs 18.401µs 0.97% 1.379 3.888 0.16% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54344271.883op/s 54821967.401op/s ± 85774.857op/s 54872095.703op/s ± 36755.605op/s 54891999.410op/s 54906021.713op/s 54926265.060op/s 54940373.399op/s 0.12% -1.360 3.762 0.16% 6065.198op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 11.310µs 11.367µs ± 0.035µs 11.361µs ± 0.016µs 11.382µs 11.428µs 11.471µs 11.621µs 2.29% 2.540 13.691 0.31% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 86048588.770op/s 87975290.252op/s ± 268044.340op/s 88020270.934op/s ± 123001.145op/s 88132317.360op/s 88315684.346op/s 88376612.071op/s 88420905.444op/s 0.46% -2.457 12.931 0.30% 18953.597op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [191.944µs; 192.227µs] or [-0.074%; +0.074%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5202307.919op/s; 5210015.847op/s] or [-0.074%; +0.074%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.237µs; 18.245µs] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54810079.830op/s; 54833854.971op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_name/normalize_name/good execution_time [11.362µs; 11.372µs] or [-0.043%; +0.043%] None None None
normalization/normalize_name/normalize_name/good throughput [87938141.884op/s; 88012438.620op/s] or [-0.042%; +0.042%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 263.895ns 272.406ns ± 12.222ns 266.695ns ± 2.269ns 276.507ns 308.091ns 310.074ns 312.157ns 17.05% 2.019 3.168 4.48% 0.864ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [270.712ns; 274.100ns] or [-0.622%; +0.622%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.878µs 24.272µs ± 11.080µs 18.844µs ± 0.538µs 19.921µs 41.019µs 42.131µs 101.790µs 440.18% 2.882 13.002 45.54% 0.784µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [22.736µs; 25.808µs] or [-6.327%; +6.327%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.603µs 2.660µs ± 0.017µs 2.659µs ± 0.006µs 2.665µs 2.696µs 2.700µs 2.717µs 2.16% -0.226 3.253 0.63% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.657µs; 2.662µs] or [-0.088%; +0.088%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 73.270µs 73.404µs ± 0.109µs 73.388µs ± 0.026µs 73.417µs 73.485µs 73.638µs 74.747µs 1.85% 9.649 115.038 0.15% 0.008µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [73.389µs; 73.420µs] or [-0.021%; +0.021%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.362µs 3.205µs ± 1.410µs 3.054µs ± 0.023µs 3.076µs 3.119µs 13.893µs 14.992µs 390.83% 7.596 57.845 43.87% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.010µs; 3.401µs] or [-6.095%; +6.095%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 1a7d347 1729613131 bob/sidecar-proc-fd
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.790µs 38.427µs ± 1.058µs 37.966µs ± 0.088µs 38.048µs 40.684µs 40.739µs 41.877µs 10.30% 1.718 1.082 2.75% 0.075µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.280µs; 38.573µs] or [-0.382%; +0.382%] None None None

Baseline

Omitted due to size.

@bwoebi bwoebi merged commit 8d6b9cc into main Oct 22, 2024
30 checks passed
@bwoebi bwoebi deleted the bob/sidecar-proc-fd branch October 22, 2024 17:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants