Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(profiling-replayer): add the ability to print stacks #854

Merged
merged 1 commit into from
Feb 5, 2025

Conversation

morrisonlevi
Copy link
Contributor

What does this PR do?

Adds an option --print-stacks which prints out the stack samples. Very verbose, meant for exploring or debugging profiles.

Motivation

I wanted to see the stacks without having to upload to Datadog.

Additional Notes

This is just a utility that isn't used for prod or shipping code in any way.

How to test the change?

No changes.

@morrisonlevi morrisonlevi requested a review from a team as a code owner February 5, 2025 00:49
@pr-commenter
Copy link

pr-commenter bot commented Feb 5, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-05 00:58:30

Comparing candidate commit ac39e61 in PR branch levi/replayer-printer with baseline commit a2bd795 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 69.018µs 69.225µs ± 0.176µs 69.214µs ± 0.048µs 69.259µs 69.328µs 69.377µs 71.501µs 3.30% 10.894 138.886 0.25% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [69.200µs; 69.249µs] or [-0.035%; +0.035%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 57.276ms 57.508ms ± 0.127ms 57.515ms ± 0.068ms 57.555ms 57.706ms 57.907ms 58.396ms 1.53% 2.177 11.795 0.22% 0.009ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [57.491ms; 57.526ms] or [-0.031%; +0.031%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 261.350ns 275.022ns ± 13.823ns 268.506ns ± 4.310ns 280.116ns 300.234ns 316.321ns 321.264ns 19.65% 1.494 1.469 5.01% 0.977ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [273.106ns; 276.937ns] or [-0.697%; +0.697%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.335ms 6.351ms ± 0.009ms 6.351ms ± 0.005ms 6.355ms 6.364ms 6.372ms 6.412ms 0.96% 2.611 14.391 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.350ms; 6.353ms] or [-0.020%; +0.020%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 179.039µs 184.309µs ± 2.028µs 184.287µs ± 1.471µs 185.713µs 187.774µs 188.807µs 189.783µs 2.98% 0.071 -0.452 1.10% 0.143µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5269184.177op/s 5426317.230op/s ± 59684.478op/s 5426323.148op/s ± 43653.122op/s 5471797.737op/s 5523288.268op/s 5544786.728op/s 5585390.072op/s 2.93% -0.020 -0.466 1.10% 4220.330op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 21.041µs 21.159µs ± 0.071µs 21.144µs ± 0.040µs 21.193µs 21.301µs 21.376µs 21.398µs 1.20% 1.084 0.999 0.33% 0.005µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 46732707.361op/s 47260717.856op/s ± 157048.238op/s 47294829.141op/s ± 88960.688op/s 47376775.969op/s 47453529.172op/s 47480582.312op/s 47525544.980op/s 0.49% -1.066 0.948 0.33% 11104.987op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 14.228µs 14.300µs ± 0.045µs 14.290µs ± 0.028µs 14.327µs 14.387µs 14.427µs 14.444µs 1.08% 0.862 0.395 0.31% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 69234302.388op/s 69930263.069op/s ± 218922.605op/s 69980479.444op/s ± 136033.682op/s 70099190.367op/s 70213342.421op/s 70255039.811op/s 70285915.103op/s 0.44% -0.847 0.357 0.31% 15480.166op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [184.028µs; 184.590µs] or [-0.153%; +0.153%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5418045.536op/s; 5434588.925op/s] or [-0.152%; +0.152%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [21.150µs; 21.169µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [47238952.481op/s; 47282483.232op/s] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.294µs; 14.306µs] or [-0.044%; +0.044%] None None None
normalization/normalize_name/normalize_name/good throughput [69899922.502op/s; 69960603.637op/s] or [-0.043%; +0.043%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.405µs 5.472µs ± 0.034µs 5.478µs ± 0.019µs 5.493µs 5.508µs 5.563µs 5.567µs 1.63% 0.395 0.424 0.62% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.467µs; 5.476µs] or [-0.087%; +0.087%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.778µs 2.805µs ± 0.020µs 2.800µs ± 0.008µs 2.810µs 2.857µs 2.869µs 2.875µs 2.70% 1.848 3.132 0.70% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.803µs; 2.808µs] or [-0.098%; +0.098%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.349µs 27.881µs ± 13.821µs 18.675µs ± 0.211µs 36.420µs 45.799µs 48.493µs 149.413µs 700.09% 3.980 29.743 49.45% 0.977µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.965µs; 29.796µs] or [-6.870%; +6.870%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 138.105µs 138.835µs ± 0.351µs 138.794µs ± 0.157µs 138.960µs 139.340µs 139.730µs 141.679µs 2.08% 3.538 23.835 0.25% 0.025µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [138.786µs; 138.883µs] or [-0.035%; +0.035%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.440µs 3.324µs ± 1.472µs 3.130µs ± 0.033µs 3.160µs 3.787µs 14.382µs 15.489µs 394.85% 7.438 56.071 44.18% 0.104µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.120µs; 3.528µs] or [-6.138%; +6.138%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.273µs 4.289µs ± 0.005µs 4.288µs ± 0.002µs 4.290µs 4.292µs 4.294µs 4.344µs 1.29% 7.566 88.526 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 230209915.328op/s 233181248.093op/s ± 257786.224op/s 233186554.747op/s ± 88650.630op/s 233264701.225op/s 233442003.114op/s 233543916.449op/s 234017474.174op/s 0.36% -7.455 86.973 0.11% 18228.239op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 89.527µs 90.966µs ± 0.672µs 90.962µs ± 0.379µs 91.265µs 91.919µs 92.194µs 96.525µs 6.12% 2.803 21.868 0.74% 0.048µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10360027.923op/s 10993726.654op/s ± 79683.677op/s 10993639.089op/s ± 45937.797op/s 11041864.409op/s 11105424.933op/s 11148339.444op/s 11169774.995op/s 1.60% -2.470 18.540 0.72% 5634.487op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 83.113µs 83.579µs ± 0.416µs 83.552µs ± 0.124µs 83.670µs 83.893µs 84.020µs 88.750µs 6.22% 9.645 117.693 0.50% 0.029µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11267634.200op/s 11964987.878op/s ± 56883.205op/s 11968575.315op/s ± 17723.522op/s 11986604.109op/s 12019146.683op/s 12025697.846op/s 12031816.937op/s 0.53% -9.249 111.239 0.47% 4022.250op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.271µs 4.289µs ± 0.005µs 4.288µs ± 0.002µs 4.290µs 4.292µs 4.294µs 4.342µs 1.24% 7.395 87.470 0.11% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 230324711.443op/s 233165707.195op/s ± 247514.605op/s 233188291.149op/s ± 88672.754op/s 233252282.461op/s 233362515.649op/s 233560998.811op/s 234115635.462op/s 0.40% -7.283 85.983 0.11% 17501.926op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 80.485µs 80.982µs ± 0.206µs 80.941µs ± 0.074µs 81.023µs 81.513µs 81.618µs 81.825µs 1.09% 1.604 3.509 0.25% 0.015µs 1 200
credit_card/is_card_number/378282246310005 throughput 12221229.083op/s 12348572.875op/s ± 31271.930op/s 12354615.936op/s ± 11300.144op/s 12364688.922op/s 12384054.852op/s 12411572.495op/s 12424709.019op/s 0.57% -1.582 3.453 0.25% 2211.259op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.594µs 58.682µs ± 0.034µs 58.681µs ± 0.018µs 58.698µs 58.735µs 58.777µs 58.820µs 0.24% 0.567 1.831 0.06% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 17000981.185op/s 17041006.813op/s ± 9736.200op/s 17041339.449op/s ± 5089.590op/s 17046424.367op/s 17056249.781op/s 17062629.872op/s 17066535.936op/s 0.15% -0.561 1.817 0.06% 688.453op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.433µs 6.443µs ± 0.003µs 6.442µs ± 0.002µs 6.445µs 6.448µs 6.450µs 6.461µs 0.28% 0.523 3.967 0.05% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154784450.187op/s 155218118.772op/s ± 80480.487op/s 155220714.204op/s ± 49809.668op/s 155266302.594op/s 155330409.199op/s 155428788.564op/s 155459072.544op/s 0.15% -0.514 3.934 0.05% 5690.830op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.273µs 4.289µs ± 0.003µs 4.289µs ± 0.001µs 4.290µs 4.293µs 4.296µs 4.299µs 0.25% -0.712 4.658 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 232592978.844op/s 233177150.401op/s ± 157374.653op/s 233172893.653op/s ± 78383.835op/s 233249163.092op/s 233469242.598op/s 233563915.244op/s 234023223.493op/s 0.36% 0.724 4.696 0.07% 11128.068op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 69.164µs 69.976µs ± 0.358µs 69.970µs ± 0.209µs 70.158µs 70.662µs 70.913µs 71.309µs 1.91% 0.464 0.791 0.51% 0.025µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 14023396.910op/s 14290897.339op/s ± 73008.869op/s 14291787.939op/s ± 42684.861op/s 14336742.562op/s 14400076.833op/s 14454272.430op/s 14458337.592op/s 1.17% -0.424 0.732 0.51% 5162.507op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 63.851µs 64.924µs ± 0.468µs 64.879µs ± 0.273µs 65.166µs 65.818µs 66.113µs 66.326µs 2.23% 0.495 0.316 0.72% 0.033µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15077025.980op/s 15403487.863op/s ± 110767.685op/s 15413425.865op/s ± 64885.091op/s 15475099.498op/s 15573972.549op/s 15639820.302op/s 15661444.321op/s 1.61% -0.450 0.268 0.72% 7832.458op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.274µs 4.288µs ± 0.002µs 4.288µs ± 0.001µs 4.290µs 4.292µs 4.296µs 4.298µs 0.23% -0.479 7.414 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 232666054.671op/s 233186763.809op/s ± 135686.241op/s 233196245.543op/s ± 63242.605op/s 233252271.834op/s 233402619.148op/s 233503542.560op/s 233995326.716op/s 0.34% 0.495 7.471 0.06% 9594.466op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 61.696µs 61.914µs ± 0.094µs 61.907µs ± 0.063µs 61.973µs 62.067µs 62.174µs 62.235µs 0.53% 0.474 0.486 0.15% 0.007µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 16068237.241op/s 16151468.414op/s ± 24523.945op/s 16153197.725op/s ± 16372.588op/s 16167074.543op/s 16188893.934op/s 16204045.106op/s 16208417.031op/s 0.34% -0.464 0.470 0.15% 1734.105op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.554µs 58.673µs ± 0.038µs 58.671µs ± 0.026µs 58.700µs 58.733µs 58.758µs 58.771µs 0.17% -0.125 0.306 0.06% 0.003µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 17015142.083op/s 17043762.653op/s ± 10946.985op/s 17044219.383op/s ± 7445.407op/s 17050799.067op/s 17062104.809op/s 17071213.625op/s 17078300.312op/s 0.20% 0.130 0.310 0.06% 774.069op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.389µs 6.444µs ± 0.010µs 6.443µs ± 0.002µs 6.445µs 6.450µs 6.455µs 6.565µs 1.90% 7.287 98.031 0.16% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 152315855.602op/s 155194965.349op/s ± 246628.757op/s 155210462.002op/s ± 42513.350op/s 155249922.002op/s 155329214.846op/s 155418395.402op/s 156512417.438op/s 0.84% -7.060 95.666 0.16% 17439.287op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.288µs; 4.289µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ throughput [233145521.402op/s; 233216974.784op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [90.873µs; 91.059µs] or [-0.102%; +0.102%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10982683.263op/s; 11004770.045op/s] or [-0.100%; +0.100%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [83.522µs; 83.637µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11957104.413op/s; 11972871.343op/s] or [-0.066%; +0.066%] None None None
credit_card/is_card_number/37828224631 execution_time [4.288µs; 4.289µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/37828224631 throughput [233131404.051op/s; 233200010.339op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/378282246310005 execution_time [80.953µs; 81.010µs] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/378282246310005 throughput [12344238.887op/s; 12352906.864op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [58.677µs; 58.687µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [17039657.469op/s; 17042356.156op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.442µs; 6.443µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 throughput [155206964.951op/s; 155229272.594op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.288µs; 4.289µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [233155339.788op/s; 233198961.015op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [69.927µs; 70.026µs] or [-0.071%; +0.071%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [14280779.011op/s; 14301015.666op/s] or [-0.071%; +0.071%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [64.859µs; 64.989µs] or [-0.100%; +0.100%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15388136.527op/s; 15418839.199op/s] or [-0.100%; +0.100%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.288µs; 4.289µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [233167959.001op/s; 233205568.617op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [61.901µs; 61.927µs] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [16148069.631op/s; 16154867.197op/s] or [-0.021%; +0.021%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [58.667µs; 58.678µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [17042245.506op/s; 17045279.800op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.442µs; 6.445µs] or [-0.022%; +0.022%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155160784.975op/s; 155229145.722op/s] or [-0.022%; +0.022%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.633µs 39.316µs ± 1.160µs 38.796µs ± 0.077µs 38.921µs 41.844µs 41.868µs 42.180µs 8.72% 1.693 0.905 2.94% 0.082µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.155µs; 39.477µs] or [-0.409%; +0.409%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz ac39e61 1738716427 levi/replayer-printer
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 700.617µs 701.957µs ± 0.952µs 701.862µs ± 0.385µs 702.255µs 702.910µs 706.390µs 709.054µs 1.02% 4.591 30.591 0.14% 0.067µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1410330.585op/s 1424590.742op/s ± 1920.398op/s 1424782.056op/s ± 780.109op/s 1425539.885op/s 1426556.011op/s 1426906.136op/s 1427313.040op/s 0.18% -4.544 30.145 0.13% 135.793op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 479.750µs 481.036µs ± 0.595µs 480.998µs ± 0.215µs 481.206µs 481.528µs 481.959µs 487.823µs 1.42% 7.392 82.723 0.12% 0.042µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2049925.013op/s 2078850.296op/s ± 2550.275op/s 2079008.923op/s ± 927.075op/s 2080010.072op/s 2081214.192op/s 2082990.692op/s 2084418.968op/s 0.26% -7.281 81.092 0.12% 180.332op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 190.220µs 190.689µs ± 0.203µs 190.683µs ± 0.143µs 190.825µs 191.031µs 191.291µs 191.382µs 0.37% 0.491 0.528 0.11% 0.014µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5225147.590op/s 5244136.214op/s ± 5574.863op/s 5244314.458op/s ± 3930.310op/s 5248171.392op/s 5252417.021op/s 5254493.081op/s 5257083.516op/s 0.24% -0.484 0.512 0.11% 394.202op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.301µs 46.449µs ± 0.126µs 46.441µs ± 0.030µs 46.472µs 46.532µs 46.567µs 48.076µs 3.52% 10.812 137.365 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 20800186.088op/s 21528952.185op/s ± 56769.140op/s 21532632.101op/s ± 14116.415op/s 21545945.904op/s 21569947.027op/s 21590296.684op/s 21597631.561op/s 0.30% -10.629 134.255 0.26% 4014.184op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.019µs 49.195µs ± 0.205µs 49.173µs ± 0.049µs 49.225µs 49.292µs 49.390µs 51.507µs 4.75% 8.908 90.500 0.42% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19414906.140op/s 20327458.374op/s ± 81780.031op/s 20336351.567op/s ± 20404.912op/s 20355981.665op/s 20376940.612op/s 20394403.584op/s 20400367.769op/s 0.31% -8.746 87.861 0.40% 5782.721op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [701.825µs; 702.089µs] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1424324.593op/s; 1424856.891op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [480.953µs; 481.118µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2078496.852op/s; 2079203.739op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [190.661µs; 190.717µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5243363.592op/s; 5244908.837op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.432µs; 46.467µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21521084.528op/s; 21536819.841op/s] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.167µs; 49.224µs] or [-0.058%; +0.058%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20316124.448op/s; 20338792.299op/s] or [-0.056%; +0.056%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

Codecov Report

Attention: Patch coverage is 0% with 19 lines in your changes missing coverage. Please review.

Project coverage is 71.54%. Comparing base (03ca950) to head (ac39e61).
Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #854      +/-   ##
==========================================
- Coverage   71.63%   71.54%   -0.10%     
==========================================
  Files         317      320       +3     
  Lines       46745    46942     +197     
==========================================
+ Hits        33487    33583      +96     
- Misses      13258    13359     +101     
Components Coverage Δ
crashtracker 43.29% <76.33%> (+0.99%) ⬆️
crashtracker-ffi 6.28% <0.00%> (-0.11%) ⬇️
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.48% <ø> (ø)
data-pipeline-ffi 90.08% <ø> (ø)
ddcommon 80.61% <ø> (ø)
ddcommon-ffi 62.11% <ø> (ø)
ddtelemetry 59.51% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.01% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 79.98% <0.00%> (-0.25%) ⬇️
profiling-ffi 70.44% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 41.79% <ø> (ø)
sidecar-ffi 10.78% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 93.60% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 94.21% <ø> (ø)

@realFlowControl realFlowControl merged commit d62c468 into main Feb 5, 2025
31 checks passed
@realFlowControl realFlowControl deleted the levi/replayer-printer branch February 5, 2025 07:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants