Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make runtime configurable #849

Merged
merged 1 commit into from
Feb 6, 2025
Merged

Make runtime configurable #849

merged 1 commit into from
Feb 6, 2025

Conversation

hoolioh
Copy link
Contributor

@hoolioh hoolioh commented Feb 3, 2025

What does this PR do?

Makes the runtime_id property configurable by library clients.

@hoolioh hoolioh changed the base branch from main to julio/APMSP-1449-add-telemetry-metrics February 3, 2025 13:30
@hoolioh hoolioh force-pushed the julio/APMSP-1449-add-telemetry-metrics branch 2 times, most recently from 3af2a38 to 522fad4 Compare February 3, 2025 13:32
@hoolioh hoolioh force-pushed the julio/APMSP-1449-runtime-id branch from c3a6b66 to 0d7e959 Compare February 3, 2025 13:33
@pr-commenter
Copy link

pr-commenter bot commented Feb 3, 2025

Benchmarks

Comparison

Benchmark execution time: 2025-02-06 10:59:52

Comparing candidate commit 13bcec4 in PR branch julio/APMSP-1449-runtime-id with baseline commit b8cdf9e in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.436µs 39.006µs ± 0.973µs 38.546µs ± 0.051µs 38.664µs 41.087µs 41.151µs 41.828µs 8.51% 1.692 0.945 2.49% 0.069µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [38.871µs; 39.140µs] or [-0.346%; +0.346%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 58.243ms 58.464ms ± 0.191ms 58.410ms ± 0.046ms 58.475ms 58.899ms 59.347ms 59.456ms 1.79% 2.944 9.749 0.33% 0.014ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [58.438ms; 58.491ms] or [-0.045%; +0.045%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 500.000µs 500.849µs ± 0.584µs 500.809µs ± 0.248µs 501.034µs 501.545µs 502.224µs 506.550µs 1.15% 5.106 44.892 0.12% 0.041µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1974137.699op/s 1996611.913op/s ± 2315.524op/s 1996769.228op/s ± 988.564op/s 1997843.162op/s 1998957.511op/s 1999759.687op/s 1999999.333op/s 0.16% -5.034 43.951 0.12% 163.732op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 472.944µs 474.362µs ± 0.957µs 474.260µs ± 0.173µs 474.447µs 474.792µs 475.439µs 483.467µs 1.94% 8.161 73.881 0.20% 0.068µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2068394.175op/s 2108102.676op/s ± 4185.651op/s 2108546.533op/s ± 767.820op/s 2109186.420op/s 2110790.066op/s 2112177.564op/s 2114414.061op/s 0.28% -8.105 73.202 0.20% 295.970op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 166.235µs 166.721µs ± 0.184µs 166.736µs ± 0.114µs 166.831µs 167.003µs 167.150µs 167.273µs 0.32% -0.140 0.355 0.11% 0.013µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5978266.083op/s 5998038.956op/s ± 6630.159op/s 5997507.966op/s ± 4113.626op/s 6002235.065op/s 6010139.157op/s 6014308.407op/s 6015577.828op/s 0.30% 0.148 0.354 0.11% 468.823op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.677µs 45.954µs ± 0.122µs 45.953µs ± 0.081µs 46.037µs 46.149µs 46.221µs 46.579µs 1.36% 0.585 2.330 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21468931.102op/s 21761201.945op/s ± 57800.375op/s 21761371.451op/s ± 38579.349op/s 21798412.145op/s 21855505.065op/s 21874783.587op/s 21893072.713op/s 0.61% -0.553 2.188 0.26% 4087.104op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 42.074µs 42.354µs ± 0.135µs 42.337µs ± 0.058µs 42.404µs 42.495µs 42.585µs 43.605µs 2.99% 4.909 40.073 0.32% 0.010µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22933296.903op/s 23610753.917op/s ± 74199.579op/s 23620037.412op/s ± 32421.342op/s 23649263.121op/s 23686468.486op/s 23709011.259op/s 23767647.478op/s 0.62% -4.740 38.099 0.31% 5246.703op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [500.768µs; 500.930µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1996291.003op/s; 1996932.822op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [474.229µs; 474.495µs] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2107522.585op/s; 2108682.766op/s] or [-0.028%; +0.028%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [166.696µs; 166.747µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5997120.080op/s; 5998957.832op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.937µs; 45.971µs] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21753191.369op/s; 21769212.521op/s] or [-0.037%; +0.037%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [42.335µs; 42.373µs] or [-0.044%; +0.044%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [23600470.569op/s; 23621037.265op/s] or [-0.044%; +0.044%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.317µs 4.337µs ± 0.005µs 4.336µs ± 0.001µs 4.338µs 4.340µs 4.344µs 4.391µs 1.27% 8.159 100.888 0.11% 0.000µs 1 200
credit_card/is_card_number/ throughput 227732756.055op/s 230599491.330op/s ± 241475.517op/s 230619202.568op/s ± 67847.474op/s 230681343.647op/s 230763438.023op/s 230829913.520op/s 231661511.102op/s 0.45% -8.044 99.402 0.10% 17074.898op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 96.063µs 96.931µs ± 0.441µs 96.912µs ± 0.164µs 97.078µs 97.245µs 97.416µs 102.207µs 5.46% 8.547 101.013 0.45% 0.031µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 9784105.251op/s 10316792.997op/s ± 45191.046op/s 10318614.509op/s ± 17390.882op/s 10334222.160op/s 10363077.186op/s 10379686.358op/s 10409887.311op/s 0.88% -8.143 94.830 0.44% 3195.489op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 87.420µs 88.395µs ± 0.485µs 88.386µs ± 0.242µs 88.617µs 88.895µs 89.179µs 93.351µs 5.62% 5.237 52.727 0.55% 0.034µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 10712223.813op/s 11313170.123op/s ± 60423.570op/s 11313989.927op/s ± 31033.447op/s 11345439.784op/s 11378226.516op/s 11423845.667op/s 11439003.570op/s 1.10% -4.804 47.193 0.53% 4272.592op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.318µs 4.336µs ± 0.004µs 4.336µs ± 0.001µs 4.337µs 4.340µs 4.342µs 4.383µs 1.10% 7.094 85.852 0.09% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 228140897.920op/s 230616800.863op/s ± 217240.475op/s 230639272.680op/s ± 54520.516op/s 230683702.197op/s 230773104.590op/s 230946793.214op/s 231597021.584op/s 0.42% -6.987 84.546 0.09% 15361.221op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 84.260µs 85.482µs ± 0.319µs 85.543µs ± 0.185µs 85.708µs 85.915µs 86.016µs 86.162µs 0.72% -1.042 1.702 0.37% 0.023µs 1 200
credit_card/is_card_number/378282246310005 throughput 11606078.967op/s 11698552.316op/s ± 43765.038op/s 11689988.743op/s ± 25220.702op/s 11718744.448op/s 11783756.318op/s 11841282.912op/s 11868085.319op/s 1.52% 1.071 1.798 0.37% 3094.656op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 59.554µs 60.042µs ± 0.125µs 60.055µs ± 0.077µs 60.129µs 60.212µs 60.270µs 60.278µs 0.37% -0.761 0.970 0.21% 0.009µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16589729.725op/s 16654956.011op/s ± 34715.947op/s 16651397.900op/s ± 21226.327op/s 16674799.801op/s 16716847.408op/s 16739691.742op/s 16791490.113op/s 0.84% 0.776 1.016 0.21% 2454.788op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.840µs 6.847µs ± 0.003µs 6.846µs ± 0.002µs 6.848µs 6.853µs 6.857µs 6.864µs 0.26% 1.548 4.599 0.05% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 145689418.082op/s 146050528.367op/s ± 67049.710op/s 146062440.044op/s ± 35317.355op/s 146094543.369op/s 146126185.082op/s 146168950.964op/s 146193651.653op/s 0.09% -1.542 4.568 0.05% 4741.130op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.316µs 4.336µs ± 0.002µs 4.336µs ± 0.001µs 4.337µs 4.339µs 4.341µs 4.341µs 0.12% -3.036 24.239 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 230340001.611op/s 230622511.772op/s ± 125776.702op/s 230615467.907op/s ± 64795.577op/s 230683690.664op/s 230777115.339op/s 230897429.666op/s 231686846.956op/s 0.46% 3.064 24.527 0.05% 8893.756op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 73.437µs 74.255µs ± 0.209µs 74.268µs ± 0.111µs 74.371µs 74.555µs 74.639µs 75.360µs 1.47% 0.016 4.387 0.28% 0.015µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13269659.935op/s 13467205.087op/s ± 37956.044op/s 13464749.286op/s ± 20149.278op/s 13486410.759op/s 13529920.642op/s 13569137.019op/s 13617188.160op/s 1.13% 0.038 4.251 0.28% 2683.898op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 66.075µs 66.655µs ± 0.161µs 66.679µs ± 0.101µs 66.761µs 66.896µs 66.963µs 67.022µs 0.51% -0.620 0.831 0.24% 0.011µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 14920559.955op/s 15002651.116op/s ± 36333.325op/s 14997123.552op/s ± 22671.345op/s 15022974.640op/s 15065055.133op/s 15113822.205op/s 15134402.576op/s 0.92% 0.638 0.869 0.24% 2569.154op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.311µs 4.336µs ± 0.003µs 4.336µs ± 0.001µs 4.337µs 4.339µs 4.340µs 4.342µs 0.14% -4.262 37.649 0.06% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 230312154.332op/s 230644772.890op/s ± 138099.380op/s 230638949.870op/s ± 57044.489op/s 230687629.378op/s 230828942.214op/s 230995427.984op/s 231944614.803op/s 0.57% 4.300 38.109 0.06% 9765.101op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 62.836µs 63.396µs ± 0.177µs 63.408µs ± 0.111µs 63.516µs 63.653µs 63.770µs 64.005µs 0.94% -0.290 0.581 0.28% 0.013µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15623753.128op/s 15774077.433op/s ± 44147.379op/s 15770804.299op/s ± 27656.933op/s 15798690.289op/s 15853159.142op/s 15874388.504op/s 15914495.245op/s 0.91% 0.311 0.583 0.28% 3121.691op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 59.677µs 60.055µs ± 0.115µs 60.063µs ± 0.077µs 60.133µs 60.236µs 60.272µs 60.296µs 0.39% -0.449 0.329 0.19% 0.008µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16584797.024op/s 16651361.873op/s ± 31846.846op/s 16649263.867op/s ± 21314.229op/s 16671282.050op/s 16698894.222op/s 16727649.540op/s 16756995.569op/s 0.65% 0.461 0.352 0.19% 2251.912op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.839µs 6.848µs ± 0.004µs 6.847µs ± 0.002µs 6.849µs 6.855µs 6.859µs 6.863µs 0.24% 0.952 1.920 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 145703613.320op/s 146035056.615op/s ± 79083.261op/s 146048773.393op/s ± 38321.601op/s 146080644.315op/s 146142973.349op/s 146211446.020op/s 146230027.741op/s 0.12% -0.947 1.907 0.05% 5592.031op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.336µs; 4.337µs] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ throughput [230566025.146op/s; 230632957.514op/s] or [-0.015%; +0.015%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [96.870µs; 96.992µs] or [-0.063%; +0.063%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10310529.953op/s; 10323056.041op/s] or [-0.061%; +0.061%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [88.328µs; 88.462µs] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11304795.998op/s; 11321544.249op/s] or [-0.074%; +0.074%] None None None
credit_card/is_card_number/37828224631 execution_time [4.336µs; 4.337µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/37828224631 throughput [230586693.423op/s; 230646908.304op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/378282246310005 execution_time [85.438µs; 85.526µs] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/378282246310005 throughput [11692486.903op/s; 11704617.730op/s] or [-0.052%; +0.052%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [60.025µs; 60.060µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16650144.715op/s; 16659767.308op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.847µs; 6.847µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number/x371413321323331 throughput [146041235.922op/s; 146059820.812op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.336µs; 4.336µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ throughput [230605080.331op/s; 230639943.213op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [74.226µs; 74.284µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13461944.744op/s; 13472465.430op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [66.633µs; 66.678µs] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [14997615.667op/s; 15007686.566op/s] or [-0.034%; +0.034%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.335µs; 4.336µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [230625633.645op/s; 230663912.136op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [63.371µs; 63.420µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [15767959.031op/s; 15780195.835op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [60.039µs; 60.071µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16646948.206op/s; 16655775.540op/s] or [-0.027%; +0.027%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.847µs; 6.848µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [146024096.435op/s; 146046016.794op/s] or [-0.008%; +0.008%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.388µs 5.460µs ± 0.047µs 5.445µs ± 0.030µs 5.512µs 5.539µs 5.558µs 5.564µs 2.19% 0.611 -0.861 0.85% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.453µs; 5.466µs] or [-0.118%; +0.118%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 274.105µs 274.597µs ± 0.228µs 274.584µs ± 0.175µs 274.761µs 274.925µs 275.056µs 275.792µs 0.44% 0.833 2.885 0.08% 0.016µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3625916.602op/s 3641701.499op/s ± 3019.648op/s 3641878.986op/s ± 2320.700op/s 3644076.158op/s 3646028.885op/s 3647110.376op/s 3648232.997op/s 0.17% -0.823 2.832 0.08% 213.521op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 25.014µs 25.081µs ± 0.038µs 25.078µs ± 0.022µs 25.097µs 25.135µs 25.160µs 25.399µs 1.28% 2.954 21.773 0.15% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 39371955.149op/s 39871003.690op/s ± 60809.095op/s 39875351.052op/s ± 34361.974op/s 39914139.087op/s 39948092.011op/s 39967325.660op/s 39977177.941op/s 0.26% -2.886 21.049 0.15% 4299.852op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 14.946µs 14.996µs ± 0.029µs 14.995µs ± 0.024µs 15.013µs 15.048µs 15.071µs 15.090µs 0.64% 0.645 0.074 0.19% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 66267954.474op/s 66685236.282op/s ± 127095.607op/s 66691120.077op/s ± 106953.136op/s 66806961.322op/s 66850369.393op/s 66864094.406op/s 66905960.014op/s 0.32% -0.635 0.052 0.19% 8987.017op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [274.566µs; 274.629µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3641283.005op/s; 3642119.993op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [25.076µs; 25.086µs] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [39862576.134op/s; 39879431.246op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_name/normalize_name/good execution_time [14.992µs; 15.000µs] or [-0.026%; +0.026%] None None None
normalization/normalize_name/normalize_name/good throughput [66667622.053op/s; 66702850.510op/s] or [-0.026%; +0.026%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 294.411ns 306.087ns ± 13.405ns 299.846ns ± 3.053ns 305.559ns 334.352ns 344.884ns 349.477ns 16.55% 1.572 1.270 4.37% 0.948ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [304.229ns; 307.944ns] or [-0.607%; +0.607%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.225ms 6.242ms ± 0.010ms 6.241ms ± 0.004ms 6.245ms 6.254ms 6.267ms 6.336ms 1.51% 4.855 38.181 0.16% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.241ms; 6.244ms] or [-0.023%; +0.023%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.423µs 3.305µs ± 1.471µs 3.106µs ± 0.027µs 3.133µs 3.749µs 14.423µs 15.361µs 394.63% 7.478 56.473 44.39% 0.104µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.101µs; 3.509µs] or [-6.167%; +6.167%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 79.390µs 79.667µs ± 0.264µs 79.643µs ± 0.045µs 79.691µs 79.790µs 79.885µs 83.218µs 4.49% 12.190 161.180 0.33% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [79.630µs; 79.703µs] or [-0.046%; +0.046%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.668µs 2.739µs ± 0.021µs 2.741µs ± 0.004µs 2.747µs 2.770µs 2.779µs 2.788µs 1.72% -1.711 4.127 0.76% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.736µs; 2.742µs] or [-0.105%; +0.105%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 145.559µs 146.506µs ± 0.441µs 146.442µs ± 0.161µs 146.608µs 146.999µs 148.026µs 150.309µs 2.64% 4.808 34.388 0.30% 0.031µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [146.445µs; 146.567µs] or [-0.042%; +0.042%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 13bcec4 1738838942 julio/APMSP-1449-runtime-id
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.199µs 27.589µs ± 13.766µs 18.686µs ± 0.355µs 36.353µs 46.145µs 53.073µs 144.880µs 675.34% 3.761 26.498 49.77% 0.973µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.681µs; 29.496µs] or [-6.915%; +6.915%] None None None

Baseline

Omitted due to size.

@codecov-commenter
Copy link

codecov-commenter commented Feb 3, 2025

Codecov Report

Attention: Patch coverage is 97.18310% with 2 lines in your changes missing coverage. Please review.

Project coverage is 71.94%. Comparing base (b8cdf9e) to head (13bcec4).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #849      +/-   ##
==========================================
+ Coverage   71.89%   71.94%   +0.05%     
==========================================
  Files         322      322              
  Lines       47977    48026      +49     
==========================================
+ Hits        34491    34551      +60     
+ Misses      13486    13475      -11     
Components Coverage Δ
crashtracker 43.31% <ø> (ø)
crashtracker-ffi 6.30% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.04% <97.18%> (+0.02%) ⬆️
data-pipeline-ffi 89.93% <ø> (ø)
ddcommon 80.08% <ø> (ø)
ddcommon-ffi 61.05% <ø> (ø)
ddtelemetry 61.74% <ø> (ø)
ddtelemetry-ffi 22.46% <ø> (ø)
dogstatsd 90.01% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.68% <ø> (ø)
profiling 80.04% <ø> (ø)
profiling-ffi 70.68% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.89% <ø> (ø)
sidecar-ffi 3.84% <ø> (ø)
spawn-worker 54.37% <ø> (ø)
tinybytes 93.60% <ø> (ø)
trace-mini-agent 72.48% <ø> (ø)
trace-normalization 98.23% <ø> (ø)
trace-obfuscation 95.96% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.87% <ø> (ø)

@hoolioh hoolioh force-pushed the julio/APMSP-1449-add-telemetry-metrics branch 2 times, most recently from c9899e6 to 650a7ca Compare February 5, 2025 13:53
Base automatically changed from julio/APMSP-1449-add-telemetry-metrics to main February 5, 2025 14:22
@hoolioh hoolioh force-pushed the julio/APMSP-1449-runtime-id branch 3 times, most recently from 1c2f426 to 6e703ef Compare February 6, 2025 09:49
@hoolioh hoolioh marked this pull request as ready for review February 6, 2025 09:52
@hoolioh hoolioh requested a review from a team as a code owner February 6, 2025 09:52
@hoolioh hoolioh force-pushed the julio/APMSP-1449-runtime-id branch from 6e703ef to 13bcec4 Compare February 6, 2025 10:49
@hoolioh hoolioh enabled auto-merge (squash) February 6, 2025 10:49
@hoolioh hoolioh merged commit faad98b into main Feb 6, 2025
31 checks passed
@hoolioh hoolioh deleted the julio/APMSP-1449-runtime-id branch February 6, 2025 11:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants