Various update-related fixups

[sanchda]

What does this PR do?

Bump version numbers to v14.0.0

Motivation

New release, mostly for crashtracking

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

[pr-commenter]

Benchmarks

Comparison

Benchmark execution time: 2024-11-01 15:23:31

Comparing candidate commit 3f1523d in PR branch sanchda/v14.0.0 with baseline commit 4f324e7 in branch main.

Found 8 performance improvements and 12 performance regressions! Performance is the same for 31 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

• 🟥 execution_time [+8.629µs; +8.689µs] or [+14.512%; +14.613%]
• 🟥 throughput [-2145990.537op/s; -2129842.207op/s] or [-12.760%; -12.664%]

scenario:credit_card/is_card_number/x371413321323331

• 🟩 execution_time [-404.208ns; -401.920ns] or [-5.597%; -5.565%]
• 🟩 throughput [+8161227.717op/s; +8207355.577op/s] or [+5.894%; +5.927%]

scenario:credit_card/is_card_number_no_luhn/ 378282246310005

• 🟩 execution_time [-1.753µs; -1.599µs] or [-2.622%; -2.392%]
• 🟩 throughput [+367568.491op/s; +403365.355op/s] or [+2.457%; +2.696%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

• 🟥 execution_time [+8.515µs; +8.581µs] or [+14.295%; +14.406%]
• 🟥 throughput [-2116072.864op/s; -2097990.415op/s] or [-12.605%; -12.497%]

scenario:credit_card/is_card_number_no_luhn/x371413321323331

• 🟩 execution_time [-403.261ns; -402.257ns] or [-5.584%; -5.570%]
• 🟩 throughput [+8167855.635op/s; +8188478.287op/s] or [+5.899%; +5.914%]

scenario:normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...

• 🟥 execution_time [+35.962µs; +36.332µs] or [+18.802%; +18.996%]
• 🟥 throughput [-836168.137op/s; -826389.182op/s] or [-15.992%; -15.805%]

scenario:normalization/normalize_name/normalize_name/bad-name

• 🟥 execution_time [+2.550µs; +2.610µs] or [+13.993%; +14.325%]
• 🟥 throughput [-6871039.739op/s; -6730297.607op/s] or [-12.522%; -12.265%]

scenario:normalization/normalize_name/normalize_name/good

• 🟥 execution_time [+1.346µs; +1.401µs] or [+11.859%; +12.344%]
• 🟥 throughput [-9666610.632op/s; -9324855.939op/s] or [-10.968%; -10.581%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

• 🟩 execution_time [-79.804µs; -79.449µs] or [-12.776%; -12.719%]
• 🟩 throughput [+233310.790op/s; +234477.882op/s] or [+14.574%; +14.647%]

scenario:normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters

• 🟥 execution_time [+15.928µs; +15.976µs] or [+8.929%; +8.956%]
• 🟥 throughput [-460822.122op/s; -459447.537op/s] or [-8.220%; -8.196%]

Candidate

Candidate benchmark details

Group 1

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
credit_card/is_card_number/	execution_time	4.600µs	4.607µs ± 0.004µs	4.606µs ± 0.003µs	4.610µs	4.615µs	4.618µs	4.622µs	0.35%	0.761	0.213	0.10%	0.000µs	1	200
credit_card/is_card_number/	throughput	216339243.052op/s	217070685.440op/s ± 210428.306op/s	217102974.325op/s ± 138449.842op/s	217234788.764op/s	217353288.313op/s	217383830.894op/s	217405803.003op/s	0.14%	-0.757	0.201	0.10%	14879.528op/s	1	200
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	90.768µs	91.980µs ± 0.518µs	91.955µs ± 0.199µs	92.135µs	92.667µs	93.437µs	96.305µs	4.73%	3.085	23.465	0.56%	0.037µs	1	200
credit_card/is_card_number/ 3782-8224-6310-005	throughput	10383627.401op/s	10872293.376op/s ± 60262.789op/s	10874887.210op/s ± 23509.265op/s	10901850.318op/s	10954132.519op/s	10985138.383op/s	11017151.987op/s	1.31%	-2.828	20.894	0.55%	4261.223op/s	1	200
credit_card/is_card_number/ 378282246310005	execution_time	83.121µs	83.828µs ± 0.419µs	83.736µs ± 0.040µs	83.813µs	84.546µs	85.695µs	87.646µs	4.67%	5.335	38.505	0.50%	0.030µs	1	200
credit_card/is_card_number/ 378282246310005	throughput	11409473.057op/s	11929432.134op/s ± 58046.275op/s	11942274.629op/s ± 5755.268op/s	11947192.216op/s	11963656.441op/s	12025265.029op/s	12030625.159op/s	0.74%	-5.160	36.226	0.49%	4104.491op/s	1	200
credit_card/is_card_number/37828224631	execution_time	4.600µs	4.609µs ± 0.006µs	4.608µs ± 0.004µs	4.612µs	4.618µs	4.627µs	4.654µs	0.99%	2.296	12.745	0.13%	0.000µs	1	200
credit_card/is_card_number/37828224631	throughput	214884136.275op/s	216977121.578op/s ± 291776.112op/s	217018585.488op/s ± 175529.005op/s	217182567.396op/s	217340429.590op/s	217371355.967op/s	217412334.560op/s	0.18%	-2.258	12.402	0.13%	20631.687op/s	1	200
credit_card/is_card_number/378282246310005	execution_time	80.070µs	80.304µs ± 0.229µs	80.238µs ± 0.100µs	80.395µs	80.682µs	80.996µs	81.903µs	2.07%	2.724	12.423	0.28%	0.016µs	1	200
credit_card/is_card_number/378282246310005	throughput	12209591.210op/s	12452825.108op/s ± 35276.306op/s	12462887.397op/s ± 15458.961op/s	12476051.595op/s	12484450.180op/s	12486707.962op/s	12489095.770op/s	0.21%	-2.665	11.876	0.28%	2494.412op/s	1	200
credit_card/is_card_number/37828224631000521389798	execution_time	68.040µs	68.118µs ± 0.101µs	68.090µs ± 0.024µs	68.118µs	68.330µs	68.524µs	68.771µs	1.00%	3.406	13.948	0.15%	0.007µs	1	200
credit_card/is_card_number/37828224631000521389798	throughput	14540975.529op/s	14680360.762op/s ± 21668.894op/s	14686499.436op/s ± 5200.489op/s	14691429.387op/s	14693846.438op/s	14694702.518op/s	14697282.472op/s	0.07%	-3.387	13.768	0.15%	1532.222op/s	1	200
credit_card/is_card_number/x371413321323331	execution_time	6.815µs	6.819µs ± 0.006µs	6.819µs ± 0.002µs	6.820µs	6.822µs	6.825µs	6.894µs	1.11%	11.329	146.046	0.08%	0.000µs	1	200
credit_card/is_card_number/x371413321323331	throughput	145047617.541op/s	146647177.617op/s ± 122228.098op/s	146658693.585op/s ± 33406.499op/s	146688917.653op/s	146725908.128op/s	146734708.778op/s	146742966.341op/s	0.06%	-11.279	145.180	0.08%	8642.832op/s	1	200
credit_card/is_card_number_no_luhn/	execution_time	4.597µs	4.608µs ± 0.005µs	4.607µs ± 0.004µs	4.612µs	4.617µs	4.622µs	4.629µs	0.47%	0.707	0.582	0.11%	0.000µs	1	200
credit_card/is_card_number_no_luhn/	throughput	216018718.306op/s	217009368.391op/s ± 246546.025op/s	217042462.043op/s ± 182279.001op/s	217217650.513op/s	217336135.711op/s	217359983.847op/s	217549566.179op/s	0.23%	-0.700	0.559	0.11%	17433.437op/s	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	72.672µs	73.402µs ± 0.174µs	73.395µs ± 0.092µs	73.501µs	73.650µs	73.710µs	74.227µs	1.13%	-0.682	6.130	0.24%	0.012µs	1	200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	13472111.157op/s	13623758.234op/s ± 32421.669op/s	13624817.576op/s ± 17092.242op/s	13640312.046op/s	13659872.354op/s	13756668.381op/s	13760500.794op/s	1.00%	0.737	6.168	0.24%	2292.558op/s	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	64.470µs	65.166µs ± 0.500µs	65.130µs ± 0.398µs	65.513µs	66.068µs	66.184µs	66.241µs	1.71%	0.314	-0.952	0.76%	0.035µs	1	200
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	15096473.327op/s	15346368.354op/s ± 117377.877op/s	15353994.829op/s ± 94504.321op/s	15447785.506op/s	15506768.760op/s	15509389.040op/s	15511070.120op/s	1.02%	-0.292	-0.972	0.76%	8299.869op/s	1	200
credit_card/is_card_number_no_luhn/37828224631	execution_time	4.600µs	4.608µs ± 0.006µs	4.607µs ± 0.004µs	4.611µs	4.618µs	4.625µs	4.641µs	0.73%	1.533	4.814	0.12%	0.000µs	1	200
credit_card/is_card_number_no_luhn/37828224631	throughput	215483849.580op/s	217020192.797op/s ± 269694.083op/s	217060180.473op/s ± 173972.484op/s	217213689.647op/s	217346371.894op/s	217379791.921op/s	217399598.387op/s	0.16%	-1.516	4.705	0.12%	19070.251op/s	1	200
credit_card/is_card_number_no_luhn/378282246310005	execution_time	62.080µs	62.509µs ± 0.407µs	62.450µs ± 0.309µs	62.752µs	63.207µs	63.674µs	64.698µs	3.60%	1.330	3.355	0.65%	0.029µs	1	200
credit_card/is_card_number_no_luhn/378282246310005	throughput	15456506.973op/s	15998453.567op/s ± 103323.080op/s	16012932.888op/s ± 79190.022op/s	16094076.575op/s	16105492.537op/s	16106652.611op/s	16108178.122op/s	0.59%	-1.263	2.941	0.64%	7306.045op/s	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	68.046µs	68.116µs ± 0.078µs	68.098µs ± 0.021µs	68.112µs	68.291µs	68.430µs	68.454µs	0.52%	2.644	6.870	0.11%	0.006µs	1	200
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	14608245.609op/s	14680962.490op/s ± 16830.781op/s	14684808.566op/s ± 4467.011op/s	14690692.712op/s	14693175.608op/s	14695064.883op/s	14695908.659op/s	0.08%	-2.638	6.834	0.11%	1190.116op/s	1	200
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	6.814µs	6.819µs ± 0.003µs	6.819µs ± 0.002µs	6.821µs	6.825µs	6.826µs	6.830µs	0.17%	1.001	1.042	0.04%	0.000µs	1	200
credit_card/is_card_number_no_luhn/x371413321323331	throughput	146403562.068op/s	146644567.458op/s ± 59037.349op/s	146655050.227op/s ± 39467.422op/s	146693340.122op/s	146708338.902op/s	146726229.372op/s	146752889.741op/s	0.07%	-0.999	1.033	0.04%	4174.571op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
credit_card/is_card_number/	execution_time	[4.606µs; 4.607µs] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/	throughput	[217041522.100op/s; 217099848.779op/s] or [-0.013%; +0.013%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	execution_time	[91.908µs; 92.052µs] or [-0.078%; +0.078%]	None	None	None
credit_card/is_card_number/ 3782-8224-6310-005	throughput	[10863941.533op/s; 10880645.219op/s] or [-0.077%; +0.077%]	None	None	None
credit_card/is_card_number/ 378282246310005	execution_time	[83.770µs; 83.886µs] or [-0.069%; +0.069%]	None	None	None
credit_card/is_card_number/ 378282246310005	throughput	[11921387.479op/s; 11937476.790op/s] or [-0.067%; +0.067%]	None	None	None
credit_card/is_card_number/37828224631	execution_time	[4.608µs; 4.610µs] or [-0.019%; +0.019%]	None	None	None
credit_card/is_card_number/37828224631	throughput	[216936684.215op/s; 217017558.941op/s] or [-0.019%; +0.019%]	None	None	None
credit_card/is_card_number/378282246310005	execution_time	[80.272µs; 80.335µs] or [-0.040%; +0.040%]	None	None	None
credit_card/is_card_number/378282246310005	throughput	[12447936.151op/s; 12457714.065op/s] or [-0.039%; +0.039%]	None	None	None
credit_card/is_card_number/37828224631000521389798	execution_time	[68.104µs; 68.132µs] or [-0.021%; +0.021%]	None	None	None
credit_card/is_card_number/37828224631000521389798	throughput	[14677357.662op/s; 14683363.862op/s] or [-0.020%; +0.020%]	None	None	None
credit_card/is_card_number/x371413321323331	execution_time	[6.818µs; 6.820µs] or [-0.012%; +0.012%]	None	None	None
credit_card/is_card_number/x371413321323331	throughput	[146630237.978op/s; 146664117.256op/s] or [-0.012%; +0.012%]	None	None	None
credit_card/is_card_number_no_luhn/	execution_time	[4.607µs; 4.609µs] or [-0.016%; +0.016%]	None	None	None
credit_card/is_card_number_no_luhn/	throughput	[216975199.484op/s; 217043537.299op/s] or [-0.016%; +0.016%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	execution_time	[73.377µs; 73.426µs] or [-0.033%; +0.033%]	None	None	None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005	throughput	[13619264.902op/s; 13628251.565op/s] or [-0.033%; +0.033%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	execution_time	[65.097µs; 65.235µs] or [-0.106%; +0.106%]	None	None	None
credit_card/is_card_number_no_luhn/ 378282246310005	throughput	[15330100.909op/s; 15362635.798op/s] or [-0.106%; +0.106%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	execution_time	[4.607µs; 4.609µs] or [-0.017%; +0.017%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631	throughput	[216982815.791op/s; 217057569.803op/s] or [-0.017%; +0.017%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	execution_time	[62.452µs; 62.565µs] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number_no_luhn/378282246310005	throughput	[15984133.982op/s; 16012773.153op/s] or [-0.090%; +0.090%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	execution_time	[68.105µs; 68.126µs] or [-0.016%; +0.016%]	None	None	None
credit_card/is_card_number_no_luhn/37828224631000521389798	throughput	[14678629.906op/s; 14683295.074op/s] or [-0.016%; +0.016%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	execution_time	[6.819µs; 6.820µs] or [-0.006%; +0.006%]	None	None	None
credit_card/is_card_number_no_luhn/x371413321323331	throughput	[146636385.449op/s; 146652749.467op/s] or [-0.006%; +0.006%]	None	None	None

Group 2

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	543.166µs	545.024µs ± 1.208µs	544.972µs ± 0.883µs	545.826µs	547.277µs	548.380µs	548.672µs	0.68%	0.628	0.001	0.22%	0.085µs	1	200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	1822581.904op/s	1834790.418op/s ± 4060.991op/s	1834956.452op/s ± 2973.597op/s	1838094.122op/s	1840115.652op/s	1840878.603op/s	1841057.163op/s	0.33%	-0.617	-0.022	0.22%	287.155op/s	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	467.768µs	468.294µs ± 0.240µs	468.276µs ± 0.176µs	468.469µs	468.689µs	468.849µs	469.009µs	0.16%	0.275	-0.356	0.05%	0.017µs	1	200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	2132155.486op/s	2135409.834op/s ± 1096.133op/s	2135494.904op/s ± 800.879op/s	2136180.555op/s	2137084.404op/s	2137428.047op/s	2137812.388op/s	0.11%	-0.273	-0.359	0.05%	77.508op/s	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	193.838µs	194.339µs ± 0.140µs	194.368µs ± 0.088µs	194.411µs	194.550µs	194.681µs	194.696µs	0.17%	-0.595	1.425	0.07%	0.010µs	1	200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	5136209.575op/s	5145656.590op/s ± 3712.357op/s	5144877.726op/s ± 2324.109op/s	5147764.026op/s	5152122.623op/s	5156540.706op/s	5158958.368op/s	0.27%	0.602	1.436	0.07%	262.503op/s	1	200
normalization/normalize_service/normalize_service/[empty string]	execution_time	46.214µs	46.545µs ± 0.190µs	46.485µs ± 0.157µs	46.738µs	46.812µs	46.837µs	46.924µs	0.94%	0.167	-1.502	0.41%	0.013µs	1	200
normalization/normalize_service/normalize_service/[empty string]	throughput	21311265.543op/s	21484815.438op/s ± 87645.578op/s	21512181.309op/s ± 73124.724op/s	21565434.921op/s	21599552.240op/s	21621159.550op/s	21638358.272op/s	0.59%	-0.161	-1.503	0.41%	6197.478op/s	1	200
normalization/normalize_service/normalize_service/test_ASCII	execution_time	49.694µs	49.908µs ± 0.210µs	49.829µs ± 0.117µs	50.118µs	50.238µs	50.304µs	51.041µs	2.43%	1.245	2.611	0.42%	0.015µs	1	200
normalization/normalize_service/normalize_service/test_ASCII	throughput	19592034.608op/s	20037363.932op/s ± 83979.571op/s	20068555.118op/s ± 47333.456op/s	20109015.483op/s	20120217.834op/s	20122660.720op/s	20123040.694op/s	0.27%	-1.208	2.349	0.42%	5938.252op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	execution_time	[544.857µs; 545.191µs] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...	throughput	[1834227.604op/s; 1835353.232op/s] or [-0.031%; +0.031%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	execution_time	[468.261µs; 468.328µs] or [-0.007%; +0.007%]	None	None	None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて	throughput	[2135257.920op/s; 2135561.747op/s] or [-0.007%; +0.007%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	execution_time	[194.319µs; 194.358µs] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters	throughput	[5145142.093op/s; 5146171.087op/s] or [-0.010%; +0.010%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	execution_time	[46.519µs; 46.572µs] or [-0.057%; +0.057%]	None	None	None
normalization/normalize_service/normalize_service/[empty string]	throughput	[21472668.604op/s; 21496962.272op/s] or [-0.057%; +0.057%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	execution_time	[49.879µs; 49.937µs] or [-0.058%; +0.058%]	None	None	None
normalization/normalize_service/normalize_service/test_ASCII	throughput	[20025725.171op/s; 20049002.693op/s] or [-0.058%; +0.058%]	None	None	None

Group 3

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
concentrator/add_spans_to_concentrator	execution_time	8.905ms	8.946ms ± 0.015ms	8.945ms ± 0.010ms	8.955ms	8.969ms	8.979ms	8.988ms	0.48%	-0.067	0.199	0.17%	0.001ms	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
concentrator/add_spans_to_concentrator	execution_time	[8.943ms; 8.948ms] or [-0.023%; +0.023%]	None	None	None

Group 4

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	225.895µs	227.407µs ± 0.473µs	227.410µs ± 0.218µs	227.633µs	227.876µs	228.160µs	231.803µs	1.93%	3.655	36.419	0.21%	0.033µs	1	200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	4314013.489op/s	4397423.388op/s ± 9072.069op/s	4397338.601op/s ± 4217.317op/s	4401323.986op/s	4408651.954op/s	4421040.473op/s	4426838.935op/s	0.67%	-3.502	34.789	0.21%	641.492op/s	1	200
normalization/normalize_name/normalize_name/bad-name	execution_time	20.102µs	20.804µs ± 0.217µs	20.815µs ± 0.142µs	20.956µs	21.164µs	21.228µs	21.324µs	2.45%	-0.298	0.045	1.04%	0.015µs	1	200
normalization/normalize_name/normalize_name/bad-name	throughput	46894484.148op/s	48072888.740op/s ± 502517.106op/s	48043361.014op/s ± 325231.588op/s	48369562.221op/s	48965106.602op/s	49218846.845op/s	49746831.884op/s	3.55%	0.360	0.116	1.04%	35533.325op/s	1	200
normalization/normalize_name/normalize_name/good	execution_time	12.232µs	12.720µs ± 0.197µs	12.734µs ± 0.125µs	12.834µs	13.048µs	13.197µs	13.486µs	5.90%	0.183	0.729	1.54%	0.014µs	1	200
normalization/normalize_name/normalize_name/good	throughput	74150321.970op/s	78635562.543op/s ± 1214483.968op/s	78528731.523op/s ± 776777.144op/s	79437631.610op/s	80667630.530op/s	81386383.843op/s	81752674.342op/s	4.11%	-0.062	0.557	1.54%	85876.985op/s	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	execution_time	[227.341µs; 227.472µs] or [-0.029%; +0.029%]	None	None	None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo...	throughput	[4396166.086op/s; 4398680.689op/s] or [-0.029%; +0.029%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	execution_time	[20.774µs; 20.834µs] or [-0.144%; +0.144%]	None	None	None
normalization/normalize_name/normalize_name/bad-name	throughput	[48003244.702op/s; 48142532.777op/s] or [-0.145%; +0.145%]	None	None	None
normalization/normalize_name/normalize_name/good	execution_time	[12.693µs; 12.747µs] or [-0.214%; +0.214%]	None	None	None
normalization/normalize_name/normalize_name/good	throughput	[78467246.745op/s; 78803878.340op/s] or [-0.214%; +0.214%]	None	None	None

Group 5

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
tags/replace_trace_tags	execution_time	2.621µs	2.659µs ± 0.015µs	2.655µs ± 0.006µs	2.668µs	2.692µs	2.697µs	2.699µs	1.68%	0.228	1.030	0.58%	0.001µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
tags/replace_trace_tags	execution_time	[2.657µs; 2.662µs] or [-0.080%; +0.080%]	None	None	None

Group 6

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
write only interface	execution_time	1.404µs	3.273µs ± 1.430µs	3.125µs ± 0.024µs	3.143µs	3.178µs	14.079µs	15.082µs	382.70%	7.577	57.568	43.57%	0.101µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
write only interface	execution_time	[3.075µs; 3.472µs] or [-6.053%; +6.053%]	None	None	None

Group 7

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching string interning on wordpress profile	execution_time	144.414µs	145.489µs ± 0.433µs	145.440µs ± 0.186µs	145.602µs	146.112µs	147.185µs	147.817µs	1.63%	2.028	7.420	0.30%	0.031µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching string interning on wordpress profile	execution_time	[145.429µs; 145.549µs] or [-0.041%; +0.041%]	None	None	None

Group 8

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
benching deserializing traces from msgpack to their internal representation	execution_time	1.115µs	1.177µs ± 0.023µs	1.179µs ± 0.014µs	1.197µs	1.200µs	1.202µs	1.203µs	2.05%	-1.230	0.802	1.98%	0.002µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
benching deserializing traces from msgpack to their internal representation	execution_time	[1.174µs; 1.180µs] or [-0.275%; +0.275%]	None	None	None

Group 9

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
redis/obfuscate_redis_string	execution_time	37.654µs	38.150µs ± 0.872µs	37.752µs ± 0.039µs	37.813µs	40.009µs	40.052µs	41.149µs	9.00%	1.737	1.175	2.28%	0.062µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
redis/obfuscate_redis_string	execution_time	[38.029µs; 38.271µs] or [-0.317%; +0.317%]	None	None	None

Group 10

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
sql/obfuscate_sql_string	execution_time	73.321µs	73.418µs ± 0.119µs	73.402µs ± 0.029µs	73.433µs	73.507µs	73.712µs	74.792µs	1.89%	8.492	90.968	0.16%	0.008µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
sql/obfuscate_sql_string	execution_time	[73.402µs; 73.435µs] or [-0.022%; +0.022%]	None	None	None

Group 11

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
normalization/normalize_trace/test_trace	execution_time	262.677ns	273.355ns ± 12.848ns	268.128ns ± 2.768ns	274.221ns	304.235ns	313.201ns	317.871ns	18.55%	1.943	2.777	4.69%	0.908ns	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
normalization/normalize_trace/test_trace	execution_time	[271.574ns; 275.135ns] or [-0.651%; +0.651%]	None	None	None

Group 12

cpu_model	git_commit_sha	git_commit_date	git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	3f1523d	1730473948	sanchda/v14.0.0

scenario	metric	min	mean ± sd	median ± mad	p75	p95	p99	max	peak_to_median_ratio	skewness	kurtosis	cv	sem	runs	sample_size
two way interface	execution_time	18.544µs	24.294µs ± 10.998µs	19.226µs ± 0.376µs	20.194µs	39.715µs	46.739µs	107.516µs	459.22%	3.526	19.365	45.16%	0.778µs	1	200

scenario	metric	95% CI mean	Shapiro-Wilk pvalue	Ljung-Box pvalue (lag=1)	Dip test pvalue
two way interface	execution_time	[22.770µs; 25.818µs] or [-6.274%; +6.274%]	None	None	None

Baseline

Omitted due to size.

[sanchda]

Converting to draft because this wasn't as automatic as I thought it would be. Will tick back when it looks good--sorry for the noise ya'll

[sanchda]

Blocking this behind #705, since we need the panic fixup from there

[sanchda]

I'm just going to go ahead and close this. Most of the work has been split into #705 and #706, so I'll open a new PR with a cleaner history to tackle the pure update-y stuff.