Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[improve](nestedtype) support schema change for nested type #39210

Merged

Conversation

amorynan
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@amorynan
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the doing label Aug 12, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 39772 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e2473053d644f4085070e51cd5d72f4a8db5cedf, data reload: false

------ Round 1 ----------------------------------
q1	17811	4555	4416	4416
q2	2720	180	180	180
q3	11085	1187	1136	1136
q4	10604	751	705	705
q5	7890	2589	2551	2551
q6	227	143	141	141
q7	996	609	602	602
q8	10113	1901	2053	1901
q9	8962	6550	6588	6550
q10	7065	2169	2149	2149
q11	469	248	251	248
q12	387	219	217	217
q13	17766	2994	2998	2994
q14	279	240	228	228
q15	529	485	478	478
q16	496	381	384	381
q17	976	631	668	631
q18	8134	7581	7370	7370
q19	1839	988	1065	988
q20	657	324	355	324
q21	5530	4604	4571	4571
q22	1123	1011	1016	1011
Total cold run time: 115658 ms
Total hot run time: 39772 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4390	4280	4237	4237
q2	380	270	268	268
q3	2886	2622	2642	2622
q4	1894	1607	1660	1607
q5	5298	5284	5261	5261
q6	219	131	156	131
q7	2061	1687	1657	1657
q8	3135	3315	3318	3315
q9	8434	8385	8405	8385
q10	3362	3194	3108	3108
q11	604	495	511	495
q12	779	586	567	567
q13	17429	2998	2947	2947
q14	301	269	265	265
q15	535	476	485	476
q16	461	433	418	418
q17	1783	1482	1487	1482
q18	7660	7560	7441	7441
q19	1719	1555	1561	1555
q20	1999	1813	1783	1783
q21	5366	5108	5179	5108
q22	1090	1038	1010	1010
Total cold run time: 71785 ms
Total hot run time: 54138 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 201177 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e2473053d644f4085070e51cd5d72f4a8db5cedf, data reload: false

query1	908	364	352	352
query2	6457	2022	1902	1902
query3	6649	203	212	203
query4	33495	23233	23026	23026
query5	4236	490	491	490
query6	269	160	160	160
query7	4579	304	299	299
query8	243	202	202	202
query9	8652	2519	2474	2474
query10	539	453	477	453
query11	15769	14899	15146	14899
query12	156	97	96	96
query13	1632	367	369	367
query14	10310	7611	7782	7611
query15	270	216	247	216
query16	7878	480	488	480
query17	1747	573	550	550
query18	2011	292	287	287
query19	187	146	142	142
query20	113	104	104	104
query21	205	103	100	100
query22	4202	4001	4191	4001
query23	33804	33102	33136	33102
query24	10885	2601	2630	2601
query25	622	384	391	384
query26	1313	158	150	150
query27	2889	289	288	288
query28	7405	2071	2062	2062
query29	950	415	428	415
query30	307	152	148	148
query31	969	755	767	755
query32	100	57	57	57
query33	765	287	285	285
query34	946	465	463	463
query35	964	838	794	794
query36	1115	934	911	911
query37	142	84	78	78
query38	4346	4202	4109	4109
query39	1577	1392	1368	1368
query40	276	121	116	116
query41	45	42	46	42
query42	117	101	99	99
query43	512	463	475	463
query44	1189	725	741	725
query45	235	209	207	207
query46	1094	752	729	729
query47	1842	1758	1774	1758
query48	368	308	295	295
query49	1086	429	431	429
query50	804	424	412	412
query51	6786	6773	6650	6650
query52	97	93	90	90
query53	254	190	183	183
query54	1043	460	452	452
query55	80	78	75	75
query56	284	253	251	251
query57	1195	1075	1104	1075
query58	239	246	242	242
query59	3151	2807	2746	2746
query60	302	264	269	264
query61	113	111	216	111
query62	822	629	638	629
query63	228	181	176	176
query64	10715	2279	1743	1743
query65	3220	3149	3158	3149
query66	1382	328	325	325
query67	15577	14763	14734	14734
query68	8727	551	567	551
query69	479	423	441	423
query70	1197	1112	1133	1112
query71	558	274	272	272
query72	20442	17065	16757	16757
query73	1193	324	329	324
query74	9249	8733	8784	8733
query75	4878	2673	2609	2609
query76	5069	1019	997	997
query77	799	309	315	309
query78	12204	9644	8987	8987
query79	11074	553	539	539
query80	1448	511	502	502
query81	604	225	221	221
query82	380	132	137	132
query83	341	149	144	144
query84	267	76	80	76
query85	757	302	263	263
query86	364	289	306	289
query87	4698	4446	4567	4446
query88	4794	2486	2508	2486
query89	403	292	293	292
query90	2407	197	197	197
query91	122	94	100	94
query92	64	49	51	49
query93	4027	546	539	539
query94	1212	286	286	286
query95	364	260	266	260
query96	619	281	276	276
query97	3209	3028	3078	3028
query98	235	196	193	193
query99	1517	1237	1252	1237
Total cold run time: 336363 ms
Total hot run time: 201177 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.81 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e2473053d644f4085070e51cd5d72f4a8db5cedf, data reload: false

query1	0.04	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.09	0.08
query5	0.50	0.49	0.49
query6	1.13	0.74	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.56	0.48	0.48
query10	0.54	0.55	0.54
query11	0.15	0.12	0.12
query12	0.15	0.12	0.12
query13	0.61	0.60	0.58
query14	0.78	0.78	0.76
query15	0.84	0.82	0.82
query16	0.36	0.38	0.37
query17	1.02	1.03	0.97
query18	0.23	0.23	0.22
query19	1.83	1.71	1.76
query20	0.01	0.01	0.01
query21	15.44	0.75	0.67
query22	3.57	7.53	2.02
query23	18.27	1.35	1.33
query24	2.12	0.23	0.22
query25	0.15	0.08	0.07
query26	0.30	0.22	0.21
query27	0.45	0.23	0.22
query28	13.27	1.01	1.00
query29	12.66	3.28	3.25
query30	0.23	0.05	0.05
query31	2.89	0.39	0.38
query32	3.29	0.48	0.47
query33	2.85	2.96	2.94
query34	17.08	4.34	4.39
query35	4.40	4.40	4.39
query36	0.66	0.47	0.47
query37	0.20	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.12	0.12
query41	0.10	0.04	0.04
query42	0.06	0.05	0.05
query43	0.04	0.04	0.04
Total cold run time: 109.18 s
Total hot run time: 30.81 s

@amorynan
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39552 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 099b71713dbf5f1630f7726b9443ec3db96e167b, data reload: false

------ Round 1 ----------------------------------
q1	17839	5267	4285	4285
q2	2022	219	202	202
q3	11693	1002	1116	1002
q4	10503	731	710	710
q5	7526	2592	2577	2577
q6	224	140	138	138
q7	967	588	594	588
q8	9220	1936	1904	1904
q9	8910	6582	6563	6563
q10	7013	2270	2179	2179
q11	451	241	242	241
q12	402	218	221	218
q13	18984	2984	3015	2984
q14	269	230	237	230
q15	537	497	495	495
q16	486	393	381	381
q17	986	667	631	631
q18	8150	7506	7406	7406
q19	5584	1077	1044	1044
q20	689	331	336	331
q21	5312	4622	4447	4447
q22	1132	996	1018	996
Total cold run time: 118899 ms
Total hot run time: 39552 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4533	4295	4281	4281
q2	378	272	269	269
q3	2879	2801	2774	2774
q4	1996	1767	1704	1704
q5	5564	5489	5452	5452
q6	224	135	135	135
q7	2149	1735	1767	1735
q8	3281	3464	3406	3406
q9	8860	8918	8750	8750
q10	3588	3194	3206	3194
q11	601	514	507	507
q12	824	643	665	643
q13	17121	3138	3144	3138
q14	332	295	300	295
q15	539	494	510	494
q16	499	445	424	424
q17	1857	1535	1531	1531
q18	8111	7947	7907	7907
q19	4938	1727	1515	1515
q20	2075	1866	1904	1866
q21	5578	5275	5356	5275
q22	1199	1064	1057	1057
Total cold run time: 77126 ms
Total hot run time: 56352 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 202976 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 099b71713dbf5f1630f7726b9443ec3db96e167b, data reload: false

query1	1715	1466	1457	1457
query2	6332	2040	1918	1918
query3	14610	9300	338	338
query4	30311	22985	23239	22985
query5	5288	484	486	484
query6	268	173	164	164
query7	3932	289	292	289
query8	243	204	201	201
query9	8266	2482	2458	2458
query10	576	468	451	451
query11	17980	14951	14858	14858
query12	144	95	96	95
query13	1533	373	358	358
query14	9519	7534	7699	7534
query15	286	251	241	241
query16	7509	522	517	517
query17	1621	584	570	570
query18	1941	308	306	306
query19	197	140	143	140
query20	129	106	108	106
query21	203	106	105	105
query22	4490	4344	4176	4176
query23	34181	33816	33730	33730
query24	10762	2589	2529	2529
query25	596	359	362	359
query26	1328	150	153	150
query27	2696	278	282	278
query28	7138	2060	2057	2057
query29	884	402	400	400
query30	249	151	153	151
query31	988	742	749	742
query32	81	54	57	54
query33	732	276	297	276
query34	867	466	470	466
query35	958	794	857	794
query36	1081	891	939	891
query37	151	83	77	77
query38	4193	4206	4190	4190
query39	1435	1364	1381	1364
query40	256	118	116	116
query41	48	45	47	45
query42	110	100	99	99
query43	526	481	466	466
query44	1222	726	728	726
query45	246	206	202	202
query46	1081	769	724	724
query47	1859	1749	1741	1741
query48	379	295	299	295
query49	855	429	436	429
query50	797	405	411	405
query51	6697	6668	6664	6664
query52	106	88	96	88
query53	254	184	187	184
query54	859	453	450	450
query55	78	74	78	74
query56	280	251	255	251
query57	1159	1070	1034	1034
query58	235	234	266	234
query59	2979	2724	2677	2677
query60	306	276	268	268
query61	117	115	115	115
query62	801	651	629	629
query63	213	181	185	181
query64	10251	2353	1838	1838
query65	3174	3131	3162	3131
query66	876	338	338	338
query67	15198	14930	14834	14834
query68	6104	556	542	542
query69	439	417	382	382
query70	1206	1023	1112	1023
query71	526	279	267	267
query72	20562	16916	16711	16711
query73	791	327	324	324
query74	9240	8723	8799	8723
query75	4309	2620	2674	2620
query76	3975	960	957	957
query77	696	319	329	319
query78	9618	9083	9010	9010
query79	4145	519	517	517
query80	2791	498	519	498
query81	600	231	219	219
query82	1278	138	137	137
query83	305	143	146	143
query84	263	80	75	75
query85	1490	273	270	270
query86	450	309	300	300
query87	4725	4472	4501	4472
query88	4746	2490	2499	2490
query89	559	286	283	283
query90	2054	196	198	196
query91	125	93	128	93
query92	70	50	51	50
query93	6346	548	536	536
query94	983	284	297	284
query95	350	266	271	266
query96	615	285	276	276
query97	3273	3061	3092	3061
query98	234	199	190	190
query99	1551	1265	1245	1245
Total cold run time: 330794 ms
Total hot run time: 202976 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.59 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 099b71713dbf5f1630f7726b9443ec3db96e167b, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.22	0.04	0.05
query4	1.67	0.08	0.07
query5	0.48	0.50	0.49
query6	1.12	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.05
query9	0.56	0.49	0.50
query10	0.55	0.54	0.53
query11	0.16	0.12	0.11
query12	0.15	0.11	0.12
query13	0.59	0.60	0.59
query14	0.76	0.79	0.78
query15	0.86	0.82	0.81
query16	0.35	0.37	0.37
query17	1.00	1.04	1.00
query18	0.23	0.22	0.21
query19	1.81	1.64	1.69
query20	0.01	0.00	0.01
query21	15.41	0.72	0.65
query22	3.95	7.29	2.01
query23	18.28	1.35	1.24
query24	2.15	0.21	0.22
query25	0.16	0.09	0.08
query26	0.29	0.22	0.21
query27	0.46	0.23	0.23
query28	13.26	1.02	1.00
query29	12.66	3.31	3.26
query30	0.24	0.05	0.05
query31	2.91	0.38	0.38
query32	3.27	0.49	0.47
query33	2.92	2.91	2.96
query34	17.07	4.38	4.36
query35	4.39	4.45	4.40
query36	0.65	0.49	0.46
query37	0.20	0.16	0.15
query38	0.16	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.12	0.13
query41	0.09	0.04	0.04
query42	0.06	0.04	0.04
query43	0.04	0.03	0.05
Total cold run time: 109.55 s
Total hot run time: 30.59 s

@amorynan
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39317 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 794a9962e0114234ec41ee041ed6e7167d368fbd, data reload: false

------ Round 1 ----------------------------------
q1	17636	4610	4254	4254
q2	2014	200	207	200
q3	11936	987	1109	987
q4	10513	740	680	680
q5	7506	2580	2525	2525
q6	218	140	135	135
q7	971	606	588	588
q8	9410	1888	1922	1888
q9	10239	6547	6519	6519
q10	7014	2193	2170	2170
q11	439	242	248	242
q12	388	212	220	212
q13	18999	3017	3017	3017
q14	278	242	237	237
q15	526	476	505	476
q16	524	389	388	388
q17	960	686	630	630
q18	7952	7419	7406	7406
q19	6729	982	933	933
q20	684	350	342	342
q21	5457	4478	4673	4478
q22	1146	1023	1010	1010
Total cold run time: 121539 ms
Total hot run time: 39317 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4503	4234	4285	4234
q2	382	279	275	275
q3	3058	2907	2846	2846
q4	2068	1775	1707	1707
q5	5640	5589	5601	5589
q6	233	137	136	136
q7	2156	1733	1821	1733
q8	3256	3478	3363	3363
q9	8776	8862	8751	8751
q10	3391	3205	3246	3205
q11	625	524	519	519
q12	822	653	640	640
q13	17137	3215	3196	3196
q14	325	301	285	285
q15	523	508	493	493
q16	512	442	434	434
q17	1796	1519	1522	1519
q18	8100	8131	7830	7830
q19	2217	1619	1590	1590
q20	2231	1887	1879	1879
q21	8070	5075	5319	5075
q22	1162	1050	1025	1025
Total cold run time: 76983 ms
Total hot run time: 56324 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203452 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 794a9962e0114234ec41ee041ed6e7167d368fbd, data reload: false

query1	1580	1493	1450	1450
query2	6337	2001	1931	1931
query3	13916	5752	330	330
query4	25919	23214	23038	23038
query5	3646	487	482	482
query6	248	163	152	152
query7	3937	290	284	284
query8	237	204	201	201
query9	8645	2479	2480	2479
query10	545	472	447	447
query11	15732	15008	14930	14930
query12	128	97	95	95
query13	1539	380	361	361
query14	9201	7811	7497	7497
query15	265	210	221	210
query16	7540	549	525	525
query17	1258	596	570	570
query18	1865	290	295	290
query19	208	148	145	145
query20	117	115	108	108
query21	202	111	101	101
query22	4740	4448	4398	4398
query23	34847	34155	34010	34010
query24	7404	2605	2495	2495
query25	526	359	378	359
query26	678	148	146	146
query27	2011	272	279	272
query28	4415	2067	2038	2038
query29	634	406	402	402
query30	253	150	150	150
query31	976	736	747	736
query32	89	53	60	53
query33	476	286	274	274
query34	844	465	460	460
query35	942	850	872	850
query36	1092	927	926	926
query37	134	78	77	77
query38	4219	4132	4159	4132
query39	1438	1386	1415	1386
query40	199	111	112	111
query41	44	44	44	44
query42	117	96	97	96
query43	506	475	471	471
query44	1049	722	727	722
query45	237	211	211	211
query46	1074	774	720	720
query47	1899	1814	1821	1814
query48	374	296	295	295
query49	837	423	434	423
query50	813	414	401	401
query51	6898	6651	6694	6651
query52	102	95	90	90
query53	255	181	182	181
query54	570	452	453	452
query55	75	76	75	75
query56	275	245	254	245
query57	1161	1102	1081	1081
query58	237	227	240	227
query59	2990	2808	2757	2757
query60	297	266	272	266
query61	115	115	112	112
query62	798	650	636	636
query63	209	182	187	182
query64	9313	2334	1804	1804
query65	3204	3182	3152	3152
query66	761	348	331	331
query67	15490	14853	14959	14853
query68	5558	571	548	548
query69	452	374	413	374
query70	1172	1161	1129	1129
query71	523	272	269	269
query72	19609	16442	16659	16442
query73	798	327	326	326
query74	9047	8733	8756	8733
query75	4384	2698	2684	2684
query76	3659	1007	909	909
query77	650	315	302	302
query78	9813	8962	8940	8940
query79	8506	528	522	522
query80	1215	487	487	487
query81	592	218	234	218
query82	825	135	133	133
query83	282	146	143	143
query84	269	78	74	74
query85	1292	276	276	276
query86	448	294	304	294
query87	4831	4446	4508	4446
query88	5026	2474	2478	2474
query89	532	288	287	287
query90	1961	196	187	187
query91	120	94	96	94
query92	60	51	48	48
query93	7805	540	530	530
query94	933	294	277	277
query95	362	257	267	257
query96	624	279	274	274
query97	3215	3103	3100	3100
query98	222	203	201	201
query99	1532	1293	1281	1281
Total cold run time: 314999 ms
Total hot run time: 203452 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 794a9962e0114234ec41ee041ed6e7167d368fbd, data reload: false

query1	0.05	0.05	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.04
query4	1.68	0.07	0.07
query5	0.51	0.50	0.48
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.55	0.50	0.48
query10	0.56	0.54	0.54
query11	0.16	0.11	0.12
query12	0.14	0.12	0.13
query13	0.60	0.59	0.58
query14	0.77	0.79	0.77
query15	0.86	0.81	0.81
query16	0.36	0.38	0.40
query17	0.98	1.02	1.00
query18	0.22	0.22	0.21
query19	1.85	1.67	1.69
query20	0.02	0.01	0.01
query21	15.38	0.74	0.64
query22	4.10	6.93	2.46
query23	18.27	1.33	1.29
query24	2.08	0.24	0.22
query25	0.15	0.08	0.08
query26	0.30	0.20	0.20
query27	0.46	0.23	0.23
query28	13.31	1.02	1.01
query29	12.63	3.31	3.30
query30	0.24	0.05	0.04
query31	2.90	0.40	0.39
query32	3.28	0.50	0.47
query33	2.86	2.96	2.89
query34	17.25	4.40	4.44
query35	4.46	4.45	4.45
query36	0.66	0.47	0.46
query37	0.18	0.16	0.15
query38	0.15	0.15	0.15
query39	0.04	0.04	0.04
query40	0.15	0.12	0.12
query41	0.09	0.05	0.04
query42	0.06	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 109.87 s
Total hot run time: 31.23 s

@amorynan
Copy link
Contributor Author

run feut

BiteTheDDDDt
BiteTheDDDDt previously approved these changes Aug 13, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 13, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

eldenmoon
eldenmoon previously approved these changes Aug 13, 2024
Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@amorynan amorynan dismissed stale reviews from eldenmoon and BiteTheDDDDt via d4d32ff August 13, 2024 12:43
@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Aug 13, 2024
@amorynan
Copy link
Contributor Author

run buildall

@amorynan
Copy link
Contributor Author

run feut

@doris-robot
Copy link

TPC-H: Total hot run time: 40396 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 124ffd228f6987e6abc85fb72a70361847c79043, data reload: false

------ Round 1 ----------------------------------
q1	17969	4439	4344	4344
q2	2029	177	171	171
q3	11708	1036	1095	1036
q4	10504	711	790	711
q5	7768	2879	2862	2862
q6	226	137	136	136
q7	979	593	599	593
q8	9322	2080	2094	2080
q9	8623	6624	6637	6624
q10	7050	2171	2166	2166
q11	450	244	249	244
q12	393	226	224	224
q13	18066	3030	2988	2988
q14	282	237	241	237
q15	538	492	496	492
q16	513	384	384	384
q17	985	766	729	729
q18	8017	7482	7383	7383
q19	5638	1130	1110	1110
q20	658	338	346	338
q21	5433	4491	4576	4491
q22	1127	1053	1058	1053
Total cold run time: 118278 ms
Total hot run time: 40396 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4614	4304	4317	4304
q2	395	264	265	264
q3	2897	2774	2814	2774
q4	1993	1729	1870	1729
q5	5665	5630	5545	5545
q6	222	141	142	141
q7	2169	1748	1786	1748
q8	3318	3506	3470	3470
q9	8747	8847	8791	8791
q10	3571	3192	3227	3192
q11	599	503	515	503
q12	810	634	648	634
q13	16971	3153	3189	3153
q14	322	291	280	280
q15	548	482	498	482
q16	497	435	445	435
q17	1823	1562	1568	1562
q18	8061	7923	7999	7923
q19	1756	1559	1641	1559
q20	2188	1895	1878	1878
q21	5539	5400	5197	5197
q22	1155	1038	1071	1038
Total cold run time: 73860 ms
Total hot run time: 56602 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189631 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 124ffd228f6987e6abc85fb72a70361847c79043, data reload: false

query1	1265	906	861	861
query2	6436	1879	1893	1879
query3	10750	3915	3825	3825
query4	59499	25940	23213	23213
query5	5983	491	473	473
query6	489	157	165	157
query7	6490	289	295	289
query8	296	202	189	189
query9	9058	2448	2421	2421
query10	507	265	261	261
query11	17230	15131	15216	15131
query12	169	98	103	98
query13	1566	386	377	377
query14	11824	7066	7292	7066
query15	251	170	177	170
query16	7643	498	514	498
query17	1156	587	581	581
query18	2058	303	302	302
query19	293	164	158	158
query20	131	111	114	111
query21	214	111	108	108
query22	4628	4289	4343	4289
query23	34277	33383	33414	33383
query24	5591	2941	3026	2941
query25	563	394	411	394
query26	699	158	157	157
query27	1812	273	276	273
query28	3762	2026	2115	2026
query29	717	413	402	402
query30	237	148	145	145
query31	948	742	744	742
query32	82	64	50	50
query33	446	281	269	269
query34	919	455	466	455
query35	843	731	692	692
query36	1089	914	904	904
query37	136	83	76	76
query38	3933	3868	3771	3771
query39	1443	1368	1374	1368
query40	205	122	111	111
query41	58	43	42	42
query42	114	95	97	95
query43	505	466	455	455
query44	1092	718	740	718
query45	192	164	162	162
query46	1181	769	760	760
query47	1927	1757	1741	1741
query48	368	293	291	291
query49	772	410	456	410
query50	868	402	399	399
query51	6768	6710	6761	6710
query52	101	91	89	89
query53	267	183	176	176
query54	576	447	435	435
query55	74	72	71	71
query56	273	246	255	246
query57	1188	1039	1092	1039
query58	229	224	227	224
query59	2915	2757	2749	2749
query60	301	257	269	257
query61	94	90	96	90
query62	761	633	646	633
query63	242	184	179	179
query64	4449	1784	1690	1690
query65	3240	3127	3160	3127
query66	702	365	332	332
query67	15291	14892	14624	14624
query68	4776	555	565	555
query69	519	267	267	267
query70	1186	1106	1098	1098
query71	407	295	275	275
query72	7251	2303	2002	2002
query73	827	327	325	325
query74	9123	8836	8650	8650
query75	3529	2666	2730	2666
query76	2677	1074	1064	1064
query77	543	307	316	307
query78	9816	9047	9137	9047
query79	2969	575	526	526
query80	1692	484	489	484
query81	592	223	228	223
query82	808	138	136	136
query83	261	145	145	145
query84	270	80	77	77
query85	1138	275	266	266
query86	462	297	288	288
query87	4352	4196	4070	4070
query88	4687	2408	2416	2408
query89	424	287	287	287
query90	2016	199	193	193
query91	128	145	94	94
query92	62	54	52	52
query93	4330	539	534	534
query94	992	288	294	288
query95	355	259	259	259
query96	658	274	267	267
query97	3235	2983	3023	2983
query98	218	209	203	203
query99	1626	1281	1232	1232
Total cold run time: 322115 ms
Total hot run time: 189631 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 124ffd228f6987e6abc85fb72a70361847c79043, data reload: false

query1	0.05	0.04	0.04
query2	0.07	0.04	0.04
query3	0.23	0.05	0.06
query4	1.66	0.09	0.08
query5	0.51	0.48	0.49
query6	1.13	0.72	0.72
query7	0.02	0.02	0.01
query8	0.05	0.04	0.04
query9	0.56	0.50	0.49
query10	0.55	0.54	0.54
query11	0.15	0.12	0.12
query12	0.14	0.13	0.12
query13	0.59	0.60	0.58
query14	0.77	0.78	0.77
query15	0.86	0.82	0.82
query16	0.37	0.37	0.35
query17	0.99	1.05	1.05
query18	0.23	0.22	0.22
query19	1.83	1.71	1.76
query20	0.02	0.01	0.02
query21	15.42	0.76	0.66
query22	4.24	5.28	2.87
query23	18.28	1.36	1.33
query24	2.15	0.23	0.23
query25	0.16	0.09	0.07
query26	0.31	0.21	0.20
query27	0.46	0.23	0.23
query28	13.17	1.03	1.01
query29	12.67	3.28	3.28
query30	0.24	0.05	0.04
query31	2.89	0.41	0.39
query32	3.27	0.48	0.49
query33	2.97	2.94	2.98
query34	17.04	4.38	4.47
query35	4.47	4.43	4.42
query36	0.65	0.47	0.47
query37	0.19	0.15	0.16
query38	0.16	0.15	0.14
query39	0.05	0.03	0.04
query40	0.15	0.13	0.12
query41	0.10	0.04	0.05
query42	0.06	0.05	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.93 s
Total hot run time: 31.8 s

@amorynan
Copy link
Contributor Author

run p0

@amorynan
Copy link
Contributor Author

run feut

@amorynan
Copy link
Contributor Author

run p0

@amorynan
Copy link
Contributor Author

run cloud_p1

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Aug 14, 2024
@eldenmoon eldenmoon merged commit 837e7be into apache:master Aug 14, 2024
29 of 30 checks passed
yiguolei pushed a commit that referenced this pull request Aug 15, 2024
## Proposed changes
backport: #39210
Issue Number: close #xxx

<!--Describe your changes.-->
Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants