Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Revert "[ci](perf) add required (#30155)" #30165

Merged
merged 1 commit into from
Jan 21, 2024
Merged

Revert "[ci](perf) add required (#30155)" #30165

merged 1 commit into from
Jan 21, 2024

Conversation

shuke987
Copy link
Collaborator

This reverts commit f9c274c.

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@shuke987
Copy link
Collaborator Author

run buidlall

@xiaokang
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38822 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 816898d25c060776fca3c9a213c59078540261f5, data reload: false

------ Round 1 ----------------------------------
q1	17734	5574	5367	5367
q2	2047	138	136	136
q3	10633	1130	1148	1130
q4	10223	783	832	783
q5	7740	3122	3151	3122
q6	200	124	122	122
q7	861	503	478	478
q8	9226	1896	1930	1896
q9	7265	6359	6306	6306
q10	8253	3044	3065	3044
q11	423	218	217	217
q12	353	185	192	185
q13	17992	3322	3332	3322
q14	237	223	210	210
q15	546	509	502	502
q16	488	388	395	388
q17	921	503	474	474
q18	7374	7005	6782	6782
q19	1544	1366	1442	1366
q20	580	309	319	309
q21	2753	2387	2400	2387
q22	359	306	296	296
Total cold run time: 107752 ms
Total hot run time: 38822 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5478	5255	5241	5241
q2	328	218	220	218
q3	3313	3220	3221	3220
q4	2070	2024	1964	1964
q5	5829	5855	5888	5855
q6	199	119	116	116
q7	2348	1924	1861	1861
q8	3207	3354	3372	3354
q9	8882	8878	8693	8693
q10	3928	3841	3895	3841
q11	552	470	462	462
q12	778	630	626	626
q13	16889	3122	3130	3122
q14	288	250	271	250
q15	536	514	498	498
q16	523	470	484	470
q17	1860	1786	1797	1786
q18	9643	14628	9640	9640
q19	27333	1659	1520	1520
q20	4575	1944	1954	1944
q21	15034	5359	5399	5359
q22	1128	546	531	531
Total cold run time: 114721 ms
Total hot run time: 60571 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 177291 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 816898d25c060776fca3c9a213c59078540261f5, data reload: false

query1	935	330	332	330
query2	6620	2030	2034	2030
query3	6697	198	203	198
query4	33272	22119	22174	22119
query5	6910	604	520	520
query6	250	159	157	157
query7	4599	262	261	261
query8	225	174	182	174
query9	8497	2561	2510	2510
query10	424	222	222	222
query11	16676	15619	15517	15517
query12	131	69	67	67
query13	1680	380	389	380
query14	10531	6890	6931	6890
query15	218	175	176	175
query16	4598	232	235	232
query17	991	480	467	467
query18	1783	274	251	251
query19	180	134	129	129
query20	74	72	70	70
query21	194	137	130	130
query22	5165	5214	5080	5080
query23	31529	30949	30786	30786
query24	11571	2809	2764	2764
query25	573	317	302	302
query26	1612	144	142	142
query27	3216	282	262	262
query28	7317	1830	1818	1818
query29	1363	638	639	638
query30	277	140	144	140
query31	902	759	749	749
query32	72	54	49	49
query33	701	220	213	213
query34	1132	475	468	468
query35	875	782	778	778
query36	1328	1198	1171	1171
query37	88	64	59	59
query38	3338	3239	3240	3239
query39	1317	1259	1269	1259
query40	206	88	80	80
query41	38	36	36	36
query42	101	78	85	78
query43	517	452	468	452
query44	1076	675	690	675
query45	191	179	169	169
query46	1042	638	657	638
query47	1669	1603	1587	1587
query48	379	296	316	296
query49	1133	282	283	282
query50	683	317	313	313
query51	5293	5173	5186	5173
query52	92	80	74	74
query53	327	256	251	251
query54	449	292	287	287
query55	77	78	76	76
query56	177	174	167	167
query57	941	920	926	920
query58	197	159	165	159
query59	2941	2603	2763	2603
query60	203	184	193	184
query61	84	86	89	86
query62	637	373	358	358
query63	290	261	262	261
query64	4975	1779	1747	1747
query65	3336	3275	3247	3247
query66	1242	320	311	311
query67	15766	15280	15487	15280
query68	10644	521	505	505
query69	590	307	295	295
query70	1741	1541	1521	1521
query71	480	207	209	207
query72	4791	2829	2840	2829
query73	2112	318	324	318
query74	7064	6436	6395	6395
query75	4368	2298	2303	2298
query76	6305	996	978	978
query77	654	227	239	227
query78	9199	9028	8635	8635
query79	1009	502	525	502
query80	556	322	314	314
query81	462	200	213	200
query82	209	77	84	77
query83	140	122	120	120
query84	277	70	72	70
query85	1055	335	317	317
query86	396	388	390	388
query87	3497	3383	3306	3306
query88	3437	2208	2185	2185
query89	441	357	349	349
query90	1943	189	182	182
query91	153	125	122	122
query92	54	41	45	41
query93	2592	436	409	409
query94	1194	161	155	155
query95	522	459	453	453
query96	638	317	312	312
query97	4271	4158	4166	4158
query98	216	204	182	182
query99	950	714	705	705
Total cold run time: 293883 ms
Total hot run time: 177291 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.08 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 816898d25c060776fca3c9a213c59078540261f5, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.02	0.03
query3	0.22	0.05	0.04
query4	1.71	0.07	0.07
query5	0.54	0.53	0.55
query6	1.29	0.63	0.62
query7	0.02	0.02	0.01
query8	0.05	0.03	0.02
query9	0.56	0.51	0.50
query10	0.55	0.56	0.56
query11	0.12	0.09	0.09
query12	0.11	0.09	0.08
query13	0.61	0.62	0.61
query14	0.77	0.82	0.80
query15	0.79	0.78	0.79
query16	0.39	0.39	0.37
query17	1.01	1.01	1.03
query18	0.23	0.27	0.23
query19	1.82	1.82	1.81
query20	0.01	0.01	0.01
query21	15.40	0.57	0.58
query22	2.62	2.46	2.25
query23	17.23	0.77	0.74
query24	2.47	0.72	0.91
query25	0.39	0.22	0.15
query26	0.51	0.13	0.14
query27	0.04	0.05	0.06
query28	12.02	0.77	0.79
query29	12.52	3.16	3.12
query30	0.52	0.48	0.49
query31	2.78	0.34	0.35
query32	3.39	0.47	0.49
query33	3.22	3.23	3.19
query34	15.76	4.39	4.32
query35	4.34	4.32	4.27
query36	1.10	1.07	1.07
query37	0.06	0.05	0.05
query38	0.04	0.03	0.03
query39	0.02	0.01	0.02
query40	0.15	0.14	0.13
query41	0.07	0.01	0.02
query42	0.02	0.02	0.01
query43	0.03	0.01	0.02
Total cold run time: 105.59 s
Total hot run time: 31.08 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 816898d25c060776fca3c9a213c59078540261f5 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       14.9 seconds inserted 10000000 Rows, about 671K ops/s

xiaokang
xiaokang approved these changes Jan 20, 2024
View reviewed changes
Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 20, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

dataroaring
dataroaring approved these changes Jan 21, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 0f3f3b7 into apache:master Jan 21, 2024
18 of 20 checks passed
seawinde pushed a commit to seawinde/doris that referenced this pull request Jan 22, 2024
@shuke987 @seawinde
Revert "[ci](perf) add required (apache#30155)" (apache#30165)
d551764 
This reverts commit f9c274c.
yiguolei pushed a commit that referenced this pull request Jan 23, 2024
@shuke987 @Doris-Extras
Revert "[ci](perf) add required (#30155)" (#30165)
ec898f2 
This reverts commit f9c274c.
@shuke987 shuke987 deleted the 0120 branch January 7, 2025 03:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@xiaokang xiaokang xiaokang approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/3.0.0-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@shuke987 @xiaokang @doris-robot @dataroaring