Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ci](perf) add required #30155

Merged
merged 2 commits into from
Jan 19, 2024
Merged

[ci](perf) add required #30155

merged 2 commits into from
Jan 19, 2024

Conversation

hello-stephen
Copy link
Contributor

  1. set performance pipeline to required
  2. rm unused files

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@hello-stephen
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 38565 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab, data reload: false

------ Round 1 ----------------------------------
q1	17650	5455	5135	5135
q2	2038	150	130	130
q3	10760	1140	1133	1133
q4	10329	743	859	743
q5	7736	3165	3085	3085
q6	196	121	119	119
q7	850	491	469	469
q8	9241	1909	1940	1909
q9	7235	6369	6356	6356
q10	8188	3046	2990	2990
q11	431	217	209	209
q12	351	191	186	186
q13	18201	3406	3353	3353
q14	246	212	205	205
q15	545	504	511	504
q16	419	366	370	366
q17	926	497	541	497
q18	7351	7055	6789	6789
q19	1848	1371	1449	1371
q20	559	305	291	291
q21	2810	2422	2429	2422
q22	364	303	330	303
Total cold run time: 108274 ms
Total hot run time: 38565 ms

----- Round 2, with runtime_filter_mode=off -----
q1	5467	5335	5328	5328
q2	331	216	217	216
q3	3386	3229	3244	3229
q4	2094	2067	2092	2067
q5	6110	5948	5929	5929
q6	204	114	115	114
q7	2414	1979	1908	1908
q8	3264	3384	3431	3384
q9	9248	9004	9204	9004
q10	4052	4014	4220	4014
q11	580	482	485	482
q12	857	674	667	667
q13	18732	3268	3171	3171
q14	287	265	263	263
q15	562	501	499	499
q16	508	460	471	460
q17	1916	1845	1840	1840
q18	9654	18629	9464	9464
q19	25127	1531	1536	1531
q20	4583	1919	1927	1919
q21	14431	5491	5475	5475
q22	985	523	551	523
Total cold run time: 114792 ms
Total hot run time: 61487 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 177024 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab, data reload: false

query1	931	345	330	330
query2	6564	2094	1823	1823
query3	6693	201	197	197
query4	32424	22173	22181	22173
query5	6896	519	595	519
query6	244	154	152	152
query7	4602	258	253	253
query8	222	174	185	174
query9	8395	2545	2521	2521
query10	434	255	243	243
query11	16954	15564	15589	15564
query12	122	69	67	67
query13	1680	379	397	379
query14	10616	6960	6866	6866
query15	215	178	180	178
query16	4604	232	229	229
query17	990	471	463	463
query18	1773	245	253	245
query19	175	131	131	131
query20	74	73	70	70
query21	188	134	116	116
query22	5081	5070	4894	4894
query23	31845	30931	30909	30909
query24	6470	2824	2880	2824
query25	403	309	323	309
query26	718	141	140	140
query27	2265	269	267	267
query28	3909	1832	1827	1827
query29	922	634	624	624
query30	201	136	140	136
query31	924	749	745	745
query32	62	49	56	49
query33	421	213	205	205
query34	818	444	455	444
query35	862	778	783	778
query36	1335	1198	1292	1198
query37	89	58	56	56
query38	3362	3255	3203	3203
query39	1317	1263	1257	1257
query40	199	85	83	83
query41	36	35	33	33
query42	91	77	84	77
query43	529	473	477	473
query44	1025	674	684	674
query45	196	177	171	171
query46	1031	655	652	652
query47	1606	1579	1578	1578
query48	391	293	304	293
query49	618	277	287	277
query50	670	317	318	317
query51	5297	5228	5175	5175
query52	94	83	78	78
query53	330	271	259	259
query54	427	280	285	280
query55	77	77	79	77
query56	180	162	163	162
query57	947	943	938	938
query58	181	164	165	164
query59	2901	2685	2645	2645
query60	206	179	183	179
query61	90	84	83	83
query62	438	356	346	346
query63	285	264	256	256
query64	2570	1765	1745	1745
query65	3316	3266	3232	3232
query66	1041	314	317	314
query67	15581	15539	15170	15170
query68	11205	526	513	513
query69	619	306	297	297
query70	1638	1482	1520	1482
query71	497	223	210	210
query72	4912	2793	2829	2793
query73	2177	315	314	314
query74	6910	6313	6306	6306
query75	4833	2314	2315	2314
query76	6416	1071	1068	1068
query77	671	229	235	229
query78	9651	8919	8698	8698
query79	994	483	496	483
query80	594	325	318	318
query81	469	203	199	199
query82	180	81	80	80
query83	134	114	122	114
query84	277	66	66	66
query85	1065	336	332	332
query86	404	371	380	371
query87	3526	3376	3324	3324
query88	2840	2180	2179	2179
query89	411	365	351	351
query90	2229	187	187	187
query91	166	136	135	135
query92	52	47	41	41
query93	975	442	413	413
query94	1336	157	160	157
query95	483	451	450	450
query96	613	316	319	316
query97	4285	4121	4172	4121
query98	210	197	176	176
query99	1038	699	698	698
Total cold run time: 277963 ms
Total hot run time: 177024 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.77 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab, data reload: false

query1	0.03	0.02	0.02
query2	0.06	0.02	0.03
query3	0.23	0.05	0.05
query4	1.69	0.07	0.07
query5	0.54	0.53	0.52
query6	1.29	0.62	0.64
query7	0.02	0.01	0.01
query8	0.04	0.02	0.02
query9	0.55	0.51	0.51
query10	0.56	0.56	0.56
query11	0.11	0.09	0.08
query12	0.10	0.09	0.09
query13	0.61	0.60	0.59
query14	0.79	0.81	0.80
query15	0.78	0.78	0.76
query16	0.36	0.36	0.36
query17	1.02	1.01	1.02
query18	0.23	0.26	0.24
query19	1.90	1.74	1.78
query20	0.01	0.01	0.01
query21	15.42	0.57	0.57
query22	2.90	2.61	1.96
query23	16.95	0.81	0.81
query24	2.36	1.55	0.66
query25	0.36	0.13	0.14
query26	0.68	0.12	0.14
query27	0.08	0.05	0.05
query28	11.62	0.77	0.75
query29	12.54	3.21	3.24
query30	0.51	0.47	0.53
query31	2.79	0.34	0.34
query32	3.38	0.48	0.49
query33	3.19	3.23	3.24
query34	15.82	4.31	4.34
query35	4.46	4.27	4.27
query36	1.13	1.07	1.09
query37	0.06	0.05	0.05
query38	0.04	0.02	0.03
query39	0.02	0.01	0.02
query40	0.16	0.13	0.16
query41	0.07	0.02	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 105.5 s
Total hot run time: 30.77 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 5e020b4ca49338054ee6ca49d594d043d6c236ab with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       14.8 seconds inserted 10000000 Rows, about 675K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 19, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@hello-stephen
Copy link
Contributor Author

run pipelinex_p0

@Gabriel39 Gabriel39 merged commit f9c274c into apache:master Jan 19, 2024
18 of 20 checks passed
shuke987 added a commit to shuke987/doris that referenced this pull request Jan 20, 2024
@shuke987
Revert "[ci](perf) add required (apache#30155)"
816898d 
This reverts commit f9c274c.
dataroaring pushed a commit that referenced this pull request Jan 21, 2024
@shuke987
Revert "[ci](perf) add required (#30155)" (#30165)
0f3f3b7 
This reverts commit f9c274c.
seawinde pushed a commit to seawinde/doris that referenced this pull request Jan 22, 2024
@hello-stephen @seawinde
[ci](perf) add required (apache#30155)
814410b 
Co-authored-by: stephen <hello-stephen@qq.com>
seawinde pushed a commit to seawinde/doris that referenced this pull request Jan 22, 2024
@shuke987 @seawinde
Revert "[ci](perf) add required (apache#30155)" (apache#30165)
d551764 
This reverts commit f9c274c.
yiguolei pushed a commit that referenced this pull request Jan 23, 2024
@hello-stephen @Doris-Extras
[ci](perf) add required (#30155)
7cc85f8 
Co-authored-by: stephen <hello-stephen@qq.com>
yiguolei pushed a commit that referenced this pull request Jan 23, 2024
@shuke987 @Doris-Extras
Revert "[ci](perf) add required (#30155)" (#30165)
ec898f2 
This reverts commit f9c274c.
@hello-stephen hello-stephen deleted the 0119-perf-required branch November 19, 2024 11:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@englefly englefly englefly approved these changes

@Gabriel39 Gabriel39 Gabriel39 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/3.0.0-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@hello-stephen @doris-robot @englefly @Gabriel39 @dataroaring