Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[pipelineX](improvement) Support multiple instances execution on single tablet #28178

Merged
merged 1 commit into from
Dec 10, 2023

Conversation

Gabriel39
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

Copy link
Contributor

github-actions bot commented Dec 8, 2023

clang-tidy review says "All clean, LGTM! 👍"

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.14 seconds
stream load tsv: 576 seconds loaded 74807831229 Bytes, about 123 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 28.6 seconds inserted 10000000 Rows, about 349K ops/s
storage size: 17212374175 Bytes

@doris-robot
Copy link

TPC-H test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
Tpch sf100 test result on commit 43c4749e94ec04059214d1b6b4246653c2c90059, data reload: false

run tpch-sf100 query with default conf and session variables
q1	4692	4512	4462	4462
q2	359	154	141	141
q3	1448	1256	1238	1238
q4	1095	908	883	883
q5	3090	3126	3149	3126
q6	251	130	125	125
q7	967	480	474	474
q8	2234	2217	2181	2181
q9	6664	6629	6589	6589
q10	3220	3227	3258	3227
q11	326	214	219	214
q12	344	200	206	200
q13	4549	3819	3814	3814
q14	244	211	208	208
q15	555	515	529	515
q16	439	378	387	378
q17	1001	607	550	550
q18	7700	7293	7679	7293
q19	1501	1378	1407	1378
q20	498	294	287	287
q21	2986	2596	2598	2596
q22	343	279	284	279
Total cold run time: 44506 ms
Total hot run time: 40158 ms

run tpch-sf100 query with default conf and set session variable runtime_filter_mode=off
q1	4418	4396	4400	4396
q2	266	163	172	163
q3	3530	3521	3494	3494
q4	2368	2344	2343	2343
q5	5710	5677	5699	5677
q6	239	121	123	121
q7	2369	1849	1838	1838
q8	3501	3490	3491	3490
q9	8987	8961	8910	8910
q10	3899	3949	3971	3949
q11	495	375	370	370
q12	753	591	594	591
q13	4294	3571	3568	3568
q14	282	248	256	248
q15	561	522	518	518
q16	500	483	460	460
q17	1885	1858	1835	1835
q18	8646	8183	8284	8183
q19	1720	1725	1701	1701
q20	2242	1957	1942	1942
q21	6470	6167	6115	6115
q22	500	422	421	421
Total cold run time: 63635 ms
Total hot run time: 60333 ms

Copy link
Contributor

@HappenLee HappenLee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 9, 2023
Copy link
Contributor

github-actions bot commented Dec 9, 2023

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Dec 9, 2023

PR approved by anyone and no changes requested.

@Gabriel39 Gabriel39 merged commit 320ddf4 into apache:master Dec 10, 2023
Gabriel39 added a commit to Gabriel39/incubator-doris that referenced this pull request Dec 11, 2023
XuJianxu pushed a commit to XuJianxu/doris that referenced this pull request Dec 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. meta-change reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants