Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](arrow-flight) Modify FE Arrow version to 15.0.0 #30824

Merged
merged 1 commit into from
Feb 5, 2024

Conversation

xinyiZzz
Copy link
Contributor

@xinyiZzz xinyiZzz commented Feb 4, 2024

Proposed changes

revert #28093
Arrow has released 15.0.0

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

@xinyiZzz
Copy link
Contributor Author

xinyiZzz commented Feb 4, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 36651 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 99a2e4de2e2160b431c68c859f6ab5d6684922e6, data reload: false

------ Round 1 ----------------------------------
q1	17653	4407	4397	4397
q2	2033	140	129	129
q3	10611	888	904	888
q4	4679	697	740	697
q5	7694	2734	2830	2734
q6	186	119	116	116
q7	1160	731	707	707
q8	9286	1981	1970	1970
q9	7213	6376	6321	6321
q10	8072	2439	2467	2439
q11	417	197	207	197
q12	765	282	275	275
q13	18009	3297	3331	3297
q14	299	242	252	242
q15	532	488	485	485
q16	474	393	397	393
q17	946	506	505	505
q18	6701	5849	5933	5849
q19	1567	1418	1345	1345
q20	590	347	339	339
q21	7013	3024	3090	3024
q22	803	319	302	302
Total cold run time: 106703 ms
Total hot run time: 36651 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4428	4353	4350	4350
q2	319	235	232	232
q3	2993	2814	2844	2814
q4	1842	1627	1578	1578
q5	5154	5236	5193	5193
q6	197	114	111	111
q7	2163	1738	1781	1738
q8	3093	3221	3209	3209
q9	8320	8233	8282	8233
q10	5802	3577	3547	3547
q11	547	468	461	461
q12	739	563	566	563
q13	12499	3097	3110	3097
q14	275	262	258	258
q15	535	492	487	487
q16	502	463	498	463
q17	1841	1633	1686	1633
q18	7960	7758	7491	7491
q19	9957	1543	1517	1517
q20	2144	1900	1894	1894
q21	5044	4588	4543	4543
q22	554	488	475	475
Total cold run time: 76908 ms
Total hot run time: 53887 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 174127 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 99a2e4de2e2160b431c68c859f6ab5d6684922e6, data reload: false

query1	934	333	344	333
query2	6553	1982	1905	1905
query3	6698	209	206	206
query4	32042	22010	22037	22010
query5	4283	423	422	422
query6	249	170	173	170
query7	4599	281	278	278
query8	252	168	174	168
query9	9195	2313	2297	2297
query10	417	212	205	205
query11	18520	15350	15344	15344
query12	125	75	76	75
query13	1625	412	410	410
query14	9375	7001	6527	6527
query15	287	171	172	171
query16	8162	251	239	239
query17	2065	524	495	495
query18	2104	270	254	254
query19	361	137	138	137
query20	77	74	75	74
query21	195	122	131	122
query22	4819	4686	4683	4683
query23	30795	30014	30015	30014
query24	10134	2758	2762	2758
query25	529	340	337	337
query26	718	142	156	142
query27	2160	292	288	288
query28	5776	1864	1848	1848
query29	864	593	602	593
query30	278	133	142	133
query31	934	697	714	697
query32	88	48	46	46
query33	640	212	221	212
query34	857	450	467	450
query35	846	738	770	738
query36	1037	959	903	903
query37	93	57	58	57
query38	3280	3130	3100	3100
query39	1308	1256	1246	1246
query40	183	94	93	93
query41	39	32	34	32
query42	102	89	92	89
query43	527	465	499	465
query44	1002	679	697	679
query45	193	176	169	169
query46	1044	648	634	634
query47	1582	1480	1515	1480
query48	438	344	361	344
query49	1038	283	276	276
query50	748	368	385	368
query51	5246	5149	5167	5149
query52	97	81	85	81
query53	347	262	269	262
query54	293	214	218	214
query55	78	72	75	72
query56	214	189	197	189
query57	1001	904	913	904
query58	207	174	176	174
query59	2445	2345	2307	2307
query60	243	208	215	208
query61	81	81	79	79
query62	616	373	377	373
query63	291	271	269	269
query64	4657	3697	3369	3369
query65	3243	3221	3228	3221
query66	809	314	304	304
query67	14794	14372	14386	14372
query68	4408	512	522	512
query69	461	327	337	327
query70	1273	1216	1234	1216
query71	311	240	243	240
query72	5937	2857	2668	2668
query73	708	323	315	315
query74	6640	6162	6323	6162
query75	3015	2323	2320	2320
query76	2561	938	884	884
query77	354	225	225	225
query78	9132	8664	8620	8620
query79	3867	485	493	485
query80	1975	348	333	333
query81	533	197	199	197
query82	1597	83	81	81
query83	352	134	120	120
query84	281	89	78	78
query85	1513	325	320	320
query86	474	298	316	298
query87	3382	3235	3239	3235
query88	4446	2334	2310	2310
query89	484	375	354	354
query90	1981	163	160	160
query91	172	123	121	121
query92	51	46	41	41
query93	5200	492	492	492
query94	1287	169	172	169
query95	7926	353	7810	353
query96	598	283	269	269
query97	4239	4098	4149	4098
query98	216	192	187	187
query99	1119	674	675	674
Total cold run time: 291325 ms
Total hot run time: 174127 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 99a2e4de2e2160b431c68c859f6ab5d6684922e6, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.03	0.02
query3	0.22	0.06	0.06
query4	1.67	0.09	0.10
query5	0.54	0.53	0.52
query6	1.21	0.64	0.64
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.55	0.50	0.48
query10	0.57	0.57	0.55
query11	0.12	0.09	0.08
query12	0.12	0.08	0.09
query13	0.60	0.61	0.61
query14	0.80	0.83	0.80
query15	0.81	0.80	0.78
query16	0.38	0.39	0.40
query17	1.04	1.02	1.06
query18	0.21	0.28	0.23
query19	1.82	1.83	1.81
query20	0.01	0.01	0.01
query21	15.40	0.59	0.57
query22	2.59	2.52	1.63
query23	17.30	0.84	0.77
query24	2.39	1.19	0.72
query25	0.37	0.33	0.04
query26	0.35	0.14	0.15
query27	0.05	0.05	0.06
query28	12.04	0.88	0.86
query29	12.53	3.46	3.37
query30	0.63	0.56	0.53
query31	2.80	0.37	0.38
query32	3.29	0.50	0.49
query33	3.33	3.27	3.25
query34	16.09	4.33	4.32
query35	4.35	4.31	4.35
query36	1.12	1.07	1.05
query37	0.07	0.05	0.05
query38	0.04	0.03	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 105.85 s
Total hot run time: 30.96 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 99a2e4de2e2160b431c68c859f6ab5d6684922e6 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       13.8 seconds inserted 10000000 Rows, about 724K ops/s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 4, 2024
Copy link
Contributor

github-actions bot commented Feb 4, 2024

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Feb 4, 2024

PR approved by anyone and no changes requested.

Copy link
Collaborator

@wm1581066 wm1581066 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@yiguolei yiguolei merged commit b3620e1 into apache:master Feb 5, 2024
28 of 29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants