Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](autobucket) fix autobucket config masterOnly=true #36116 #36287

Merged

Conversation

yujun777
Copy link
Collaborator

cherry pick from #36116

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@doris-robot
Copy link

TPC-H: Total hot run time: 49698 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b81fba32db87400611d445765a8c79547b901d53, data reload: false

------ Round 1 ----------------------------------
q1	17762	4433	4331	4331
q2	2074	151	143	143
q3	10469	1935	1952	1935
q4	10322	1264	1312	1264
q5	8555	3886	3912	3886
q6	235	151	124	124
q7	2018	1577	1596	1577
q8	9323	2712	2691	2691
q9	10656	10335	10212	10212
q10	8648	3551	3498	3498
q11	417	240	248	240
q12	469	305	306	305
q13	18383	3927	4021	3927
q14	356	327	325	325
q15	503	465	455	455
q16	690	573	572	572
q17	1137	954	971	954
q18	7355	6795	6812	6795
q19	1782	1675	1611	1611
q20	531	299	311	299
q21	4415	4170	4114	4114
q22	531	450	440	440
Total cold run time: 116631 ms
Total hot run time: 49698 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4336	4262	4334	4262
q2	321	222	231	222
q3	4173	4133	4080	4080
q4	2770	2738	2738	2738
q5	7185	7159	7103	7103
q6	234	120	119	119
q7	3240	2819	2827	2819
q8	4334	4496	4469	4469
q9	16806	16820	16706	16706
q10	4268	4239	4308	4239
q11	785	669	674	669
q12	1035	854	866	854
q13	7254	3756	3719	3719
q14	458	425	426	425
q15	502	459	455	455
q16	735	678	680	678
q17	3799	3794	3823	3794
q18	8714	8705	8679	8679
q19	1739	1727	1671	1671
q20	2354	2106	2101	2101
q21	8474	8482	8402	8402
q22	1077	955	965	955
Total cold run time: 84593 ms
Total hot run time: 79159 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 205231 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b81fba32db87400611d445765a8c79547b901d53, data reload: false

query1	926	423	377	377
query2	6545	2930	2720	2720
query3	6927	208	202	202
query4	20306	18131	18128	18128
query5	19731	6496	6507	6496
query6	286	228	225	225
query7	4147	316	318	316
query8	487	412	436	412
query9	3171	2712	2639	2639
query10	410	303	296	296
query11	11213	10722	10578	10578
query12	120	78	72	72
query13	5598	700	714	700
query14	17862	13440	13414	13414
query15	404	251	242	242
query16	6468	285	266	266
query17	1703	1468	891	891
query18	2295	417	405	405
query19	209	145	153	145
query20	82	77	82	77
query21	188	98	101	98
query22	5284	5155	4956	4956
query23	32826	32020	32047	32020
query24	6939	6574	6495	6495
query25	531	453	423	423
query26	529	182	173	173
query27	1848	301	301	301
query28	6098	2388	2342	2342
query29	3033	2714	2723	2714
query30	248	164	166	164
query31	918	734	737	734
query32	70	64	63	63
query33	408	259	267	259
query34	844	479	475	475
query35	1137	949	922	922
query36	1319	1236	1189	1189
query37	89	62	60	60
query38	3045	2984	2935	2935
query39	1369	1358	1341	1341
query40	204	102	97	97
query41	46	43	43	43
query42	94	84	81	81
query43	716	686	667	667
query44	1160	719	711	711
query45	254	239	240	239
query46	1222	988	1001	988
query47	1850	1743	1781	1743
query48	1015	733	709	709
query49	618	384	380	380
query50	866	637	589	589
query51	4768	4638	4713	4638
query52	96	79	93	79
query53	463	336	319	319
query54	2693	2475	2475	2475
query55	88	77	74	74
query56	230	225	217	217
query57	1263	1108	1129	1108
query58	220	208	182	182
query59	4071	3938	4139	3938
query60	229	191	215	191
query61	101	93	95	93
query62	857	506	501	501
query63	498	344	342	342
query64	2593	1508	1468	1468
query65	3694	3573	3515	3515
query66	759	387	390	387
query67	15650	15677	15852	15677
query68	10034	658	638	638
query69	565	332	334	332
query70	1666	1278	1403	1278
query71	419	320	311	311
query72	6737	3515	3447	3447
query73	738	326	324	324
query74	6240	5805	5980	5805
query75	5328	3812	3696	3696
query76	6423	1168	1205	1168
query77	1090	261	259	259
query78	12720	12512	12431	12431
query79	8566	630	652	630
query80	720	416	422	416
query81	491	234	239	234
query82	515	99	99	99
query83	171	136	133	133
query84	262	74	72	72
query85	715	327	318	318
query86	338	303	290	290
query87	3189	3063	3024	3024
query88	4293	2332	2356	2332
query89	381	302	313	302
query90	1944	217	212	212
query91	187	140	139	139
query92	67	55	54	54
query93	3672	578	595	578
query94	673	210	211	210
query95	1109	1066	1076	1066
query96	639	330	328	328
query97	6512	6347	6377	6347
query98	200	178	172	172
query99	2794	870	918	870
Total cold run time: 311329 ms
Total hot run time: 205231 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.72 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b81fba32db87400611d445765a8c79547b901d53, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.02
query3	0.25	0.04	0.04
query4	1.79	0.05	0.06
query5	0.54	0.53	0.51
query6	1.24	0.62	0.62
query7	0.01	0.00	0.01
query8	0.04	0.03	0.02
query9	0.52	0.49	0.49
query10	0.55	0.53	0.52
query11	0.12	0.08	0.09
query12	0.11	0.09	0.09
query13	0.63	0.62	0.61
query14	0.78	0.81	0.78
query15	0.77	0.75	0.77
query16	0.36	0.38	0.39
query17	1.01	0.99	1.00
query18	0.24	0.24	0.24
query19	1.98	1.89	1.84
query20	0.02	0.01	0.00
query21	15.47	0.56	0.55
query22	2.41	1.88	1.61
query23	17.08	1.03	0.95
query24	6.15	0.93	1.35
query25	0.39	0.07	0.07
query26	0.72	0.18	0.15
query27	0.04	0.04	0.04
query28	6.89	0.73	0.72
query29	12.64	2.36	2.31
query30	0.52	0.53	0.52
query31	2.81	0.40	0.39
query32	3.36	0.48	0.49
query33	3.08	3.08	3.08
query34	15.23	4.80	4.79
query35	4.87	4.82	4.84
query36	1.05	1.01	1.01
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.02
query40	0.15	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.01	0.01
query43	0.02	0.02	0.02
Total cold run time: 104.12 s
Total hot run time: 30.72 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit b81fba32db87400611d445765a8c79547b901d53 with default session variables
Stream load json:         21 seconds loaded 2358488459 Bytes, about 107 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@yujun777
Copy link
Collaborator Author

run p0

@dataroaring dataroaring merged commit 1499b16 into apache:branch-2.0 Jun 14, 2024
24 of 25 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants