Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](cluster key) test mow cases in cluster key #42565

Closed
wants to merge 1 commit into from

Conversation

mymeiyi
Copy link
Contributor

@mymeiyi mymeiyi commented Oct 28, 2024

used for test cluster key feature, this pr does not need merge

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@mymeiyi mymeiyi force-pushed the cluster-key-random branch from 77e272c to 87ce1a4 Compare October 28, 2024 07:04
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Oct 28, 2024

run buildall

Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Eventually, we should fuzzy the config.

@doris-robot
Copy link

TPC-H: Total hot run time: 41548 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 87ce1a46af9acce7465bf91323bc5a948766e00d, data reload: false

------ Round 1 ----------------------------------
q1	17581	7508	7337	7337
q2	2066	167	156	156
q3	10608	1114	1219	1114
q4	10570	869	880	869
q5	7767	3099	3087	3087
q6	229	147	148	147
q7	1044	627	616	616
q8	9363	1965	2028	1965
q9	6578	6477	6464	6464
q10	7065	2460	2413	2413
q11	446	241	240	240
q12	404	223	218	218
q13	17775	3015	3019	3015
q14	240	205	219	205
q15	562	513	515	513
q16	634	575	590	575
q17	975	554	518	518
q18	7339	6779	6703	6703
q19	1328	946	985	946
q20	474	183	182	182
q21	4038	3307	3258	3258
q22	1112	1007	1011	1007
Total cold run time: 108198 ms
Total hot run time: 41548 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7271	7240	7246	7240
q2	328	229	226	226
q3	2998	2969	3009	2969
q4	2112	1855	1799	1799
q5	5764	5781	5804	5781
q6	232	148	148	148
q7	2272	1862	1783	1783
q8	3416	3550	3473	3473
q9	8945	8899	8882	8882
q10	3585	3578	3571	3571
q11	585	490	487	487
q12	856	652	621	621
q13	9444	3232	3186	3186
q14	315	267	270	267
q15	585	522	526	522
q16	667	674	646	646
q17	1876	1624	1612	1612
q18	8481	7882	7572	7572
q19	1737	1540	1523	1523
q20	2127	1914	1860	1860
q21	5547	5536	5441	5441
q22	1200	1060	1048	1048
Total cold run time: 70343 ms
Total hot run time: 60657 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196437 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 87ce1a46af9acce7465bf91323bc5a948766e00d, data reload: false

query1	1254	1001	1038	1001
query2	6236	2076	2085	2076
query3	11462	4833	5050	4833
query4	33843	23463	23488	23463
query5	5034	466	444	444
query6	274	172	184	172
query7	3986	304	301	301
query8	275	223	222	222
query9	9448	2710	2724	2710
query10	490	256	249	249
query11	18246	15194	15489	15194
query12	152	104	105	104
query13	1582	440	426	426
query14	9819	7274	6660	6660
query15	235	184	186	184
query16	7998	489	488	488
query17	1468	612	574	574
query18	2132	314	309	309
query19	259	159	155	155
query20	122	117	118	117
query21	205	109	110	109
query22	4970	4634	4316	4316
query23	34613	33945	34308	33945
query24	11092	2828	2755	2755
query25	595	405	406	405
query26	1050	158	160	158
query27	2342	286	287	286
query28	7306	2427	2431	2427
query29	735	431	426	426
query30	268	160	162	160
query31	1001	800	806	800
query32	89	59	58	58
query33	762	276	269	269
query34	923	523	515	515
query35	1080	897	909	897
query36	1095	938	953	938
query37	119	71	77	71
query38	4418	4259	4191	4191
query39	1452	1420	1416	1416
query40	206	99	99	99
query41	48	47	48	47
query42	112	99	96	96
query43	523	493	480	480
query44	1342	806	804	804
query45	183	167	166	166
query46	1140	704	718	704
query47	1958	1818	1836	1818
query48	431	325	324	324
query49	933	407	401	401
query50	829	403	393	393
query51	7164	7012	6892	6892
query52	105	91	86	86
query53	253	182	176	176
query54	1088	409	409	409
query55	78	79	79	79
query56	251	262	250	250
query57	1322	1188	1137	1137
query58	221	199	197	197
query59	3286	3043	2961	2961
query60	275	250	253	250
query61	104	110	104	104
query62	845	670	669	669
query63	228	191	186	186
query64	3968	640	624	624
query65	3271	3175	3199	3175
query66	841	301	299	299
query67	16591	15734	15706	15706
query68	4355	573	546	546
query69	426	265	263	263
query70	1244	1170	1170	1170
query71	318	270	253	253
query72	6204	3982	3940	3940
query73	778	355	362	355
query74	10375	8956	9058	8956
query75	3404	2699	2643	2643
query76	2588	981	985	981
query77	392	275	270	270
query78	10565	9661	9530	9530
query79	1546	594	595	594
query80	1164	419	414	414
query81	585	243	237	237
query82	975	116	111	111
query83	235	137	137	137
query84	234	71	74	71
query85	1235	297	290	290
query86	402	310	299	299
query87	4891	4701	4667	4667
query88	3260	2247	2198	2198
query89	415	290	285	285
query90	1984	185	183	183
query91	132	100	107	100
query92	58	48	47	47
query93	1986	540	539	539
query94	876	287	297	287
query95	348	248	249	248
query96	637	276	289	276
query97	2936	2725	2685	2685
query98	209	207	200	200
query99	1551	1320	1306	1306
Total cold run time: 302334 ms
Total hot run time: 196437 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 87ce1a46af9acce7465bf91323bc5a948766e00d, data reload: false

query1	0.04	0.04	0.04
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.10
query5	0.40	0.40	0.40
query6	1.12	0.66	0.65
query7	0.04	0.02	0.02
query8	0.04	0.03	0.04
query9	0.55	0.50	0.48
query10	0.54	0.55	0.54
query11	0.15	0.11	0.10
query12	0.13	0.11	0.11
query13	0.61	0.60	0.60
query14	2.73	2.75	2.76
query15	0.88	0.84	0.82
query16	0.38	0.38	0.38
query17	0.99	1.01	1.07
query18	0.21	0.20	0.20
query19	1.90	1.87	1.96
query20	0.01	0.02	0.01
query21	15.37	0.59	0.60
query22	2.35	1.78	2.49
query23	17.06	0.93	0.65
query24	3.15	1.28	0.86
query25	0.28	0.13	0.13
query26	0.40	0.13	0.13
query27	0.04	0.05	0.04
query28	10.67	1.10	1.07
query29	12.62	3.38	3.44
query30	0.25	0.06	0.06
query31	2.89	0.38	0.38
query32	3.26	0.46	0.45
query33	3.00	3.02	2.96
query34	17.11	4.46	4.46
query35	4.46	4.50	4.44
query36	0.67	0.48	0.47
query37	0.08	0.06	0.05
query38	0.04	0.04	0.04
query39	0.03	0.03	0.02
query40	0.17	0.12	0.12
query41	0.07	0.03	0.03
query42	0.03	0.03	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.68 s
Total hot run time: 32.35 s

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Oct 28, 2024

Eventually, we should fuzzy the config.

the partial update case can not pass

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Oct 29, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41619 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 63308fed27490e7047e7b74906f7861e3bd3534e, data reload: false

------ Round 1 ----------------------------------
q1	17570	7626	7324	7324
q2	2060	164	153	153
q3	10561	1109	1186	1109
q4	10342	914	810	810
q5	7732	3105	3097	3097
q6	238	148	144	144
q7	1043	635	598	598
q8	9372	1989	2056	1989
q9	6562	6477	6518	6477
q10	7126	2449	2461	2449
q11	461	237	239	237
q12	428	231	215	215
q13	17778	3015	3013	3013
q14	242	222	210	210
q15	567	521	513	513
q16	656	593	578	578
q17	982	597	609	597
q18	7298	6691	6764	6691
q19	1341	1045	958	958
q20	488	189	186	186
q21	4104	3260	3298	3260
q22	1150	1019	1011	1011
Total cold run time: 108101 ms
Total hot run time: 41619 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7288	7250	7318	7250
q2	326	234	225	225
q3	3041	2954	2937	2937
q4	2102	1863	1783	1783
q5	5757	5731	5807	5731
q6	246	146	144	144
q7	2252	1832	1826	1826
q8	3362	3603	3515	3515
q9	8976	8972	8848	8848
q10	3596	3594	3581	3581
q11	589	498	493	493
q12	839	674	633	633
q13	9932	3194	3209	3194
q14	308	274	274	274
q15	588	528	519	519
q16	702	657	641	641
q17	1881	1629	1658	1629
q18	8363	7917	7517	7517
q19	1725	1612	1496	1496
q20	2138	1898	1842	1842
q21	5574	5484	5536	5484
q22	1203	1105	1037	1037
Total cold run time: 70788 ms
Total hot run time: 60599 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196436 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 63308fed27490e7047e7b74906f7861e3bd3534e, data reload: false

query1	1270	963	1059	963
query2	6232	2061	2045	2045
query3	11577	4803	5093	4803
query4	33229	23553	23599	23553
query5	4752	459	447	447
query6	287	203	175	175
query7	3988	297	300	297
query8	290	231	235	231
query9	9675	2749	2770	2749
query10	491	251	241	241
query11	18108	15169	15323	15169
query12	152	104	100	100
query13	1573	447	415	415
query14	9473	7010	6982	6982
query15	237	192	186	186
query16	7868	496	444	444
query17	1452	572	571	571
query18	2075	297	315	297
query19	212	147	151	147
query20	124	114	117	114
query21	202	104	116	104
query22	4771	4818	4112	4112
query23	34762	34119	33958	33958
query24	10944	2772	2752	2752
query25	621	381	383	381
query26	1190	151	153	151
query27	2398	271	285	271
query28	7612	2444	2452	2444
query29	861	400	398	398
query30	264	154	151	151
query31	1018	795	807	795
query32	91	51	52	51
query33	751	254	258	254
query34	1010	516	506	506
query35	1042	868	888	868
query36	1130	956	955	955
query37	144	73	75	73
query38	4429	4309	4349	4309
query39	1478	1402	1416	1402
query40	197	96	96	96
query41	44	43	42	42
query42	105	95	95	95
query43	523	487	474	474
query44	1258	798	810	798
query45	179	164	169	164
query46	1128	709	691	691
query47	1954	1839	1885	1839
query48	427	333	335	333
query49	940	401	398	398
query50	793	385	385	385
query51	7125	7044	6943	6943
query52	99	86	91	86
query53	253	179	178	178
query54	1183	397	400	397
query55	78	78	78	78
query56	275	253	247	247
query57	1315	1175	1143	1143
query58	240	213	209	209
query59	3270	2970	3093	2970
query60	272	257	259	257
query61	126	117	121	117
query62	845	656	678	656
query63	216	187	180	180
query64	4118	732	677	677
query65	3257	3219	3214	3214
query66	949	311	318	311
query67	16014	15550	15578	15550
query68	4482	563	559	559
query69	448	298	254	254
query70	1254	1165	1112	1112
query71	317	255	258	255
query72	6255	3961	3981	3961
query73	749	347	356	347
query74	10335	9165	9039	9039
query75	3443	2679	2685	2679
query76	2675	998	994	994
query77	376	275	269	269
query78	10482	9583	9495	9495
query79	1460	591	607	591
query80	741	416	426	416
query81	552	234	241	234
query82	882	112	109	109
query83	167	143	138	138
query84	232	73	65	65
query85	1596	291	278	278
query86	467	312	311	311
query87	4730	4697	4668	4668
query88	3801	2231	2180	2180
query89	435	290	284	284
query90	2049	185	179	179
query91	136	98	100	98
query92	58	49	49	49
query93	2382	540	549	540
query94	928	292	289	289
query95	344	243	240	240
query96	616	282	294	282
query97	2945	2649	2697	2649
query98	216	194	191	191
query99	1494	1340	1289	1289
Total cold run time: 302013 ms
Total hot run time: 196436 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.96 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 63308fed27490e7047e7b74906f7861e3bd3534e, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.64	0.10	0.10
query5	0.44	0.40	0.41
query6	1.14	0.64	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.59	0.51	0.48
query10	0.55	0.54	0.54
query11	0.14	0.10	0.11
query12	0.13	0.11	0.11
query13	0.62	0.59	0.59
query14	2.83	2.74	2.71
query15	0.89	0.82	0.83
query16	0.39	0.39	0.39
query17	1.06	1.07	1.06
query18	0.20	0.20	0.20
query19	1.81	1.78	1.92
query20	0.01	0.01	0.02
query21	15.38	0.60	0.60
query22	2.41	2.49	1.20
query23	16.92	0.95	0.80
query24	3.30	0.97	1.72
query25	0.19	0.06	0.12
query26	0.63	0.14	0.13
query27	0.05	0.05	0.04
query28	10.06	1.10	1.08
query29	12.57	3.30	3.29
query30	0.25	0.06	0.06
query31	2.86	0.38	0.39
query32	3.29	0.47	0.46
query33	2.97	3.03	3.01
query34	16.88	4.48	4.52
query35	4.54	4.56	4.51
query36	0.67	0.50	0.50
query37	0.08	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.27 s
Total hot run time: 31.96 s

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Oct 29, 2024

run p0

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Oct 29, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41434 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 69ece4a0aa132bd875fae37368be659bd1e6107f, data reload: false

------ Round 1 ----------------------------------
q1	17585	7571	7284	7284
q2	2052	157	166	157
q3	10727	1102	1154	1102
q4	10488	850	848	848
q5	7785	3110	3075	3075
q6	241	151	146	146
q7	1006	612	614	612
q8	9343	2012	1995	1995
q9	6540	6439	6423	6423
q10	7133	2418	2431	2418
q11	457	235	249	235
q12	408	221	211	211
q13	17807	3024	2990	2990
q14	246	227	212	212
q15	571	516	512	512
q16	659	585	594	585
q17	991	585	584	584
q18	7447	6807	6726	6726
q19	1338	1083	1014	1014
q20	467	179	190	179
q21	3959	3290	3106	3106
q22	1105	1020	1025	1020
Total cold run time: 108355 ms
Total hot run time: 41434 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7308	7282	7306	7282
q2	325	228	231	228
q3	3072	2996	3007	2996
q4	2155	1930	1822	1822
q5	5788	5813	5798	5798
q6	229	139	141	139
q7	2285	1853	1768	1768
q8	3392	3561	3525	3525
q9	9027	8963	8976	8963
q10	3635	3589	3579	3579
q11	595	492	491	491
q12	847	652	601	601
q13	9932	3216	3210	3210
q14	318	294	300	294
q15	572	514	534	514
q16	691	635	642	635
q17	1879	1663	1655	1655
q18	8387	7842	7490	7490
q19	1708	1662	1569	1569
q20	2141	1871	1903	1871
q21	5579	5308	5391	5308
q22	1133	1049	1064	1049
Total cold run time: 70998 ms
Total hot run time: 60787 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198018 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 69ece4a0aa132bd875fae37368be659bd1e6107f, data reload: false

query1	1238	1038	994	994
query2	6213	2130	2100	2100
query3	11478	4682	4593	4593
query4	33925	23567	23703	23567
query5	5098	453	447	447
query6	283	181	199	181
query7	3979	292	301	292
query8	280	224	218	218
query9	9616	2727	2743	2727
query10	504	254	236	236
query11	18201	15298	15478	15298
query12	145	105	96	96
query13	1552	414	431	414
query14	10156	7494	7776	7494
query15	264	183	194	183
query16	8024	449	449	449
query17	1552	623	590	590
query18	2075	316	303	303
query19	362	171	154	154
query20	123	117	121	117
query21	208	110	115	110
query22	4730	4653	4730	4653
query23	35952	33935	34180	33935
query24	11107	2841	2881	2841
query25	536	403	401	401
query26	732	161	166	161
query27	2185	288	296	288
query28	7369	2448	2467	2448
query29	676	426	426	426
query30	256	168	167	167
query31	1041	802	799	799
query32	92	56	57	56
query33	757	279	277	277
query34	905	529	532	529
query35	1061	885	883	883
query36	1125	951	962	951
query37	119	79	79	79
query38	4449	4395	4274	4274
query39	1469	1422	1410	1410
query40	211	106	104	104
query41	54	47	48	47
query42	113	104	99	99
query43	534	499	492	492
query44	1308	816	805	805
query45	185	168	170	168
query46	1152	728	723	723
query47	1930	1810	1882	1810
query48	445	336	329	329
query49	935	428	414	414
query50	843	389	415	389
query51	6988	7018	7056	7018
query52	100	91	89	89
query53	261	192	181	181
query54	1219	418	409	409
query55	84	77	81	77
query56	277	256	284	256
query57	1278	1140	1160	1140
query58	236	203	214	203
query59	3118	3102	3003	3003
query60	282	241	253	241
query61	105	105	105	105
query62	868	679	658	658
query63	214	195	193	193
query64	3890	649	612	612
query65	3306	3250	3216	3216
query66	786	309	310	309
query67	15843	15670	15565	15565
query68	4331	551	544	544
query69	425	266	268	266
query70	1234	1194	1124	1124
query71	392	265	261	261
query72	6052	4011	3994	3994
query73	780	362	369	362
query74	10298	9108	8993	8993
query75	3438	2689	2699	2689
query76	2536	975	931	931
query77	388	274	279	274
query78	10627	9620	9556	9556
query79	1542	604	599	599
query80	1159	455	434	434
query81	562	241	241	241
query82	955	120	112	112
query83	232	137	139	137
query84	254	76	67	67
query85	1335	310	290	290
query86	439	301	287	287
query87	4862	4670	4736	4670
query88	3426	2222	2186	2186
query89	426	296	288	288
query90	1925	196	189	189
query91	139	104	103	103
query92	58	52	48	48
query93	1755	554	547	547
query94	873	299	292	292
query95	358	252	252	252
query96	629	283	287	283
query97	2905	2699	2713	2699
query98	213	202	202	202
query99	1564	1302	1302	1302
Total cold run time: 302514 ms
Total hot run time: 198018 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.42 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 69ece4a0aa132bd875fae37368be659bd1e6107f, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.06
query4	1.64	0.10	0.10
query5	0.42	0.40	0.41
query6	1.16	0.66	0.65
query7	0.02	0.02	0.02
query8	0.05	0.04	0.04
query9	0.55	0.49	0.50
query10	0.55	0.56	0.54
query11	0.15	0.11	0.10
query12	0.14	0.12	0.11
query13	0.61	0.60	0.60
query14	2.72	2.84	2.78
query15	0.91	0.83	0.82
query16	0.37	0.39	0.40
query17	1.02	1.06	1.05
query18	0.20	0.20	0.20
query19	1.92	1.88	2.00
query20	0.01	0.01	0.01
query21	15.35	0.60	0.58
query22	2.25	2.07	2.16
query23	17.10	1.02	0.98
query24	2.83	1.25	1.53
query25	0.27	0.14	0.10
query26	0.45	0.14	0.13
query27	0.04	0.04	0.05
query28	10.47	1.10	1.08
query29	12.54	3.25	3.31
query30	0.24	0.06	0.06
query31	2.88	0.39	0.39
query32	3.26	0.46	0.46
query33	3.01	3.08	3.01
query34	16.94	4.46	4.43
query35	4.52	4.51	4.58
query36	0.66	0.52	0.47
query37	0.08	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.05 s
Total hot run time: 33.42 s

@mymeiyi mymeiyi force-pushed the cluster-key-random branch 3 times, most recently from 29e49ed to b70fbe7 Compare October 29, 2024 09:36
@mymeiyi
Copy link
Contributor Author

mymeiyi commented Oct 29, 2024

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

2 similar comments
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 37.48% (9721/25938)
Line Coverage: 28.74% (80648/280620)
Region Coverage: 28.15% (41678/148041)
Branch Coverage: 24.72% (21175/85668)
Coverage Report: http://coverage.selectdb-in.cc/coverage/b70fbe7ac09a87e3a2da9918b547a76fafcd9444_b70fbe7ac09a87e3a2da9918b547a76fafcd9444/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 41272 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b70fbe7ac09a87e3a2da9918b547a76fafcd9444, data reload: false

------ Round 1 ----------------------------------
q1	17564	7513	7328	7328
q2	2053	162	152	152
q3	10574	1084	1166	1084
q4	10401	863	799	799
q5	7747	3083	3058	3058
q6	233	144	142	142
q7	1008	620	595	595
q8	9336	2006	2018	2006
q9	6487	6418	6451	6418
q10	7112	2389	2407	2389
q11	452	240	235	235
q12	411	217	209	209
q13	17765	3019	2996	2996
q14	245	207	215	207
q15	561	503	521	503
q16	668	585	585	585
q17	976	578	546	546
q18	7321	6776	6614	6614
q19	1334	1028	1043	1028
q20	470	183	200	183
q21	4018	3244	3220	3220
q22	1107	1023	975	975
Total cold run time: 107843 ms
Total hot run time: 41272 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7275	7246	7220	7220
q2	331	224	227	224
q3	2930	2986	2989	2986
q4	2059	1827	1758	1758
q5	5691	5768	5725	5725
q6	222	139	139	139
q7	2247	1812	1833	1812
q8	3334	3547	3503	3503
q9	8864	8927	8894	8894
q10	3587	3550	3547	3547
q11	584	494	485	485
q12	806	617	644	617
q13	9991	3183	3180	3180
q14	310	271	279	271
q15	573	526	521	521
q16	698	633	652	633
q17	1860	1644	1613	1613
q18	8383	7809	7737	7737
q19	1708	1564	1684	1564
q20	2139	1886	1879	1879
q21	5529	5330	5453	5330
q22	1159	1069	1073	1069
Total cold run time: 70280 ms
Total hot run time: 60707 ms

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.84% (10123/26064)
Line Coverage: 29.77% (85109/285909)
Region Coverage: 28.80% (43634/151490)
Branch Coverage: 25.34% (22167/87462)
Coverage Report: http://coverage.selectdb-in.cc/coverage/fdef604520e2a410f6607b2ac9ac5ebb08877374_fdef604520e2a410f6607b2ac9ac5ebb08877374/report/index.html

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Dec 17, 2024

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10128/26064)
Line Coverage: 29.77% (85134/285976)
Region Coverage: 28.82% (43669/151535)
Branch Coverage: 25.36% (22186/87496)
Coverage Report: http://coverage.selectdb-in.cc/coverage/454d0c4533b6b5dd6c6420e5783358cf8f1a8e2f_454d0c4533b6b5dd6c6420e5783358cf8f1a8e2f/report/index.html

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Dec 17, 2024

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.86% (10128/26064)
Line Coverage: 29.78% (85161/285976)
Region Coverage: 28.82% (43665/151535)
Branch Coverage: 25.35% (22181/87496)
Coverage Report: http://coverage.selectdb-in.cc/coverage/454d0c4533b6b5dd6c6420e5783358cf8f1a8e2f_454d0c4533b6b5dd6c6420e5783358cf8f1a8e2f/report/index.html

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Dec 18, 2024

run buildall

Copy link
Contributor

sh-checker report

To get the full details, please check in the job output.

shellcheck errors

'shellcheck ' returned error 1 finding the following syntactical issues:

----------

In gensrc/script/gen_build_version.sh line 38:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.


In gensrc/script/gen_build_version.sh line 228:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.

For more information:
  https://www.shellcheck.net/wiki/SC2071 -- > is for string comparisons. Use ...
----------

You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
  # shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.



shfmt errors
'shfmt ' found no issues.

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

Copy link
Contributor

sh-checker report

To get the full details, please check in the job output.

shellcheck errors

'shellcheck ' returned error 1 finding the following syntactical issues:

----------

In gensrc/script/gen_build_version.sh line 38:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.


In gensrc/script/gen_build_version.sh line 228:
if [[ ${build_version_hotfix} > 0 ]]; then
                              ^-- SC2071 (error): > is for string comparisons. Use -gt instead.

For more information:
  https://www.shellcheck.net/wiki/SC2071 -- > is for string comparisons. Use ...
----------

You can address the above issues in one of three ways:
1. Manually correct the issue in the offending shell script;
2. Disable specific issues by adding the comment:
  # shellcheck disable=NNNN
above the line that contains the issue, where NNNN is the error code;
3. Add '-e NNNN' to the SHELLCHECK_OPTS setting in your .yml action file.



shfmt errors
'shfmt ' found no issues.

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Dec 18, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39702 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a3548504fb19cfb42d914b26ff97a6af94ec8d52, data reload: false

------ Round 1 ----------------------------------
q1	17580	7410	7219	7219
q2	2040	170	166	166
q3	10813	1055	1186	1055
q4	10566	774	743	743
q5	7615	2739	2724	2724
q6	237	144	145	144
q7	990	623	610	610
q8	9241	1863	1887	1863
q9	6605	6423	6427	6423
q10	7042	2311	2293	2293
q11	465	251	258	251
q12	418	216	221	216
q13	17776	2913	2922	2913
q14	236	205	219	205
q15	561	506	493	493
q16	675	579	590	579
q17	976	559	535	535
q18	7151	6634	6719	6634
q19	1359	1029	1034	1029
q20	454	180	183	180
q21	3977	3123	3269	3123
q22	366	307	304	304
Total cold run time: 107143 ms
Total hot run time: 39702 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7183	7177	7209	7177
q2	322	232	231	231
q3	2899	2805	2936	2805
q4	2038	1856	1787	1787
q5	5677	5648	5600	5600
q6	238	145	143	143
q7	2279	1802	1785	1785
q8	3354	3518	3486	3486
q9	8884	8921	8967	8921
q10	3573	3556	3532	3532
q11	611	505	507	505
q12	851	593	613	593
q13	12669	3154	3082	3082
q14	299	279	292	279
q15	569	513	519	513
q16	718	626	668	626
q17	1844	1612	1567	1567
q18	8392	7870	7780	7780
q19	1731	1560	1387	1387
q20	2098	1911	1914	1911
q21	5659	5469	5526	5469
q22	674	619	573	573
Total cold run time: 72562 ms
Total hot run time: 59752 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.87% (10133/26066)
Line Coverage: 29.79% (85196/286016)
Region Coverage: 28.84% (43704/151556)
Branch Coverage: 25.37% (22207/87516)
Coverage Report: http://coverage.selectdb-in.cc/coverage/a3548504fb19cfb42d914b26ff97a6af94ec8d52_a3548504fb19cfb42d914b26ff97a6af94ec8d52/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 195933 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a3548504fb19cfb42d914b26ff97a6af94ec8d52, data reload: false

query1	1280	963	972	963
query2	6255	2511	2421	2421
query3	11164	4884	4799	4799
query4	33009	23303	23369	23303
query5	4233	462	459	459
query6	289	227	186	186
query7	4010	300	310	300
query8	303	242	237	237
query9	9518	2664	2630	2630
query10	490	250	267	250
query11	18068	15240	15096	15096
query12	158	109	110	109
query13	1594	425	411	411
query14	10257	7069	6745	6745
query15	314	190	190	190
query16	8088	493	474	474
query17	1716	584	594	584
query18	2172	305	302	302
query19	374	156	158	156
query20	115	111	108	108
query21	221	110	102	102
query22	4815	4644	4454	4454
query23	34520	34631	33538	33538
query24	10468	2476	2548	2476
query25	599	400	390	390
query26	1382	152	152	152
query27	2710	337	328	328
query28	7815	2453	2450	2450
query29	840	466	442	442
query30	223	146	153	146
query31	1030	824	820	820
query32	90	57	53	53
query33	758	299	302	299
query34	1122	519	523	519
query35	900	747	746	746
query36	1109	955	975	955
query37	145	70	71	70
query38	4263	4094	4176	4094
query39	1498	1524	1440	1440
query40	221	103	102	102
query41	45	42	42	42
query42	118	104	106	104
query43	560	522	529	522
query44	1283	862	855	855
query45	188	173	167	167
query46	1196	709	733	709
query47	2048	1928	1955	1928
query48	440	331	323	323
query49	903	391	378	378
query50	833	396	404	396
query51	7454	7283	7134	7134
query52	102	93	97	93
query53	265	188	193	188
query54	1050	401	418	401
query55	78	75	79	75
query56	259	246	241	241
query57	1256	1205	1191	1191
query58	232	221	226	221
query59	3422	3202	3213	3202
query60	274	260	250	250
query61	111	105	105	105
query62	861	686	684	684
query63	222	187	185	185
query64	4016	660	647	647
query65	3224	3205	3184	3184
query66	711	297	289	289
query67	15898	15568	15572	15568
query68	4851	555	559	555
query69	442	250	247	247
query70	1169	1159	1087	1087
query71	387	252	255	252
query72	7032	4115	4096	4096
query73	767	354	353	353
query74	9984	8944	8822	8822
query75	3391	2614	2649	2614
query76	2893	968	1165	968
query77	640	264	269	264
query78	10169	9451	9293	9293
query79	1585	604	604	604
query80	853	426	527	426
query81	546	235	228	228
query82	639	119	125	119
query83	258	144	140	140
query84	229	70	75	70
query85	1178	307	326	307
query86	408	305	298	298
query87	4474	4579	4492	4492
query88	3743	2197	2250	2197
query89	423	289	284	284
query90	1928	190	187	187
query91	137	108	114	108
query92	67	49	51	49
query93	2517	546	538	538
query94	733	270	282	270
query95	354	245	249	245
query96	625	276	285	276
query97	2855	2677	2669	2669
query98	225	200	198	198
query99	1549	1301	1296	1296
Total cold run time: 302236 ms
Total hot run time: 195933 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.93 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a3548504fb19cfb42d914b26ff97a6af94ec8d52, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.29	0.07	0.07
query4	1.98	0.10	0.11
query5	0.44	0.42	0.40
query6	1.20	0.66	0.64
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.57	0.50	0.49
query10	0.57	0.59	0.54
query11	0.15	0.11	0.10
query12	0.13	0.10	0.11
query13	0.61	0.60	0.59
query14	2.85	2.79	2.79
query15	0.88	0.81	0.82
query16	0.37	0.36	0.39
query17	1.06	1.05	1.01
query18	0.23	0.20	0.21
query19	1.96	1.80	1.98
query20	0.01	0.01	0.01
query21	15.37	0.58	0.59
query22	2.39	2.29	2.29
query23	17.00	0.96	0.84
query24	3.18	0.81	1.47
query25	0.25	0.19	0.04
query26	0.34	0.13	0.14
query27	0.04	0.04	0.05
query28	10.47	1.10	1.08
query29	12.57	3.25	3.27
query30	0.24	0.06	0.06
query31	2.88	0.39	0.37
query32	3.24	0.47	0.46
query33	3.09	3.22	3.12
query34	17.25	4.48	4.53
query35	4.50	4.56	4.49
query36	0.66	0.48	0.48
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.43 s
Total hot run time: 32.93 s

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Dec 26, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32673 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 51c924574b3e33a9ca7281e736d34610522341b6, data reload: false

------ Round 1 ----------------------------------
q1	17575	6189	6150	6150
q2	2044	306	173	173
q3	10406	1241	720	720
q4	10207	852	433	433
q5	7506	2158	1954	1954
q6	207	181	145	145
q7	882	757	611	611
q8	9242	1348	1160	1160
q9	5100	4898	4931	4898
q10	6743	2304	1864	1864
q11	465	273	275	273
q12	348	350	223	223
q13	17757	3590	2991	2991
q14	243	238	204	204
q15	574	509	499	499
q16	620	625	617	617
q17	580	851	350	350
q18	7288	6580	6367	6367
q19	2320	971	560	560
q20	309	303	190	190
q21	2781	2213	1982	1982
q22	351	324	309	309
Total cold run time: 103548 ms
Total hot run time: 32673 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6239	6173	6194	6173
q2	236	326	241	241
q3	2226	2679	2305	2305
q4	1473	1873	1393	1393
q5	4336	4734	4865	4734
q6	192	187	144	144
q7	2140	1974	1854	1854
q8	2596	2791	2701	2701
q9	7339	7229	7150	7150
q10	3057	3368	2788	2788
q11	581	512	515	512
q12	697	752	600	600
q13	3347	3735	3215	3215
q14	298	316	271	271
q15	568	502	503	502
q16	648	701	665	665
q17	1191	1706	1241	1241
q18	7684	7322	7230	7230
q19	817	857	1131	857
q20	1892	1990	1771	1771
q21	5333	5007	4773	4773
q22	619	607	589	589
Total cold run time: 53509 ms
Total hot run time: 51709 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.83% (10104/26020)
Line Coverage: 29.85% (85393/286093)
Region Coverage: 28.98% (43620/150542)
Branch Coverage: 25.51% (22244/87208)
Coverage Report: http://coverage.selectdb-in.cc/coverage/51c924574b3e33a9ca7281e736d34610522341b6_51c924574b3e33a9ca7281e736d34610522341b6/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 189759 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 51c924574b3e33a9ca7281e736d34610522341b6, data reload: false

query1	969	374	385	374
query2	6517	2313	2342	2313
query3	6704	212	211	211
query4	33455	23861	23494	23494
query5	4357	607	462	462
query6	288	213	197	197
query7	4611	498	310	310
query8	334	257	238	238
query9	9477	2658	2671	2658
query10	458	312	253	253
query11	17851	15489	15013	15013
query12	159	107	108	107
query13	1691	554	413	413
query14	10529	7277	6836	6836
query15	266	199	191	191
query16	8117	589	435	435
query17	1560	711	554	554
query18	2106	398	290	290
query19	224	195	175	175
query20	123	112	111	111
query21	212	121	103	103
query22	4304	4245	4176	4176
query23	35039	34109	33561	33561
query24	6411	2293	2251	2251
query25	465	432	388	388
query26	1097	255	150	150
query27	2063	457	334	334
query28	5233	2411	2376	2376
query29	521	517	417	417
query30	227	177	144	144
query31	972	898	817	817
query32	89	62	62	62
query33	513	352	293	293
query34	751	838	512	512
query35	805	810	773	773
query36	1026	1081	943	943
query37	114	96	72	72
query38	4214	4223	4073	4073
query39	1527	1455	1444	1444
query40	200	117	98	98
query41	46	47	46	46
query42	123	102	102	102
query43	506	528	495	495
query44	1309	806	823	806
query45	179	177	181	177
query46	858	1042	638	638
query47	1896	1953	1862	1862
query48	382	405	310	310
query49	780	467	385	385
query50	615	648	391	391
query51	7022	7228	7029	7029
query52	99	102	92	92
query53	224	249	182	182
query54	468	484	402	402
query55	83	77	75	75
query56	264	267	238	238
query57	1195	1186	1123	1123
query58	235	230	237	230
query59	2994	3130	2906	2906
query60	279	275	257	257
query61	111	104	112	104
query62	864	795	747	747
query63	223	188	199	188
query64	4450	1089	695	695
query65	3297	3190	3247	3190
query66	804	422	314	314
query67	16112	15969	15589	15589
query68	9289	758	528	528
query69	487	287	254	254
query70	1203	1176	1168	1168
query71	452	292	252	252
query72	5703	3796	3859	3796
query73	1361	767	363	363
query74	10226	9328	9018	9018
query75	4474	3184	2690	2690
query76	5625	1207	761	761
query77	1037	344	273	273
query78	10099	10029	9374	9374
query79	6697	830	587	587
query80	756	527	434	434
query81	481	278	225	225
query82	251	151	120	120
query83	196	164	144	144
query84	278	86	72	72
query85	753	377	317	317
query86	348	310	307	307
query87	4693	4390	4388	4388
query88	4008	2235	2213	2213
query89	439	338	292	292
query90	1787	190	194	190
query91	139	141	108	108
query92	62	56	52	52
query93	3627	876	531	531
query94	583	418	275	275
query95	328	256	256	256
query96	473	615	288	288
query97	2747	2811	2655	2655
query98	215	198	206	198
query99	1647	1563	1435	1435
Total cold run time: 301461 ms
Total hot run time: 189759 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.48 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 51c924574b3e33a9ca7281e736d34610522341b6, data reload: false

query1	0.04	0.03	0.02
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.61	0.11	0.11
query5	0.43	0.43	0.41
query6	1.16	0.66	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.49	0.51
query10	0.55	0.60	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.60	0.60	0.60
query14	2.82	2.89	2.71
query15	0.89	0.82	0.82
query16	0.38	0.39	0.38
query17	1.05	1.05	1.06
query18	0.22	0.20	0.21
query19	1.95	1.76	2.03
query20	0.02	0.01	0.01
query21	15.38	0.96	0.55
query22	0.75	0.96	0.85
query23	14.94	1.40	0.59
query24	3.00	1.08	1.84
query25	0.15	0.23	0.07
query26	0.22	0.15	0.13
query27	0.05	0.07	0.07
query28	14.01	1.52	1.05
query29	12.60	3.97	3.26
query30	0.25	0.09	0.06
query31	2.82	0.61	0.39
query32	3.22	0.55	0.47
query33	3.11	3.11	3.07
query34	16.66	5.08	4.48
query35	4.51	4.47	4.45
query36	0.67	0.52	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.8 s
Total hot run time: 31.48 s

@mymeiyi
Copy link
Contributor Author

mymeiyi commented Dec 30, 2024

run buildall

@mymeiyi mymeiyi closed this Jan 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants