Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](Nereids) set correct sort key for aggregate #45369 branch-3.0 #45706

Merged
merged 6 commits into from
Jan 5, 2025

Conversation

englefly
Copy link
Contributor

@englefly englefly commented Dec 20, 2024

What problem does this PR solve?

pick #45369

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Dec 20, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@englefly
Copy link
Contributor Author

run buildall

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40113 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit edae3f10c966e34624900591b6225b669e70b608, data reload: false

------ Round 1 ----------------------------------
q1	17572	7299	7207	7207
q2	2068	164	178	164
q3	10712	1063	1140	1063
q4	10553	747	790	747
q5	8112	2881	2822	2822
q6	238	149	148	148
q7	968	615	626	615
q8	9576	1897	1896	1896
q9	7949	6320	6377	6320
q10	6983	2243	2266	2243
q11	455	262	261	261
q12	398	207	202	202
q13	17782	2953	2958	2953
q14	242	210	213	210
q15	569	518	515	515
q16	695	603	608	603
q17	954	573	488	488
q18	7177	6652	6563	6563
q19	4045	933	1097	933
q20	460	204	190	190
q21	3903	3044	3209	3044
q22	1099	955	926	926
Total cold run time: 112510 ms
Total hot run time: 40113 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7371	7211	7235	7211
q2	332	226	235	226
q3	3005	2853	2856	2853
q4	2104	1776	1756	1756
q5	5631	5682	5714	5682
q6	249	149	142	142
q7	2177	1734	1725	1725
q8	3363	3506	3371	3371
q9	8773	8839	8759	8759
q10	3516	3511	3704	3511
q11	590	492	510	492
q12	804	632	640	632
q13	16479	3169	3147	3147
q14	308	263	268	263
q15	577	530	529	529
q16	728	685	662	662
q17	1820	1570	1589	1570
q18	8052	7788	7426	7426
q19	3444	1616	1535	1535
q20	2066	1862	1822	1822
q21	5344	5314	5372	5314
q22	1111	1016	987	987
Total cold run time: 77844 ms
Total hot run time: 59615 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195294 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit edae3f10c966e34624900591b6225b669e70b608, data reload: false

query1	1283	927	911	911
query2	6221	2189	2127	2127
query3	10816	4186	4190	4186
query4	68889	30205	23366	23366
query5	5735	447	458	447
query6	518	162	159	159
query7	6356	314	312	312
query8	335	232	243	232
query9	9268	2670	2666	2666
query10	554	264	272	264
query11	18332	15418	15643	15418
query12	160	105	99	99
query13	1591	436	411	411
query14	10848	6716	7181	6716
query15	217	185	177	177
query16	7455	501	505	501
query17	1094	574	579	574
query18	1956	312	328	312
query19	213	151	161	151
query20	116	111	109	109
query21	67	44	43	43
query22	4672	4485	4466	4466
query23	34982	33831	34143	33831
query24	5766	2999	2943	2943
query25	552	430	402	402
query26	690	170	171	170
query27	2016	344	346	344
query28	4715	2528	2515	2515
query29	702	474	477	474
query30	255	167	161	161
query31	1024	836	815	815
query32	64	56	54	54
query33	435	280	273	273
query34	915	489	491	489
query35	841	758	725	725
query36	1075	951	945	945
query37	119	68	69	68
query38	4151	4034	3981	3981
query39	1526	1445	1457	1445
query40	139	83	82	82
query41	47	47	44	44
query42	113	100	103	100
query43	550	515	516	515
query44	1171	797	780	780
query45	181	168	181	168
query46	1152	719	727	719
query47	1964	1847	1903	1847
query48	461	372	376	372
query49	711	379	388	379
query50	831	413	399	399
query51	7187	7168	7207	7168
query52	95	92	92	92
query53	257	184	182	182
query54	553	441	445	441
query55	76	78	74	74
query56	256	228	236	228
query57	1197	1125	1089	1089
query58	200	197	204	197
query59	3298	3065	3199	3065
query60	271	247	253	247
query61	103	102	108	102
query62	780	675	684	675
query63	203	182	194	182
query64	1861	666	605	605
query65	3238	3121	3183	3121
query66	742	304	296	296
query67	15722	15098	15034	15034
query68	4590	561	540	540
query69	424	246	257	246
query70	1143	1103	1146	1103
query71	367	251	248	248
query72	6637	3883	3884	3883
query73	775	338	342	338
query74	10228	8928	8822	8822
query75	3294	2625	2652	2625
query76	2586	1162	1073	1073
query77	489	266	260	260
query78	10713	9748	9441	9441
query79	8389	589	599	589
query80	1925	424	421	421
query81	544	238	234	234
query82	1293	118	109	109
query83	299	142	145	142
query84	300	91	83	83
query85	1666	291	284	284
query86	483	299	264	264
query87	4369	4292	4161	4161
query88	5816	2363	2399	2363
query89	545	290	291	290
query90	2142	184	189	184
query91	177	143	140	140
query92	63	46	48	46
query93	6621	530	533	530
query94	814	269	296	269
query95	346	251	255	251
query96	619	278	275	275
query97	3328	3129	3115	3115
query98	209	201	193	193
query99	1609	1296	1287	1287
Total cold run time: 342686 ms
Total hot run time: 195294 ms

@englefly
Copy link
Contributor Author

englefly commented Jan 4, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41126 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4ca195e9a744e5973c0c26d3063a14ebf726c504, data reload: false

------ Round 1 ----------------------------------
q1	17823	7527	7452	7452
q2	2418	174	175	174
q3	11413	1148	1229	1148
q4	10577	728	839	728
q5	7751	2812	2716	2716
q6	236	149	147	147
q7	973	623	598	598
q8	9345	1958	1935	1935
q9	6635	6418	6356	6356
q10	6989	2276	2305	2276
q11	463	264	269	264
q12	427	225	219	219
q13	17798	2999	3047	2999
q14	249	219	220	219
q15	581	540	521	521
q16	671	644	624	624
q17	967	567	544	544
q18	7233	6794	6703	6703
q19	1395	1060	1052	1052
q20	501	202	202	202
q21	4016	3276	3303	3276
q22	1093	973	979	973
Total cold run time: 109554 ms
Total hot run time: 41126 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7248	7248	7281	7248
q2	331	236	232	232
q3	2980	3040	3072	3040
q4	2069	1767	1828	1767
q5	5703	5770	5699	5699
q6	220	145	145	145
q7	2249	1821	1771	1771
q8	3371	3498	3497	3497
q9	8881	9039	8912	8912
q10	3586	3546	3533	3533
q11	601	526	505	505
q12	815	593	594	593
q13	9788	3162	3113	3113
q14	282	265	265	265
q15	563	522	516	516
q16	719	663	676	663
q17	1808	1559	1579	1559
q18	7872	7343	7309	7309
q19	1651	1515	1513	1513
q20	2053	1816	1815	1815
q21	5318	5095	5255	5095
q22	1096	1000	1017	1000
Total cold run time: 69204 ms
Total hot run time: 59790 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191812 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4ca195e9a744e5973c0c26d3063a14ebf726c504, data reload: false

query1	976	380	360	360
query2	6514	2097	2006	2006
query3	6704	214	222	214
query4	34212	23497	23407	23407
query5	4395	469	466	466
query6	296	186	178	178
query7	4625	315	315	315
query8	319	230	230	230
query9	9720	2663	2670	2663
query10	469	266	282	266
query11	18158	15273	15239	15239
query12	153	106	101	101
query13	1643	432	427	427
query14	8938	7625	6772	6772
query15	251	173	183	173
query16	8146	447	464	447
query17	1637	563	548	548
query18	2148	303	303	303
query19	378	155	148	148
query20	122	105	109	105
query21	60	45	44	44
query22	4516	4198	4201	4198
query23	35797	34941	33959	33959
query24	11768	2872	2845	2845
query25	544	377	383	377
query26	1102	175	172	172
query27	2800	352	352	352
query28	7935	2411	2401	2401
query29	662	434	421	421
query30	353	168	165	165
query31	1022	798	801	798
query32	93	56	61	56
query33	784	281	285	281
query34	958	499	507	499
query35	915	714	718	714
query36	1125	935	993	935
query37	213	81	79	79
query38	4192	4026	3973	3973
query39	1494	1435	1424	1424
query40	235	85	88	85
query41	54	49	50	49
query42	117	105	103	103
query43	537	498	481	481
query44	1288	811	811	811
query45	189	165	168	165
query46	1163	718	723	718
query47	1917	1824	1826	1824
query48	492	387	384	384
query49	1294	399	397	397
query50	820	416	416	416
query51	7244	7136	7104	7104
query52	105	95	93	93
query53	267	190	190	190
query54	1079	471	474	471
query55	86	83	85	83
query56	294	254	257	254
query57	1227	1128	1132	1128
query58	250	215	224	215
query59	3218	3081	2866	2866
query60	303	267	273	267
query61	135	130	148	130
query62	887	683	681	681
query63	231	197	194	194
query64	5282	774	735	735
query65	3313	3253	3231	3231
query66	1297	333	333	333
query67	15986	15645	15874	15645
query68	4932	591	572	572
query69	470	284	274	274
query70	1186	1106	1163	1106
query71	350	276	279	276
query72	6226	3940	3938	3938
query73	787	354	349	349
query74	10509	9071	8954	8954
query75	3384	2670	2676	2670
query76	2913	1142	1084	1084
query77	468	290	267	267
query78	10524	9611	9562	9562
query79	1130	595	602	595
query80	799	452	436	436
query81	534	243	236	236
query82	1313	124	119	119
query83	235	146	148	146
query84	246	84	84	84
query85	1117	308	309	308
query86	313	308	291	291
query87	4481	4574	4331	4331
query88	3577	2434	2371	2371
query89	414	291	306	291
query90	2117	194	194	194
query91	186	147	149	147
query92	63	51	51	51
query93	1047	559	550	550
query94	796	298	284	284
query95	358	262	260	260
query96	625	281	292	281
query97	3325	3231	3177	3177
query98	219	208	203	203
query99	1723	1346	1291	1291
Total cold run time: 301814 ms
Total hot run time: 191812 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.38 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4ca195e9a744e5973c0c26d3063a14ebf726c504, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.10
query5	0.53	0.50	0.51
query6	1.14	0.72	0.72
query7	0.02	0.02	0.02
query8	0.04	0.04	0.05
query9	0.57	0.52	0.51
query10	0.57	0.57	0.57
query11	0.15	0.11	0.10
query12	0.14	0.12	0.11
query13	0.61	0.60	0.60
query14	2.96	3.03	2.93
query15	0.89	0.83	0.83
query16	0.39	0.37	0.40
query17	1.08	1.02	1.06
query18	0.23	0.22	0.21
query19	1.95	1.77	1.96
query20	0.02	0.01	0.01
query21	15.35	0.60	0.57
query22	2.49	2.00	1.76
query23	17.24	0.95	0.78
query24	2.64	1.26	1.35
query25	0.27	0.20	0.14
query26	0.24	0.13	0.13
query27	0.04	0.05	0.04
query28	10.54	1.09	1.07
query29	12.62	3.30	3.29
query30	0.25	0.07	0.06
query31	2.84	0.40	0.39
query32	3.25	0.46	0.46
query33	2.98	3.02	3.05
query34	17.10	4.53	4.54
query35	4.54	4.56	4.64
query36	0.67	0.49	0.48
query37	0.10	0.06	0.06
query38	0.05	0.03	0.04
query39	0.04	0.03	0.02
query40	0.16	0.12	0.12
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.84 s
Total hot run time: 33.38 s

@englefly
Copy link
Contributor Author

englefly commented Jan 4, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40628 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b6f9d096c3ee2e0d03be7a003c6f387cd10b42bb, data reload: false

------ Round 1 ----------------------------------
q1	17594	7299	7204	7204
q2	2061	178	168	168
q3	10603	1065	1203	1065
q4	10574	728	701	701
q5	7725	2813	2773	2773
q6	233	147	140	140
q7	971	606	595	595
q8	9346	1953	2001	1953
q9	6588	6402	6414	6402
q10	6998	2295	2337	2295
q11	468	268	264	264
q12	405	208	198	198
q13	18272	3024	2995	2995
q14	245	212	206	206
q15	563	523	531	523
q16	673	636	629	629
q17	978	609	575	575
q18	7138	6652	6827	6652
q19	1406	1112	972	972
q20	482	206	197	197
q21	4001	3137	3175	3137
q22	1102	984	999	984
Total cold run time: 108426 ms
Total hot run time: 40628 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7242	7168	7223	7168
q2	327	235	231	231
q3	2892	2946	2910	2910
q4	2023	1826	1783	1783
q5	5678	5745	5788	5745
q6	222	139	137	137
q7	2260	1820	1836	1820
q8	3350	3562	3541	3541
q9	8750	8825	8902	8825
q10	3601	3533	3558	3533
q11	595	513	533	513
q12	795	567	594	567
q13	9283	3237	3143	3143
q14	298	272	272	272
q15	574	538	515	515
q16	712	672	695	672
q17	1837	1608	1592	1592
q18	8202	7732	7605	7605
q19	1640	1637	1569	1569
q20	2159	1861	1891	1861
q21	5619	5482	5359	5359
q22	1127	1058	1020	1020
Total cold run time: 69186 ms
Total hot run time: 60381 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196919 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b6f9d096c3ee2e0d03be7a003c6f387cd10b42bb, data reload: false

query1	1292	960	944	944
query2	6245	2094	2056	2056
query3	10776	4244	4034	4034
query4	66021	29237	23372	23372
query5	5047	465	456	456
query6	428	186	181	181
query7	5648	314	305	305
query8	320	238	234	234
query9	9233	2666	2667	2666
query10	448	261	264	261
query11	17287	15118	15770	15118
query12	166	106	103	103
query13	1534	455	460	455
query14	10472	7530	7071	7071
query15	190	184	181	181
query16	7066	475	489	475
query17	1129	575	606	575
query18	1832	323	338	323
query19	225	171	174	171
query20	115	114	117	114
query21	59	45	48	45
query22	4646	4371	4447	4371
query23	34792	34196	34321	34196
query24	6063	2902	2930	2902
query25	526	433	414	414
query26	652	172	167	167
query27	1834	352	356	352
query28	4261	2465	2477	2465
query29	717	453	466	453
query30	250	164	162	162
query31	1004	807	826	807
query32	65	57	57	57
query33	450	284	304	284
query34	914	487	494	487
query35	871	743	763	743
query36	1071	952	977	952
query37	118	75	79	75
query38	4043	3996	4050	3996
query39	1538	1503	1473	1473
query40	145	83	84	83
query41	50	47	50	47
query42	112	98	97	97
query43	534	488	522	488
query44	1179	845	824	824
query45	187	174	173	173
query46	1167	727	730	727
query47	2039	1965	1958	1958
query48	478	379	421	379
query49	728	378	388	378
query50	848	417	413	413
query51	7325	7094	7249	7094
query52	103	91	89	89
query53	253	180	193	180
query54	543	444	465	444
query55	77	86	79	79
query56	242	245	243	243
query57	1254	1127	1105	1105
query58	205	198	200	198
query59	3272	3091	2901	2901
query60	291	260	256	256
query61	114	105	109	105
query62	785	639	663	639
query63	215	187	182	182
query64	1410	655	648	648
query65	3238	3140	3174	3140
query66	694	300	306	300
query67	15894	15826	15624	15624
query68	4071	577	564	564
query69	432	256	258	256
query70	1205	1118	1116	1116
query71	353	255	249	249
query72	6454	4014	4099	4014
query73	753	340	341	340
query74	10257	9208	8980	8980
query75	3369	2657	2658	2657
query76	1954	1146	1055	1055
query77	507	271	264	264
query78	10572	9663	9676	9663
query79	1125	591	594	591
query80	745	420	426	420
query81	526	243	243	243
query82	212	119	121	119
query83	166	142	156	142
query84	288	85	84	84
query85	830	301	295	295
query86	327	288	297	288
query87	4461	4255	4314	4255
query88	3957	2386	2364	2364
query89	412	283	290	283
query90	2042	184	184	184
query91	190	147	147	147
query92	71	49	49	49
query93	1387	542	551	542
query94	782	291	287	287
query95	356	244	249	244
query96	608	281	278	278
query97	3355	3155	3171	3155
query98	214	210	193	193
query99	1687	1308	1316	1308
Total cold run time: 316398 ms
Total hot run time: 196919 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.48 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b6f9d096c3ee2e0d03be7a003c6f387cd10b42bb, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.02
query3	0.22	0.06	0.06
query4	1.63	0.11	0.10
query5	0.54	0.53	0.50
query6	1.13	0.74	0.72
query7	0.03	0.02	0.02
query8	0.04	0.04	0.03
query9	0.56	0.51	0.51
query10	0.55	0.55	0.56
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.61	0.60	0.60
query14	3.05	2.92	2.96
query15	0.88	0.83	0.81
query16	0.38	0.37	0.39
query17	1.07	1.06	1.04
query18	0.24	0.22	0.21
query19	1.98	1.78	2.03
query20	0.01	0.01	0.02
query21	15.35	0.58	0.57
query22	2.91	2.07	1.84
query23	16.94	1.01	0.94
query24	2.99	1.91	0.38
query25	0.18	0.17	0.09
query26	0.45	0.13	0.13
query27	0.04	0.06	0.04
query28	10.69	1.10	1.06
query29	12.55	3.27	3.26
query30	0.25	0.06	0.07
query31	2.87	0.39	0.39
query32	3.23	0.46	0.47
query33	2.95	3.05	3.05
query34	16.84	4.44	4.51
query35	4.57	4.49	4.54
query36	0.67	0.50	0.49
query37	0.09	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.28 s
Total hot run time: 32.48 s

@englefly
Copy link
Contributor Author

englefly commented Jan 4, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41318 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b2d577ceee7a9d2bb18a7795e652987deb1ad6db, data reload: false

------ Round 1 ----------------------------------
q1	18826	7466	7307	7307
q2	2075	176	167	167
q3	11448	1128	1149	1128
q4	10534	722	739	722
q5	7743	2867	2819	2819
q6	236	149	151	149
q7	991	648	627	627
q8	9684	2024	2070	2024
q9	6786	6497	6436	6436
q10	7195	2298	2352	2298
q11	471	280	273	273
q12	434	213	202	202
q13	19251	3063	3037	3037
q14	252	232	221	221
q15	582	523	528	523
q16	1711	646	628	628
q17	1059	533	505	505
q18	7568	7026	6829	6829
q19	1399	1048	1017	1017
q20	490	210	196	196
q21	4013	3238	3270	3238
q22	1068	972	987	972
Total cold run time: 113816 ms
Total hot run time: 41318 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7289	7214	7264	7214
q2	332	233	237	233
q3	3108	2962	3057	2962
q4	2054	1749	1834	1749
q5	5721	5702	5847	5702
q6	225	139	143	139
q7	2273	1829	1842	1829
q8	3361	3435	3505	3435
q9	8891	8841	8759	8759
q10	3605	3520	3512	3512
q11	617	512	508	508
q12	809	623	598	598
q13	11246	3155	3199	3155
q14	307	282	268	268
q15	564	524	513	513
q16	714	685	674	674
q17	1850	1628	1621	1621
q18	8159	7629	7712	7629
q19	1693	1607	1612	1607
q20	2101	1815	1871	1815
q21	5603	5547	5535	5535
q22	1080	1029	1012	1012
Total cold run time: 71602 ms
Total hot run time: 60469 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 199360 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b2d577ceee7a9d2bb18a7795e652987deb1ad6db, data reload: false

query1	1255	949	917	917
query2	6579	2121	2052	2052
query3	10847	4279	4308	4279
query4	66631	29318	23759	23759
query5	4912	471	445	445
query6	438	182	179	179
query7	5672	309	304	304
query8	313	238	230	230
query9	9383	2673	2677	2673
query10	477	281	269	269
query11	17721	15302	16111	15302
query12	163	118	110	110
query13	1550	451	454	451
query14	9995	7837	7131	7131
query15	215	192	181	181
query16	7109	491	469	469
query17	1163	614	614	614
query18	1837	369	331	331
query19	237	167	167	167
query20	126	118	124	118
query21	64	48	46	46
query22	4667	4690	4476	4476
query23	35068	34385	34638	34385
query24	6138	3000	2945	2945
query25	542	424	449	424
query26	665	173	176	173
query27	1935	369	357	357
query28	4332	2517	2469	2469
query29	776	492	471	471
query30	256	178	194	178
query31	1020	816	822	816
query32	66	59	60	59
query33	435	309	294	294
query34	951	532	521	521
query35	900	744	750	744
query36	1110	960	928	928
query37	127	74	75	74
query38	4244	4172	4067	4067
query39	1520	1491	1506	1491
query40	151	90	89	89
query41	51	50	51	50
query42	121	109	105	105
query43	562	515	522	515
query44	1240	840	825	825
query45	187	169	175	169
query46	1177	745	736	736
query47	2051	1929	1920	1920
query48	476	379	393	379
query49	725	407	399	399
query50	868	430	435	430
query51	7424	7313	7359	7313
query52	105	96	90	90
query53	271	188	185	185
query54	568	459	442	442
query55	77	76	74	74
query56	274	266	248	248
query57	1261	1089	1141	1089
query58	220	211	225	211
query59	3268	3062	3073	3062
query60	276	269	266	266
query61	107	128	115	115
query62	778	676	687	676
query63	224	189	196	189
query64	1419	705	654	654
query65	3414	3234	3311	3234
query66	711	309	317	309
query67	15837	15627	15561	15561
query68	4053	576	571	571
query69	444	269	265	265
query70	1155	1134	1074	1074
query71	368	260	252	252
query72	6475	4109	4018	4018
query73	781	341	347	341
query74	10010	9000	9095	9000
query75	3487	2654	2695	2654
query76	1877	1094	1052	1052
query77	514	277	277	277
query78	10978	10038	9931	9931
query79	1820	602	626	602
query80	1390	451	421	421
query81	534	256	252	252
query82	1293	124	118	118
query83	253	155	150	150
query84	283	82	80	80
query85	1005	311	291	291
query86	424	313	291	291
query87	4411	4386	4500	4386
query88	3996	2376	2364	2364
query89	433	295	304	295
query90	1940	191	190	190
query91	188	149	145	145
query92	67	51	52	51
query93	2301	556	555	555
query94	871	297	290	290
query95	363	254	257	254
query96	628	285	286	285
query97	3387	3228	3190	3190
query98	225	206	197	197
query99	1597	1313	1284	1284
Total cold run time: 322833 ms
Total hot run time: 199360 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b2d577ceee7a9d2bb18a7795e652987deb1ad6db, data reload: false

query1	0.04	0.03	0.04
query2	0.07	0.02	0.03
query3	0.22	0.07	0.07
query4	1.63	0.10	0.10
query5	0.51	0.51	0.53
query6	1.14	0.73	0.72
query7	0.02	0.02	0.02
query8	0.05	0.05	0.03
query9	0.57	0.50	0.49
query10	0.54	0.53	0.55
query11	0.15	0.10	0.10
query12	0.13	0.12	0.11
query13	0.62	0.60	0.60
query14	2.93	2.97	2.96
query15	0.91	0.84	0.81
query16	0.39	0.37	0.39
query17	1.06	1.01	1.02
query18	0.24	0.22	0.21
query19	1.91	1.84	2.08
query20	0.01	0.01	0.02
query21	15.36	0.58	0.56
query22	2.68	2.42	2.49
query23	17.22	0.97	0.80
query24	2.79	1.31	2.00
query25	0.26	0.15	0.21
query26	0.32	0.13	0.13
query27	0.05	0.04	0.05
query28	9.93	1.11	1.07
query29	12.59	3.32	3.28
query30	0.25	0.06	0.06
query31	2.87	0.39	0.41
query32	3.23	0.46	0.47
query33	2.95	3.01	3.02
query34	16.87	4.45	4.44
query35	4.53	4.48	4.54
query36	0.67	0.52	0.51
query37	0.09	0.06	0.07
query38	0.04	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.19 s
Total hot run time: 33.95 s

@englefly
Copy link
Contributor Author

englefly commented Jan 5, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41068 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2781da330427608cb2ffa87bdfbb1e7b757fade9, data reload: false

------ Round 1 ----------------------------------
q1	17572	7435	7257	7257
q2	2042	206	169	169
q3	10537	1085	1181	1085
q4	10570	766	707	707
q5	7738	2840	2829	2829
q6	240	148	146	146
q7	982	607	593	593
q8	9359	1954	2050	1954
q9	6585	6390	6402	6390
q10	6988	2324	2317	2317
q11	462	264	267	264
q12	413	212	210	210
q13	17782	3048	3031	3031
q14	238	210	217	210
q15	559	529	539	529
q16	675	625	611	611
q17	960	591	581	581
q18	7232	6685	6850	6685
q19	1421	1116	1131	1116
q20	497	209	213	209
q21	4109	3187	3328	3187
q22	1104	1014	988	988
Total cold run time: 108065 ms
Total hot run time: 41068 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7258	7264	7255	7255
q2	326	238	232	232
q3	2928	2927	2956	2927
q4	2088	1916	1904	1904
q5	5680	5747	5749	5747
q6	223	141	148	141
q7	2267	1824	1852	1824
q8	3358	3558	3581	3558
q9	8901	8914	8898	8898
q10	3602	3601	3560	3560
q11	605	511	505	505
q12	787	608	626	608
q13	10562	3203	3198	3198
q14	311	278	292	278
q15	597	525	530	525
q16	718	676	681	676
q17	1833	1626	1612	1612
q18	8391	7645	7672	7645
q19	1650	1698	1594	1594
q20	2094	1881	1876	1876
q21	5463	5420	5407	5407
q22	1195	1069	1033	1033
Total cold run time: 70837 ms
Total hot run time: 61003 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198944 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2781da330427608cb2ffa87bdfbb1e7b757fade9, data reload: false

query1	1318	921	939	921
query2	6253	2109	2060	2060
query3	10943	4372	4415	4372
query4	66936	29114	23434	23434
query5	4958	477	465	465
query6	407	165	169	165
query7	5681	311	301	301
query8	312	224	229	224
query9	9351	2677	2659	2659
query10	466	269	261	261
query11	17515	15280	15920	15280
query12	175	105	103	103
query13	1531	435	444	435
query14	10455	7630	7521	7521
query15	209	180	189	180
query16	6775	479	480	479
query17	1251	563	569	563
query18	1813	323	327	323
query19	229	150	161	150
query20	117	106	113	106
query21	222	105	103	103
query22	4822	4398	4526	4398
query23	34611	34663	34963	34663
query24	6353	2898	2904	2898
query25	528	410	422	410
query26	660	172	172	172
query27	2116	349	366	349
query28	3938	2471	2454	2454
query29	706	469	451	451
query30	252	168	163	163
query31	1010	846	891	846
query32	70	58	60	58
query33	469	297	307	297
query34	908	511	516	511
query35	856	730	759	730
query36	1088	984	998	984
query37	123	75	76	75
query38	4119	4132	4070	4070
query39	1522	1493	1486	1486
query40	201	104	100	100
query41	50	47	49	47
query42	116	102	99	99
query43	546	530	505	505
query44	1159	820	842	820
query45	194	180	175	175
query46	1146	728	726	726
query47	2025	1902	1929	1902
query48	480	388	379	379
query49	731	385	384	384
query50	847	443	424	424
query51	7383	7209	7130	7130
query52	100	87	91	87
query53	259	194	183	183
query54	557	449	464	449
query55	77	77	80	77
query56	271	247	239	239
query57	1228	1124	1112	1112
query58	213	212	216	212
query59	3157	2989	3040	2989
query60	288	246	257	246
query61	113	111	106	106
query62	800	676	679	676
query63	224	191	191	191
query64	1481	762	727	727
query65	3288	3237	3205	3205
query66	717	332	316	316
query67	16034	15569	15620	15569
query68	3642	587	585	585
query69	450	281	285	281
query70	1180	1104	1118	1104
query71	359	261	259	259
query72	6078	4153	4130	4130
query73	761	341	353	341
query74	10032	9093	8944	8944
query75	3353	2635	2654	2635
query76	1846	1097	1062	1062
query77	488	273	294	273
query78	10614	9562	9613	9562
query79	1765	600	586	586
query80	1448	421	433	421
query81	540	240	242	240
query82	1236	113	112	112
query83	273	141	155	141
query84	287	81	77	77
query85	1006	305	296	296
query86	442	307	296	296
query87	4509	4310	4343	4310
query88	3858	2406	2374	2374
query89	420	297	293	293
query90	1930	191	184	184
query91	186	162	151	151
query92	69	53	50	50
query93	1977	553	544	544
query94	837	297	291	291
query95	367	254	257	254
query96	621	283	285	283
query97	3349	3173	3199	3173
query98	217	206	203	203
query99	1613	1310	1294	1294
Total cold run time: 320506 ms
Total hot run time: 198944 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.86 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 2781da330427608cb2ffa87bdfbb1e7b757fade9, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.06
query4	1.62	0.10	0.11
query5	0.52	0.50	0.54
query6	1.14	0.73	0.74
query7	0.02	0.04	0.02
query8	0.04	0.03	0.04
query9	0.56	0.49	0.48
query10	0.56	0.55	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.93	2.93	2.91
query15	0.90	0.82	0.83
query16	0.39	0.37	0.38
query17	1.00	1.05	1.00
query18	0.23	0.21	0.22
query19	1.99	1.88	2.08
query20	0.01	0.01	0.01
query21	15.38	0.58	0.56
query22	2.83	2.80	2.35
query23	17.07	0.94	0.87
query24	2.72	1.45	1.20
query25	0.28	0.12	0.13
query26	0.45	0.14	0.14
query27	0.05	0.04	0.06
query28	10.53	1.09	1.10
query29	12.57	3.20	3.24
query30	0.24	0.07	0.07
query31	2.83	0.41	0.38
query32	3.23	0.47	0.46
query33	3.00	3.05	3.01
query34	17.26	4.49	4.52
query35	4.57	4.59	4.56
query36	0.66	0.49	0.52
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.04	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.04
Total cold run time: 107.31 s
Total hot run time: 33.86 s

@englefly englefly merged commit e6678e6 into apache:branch-3.0 Jan 5, 2025
20 checks passed
@englefly englefly deleted the pick45369 branch January 5, 2025 09:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants