Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feat](nereids) implement showConvertLscCommand in nereids #45631

Merged
merged 16 commits into from
Jan 10, 2025
Merged

[feat](nereids) implement showConvertLscCommand in nereids #45631

merged 16 commits into from
Jan 10, 2025

Conversation

vinlee19
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #42781

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40226 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6d4f834ad3e121c76f29963b3d873499d20f8578, data reload: false

------ Round 1 ----------------------------------
q1	17632	7481	7324	7324
q2	2044	176	170	170
q3	10864	1106	1161	1106
q4	10548	760	824	760
q5	7600	2719	2749	2719
q6	241	148	148	148
q7	998	632	607	607
q8	9243	1856	1918	1856
q9	6489	6475	6496	6475
q10	7000	2273	2326	2273
q11	488	267	263	263
q12	442	225	219	219
q13	17793	2955	2952	2952
q14	251	208	226	208
q15	543	497	504	497
q16	663	594	599	594
q17	980	690	555	555
q18	7307	6929	6729	6729
q19	1369	1028	1058	1028
q20	483	185	182	182
q21	4054	3394	3242	3242
q22	387	322	319	319
Total cold run time: 107419 ms
Total hot run time: 40226 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7306	7326	7252	7252
q2	331	232	245	232
q3	2990	2994	2992	2992
q4	2088	1885	1964	1885
q5	5744	5664	5682	5664
q6	231	143	143	143
q7	2248	1862	1798	1798
q8	3418	3619	3526	3526
q9	8878	8888	8912	8888
q10	3642	3576	3551	3551
q11	600	500	514	500
q12	827	598	582	582
q13	11886	3150	3125	3125
q14	316	279	272	272
q15	564	513	501	501
q16	709	658	653	653
q17	1847	1623	1615	1615
q18	8238	7861	7736	7736
q19	1741	1504	1490	1490
q20	2118	1858	1910	1858
q21	5594	5576	5543	5543
q22	678	580	588	580
Total cold run time: 71994 ms
Total hot run time: 60386 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195973 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6d4f834ad3e121c76f29963b3d873499d20f8578, data reload: false

query1	1298	994	899	899
query2	6247	2419	2288	2288
query3	10971	4761	4794	4761
query4	33308	23405	23442	23405
query5	4820	459	465	459
query6	287	187	183	183
query7	3993	300	311	300
query8	320	267	234	234
query9	9479	2713	2696	2696
query10	490	254	247	247
query11	17872	14999	15342	14999
query12	163	109	103	103
query13	1571	421	397	397
query14	9598	7279	6995	6995
query15	285	200	182	182
query16	8072	474	425	425
query17	1524	583	593	583
query18	2258	304	321	304
query19	377	158	147	147
query20	123	114	111	111
query21	204	106	117	106
query22	4613	4447	4383	4383
query23	36987	33682	33712	33682
query24	10367	2533	2439	2439
query25	564	434	422	422
query26	844	165	165	165
query27	2874	331	337	331
query28	8107	2476	2439	2439
query29	692	442	439	439
query30	234	150	158	150
query31	1028	848	821	821
query32	142	53	58	53
query33	808	292	299	292
query34	1156	533	513	513
query35	888	758	764	758
query36	1099	956	993	956
query37	124	80	75	75
query38	4187	4112	4386	4112
query39	1505	1503	1483	1483
query40	258	101	100	100
query41	46	42	45	42
query42	118	100	101	100
query43	529	508	477	477
query44	1283	848	826	826
query45	189	165	179	165
query46	1187	711	720	711
query47	2014	1950	1948	1948
query48	425	327	337	327
query49	899	386	373	373
query50	839	400	406	400
query51	7341	7283	7213	7213
query52	108	92	93	92
query53	256	185	179	179
query54	1061	441	415	415
query55	81	77	82	77
query56	275	247	245	245
query57	1274	1194	1166	1166
query58	247	217	225	217
query59	3376	3085	3072	3072
query60	275	253	257	253
query61	114	108	108	108
query62	846	717	709	709
query63	218	195	188	188
query64	3926	672	653	653
query65	3262	3247	3245	3245
query66	861	310	313	310
query67	16578	15501	15404	15404
query68	7769	529	550	529
query69	518	256	255	255
query70	1198	1240	1147	1147
query71	528	259	265	259
query72	6801	4095	4011	4011
query73	828	356	351	351
query74	10263	8857	8863	8857
query75	4165	2736	2630	2630
query76	4742	1125	1054	1054
query77	670	268	271	268
query78	10270	9390	9388	9388
query79	1628	606	579	579
query80	1043	437	442	437
query81	484	231	236	231
query82	216	117	118	117
query83	196	146	138	138
query84	285	81	115	81
query85	1018	297	286	286
query86	358	266	307	266
query87	4621	4558	4471	4471
query88	4354	2182	2162	2162
query89	430	289	288	288
query90	2156	188	181	181
query91	132	103	106	103
query92	66	46	50	46
query93	4425	533	527	527
query94	863	288	284	284
query95	348	245	247	245
query96	639	276	284	276
query97	2859	2653	2683	2653
query98	215	199	194	194
query99	1635	1315	1307	1307
Total cold run time: 313088 ms
Total hot run time: 195973 ms

@vinlee19
Copy link
Contributor Author

run external

@doris-robot
Copy link

ClickBench: Total hot run time: 32.3 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6d4f834ad3e121c76f29963b3d873499d20f8578, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.61	0.11	0.10
query5	0.42	0.42	0.44
query6	1.16	0.64	0.64
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.51	0.50
query10	0.57	0.60	0.57
query11	0.13	0.10	0.10
query12	0.14	0.12	0.11
query13	0.60	0.60	0.60
query14	2.72	2.87	2.87
query15	0.89	0.83	0.84
query16	0.39	0.39	0.39
query17	1.07	1.05	1.04
query18	0.23	0.22	0.21
query19	1.95	1.88	2.02
query20	0.02	0.01	0.01
query21	15.37	0.60	0.58
query22	3.09	2.72	1.26
query23	16.94	0.96	0.76
query24	3.19	1.14	1.06
query25	0.22	0.19	0.08
query26	0.44	0.14	0.14
query27	0.05	0.05	0.05
query28	10.38	1.11	1.07
query29	12.60	3.26	3.25
query30	0.24	0.07	0.06
query31	3.09	0.39	0.38
query32	3.64	0.45	0.46
query33	3.08	3.26	3.08
query34	16.98	4.41	4.51
query35	4.44	4.43	4.44
query36	0.67	0.48	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 107.78 s
Total hot run time: 32.3 s

@vinlee19
Merge branch 'master' into nereids_show_convertlsc_command
16ed517
@vinlee19
Merge remote-tracking branch 'upstream/master' into nereids_show_conv…
6d1aae2 
…ertlsc_command

# Conflicts:
#	fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java
@vinlee19
resovle conflict
c1316f9
@vinlee19
Merge remote-tracking branch 'origin/nereids_show_convertlsc_command'…
b109abb 
… into nereids_show_convertlsc_command

# Conflicts:
#	fe/fe-core/src/main/java/org/apache/doris/nereids/parser/LogicalPlanBuilder.java
@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40573 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b109abb129cdbbad4d53fdb85f123e1d52a87697, data reload: false

------ Round 1 ----------------------------------
q1	17607	7568	7592	7568
q2	2056	190	181	181
q3	10668	1119	1163	1119
q4	10568	796	767	767
q5	7643	2726	2717	2717
q6	243	152	154	152
q7	1005	637	611	611
q8	9262	1850	1912	1850
q9	6726	6372	6398	6372
q10	7014	2324	2325	2324
q11	475	259	261	259
q12	453	229	233	229
q13	17769	3006	3029	3006
q14	247	218	218	218
q15	557	523	497	497
q16	669	590	582	582
q17	984	566	580	566
q18	7351	6897	6799	6799
q19	1349	988	1039	988
q20	477	195	186	186
q21	4141	3297	3262	3262
q22	399	320	320	320
Total cold run time: 107663 ms
Total hot run time: 40573 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7274	7278	7243	7243
q2	338	229	234	229
q3	2941	3100	2975	2975
q4	2139	1876	1883	1876
q5	5635	5635	5683	5635
q6	224	146	154	146
q7	2269	1858	1860	1858
q8	3412	3559	3565	3559
q9	8792	8958	8929	8929
q10	3588	3546	3551	3546
q11	603	511	523	511
q12	827	609	594	594
q13	12150	3220	3119	3119
q14	308	274	276	274
q15	569	499	516	499
q16	688	635	663	635
q17	1858	1667	1665	1665
q18	8511	7949	7892	7892
q19	1735	1504	1505	1504
q20	2164	1937	1889	1889
q21	5544	5550	5450	5450
q22	663	578	607	578
Total cold run time: 72232 ms
Total hot run time: 60606 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197068 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b109abb129cdbbad4d53fdb85f123e1d52a87697, data reload: false

query1	1326	955	966	955
query2	6253	2478	2386	2386
query3	10980	4680	4678	4678
query4	33241	23417	23533	23417
query5	4010	466	469	466
query6	293	178	176	176
query7	3996	290	301	290
query8	287	226	233	226
query9	9407	2678	2647	2647
query10	468	245	247	245
query11	17882	15049	15147	15049
query12	157	105	99	99
query13	1566	430	427	427
query14	9386	7752	7693	7693
query15	289	220	208	208
query16	8139	428	494	428
query17	1705	612	556	556
query18	2123	301	308	301
query19	393	164	155	155
query20	117	119	120	119
query21	206	106	112	106
query22	4778	4624	4520	4520
query23	34724	33975	33739	33739
query24	8242	2597	2458	2458
query25	615	419	417	417
query26	740	160	160	160
query27	2273	330	345	330
query28	6672	2456	2459	2456
query29	763	452	442	442
query30	239	152	165	152
query31	1065	876	842	842
query32	98	60	63	60
query33	636	312	306	306
query34	1007	527	521	521
query35	882	766	744	744
query36	1081	978	956	956
query37	127	74	73	73
query38	4298	4109	4130	4109
query39	1497	1480	1495	1480
query40	208	105	100	100
query41	47	42	43	42
query42	117	103	103	103
query43	543	509	529	509
query44	1181	842	837	837
query45	199	163	172	163
query46	1169	726	739	726
query47	2049	1907	1906	1906
query48	426	308	324	308
query49	873	385	387	385
query50	868	414	400	400
query51	7461	7096	7286	7096
query52	109	88	88	88
query53	262	194	181	181
query54	843	409	422	409
query55	85	83	86	83
query56	264	238	243	238
query57	1294	1161	1152	1152
query58	237	210	220	210
query59	3372	3170	3394	3170
query60	285	274	261	261
query61	130	125	165	125
query62	856	700	677	677
query63	221	195	183	183
query64	3597	678	636	636
query65	3319	3370	3251	3251
query66	730	296	315	296
query67	16535	15540	15535	15535
query68	5303	551	557	551
query69	507	265	252	252
query70	1222	1141	1131	1131
query71	463	252	246	246
query72	7110	4161	4018	4018
query73	793	358	369	358
query74	9864	8886	8832	8832
query75	3490	2669	2636	2636
query76	3490	1125	984	984
query77	595	270	264	264
query78	10305	9499	9967	9499
query79	1825	599	593	593
query80	1351	418	426	418
query81	519	233	225	225
query82	544	121	120	120
query83	197	144	140	140
query84	288	69	69	69
query85	1368	301	298	298
query86	406	290	306	290
query87	4602	4367	4404	4367
query88	3475	2225	2189	2189
query89	432	290	292	290
query90	1966	188	185	185
query91	147	107	105	105
query92	64	51	56	51
query93	1634	544	541	541
query94	823	286	282	282
query95	350	251	246	246
query96	621	271	281	271
query97	2864	2624	2672	2624
query98	216	196	201	196
query99	1584	1363	1335	1335
Total cold run time: 297659 ms
Total hot run time: 197068 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.51 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b109abb129cdbbad4d53fdb85f123e1d52a87697, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.04
query3	0.23	0.08	0.07
query4	1.59	0.11	0.11
query5	0.44	0.43	0.42
query6	1.17	0.66	0.66
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.60	0.50	0.51
query10	0.54	0.58	0.55
query11	0.14	0.10	0.10
query12	0.15	0.11	0.11
query13	0.60	0.61	0.60
query14	2.75	2.74	2.84
query15	0.90	0.84	0.82
query16	0.38	0.38	0.38
query17	1.06	1.06	1.07
query18	0.22	0.20	0.21
query19	1.88	1.79	1.99
query20	0.01	0.01	0.01
query21	15.37	0.60	0.58
query22	2.82	2.33	2.43
query23	16.93	0.85	0.72
query24	3.29	0.57	1.72
query25	0.24	0.05	0.13
query26	0.53	0.13	0.13
query27	0.04	0.05	0.05
query28	10.68	1.09	1.07
query29	12.57	3.21	3.18
query30	0.24	0.06	0.06
query31	2.83	0.40	0.38
query32	3.23	0.46	0.46
query33	3.09	3.06	3.22
query34	16.89	4.44	4.48
query35	4.51	4.46	4.43
query36	0.69	0.49	0.49
query37	0.10	0.06	0.07
query38	0.04	0.03	0.04
query39	0.03	0.02	0.03
query40	0.17	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 107.26 s
Total hot run time: 32.51 s

@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32595 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 31dda73647d3bb4788aa8ac10fb069c4c14453e3, data reload: false

------ Round 1 ----------------------------------
q1	17576	6159	6065	6065
q2	2048	293	172	172
q3	10430	1219	759	759
q4	10200	870	432	432
q5	7500	2146	1950	1950
q6	205	177	144	144
q7	892	749	608	608
q8	9238	1334	1149	1149
q9	5165	4871	4871	4871
q10	6752	2315	1854	1854
q11	480	277	252	252
q12	344	352	219	219
q13	17801	3535	3084	3084
q14	238	242	219	219
q15	572	504	517	504
q16	645	615	587	587
q17	564	842	323	323
q18	6886	6417	6414	6414
q19	1653	962	552	552
q20	307	311	181	181
q21	2796	2201	1952	1952
q22	361	328	304	304
Total cold run time: 102653 ms
Total hot run time: 32595 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6220	6217	6251	6217
q2	235	319	243	243
q3	2272	2667	2374	2374
q4	1432	1883	1376	1376
q5	4346	4723	4740	4723
q6	189	181	146	146
q7	2108	1938	1768	1768
q8	2651	2834	2683	2683
q9	7330	7243	7261	7243
q10	3060	3394	2851	2851
q11	593	508	498	498
q12	643	710	598	598
q13	3373	3715	3167	3167
q14	298	317	285	285
q15	593	523	511	511
q16	662	703	658	658
q17	1213	1750	1270	1270
q18	7754	7504	7335	7335
q19	824	1204	1082	1082
q20	2014	2011	1931	1931
q21	5666	5240	4755	4755
q22	590	608	562	562
Total cold run time: 54066 ms
Total hot run time: 52276 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197516 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 31dda73647d3bb4788aa8ac10fb069c4c14453e3, data reload: false

query1	1309	947	968	947
query2	6505	2332	2316	2316
query3	11005	4796	4705	4705
query4	32731	23592	23772	23592
query5	3739	595	462	462
query6	275	198	198	198
query7	3981	486	303	303
query8	303	251	233	233
query9	9541	2744	2734	2734
query10	461	297	248	248
query11	17791	15363	15300	15300
query12	155	106	104	104
query13	1550	527	415	415
query14	10367	6748	7211	6748
query15	237	201	200	200
query16	8005	598	411	411
query17	1570	783	601	601
query18	2125	423	332	332
query19	208	184	177	177
query20	122	118	116	116
query21	219	125	118	118
query22	4531	4668	4474	4474
query23	34480	34387	34240	34240
query24	6767	2326	2392	2326
query25	525	458	398	398
query26	800	293	150	150
query27	2133	469	341	341
query28	5765	2515	2473	2473
query29	668	554	423	423
query30	207	197	149	149
query31	989	898	826	826
query32	85	58	61	58
query33	481	353	304	304
query34	769	904	528	528
query35	812	843	786	786
query36	1048	1053	974	974
query37	120	105	74	74
query38	4166	4424	4340	4340
query39	1568	1494	1459	1459
query40	201	112	100	100
query41	44	43	46	43
query42	125	100	105	100
query43	508	522	491	491
query44	1372	833	833	833
query45	187	172	162	162
query46	890	1067	675	675
query47	2032	2025	1963	1963
query48	398	407	333	333
query49	709	487	406	406
query50	635	678	395	395
query51	7308	7436	7227	7227
query52	106	102	94	94
query53	233	255	206	206
query54	500	525	434	434
query55	76	77	79	77
query56	268	263	253	253
query57	1276	1258	1190	1190
query58	261	222	232	222
query59	3209	3218	3207	3207
query60	290	264	246	246
query61	108	110	109	109
query62	858	791	743	743
query63	233	203	190	190
query64	3512	1020	680	680
query65	3342	3274	3229	3229
query66	800	408	320	320
query67	16672	15919	15539	15539
query68	10110	759	528	528
query69	498	303	259	259
query70	1225	1164	1154	1154
query71	445	292	277	277
query72	5944	3793	3903	3793
query73	1995	755	361	361
query74	10345	9007	8738	8738
query75	4647	3183	2690	2690
query76	5604	1177	752	752
query77	994	364	272	272
query78	11005	10223	9380	9380
query79	2971	856	600	600
query80	692	530	458	458
query81	469	279	230	230
query82	208	158	126	126
query83	196	174	162	162
query84	279	93	69	69
query85	725	460	309	309
query86	349	340	303	303
query87	4618	4544	4325	4325
query88	3456	2269	2244	2244
query89	409	322	304	304
query90	2085	188	189	188
query91	129	132	107	107
query92	67	56	51	51
query93	1149	740	547	547
query94	668	399	360	360
query95	333	259	245	245
query96	478	606	289	289
query97	2737	2835	2715	2715
query98	218	204	194	194
query99	1654	1608	1436	1436
Total cold run time: 300968 ms
Total hot run time: 197516 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.86 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 31dda73647d3bb4788aa8ac10fb069c4c14453e3, data reload: false

query1	0.04	0.02	0.03
query2	0.07	0.03	0.04
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.43	0.41	0.40
query6	1.18	0.65	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.48	0.52
query10	0.56	0.57	0.57
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.62	0.58
query14	2.82	2.71	2.73
query15	0.89	0.83	0.83
query16	0.38	0.38	0.37
query17	1.04	1.02	1.03
query18	0.22	0.22	0.22
query19	1.93	1.88	1.99
query20	0.01	0.01	0.02
query21	15.37	0.95	0.57
query22	0.77	0.87	0.77
query23	15.15	1.36	0.59
query24	3.64	0.34	1.57
query25	0.23	0.15	0.13
query26	0.34	0.16	0.14
query27	0.07	0.05	0.04
query28	13.34	1.52	1.06
query29	12.60	3.92	3.27
query30	0.24	0.08	0.07
query31	2.81	0.58	0.38
query32	3.25	0.56	0.47
query33	3.05	3.11	3.13
query34	16.91	5.10	4.49
query35	4.50	4.45	4.51
query36	0.64	0.49	0.48
query37	0.10	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.13	0.12
query41	0.07	0.02	0.02
query42	0.03	0.03	0.02
query43	0.04	0.03	0.04
Total cold run time: 106.37 s
Total hot run time: 30.86 s

@vinlee19
Copy link
Contributor Author

vinlee19 commented Jan 6, 2025

buildall

@vinlee19
Copy link
Contributor Author

vinlee19 commented Jan 7, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32654 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d721498f9347a0c47f968047b3169c888003f664, data reload: false

------ Round 1 ----------------------------------
q1	17598	6144	5984	5984
q2	2042	316	164	164
q3	10407	1220	738	738
q4	10228	865	432	432
q5	7889	2202	1974	1974
q6	205	178	149	149
q7	899	735	613	613
q8	9243	1374	1169	1169
q9	5214	4901	4937	4901
q10	6749	2301	1855	1855
q11	465	278	262	262
q12	344	356	227	227
q13	17775	3733	3138	3138
q14	252	241	217	217
q15	562	505	502	502
q16	631	601	596	596
q17	561	845	337	337
q18	7231	6527	6316	6316
q19	2305	959	568	568
q20	307	316	188	188
q21	3041	2219	2008	2008
q22	361	335	316	316
Total cold run time: 104309 ms
Total hot run time: 32654 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6277	6191	6236	6191
q2	242	323	229	229
q3	2282	2675	2292	2292
q4	1390	1830	1324	1324
q5	4375	4783	4879	4783
q6	184	178	143	143
q7	2086	2010	1803	1803
q8	2658	2830	2713	2713
q9	7303	7317	7316	7316
q10	3077	3358	2823	2823
q11	574	516	490	490
q12	622	776	663	663
q13	3502	3882	3244	3244
q14	287	329	280	280
q15	570	520	516	516
q16	646	669	652	652
q17	1229	1743	1246	1246
q18	7734	7539	7349	7349
q19	904	1166	1137	1137
q20	1952	2104	1912	1912
q21	5587	5404	4817	4817
q22	608	632	600	600
Total cold run time: 54089 ms
Total hot run time: 52523 ms

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jan 7, 2025

PR approved by anyone and no changes requested.

@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jan 8, 2025
@vinlee19
Copy link
Contributor Author

vinlee19 commented Jan 8, 2025

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32936 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 97503f73a7d603bb03931eef5958bf1295be6fe6, data reload: false

------ Round 1 ----------------------------------
q1	17579	6174	6051	6051
q2	2049	310	165	165
q3	10409	1326	736	736
q4	10211	870	437	437
q5	7501	2232	2017	2017
q6	205	178	146	146
q7	898	763	644	644
q8	9258	1443	1265	1265
q9	5401	4941	5067	4941
q10	6791	2318	1857	1857
q11	467	278	261	261
q12	343	357	227	227
q13	17780	3748	3089	3089
q14	232	223	217	217
q15	573	523	502	502
q16	630	641	588	588
q17	580	862	331	331
q18	7324	6378	6513	6378
q19	1865	977	558	558
q20	302	317	183	183
q21	2865	2229	2031	2031
q22	356	333	312	312
Total cold run time: 103619 ms
Total hot run time: 32936 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6314	6281	6294	6281
q2	240	329	230	230
q3	2243	2660	2349	2349
q4	1406	1900	1352	1352
q5	4419	4794	4974	4794
q6	189	189	146	146
q7	2144	2006	1797	1797
q8	2675	2768	2731	2731
q9	7296	7225	7248	7225
q10	3051	3351	2811	2811
q11	591	506	503	503
q12	682	757	619	619
q13	3408	3858	3184	3184
q14	295	323	299	299
q15	567	519	532	519
q16	663	706	654	654
q17	1225	1774	1264	1264
q18	7928	7308	7046	7046
q19	810	1163	1008	1008
q20	1918	1964	1810	1810
q21	5512	5092	4913	4913
q22	613	649	617	617
Total cold run time: 54189 ms
Total hot run time: 52152 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191168 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 97503f73a7d603bb03931eef5958bf1295be6fe6, data reload: false

query1	980	387	369	369
query2	6538	2305	2295	2295
query3	6700	213	210	210
query4	33801	23507	23717	23507
query5	4350	630	477	477
query6	291	213	190	190
query7	4627	504	327	327
query8	306	255	240	240
query9	9539	2838	2812	2812
query10	446	313	251	251
query11	18394	15449	15169	15169
query12	160	102	102	102
query13	1649	536	393	393
query14	10403	6725	7273	6725
query15	262	191	192	191
query16	8246	572	420	420
query17	1538	739	550	550
query18	2129	397	286	286
query19	214	173	151	151
query20	124	112	111	111
query21	205	118	102	102
query22	4514	4613	4424	4424
query23	34724	33803	33717	33717
query24	6370	2266	2307	2266
query25	490	455	372	372
query26	1206	271	157	157
query27	2006	456	337	337
query28	5172	2496	2461	2461
query29	745	542	411	411
query30	232	177	153	153
query31	986	891	832	832
query32	92	60	58	58
query33	501	414	290	290
query34	764	824	532	532
query35	790	852	738	738
query36	1019	1029	942	942
query37	117	101	74	74
query38	4177	4126	4109	4109
query39	1462	1453	1457	1453
query40	207	115	101	101
query41	47	45	44	44
query42	128	107	102	102
query43	515	529	504	504
query44	1301	810	814	810
query45	183	169	162	162
query46	870	1034	644	644
query47	1931	1958	1862	1862
query48	394	406	326	326
query49	788	477	391	391
query50	626	647	383	383
query51	6990	7048	7016	7016
query52	107	101	92	92
query53	223	263	186	186
query54	487	498	435	435
query55	82	82	83	82
query56	274	265	268	265
query57	1220	1171	1114	1114
query58	243	246	242	242
query59	3080	3174	2902	2902
query60	290	289	272	272
query61	136	132	167	132
query62	873	773	708	708
query63	238	202	192	192
query64	4590	994	650	650
query65	3289	3171	3231	3171
query66	1067	414	322	322
query67	16022	15906	15775	15775
query68	8004	705	521	521
query69	505	289	266	266
query70	1215	1144	1128	1128
query71	448	282	263	263
query72	6146	3825	3820	3820
query73	666	748	372	372
query74	9514	9312	8984	8984
query75	4082	3163	2687	2687
query76	3699	1198	785	785
query77	766	368	273	273
query78	10091	10069	9493	9493
query79	3293	817	592	592
query80	655	531	422	422
query81	470	275	227	227
query82	617	199	125	125
query83	204	170	147	147
query84	288	89	76	76
query85	739	355	309	309
query86	353	322	271	271
query87	4461	4563	4608	4563
query88	4550	2265	2253	2253
query89	423	342	298	298
query90	1902	191	191	191
query91	140	136	103	103
query92	65	58	54	54
query93	1707	862	537	537
query94	671	394	286	286
query95	344	265	253	253
query96	501	616	284	284
query97	2922	2876	2883	2876
query98	240	207	198	198
query99	1707	1542	1422	1422
Total cold run time: 293858 ms
Total hot run time: 191168 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.77 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 97503f73a7d603bb03931eef5958bf1295be6fe6, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.04	0.03
query3	0.24	0.07	0.07
query4	1.59	0.10	0.11
query5	0.44	0.39	0.42
query6	1.18	0.65	0.65
query7	0.02	0.02	0.02
query8	0.03	0.03	0.03
query9	0.58	0.53	0.51
query10	0.56	0.57	0.55
query11	0.14	0.10	0.10
query12	0.14	0.10	0.10
query13	0.60	0.61	0.60
query14	2.72	2.77	2.75
query15	0.90	0.82	0.82
query16	0.38	0.40	0.38
query17	1.04	1.06	1.07
query18	0.23	0.21	0.21
query19	1.89	1.86	1.96
query20	0.02	0.00	0.01
query21	15.37	0.88	0.57
query22	0.76	0.86	0.67
query23	15.21	1.46	0.56
query24	2.91	1.34	1.64
query25	0.22	0.18	0.11
query26	0.22	0.14	0.13
query27	0.05	0.05	0.05
query28	14.44	1.50	1.05
query29	12.59	3.91	3.27
query30	0.25	0.09	0.07
query31	2.82	0.60	0.37
query32	3.24	0.54	0.45
query33	3.03	3.14	3.22
query34	16.76	5.09	4.48
query35	4.51	4.47	4.47
query36	0.63	0.50	0.48
query37	0.10	0.06	0.05
query38	0.04	0.04	0.03
query39	0.04	0.02	0.02
query40	0.18	0.13	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.03
query43	0.04	0.03	0.04
Total cold run time: 106.32 s
Total hot run time: 31.77 s

@vinlee19
Copy link
Contributor Author

vinlee19 commented Jan 8, 2025

run external

@LiBinfeng-01 LiBinfeng-01 self-requested a review January 9, 2025 08:04
TangSiyang2001
TangSiyang2001 approved these changes Jan 9, 2025
View reviewed changes
Copy link
Collaborator

@TangSiyang2001 TangSiyang2001 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@vinlee19
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 33462 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 218b88f0bec44e07df9f5ffc2483ec4805dc5f6f, data reload: false

------ Round 1 ----------------------------------
q1	17601	6496	6041	6041
q2	2045	317	175	175
q3	11057	1341	756	756
q4	10230	883	435	435
q5	7925	2191	1990	1990
q6	209	180	146	146
q7	906	761	612	612
q8	9376	1326	1130	1130
q9	5796	4978	4867	4867
q10	6820	2295	1876	1876
q11	501	278	254	254
q12	347	358	222	222
q13	18539	3690	3039	3039
q14	251	238	208	208
q15	572	518	503	503
q16	621	609	588	588
q17	580	855	338	338
q18	7816	7096	6984	6984
q19	5985	1401	744	744
q20	303	330	203	203
q21	2982	2320	2043	2043
q22	378	354	308	308
Total cold run time: 110840 ms
Total hot run time: 33462 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6470	6254	6270	6254
q2	238	326	232	232
q3	2348	2746	2284	2284
q4	1429	1808	1388	1388
q5	4487	4956	4946	4946
q6	187	174	151	151
q7	2103	1965	1841	1841
q8	2595	2771	2683	2683
q9	7391	7228	7013	7013
q10	3081	3318	2817	2817
q11	590	520	511	511
q12	678	771	593	593
q13	3400	3937	3229	3229
q14	287	321	289	289
q15	559	520	509	509
q16	671	696	649	649
q17	1216	1779	1245	1245
q18	7925	7498	7235	7235
q19	791	1195	1044	1044
q20	2012	2029	1783	1783
q21	8530	5188	4967	4967
q22	596	609	590	590
Total cold run time: 57584 ms
Total hot run time: 52253 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193872 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 218b88f0bec44e07df9f5ffc2483ec4805dc5f6f, data reload: false

query1	1298	934	945	934
query2	6423	2365	2313	2313
query3	11147	4839	4947	4839
query4	33154	23547	22957	22957
query5	3703	592	433	433
query6	273	193	181	181
query7	3984	497	304	304
query8	301	254	235	235
query9	9490	2701	2702	2701
query10	445	312	258	258
query11	17663	15166	15260	15166
query12	166	109	102	102
query13	1554	532	392	392
query14	10934	7398	7053	7053
query15	239	198	182	182
query16	7817	610	484	484
query17	1524	764	601	601
query18	2068	439	342	342
query19	222	199	174	174
query20	119	151	113	113
query21	206	122	108	108
query22	4744	4641	4333	4333
query23	33939	32834	33274	32834
query24	6210	2320	2358	2320
query25	464	464	412	412
query26	845	271	152	152
query27	2031	488	335	335
query28	5248	2502	2485	2485
query29	571	570	415	415
query30	217	184	152	152
query31	973	871	810	810
query32	71	55	55	55
query33	481	375	290	290
query34	761	854	510	510
query35	810	820	742	742
query36	1010	1041	932	932
query37	119	109	76	76
query38	4141	4138	4097	4097
query39	1471	1450	1456	1450
query40	205	119	102	102
query41	51	48	46	46
query42	119	100	101	100
query43	525	525	504	504
query44	1373	838	848	838
query45	191	174	164	164
query46	899	1076	658	658
query47	1895	1957	1831	1831
query48	392	403	319	319
query49	714	490	383	383
query50	660	674	392	392
query51	6991	7044	6967	6967
query52	99	100	89	89
query53	225	256	177	177
query54	494	515	404	404
query55	82	78	77	77
query56	248	261	230	230
query57	1209	1205	1129	1129
query58	236	218	225	218
query59	3264	3171	3033	3033
query60	282	271	244	244
query61	111	111	111	111
query62	850	818	712	712
query63	221	185	185	185
query64	3174	1066	664	664
query65	3266	3259	3258	3258
query66	799	400	312	312
query67	16285	15710	15387	15387
query68	8015	699	526	526
query69	474	291	250	250
query70	1191	1100	1110	1100
query71	439	291	251	251
query72	6442	3908	3927	3908
query73	657	745	354	354
query74	10000	8998	8892	8892
query75	3913	3145	2624	2624
query76	3609	1152	739	739
query77	768	354	277	277
query78	10023	9915	9292	9292
query79	3456	789	572	572
query80	631	511	435	435
query81	507	282	221	221
query82	689	149	123	123
query83	166	159	142	142
query84	248	82	76	76
query85	778	374	293	293
query86	395	321	276	276
query87	4397	4377	4202	4202
query88	4839	2170	2159	2159
query89	417	328	287	287
query90	1840	184	183	183
query91	129	136	106	106
query92	68	55	56	55
query93	2097	870	531	531
query94	636	392	286	286
query95	336	295	250	250
query96	494	609	276	276
query97	2888	2944	2809	2809
query98	230	203	198	198
query99	1644	1508	1373	1373
Total cold run time: 294112 ms
Total hot run time: 193872 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.22 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 218b88f0bec44e07df9f5ffc2483ec4805dc5f6f, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.04
query3	0.23	0.08	0.07
query4	1.62	0.11	0.10
query5	0.42	0.40	0.41
query6	1.16	0.64	0.65
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.59	0.51	0.51
query10	0.56	0.57	0.56
query11	0.14	0.10	0.10
query12	0.15	0.12	0.12
query13	0.61	0.61	0.59
query14	2.69	2.87	2.89
query15	0.89	0.82	0.81
query16	0.40	0.40	0.38
query17	0.97	1.06	1.03
query18	0.24	0.21	0.22
query19	1.80	1.81	1.97
query20	0.02	0.01	0.01
query21	15.36	0.92	0.58
query22	0.76	0.79	0.61
query23	15.37	1.43	0.57
query24	3.64	1.44	0.73
query25	0.12	0.16	0.17
query26	0.40	0.15	0.14
query27	0.05	0.05	0.06
query28	13.22	1.50	1.05
query29	12.64	3.91	3.25
query30	0.26	0.09	0.06
query31	2.82	0.62	0.39
query32	3.22	0.54	0.46
query33	3.07	3.13	3.08
query34	16.93	5.16	4.51
query35	4.61	4.51	4.46
query36	0.64	0.49	0.49
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.14	0.12
query41	0.07	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.25 s
Total hot run time: 31.22 s

TangSiyang2001
TangSiyang2001 approved these changes Jan 10, 2025
View reviewed changes
Copy link
Collaborator

@TangSiyang2001 TangSiyang2001 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 10, 2025
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@starocean999 starocean999 merged commit afadd68 into apache:master Jan 10, 2025
26 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@TangSiyang2001 TangSiyang2001 TangSiyang2001 approved these changes

@starocean999 starocean999 starocean999 approved these changes

@LiBinfeng-01 LiBinfeng-01 Awaiting requested review from LiBinfeng-01

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement showConvertLscCommand in nereids
6 participants
@vinlee19 @hello-stephen @doris-robot @starocean999 @LiBinfeng-01 @TangSiyang2001