Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] (nereids)implement showQueryProfileCommand in nereids #45271

Merged
merged 1 commit into from
Dec 12, 2024

Conversation

rijeshkp
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #42772

Related PR: #xxx

Problem Summary:

Support showQueryProfile command in nereids.

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@rijeshkp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39999 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 7fb80d612f7e6d7f03e015275e62d1667cd38c61, data reload: false

------ Round 1 ----------------------------------
q1	17573	7674	7299	7299
q2	2056	172	162	162
q3	10632	1082	1145	1082
q4	10539	688	657	657
q5	7593	2756	2701	2701
q6	232	150	150	150
q7	976	638	604	604
q8	9244	1846	1899	1846
q9	6589	6525	6493	6493
q10	7009	2340	2357	2340
q11	462	274	251	251
q12	411	229	227	227
q13	17809	3035	2997	2997
q14	242	207	212	207
q15	589	526	528	526
q16	638	580	607	580
q17	1000	594	524	524
q18	7268	6659	6761	6659
q19	1359	964	993	964
q20	466	184	183	183
q21	4525	3361	3231	3231
q22	383	320	316	316
Total cold run time: 107595 ms
Total hot run time: 39999 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7330	7273	7274	7273
q2	323	224	227	224
q3	2914	2892	2894	2892
q4	2123	1847	1921	1847
q5	5615	5680	5654	5654
q6	233	145	150	145
q7	2254	1876	1839	1839
q8	3380	3549	3501	3501
q9	8995	9060	9104	9060
q10	3622	3557	3571	3557
q11	598	519	509	509
q12	837	647	602	602
q13	12886	3248	3218	3218
q14	301	276	288	276
q15	577	560	529	529
q16	711	637	625	625
q17	1871	1648	1629	1629
q18	8313	7708	7592	7592
q19	2375	1590	1465	1465
q20	2098	1882	1869	1869
q21	5747	5553	5386	5386
q22	704	606	569	569
Total cold run time: 73807 ms
Total hot run time: 60261 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 199036 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 7fb80d612f7e6d7f03e015275e62d1667cd38c61, data reload: false

query1	1235	958	942	942
query2	6214	2181	2115	2115
query3	11140	4525	4652	4525
query4	33540	23713	23779	23713
query5	3497	477	451	451
query6	291	198	182	182
query7	3990	299	300	299
query8	320	238	224	224
query9	9607	2690	2699	2690
query10	451	243	241	241
query11	18065	15369	15498	15369
query12	147	103	99	99
query13	1549	403	380	380
query14	9436	6904	7407	6904
query15	262	212	188	188
query16	7312	486	473	473
query17	1626	617	626	617
query18	1377	326	330	326
query19	222	172	161	161
query20	130	115	123	115
query21	208	114	115	114
query22	4872	4736	4585	4585
query23	35637	34646	34939	34646
query24	10608	2646	2624	2624
query25	606	420	390	390
query26	1240	157	156	156
query27	2513	284	286	284
query28	8023	2481	2474	2474
query29	738	413	412	412
query30	243	159	157	157
query31	1051	860	871	860
query32	102	54	60	54
query33	761	301	299	299
query34	1212	515	534	515
query35	908	784	781	781
query36	1152	960	946	946
query37	133	83	73	73
query38	4552	4448	4327	4327
query39	1528	1491	1504	1491
query40	222	100	97	97
query41	48	44	41	41
query42	109	104	96	96
query43	538	510	505	505
query44	1290	825	841	825
query45	193	175	172	172
query46	1226	736	730	730
query47	2122	1921	1949	1921
query48	424	333	310	310
query49	1024	422	422	422
query50	840	419	387	387
query51	7491	7181	7373	7181
query52	105	92	91	91
query53	270	186	193	186
query54	1198	419	411	411
query55	77	76	77	76
query56	252	235	230	230
query57	1259	1122	1087	1087
query58	229	220	215	215
query59	3340	3281	3041	3041
query60	284	270	248	248
query61	137	100	103	100
query62	871	679	691	679
query63	226	193	207	193
query64	4009	660	631	631
query65	3363	3335	3293	3293
query66	841	297	310	297
query67	16139	15656	15572	15572
query68	4544	564	543	543
query69	434	255	258	255
query70	1177	1156	1152	1152
query71	343	256	258	256
query72	6351	4152	4239	4152
query73	779	355	361	355
query74	10267	9062	8998	8998
query75	3502	2703	2685	2685
query76	2670	1103	1086	1086
query77	422	275	273	273
query78	10800	9837	9823	9823
query79	1677	597	635	597
query80	935	442	433	433
query81	574	244	242	242
query82	942	124	119	119
query83	242	163	158	158
query84	227	67	67	67
query85	1361	300	300	300
query86	443	293	317	293
query87	4834	4651	4697	4651
query88	3486	2203	2168	2168
query89	438	298	292	292
query90	2001	192	192	192
query91	136	104	104	104
query92	64	49	51	49
query93	2073	545	536	536
query94	941	305	298	298
query95	351	256	244	244
query96	641	291	274	274
query97	2912	2702	2718	2702
query98	229	195	197	195
query99	1557	1312	1305	1305
Total cold run time: 301978 ms
Total hot run time: 199036 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 7fb80d612f7e6d7f03e015275e62d1667cd38c61, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.08	0.07
query4	1.62	0.10	0.10
query5	0.45	0.39	0.40
query6	1.16	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.54	0.50
query10	0.55	0.56	0.55
query11	0.14	0.11	0.11
query12	0.13	0.11	0.12
query13	0.61	0.60	0.59
query14	2.68	2.88	2.71
query15	0.91	0.82	0.82
query16	0.39	0.38	0.38
query17	1.06	1.05	0.96
query18	0.23	0.21	0.21
query19	1.93	1.88	2.02
query20	0.02	0.01	0.01
query21	15.36	0.58	0.58
query22	2.39	1.85	1.27
query23	17.07	1.03	0.75
query24	3.00	1.35	1.68
query25	0.31	0.14	0.04
query26	0.53	0.14	0.14
query27	0.04	0.04	0.05
query28	9.89	1.09	1.08
query29	12.55	3.34	3.32
query30	0.27	0.08	0.06
query31	2.85	0.40	0.39
query32	3.25	0.47	0.46
query33	3.00	3.06	3.04
query34	16.94	4.48	4.56
query35	4.56	4.54	4.51
query36	0.68	0.49	0.48
query37	0.09	0.06	0.05
query38	0.06	0.03	0.03
query39	0.03	0.02	0.03
query40	0.17	0.12	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.05 s
Total hot run time: 32.43 s

@rijeshkp rijeshkp force-pushed the ShowQueryProfileCmdNereids branch from 9e40e6c to da13460 Compare December 11, 2024 04:44
@rijeshkp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40069 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit da134600d06b8766d7fd2bbc210deff574a7105d, data reload: false

------ Round 1 ----------------------------------
q1	17584	7412	7287	7287
q2	2053	179	189	179
q3	10536	1151	1195	1151
q4	10236	738	827	738
q5	7604	2732	2699	2699
q6	238	149	150	149
q7	978	640	631	631
q8	9270	1829	1896	1829
q9	6670	6490	6451	6451
q10	7034	2294	2284	2284
q11	462	252	259	252
q12	444	223	220	220
q13	17791	3035	3029	3029
q14	239	211	209	209
q15	579	531	538	531
q16	665	577	605	577
q17	985	588	531	531
q18	7437	6669	6814	6669
q19	1347	1023	975	975
q20	469	180	180	180
q21	4001	3180	3243	3180
q22	392	325	318	318
Total cold run time: 107014 ms
Total hot run time: 40069 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7276	7249	7312	7249
q2	330	228	230	228
q3	2894	2749	3014	2749
q4	2102	1832	1807	1807
q5	5591	5704	5663	5663
q6	224	143	140	140
q7	2146	1788	1791	1788
q8	3412	3552	3502	3502
q9	8943	8955	9040	8955
q10	3601	3569	3517	3517
q11	610	516	499	499
q12	832	602	614	602
q13	11295	3320	3234	3234
q14	294	276	267	267
q15	572	523	535	523
q16	687	657	628	628
q17	1799	1569	1564	1564
q18	8072	7392	7626	7392
q19	1718	1595	1581	1581
q20	2030	1803	1781	1781
q21	5534	5251	5222	5222
q22	634	572	562	562
Total cold run time: 70596 ms
Total hot run time: 59453 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191606 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit da134600d06b8766d7fd2bbc210deff574a7105d, data reload: false

query1	953	395	379	379
query2	6520	2103	2015	2015
query3	6704	222	214	214
query4	33839	23614	23594	23594
query5	4370	471	457	457
query6	283	190	184	184
query7	4627	311	308	308
query8	307	241	236	236
query9	9671	2740	2726	2726
query10	485	255	254	254
query11	18064	15218	15048	15048
query12	155	100	99	99
query13	1646	402	421	402
query14	9294	7729	7230	7230
query15	272	174	181	174
query16	8148	456	468	456
query17	1663	562	527	527
query18	2114	292	291	291
query19	365	152	142	142
query20	114	110	108	108
query21	206	101	100	100
query22	4616	4232	4362	4232
query23	34920	34056	34502	34056
query24	10488	2548	2432	2432
query25	638	409	403	403
query26	1355	161	155	155
query27	2787	278	281	278
query28	8237	2433	2452	2433
query29	848	431	432	431
query30	294	152	159	152
query31	1059	809	823	809
query32	103	67	73	67
query33	793	305	309	305
query34	999	509	530	509
query35	894	734	739	734
query36	1087	943	949	943
query37	149	75	74	74
query38	4336	4243	4322	4243
query39	1465	1457	1488	1457
query40	290	101	101	101
query41	46	44	43	43
query42	157	103	101	101
query43	559	481	488	481
query44	1290	810	795	795
query45	195	169	157	157
query46	1138	709	685	685
query47	1948	1841	1859	1841
query48	427	315	323	315
query49	1165	391	388	388
query50	814	383	393	383
query51	7260	7112	7147	7112
query52	108	90	86	86
query53	257	180	182	180
query54	1295	412	408	408
query55	84	80	78	78
query56	267	247	246	246
query57	1239	1102	1096	1096
query58	233	213	215	213
query59	3285	3233	2887	2887
query60	291	241	247	241
query61	137	102	110	102
query62	908	682	690	682
query63	206	187	192	187
query64	5369	673	686	673
query65	3306	3164	3238	3164
query66	1434	315	305	305
query67	15930	15763	15771	15763
query68	5070	539	554	539
query69	437	256	258	256
query70	1211	1113	1133	1113
query71	335	259	253	253
query72	6389	4066	4025	4025
query73	746	357	368	357
query74	10257	9063	9087	9063
query75	3408	2676	2629	2629
query76	2907	1095	1083	1083
query77	398	283	274	274
query78	10771	9593	9493	9493
query79	1714	595	611	595
query80	975	429	432	429
query81	536	235	235	235
query82	809	124	123	123
query83	233	150	141	141
query84	237	72	69	69
query85	1264	308	332	308
query86	426	312	310	310
query87	4708	4618	4645	4618
query88	3626	2209	2185	2185
query89	412	294	304	294
query90	2200	197	190	190
query91	137	110	103	103
query92	67	50	52	50
query93	1538	549	537	537
query94	1041	304	293	293
query95	357	253	258	253
query96	624	305	277	277
query97	2838	2718	2637	2637
query98	215	196	201	196
query99	1543	1326	1308	1308
Total cold run time: 301935 ms
Total hot run time: 191606 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.12 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit da134600d06b8766d7fd2bbc210deff574a7105d, data reload: false

query1	0.04	0.06	0.03
query2	0.07	0.04	0.04
query3	0.23	0.08	0.07
query4	1.61	0.10	0.11
query5	0.44	0.38	0.41
query6	1.17	0.67	0.68
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.59	0.53	0.49
query10	0.56	0.58	0.54
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.61	0.60	0.60
query14	2.72	2.84	2.83
query15	0.90	0.85	0.82
query16	0.38	0.39	0.37
query17	0.97	1.07	1.06
query18	0.23	0.22	0.21
query19	1.90	1.80	1.95
query20	0.02	0.01	0.02
query21	15.39	0.60	0.58
query22	2.45	2.38	1.92
query23	16.96	0.96	0.87
query24	3.17	0.27	0.65
query25	0.23	0.20	0.15
query26	0.28	0.14	0.13
query27	0.04	0.04	0.04
query28	11.69	1.09	1.08
query29	12.58	3.31	3.23
query30	0.25	0.07	0.06
query31	2.85	0.38	0.37
query32	3.30	0.47	0.46
query33	2.97	2.99	3.04
query34	16.73	4.43	4.44
query35	4.53	4.48	4.49
query36	0.67	0.49	0.48
query37	0.10	0.06	0.06
query38	0.04	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.12	0.13
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 107.35 s
Total hot run time: 32.12 s

@rijeshkp rijeshkp force-pushed the ShowQueryProfileCmdNereids branch from da13460 to 80f20f8 Compare December 11, 2024 06:25
@rijeshkp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40814 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

------ Round 1 ----------------------------------
q1	17592	7444	7342	7342
q2	2048	171	161	161
q3	10599	1085	1176	1085
q4	10608	746	722	722
q5	7770	2745	2797	2745
q6	241	149	148	148
q7	1014	628	612	612
q8	9259	1878	1927	1878
q9	6795	6577	6580	6577
q10	7055	2323	2369	2323
q11	465	273	252	252
q12	428	226	234	226
q13	20451	3089	3064	3064
q14	244	211	224	211
q15	588	535	520	520
q16	660	570	583	570
q17	1023	569	565	565
q18	7380	7115	7300	7115
q19	2228	1043	948	948
q20	473	182	186	182
q21	4304	3252	3330	3252
q22	377	325	316	316
Total cold run time: 111602 ms
Total hot run time: 40814 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7359	7400	7381	7381
q2	337	243	250	243
q3	3142	3018	3015	3015
q4	2139	1844	1783	1783
q5	5660	5663	5705	5663
q6	227	142	143	142
q7	2279	1813	1807	1807
q8	3415	3547	3432	3432
q9	9101	9019	9025	9019
q10	3632	3550	3575	3550
q11	593	515	509	509
q12	804	608	607	607
q13	14739	3211	3217	3211
q14	299	267	267	267
q15	563	529	528	528
q16	695	642	665	642
q17	1859	1668	1606	1606
q18	8295	7672	7610	7610
q19	1757	1577	1629	1577
q20	2199	1919	1863	1863
q21	5658	5515	5652	5515
q22	642	546	555	546
Total cold run time: 75394 ms
Total hot run time: 60516 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195899 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

query1	1236	823	763	763
query2	6226	2131	2069	2069
query3	10982	4598	4333	4333
query4	66783	28850	23410	23410
query5	4844	475	444	444
query6	421	187	180	180
query7	5545	318	287	287
query8	309	226	221	221
query9	8624	2737	2708	2708
query10	464	251	245	245
query11	16863	15122	15836	15122
query12	174	107	103	103
query13	1509	451	417	417
query14	11083	7761	6698	6698
query15	225	199	192	192
query16	7601	465	494	465
query17	1437	595	581	581
query18	1830	318	317	317
query19	207	156	167	156
query20	135	122	123	122
query21	204	103	114	103
query22	4784	4785	4436	4436
query23	34337	34907	34304	34304
query24	5543	2534	2463	2463
query25	497	389	396	389
query26	653	146	148	146
query27	1925	280	279	279
query28	4558	2477	2462	2462
query29	677	416	426	416
query30	239	157	153	153
query31	1033	843	832	832
query32	80	87	59	59
query33	440	287	304	287
query34	950	522	509	509
query35	906	770	768	768
query36	1125	951	991	951
query37	128	71	70	70
query38	4502	4472	4371	4371
query39	1522	1486	1433	1433
query40	199	106	98	98
query41	45	43	48	43
query42	115	98	99	98
query43	552	498	490	490
query44	1187	852	859	852
query45	190	170	177	170
query46	1197	729	732	729
query47	2056	1918	1949	1918
query48	423	324	322	322
query49	750	388	385	385
query50	849	394	394	394
query51	7274	7114	7139	7114
query52	101	88	84	84
query53	252	174	186	174
query54	528	380	392	380
query55	75	76	73	73
query56	257	237	236	236
query57	1234	1100	1102	1100
query58	213	222	214	214
query59	3357	2887	2960	2887
query60	268	251	252	251
query61	114	105	109	105
query62	823	689	676	676
query63	213	181	182	181
query64	1464	653	683	653
query65	3284	3192	3225	3192
query66	725	295	309	295
query67	15805	15468	15708	15468
query68	4081	547	542	542
query69	433	255	256	255
query70	1205	1236	1131	1131
query71	365	247	263	247
query72	6188	4092	4054	4054
query73	772	357	356	356
query74	10395	8954	9033	8954
query75	3409	2691	2696	2691
query76	1856	1129	1187	1129
query77	474	273	273	273
query78	10485	9462	9407	9407
query79	1125	593	598	593
query80	856	425	437	425
query81	507	242	232	232
query82	221	119	118	118
query83	170	143	146	143
query84	281	85	75	75
query85	907	319	306	306
query86	378	309	298	298
query87	4682	4716	4548	4548
query88	3750	2223	2179	2179
query89	422	288	288	288
query90	2102	189	186	186
query91	142	105	103	103
query92	62	49	51	49
query93	1853	539	532	532
query94	773	292	312	292
query95	349	251	251	251
query96	616	275	276	275
query97	2819	2668	2631	2631
query98	217	202	197	197
query99	1693	1332	1293	1293
Total cold run time: 317739 ms
Total hot run time: 195899 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.91 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

query1	0.03	0.04	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.64	0.11	0.10
query5	0.43	0.40	0.41
query6	1.14	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.56	0.54	0.49
query10	0.55	0.59	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.69	2.75	2.76
query15	0.90	0.83	0.83
query16	0.38	0.38	0.38
query17	0.98	1.07	1.03
query18	0.22	0.22	0.20
query19	1.96	1.85	1.96
query20	0.01	0.01	0.01
query21	15.36	0.59	0.59
query22	2.55	1.72	1.89
query23	17.12	0.96	0.86
query24	3.40	1.33	1.63
query25	0.30	0.17	0.06
query26	0.54	0.13	0.13
query27	0.06	0.04	0.04
query28	9.68	1.11	1.08
query29	12.60	3.22	3.18
query30	0.25	0.07	0.06
query31	2.87	0.37	0.38
query32	3.29	0.46	0.47
query33	2.96	3.04	3.05
query34	17.14	4.48	4.50
query35	4.50	4.52	4.51
query36	0.68	0.48	0.47
query37	0.10	0.06	0.06
query38	0.05	0.03	0.03
query39	0.03	0.03	0.02
query40	0.17	0.13	0.12
query41	0.07	0.02	0.03
query42	0.04	0.02	0.02
query43	0.04	0.02	0.02
Total cold run time: 106.54 s
Total hot run time: 32.91 s

@rijeshkp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39968 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

------ Round 1 ----------------------------------
q1	17594	7426	7274	7274
q2	2052	169	169	169
q3	10944	1090	1179	1090
q4	10570	743	721	721
q5	7590	2701	2694	2694
q6	236	146	142	142
q7	978	626	596	596
q8	9258	1873	1875	1873
q9	6650	6419	6451	6419
q10	6979	2286	2286	2286
q11	475	257	260	257
q12	429	224	221	221
q13	17790	3058	3000	3000
q14	228	204	209	204
q15	574	520	518	518
q16	651	574	605	574
q17	971	544	532	532
q18	7269	6669	6767	6669
q19	1384	1041	989	989
q20	476	179	176	176
q21	4062	3255	3340	3255
q22	376	316	309	309
Total cold run time: 107536 ms
Total hot run time: 39968 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7189	7233	7179	7179
q2	322	232	239	232
q3	2876	2775	2914	2775
q4	2055	1833	1833	1833
q5	5677	5615	5640	5615
q6	225	141	146	141
q7	2229	1791	1786	1786
q8	3333	3559	3491	3491
q9	8868	8903	8968	8903
q10	3599	3519	3560	3519
q11	597	509	496	496
q12	843	599	607	599
q13	10650	3289	3275	3275
q14	306	271	270	270
q15	571	519	527	519
q16	681	637	639	637
q17	1847	1632	1612	1612
q18	8394	7731	7618	7618
q19	1770	1486	1502	1486
q20	2094	1901	1885	1885
q21	5694	5414	5395	5395
q22	623	599	580	580
Total cold run time: 70443 ms
Total hot run time: 59846 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195197 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

query1	1277	1016	931	931
query2	6219	2066	2027	2027
query3	10994	4447	4466	4447
query4	66683	28798	23358	23358
query5	4923	458	456	456
query6	419	183	184	183
query7	5519	301	295	295
query8	315	234	228	228
query9	8650	2707	2687	2687
query10	450	247	246	246
query11	16972	15017	16094	15017
query12	156	106	110	106
query13	1481	453	447	447
query14	10331	6701	7257	6701
query15	220	184	195	184
query16	7105	485	490	485
query17	1195	601	581	581
query18	1810	326	317	317
query19	198	165	168	165
query20	128	126	116	116
query21	203	106	110	106
query22	4696	4696	4691	4691
query23	34338	33929	33801	33801
query24	5668	2462	2439	2439
query25	489	389	377	377
query26	650	152	159	152
query27	1944	279	276	276
query28	4478	2469	2421	2421
query29	666	431	414	414
query30	222	154	156	154
query31	988	832	831	831
query32	67	52	56	52
query33	425	285	288	285
query34	1000	494	498	494
query35	868	756	759	756
query36	1083	953	949	949
query37	134	75	80	75
query38	4543	4262	4357	4262
query39	1478	1466	1413	1413
query40	205	101	100	100
query41	44	43	43	43
query42	110	95	94	94
query43	533	506	480	480
query44	1199	862	822	822
query45	193	181	184	181
query46	1162	699	694	694
query47	2025	1947	1935	1935
query48	419	324	307	307
query49	755	376	385	376
query50	855	397	393	393
query51	7389	7157	7121	7121
query52	99	85	84	84
query53	253	172	178	172
query54	512	382	381	381
query55	76	74	77	74
query56	242	219	252	219
query57	1250	1131	1090	1090
query58	216	222	207	207
query59	3142	2946	3013	2946
query60	268	238	250	238
query61	108	106	107	106
query62	799	651	658	651
query63	217	189	184	184
query64	1407	735	681	681
query65	3301	3223	3194	3194
query66	693	297	301	297
query67	15822	15713	15558	15558
query68	4003	558	551	551
query69	434	254	248	248
query70	1160	1152	1189	1152
query71	362	252	255	252
query72	6411	4093	4052	4052
query73	743	351	359	351
query74	10142	9003	8969	8969
query75	3397	2642	2706	2642
query76	1747	1086	1077	1077
query77	493	269	277	269
query78	10453	9447	9332	9332
query79	1550	579	582	579
query80	915	429	419	419
query81	493	247	224	224
query82	1302	118	113	113
query83	169	147	147	147
query84	291	70	70	70
query85	840	305	305	305
query86	339	271	296	271
query87	4650	4382	4645	4382
query88	3347	2212	2178	2178
query89	421	297	295	295
query90	2026	186	179	179
query91	138	104	100	100
query92	61	48	51	48
query93	1901	525	530	525
query94	789	283	296	283
query95	343	243	248	243
query96	624	284	274	274
query97	2802	2623	2680	2623
query98	226	191	192	191
query99	1884	1317	1300	1300
Total cold run time: 316735 ms
Total hot run time: 195197 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.09 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.03	0.04
query3	0.23	0.07	0.07
query4	1.62	0.11	0.11
query5	0.45	0.42	0.41
query6	1.17	0.65	0.64
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.53	0.50
query10	0.55	0.56	0.57
query11	0.14	0.09	0.10
query12	0.13	0.10	0.10
query13	0.62	0.60	0.59
query14	2.82	2.73	2.75
query15	0.92	0.82	0.82
query16	0.38	0.39	0.37
query17	1.04	1.00	0.96
query18	0.22	0.20	0.21
query19	1.86	1.84	2.03
query20	0.02	0.01	0.01
query21	15.37	0.59	0.59
query22	2.11	1.71	1.09
query23	16.82	1.02	0.80
query24	3.02	1.45	1.81
query25	0.26	0.22	0.06
query26	0.55	0.13	0.13
query27	0.05	0.04	0.04
query28	9.81	1.09	1.08
query29	12.60	3.25	3.22
query30	0.24	0.07	0.06
query31	2.87	0.36	0.38
query32	3.29	0.46	0.46
query33	2.99	3.02	3.04
query34	17.04	4.43	4.44
query35	4.53	4.47	4.43
query36	0.64	0.47	0.48
query37	0.08	0.06	0.06
query38	0.04	0.03	0.03
query39	0.04	0.02	0.03
query40	0.16	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.03	0.02	0.02
Total cold run time: 105.57 s
Total hot run time: 32.09 s

@rijeshkp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39533 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

------ Round 1 ----------------------------------
q1	17576	7497	7192	7192
q2	2049	172	158	158
q3	10721	1108	1156	1108
q4	10556	706	704	704
q5	7559	2671	2661	2661
q6	235	148	145	145
q7	985	632	600	600
q8	9239	1775	1874	1775
q9	6697	6447	6378	6378
q10	7003	2283	2312	2283
q11	467	268	255	255
q12	425	226	221	221
q13	17785	2997	3028	2997
q14	233	205	210	205
q15	575	532	518	518
q16	674	575	569	569
q17	988	510	537	510
q18	7373	6715	6717	6715
q19	1390	997	968	968
q20	476	179	179	179
q21	4136	3089	3213	3089
q22	394	315	303	303
Total cold run time: 107536 ms
Total hot run time: 39533 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7254	7244	7212	7212
q2	325	229	227	227
q3	2926	2778	2938	2778
q4	2065	1869	1868	1868
q5	5651	5635	5656	5635
q6	229	147	144	144
q7	2231	1821	1840	1821
q8	3395	3562	3508	3508
q9	8860	9029	9014	9014
q10	3574	3526	3553	3526
q11	601	498	501	498
q12	823	595	599	595
q13	11314	3267	3195	3195
q14	306	289	280	280
q15	565	523	525	523
q16	713	647	645	645
q17	1857	1610	1619	1610
q18	8275	7876	7623	7623
q19	1777	1534	1570	1534
q20	2084	1890	1854	1854
q21	5587	5403	5363	5363
q22	647	559	553	553
Total cold run time: 71059 ms
Total hot run time: 60006 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195379 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

query1	1246	982	930	930
query2	6234	2116	2040	2040
query3	10962	4393	4398	4393
query4	66616	28003	23312	23312
query5	4910	469	447	447
query6	384	176	163	163
query7	5506	300	298	298
query8	304	222	232	222
query9	8362	2705	2696	2696
query10	406	242	241	241
query11	17114	14993	15717	14993
query12	152	97	100	97
query13	1453	432	427	427
query14	10675	7080	6685	6685
query15	221	197	196	196
query16	7150	489	461	461
query17	1231	588	576	576
query18	1812	312	328	312
query19	214	155	158	155
query20	133	120	118	118
query21	203	107	106	106
query22	4559	4525	4567	4525
query23	34683	34002	33923	33923
query24	5360	2551	2432	2432
query25	495	393	393	393
query26	638	146	147	146
query27	1825	295	288	288
query28	4178	2477	2481	2477
query29	667	429	431	429
query30	209	154	149	149
query31	1020	828	853	828
query32	68	52	56	52
query33	464	297	307	297
query34	929	511	509	509
query35	906	776	773	773
query36	1094	960	969	960
query37	114	77	78	77
query38	4430	4415	4432	4415
query39	1476	1437	1467	1437
query40	196	98	99	98
query41	44	42	40	40
query42	114	98	98	98
query43	530	511	493	493
query44	1171	861	861	861
query45	193	181	167	167
query46	1184	706	696	696
query47	2013	1964	1965	1964
query48	424	319	325	319
query49	730	391	395	391
query50	826	388	392	388
query51	7288	7276	7187	7187
query52	96	84	88	84
query53	250	175	178	175
query54	508	398	395	395
query55	80	78	83	78
query56	253	232	230	230
query57	1200	1116	1123	1116
query58	213	212	202	202
query59	3055	2992	3186	2992
query60	278	237	247	237
query61	103	99	103	99
query62	805	688	673	673
query63	206	180	188	180
query64	1351	706	638	638
query65	3222	3159	3176	3159
query66	691	299	286	286
query67	15879	15625	15471	15471
query68	4068	562	566	562
query69	432	251	250	250
query70	1177	1146	1090	1090
query71	313	247	254	247
query72	6317	4100	4082	4082
query73	767	368	358	358
query74	10305	8938	8950	8938
query75	3361	2616	2628	2616
query76	1759	1028	1087	1028
query77	524	293	282	282
query78	10534	9460	9360	9360
query79	1122	596	589	589
query80	834	485	445	445
query81	504	225	218	218
query82	1343	111	120	111
query83	251	140	135	135
query84	280	70	69	69
query85	860	306	297	297
query86	326	271	296	271
query87	4592	4497	4464	4464
query88	3392	2283	2173	2173
query89	417	309	287	287
query90	2128	179	179	179
query91	135	99	103	99
query92	59	49	47	47
query93	1210	543	546	543
query94	820	280	279	279
query95	352	241	236	236
query96	619	279	272	272
query97	2830	2666	2675	2666
query98	221	196	188	188
query99	1689	1310	1303	1303
Total cold run time: 314847 ms
Total hot run time: 195379 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 80f20f87188dd4c842a7d3548278999cb9a65972, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.04
query3	0.23	0.07	0.08
query4	1.62	0.10	0.10
query5	0.44	0.40	0.41
query6	1.20	0.65	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.04
query9	0.57	0.50	0.49
query10	0.55	0.59	0.56
query11	0.15	0.11	0.10
query12	0.14	0.11	0.11
query13	0.61	0.59	0.61
query14	2.70	2.82	2.74
query15	0.90	0.83	0.83
query16	0.38	0.37	0.37
query17	1.06	1.02	1.00
query18	0.22	0.21	0.22
query19	1.92	1.78	1.94
query20	0.02	0.01	0.02
query21	15.36	0.56	0.57
query22	3.15	2.05	1.61
query23	16.94	0.96	0.87
query24	3.01	0.88	2.10
query25	0.25	0.22	0.10
query26	0.50	0.13	0.13
query27	0.05	0.05	0.04
query28	10.04	1.11	1.06
query29	12.60	3.28	3.24
query30	0.25	0.06	0.06
query31	2.88	0.39	0.39
query32	3.26	0.45	0.45
query33	2.95	3.01	3.07
query34	16.88	4.41	4.45
query35	4.50	4.48	4.41
query36	0.67	0.47	0.48
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.03	0.02
query40	0.16	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.63 s
Total hot run time: 32.11 s

Copy link
Contributor

@Vallishp Vallishp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 12, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@starocean999 starocean999 merged commit 7335ea8 into apache:master Dec 12, 2024
27 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement showQueryProfileCommand in nereids
5 participants