Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feat](Nereids) support show variables and show view command #43271

Merged
merged 4 commits into from
Nov 8, 2024

Conversation

starocean999
Copy link
Contributor

@starocean999 starocean999 commented Nov 5, 2024

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
migrate ShowVariablesStmt and ShowViewStmt to nereids

Check List (For Committer)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No colde files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.
  • Release note

    None

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@starocean999
Copy link
Contributor Author

run buildall

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40934 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c3ab6a0e4437e6220bd93a34caf4915fc8ad4f70, data reload: false

------ Round 1 ----------------------------------
q1	17559	7370	7304	7304
q2	2048	157	152	152
q3	10585	1089	1200	1089
q4	10585	809	798	798
q5	7747	3019	3081	3019
q6	230	143	143	143
q7	999	602	595	595
q8	9347	1941	2042	1941
q9	6574	6421	6423	6421
q10	7061	2433	2426	2426
q11	470	260	253	253
q12	407	213	205	205
q13	17773	2992	3007	2992
q14	238	223	206	206
q15	580	528	501	501
q16	662	600	579	579
q17	960	491	474	474
q18	7233	6608	6534	6534
q19	1331	1015	1035	1015
q20	451	190	181	181
q21	3992	3150	3107	3107
q22	1123	999	1013	999
Total cold run time: 107955 ms
Total hot run time: 40934 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7267	7257	7332	7257
q2	326	233	237	233
q3	2934	2948	2989	2948
q4	2074	1835	1851	1835
q5	5732	5752	5761	5752
q6	228	141	142	141
q7	2275	1875	1791	1791
q8	3397	3565	3404	3404
q9	8846	8878	8864	8864
q10	3563	3548	3558	3548
q11	592	520	487	487
q12	838	645	605	605
q13	9352	3169	3187	3169
q14	311	273	276	273
q15	598	528	517	517
q16	684	667	647	647
q17	1845	1614	1620	1614
q18	8301	7693	7655	7655
q19	1684	1443	1516	1443
q20	2147	1885	1862	1862
q21	5686	5522	5512	5512
q22	1149	1060	1038	1038
Total cold run time: 69829 ms
Total hot run time: 60595 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196066 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c3ab6a0e4437e6220bd93a34caf4915fc8ad4f70, data reload: false

query1	1192	916	921	916
query2	6227	2020	2040	2020
query3	10907	4126	4106	4106
query4	68484	28560	23706	23706
query5	4911	458	439	439
query6	409	207	179	179
query7	5530	288	284	284
query8	305	223	219	219
query9	8720	2619	2620	2619
query10	438	255	248	248
query11	17338	15432	15950	15432
query12	153	102	98	98
query13	1515	460	422	422
query14	10414	7240	7445	7240
query15	208	194	186	186
query16	7106	490	489	489
query17	1001	553	557	553
query18	1798	294	292	292
query19	197	157	150	150
query20	112	108	107	107
query21	199	100	96	96
query22	4458	4270	4411	4270
query23	34947	33972	33862	33862
query24	6001	2789	2797	2789
query25	508	408	414	408
query26	651	163	155	155
query27	1673	295	284	284
query28	4137	2412	2391	2391
query29	681	426	425	425
query30	242	154	155	154
query31	997	784	815	784
query32	70	53	56	53
query33	405	268	270	268
query34	898	511	508	508
query35	864	733	727	727
query36	1096	940	950	940
query37	116	73	72	72
query38	4350	4278	4282	4278
query39	1486	1440	1421	1421
query40	203	97	96	96
query41	46	45	47	45
query42	115	98	99	98
query43	527	488	472	472
query44	1161	814	817	814
query45	178	165	170	165
query46	1100	684	702	684
query47	1944	1825	1865	1825
query48	414	319	317	317
query49	723	404	424	404
query50	809	401	397	397
query51	7249	7159	7090	7090
query52	97	92	85	85
query53	249	176	175	175
query54	505	393	396	393
query55	75	77	76	76
query56	252	230	235	230
query57	1302	1153	1131	1131
query58	209	198	205	198
query59	3291	3112	2811	2811
query60	264	245	240	240
query61	106	105	104	104
query62	792	679	691	679
query63	212	186	181	181
query64	1334	637	619	619
query65	3303	3208	3245	3208
query66	632	326	307	307
query67	15957	15645	15615	15615
query68	3843	581	557	557
query69	414	253	243	243
query70	1139	1107	1136	1107
query71	327	258	263	258
query72	6346	3905	4031	3905
query73	752	364	353	353
query74	9900	9158	9135	9135
query75	3377	2655	2669	2655
query76	1772	1132	1066	1066
query77	492	277	268	268
query78	10478	9417	9396	9396
query79	1147	588	577	577
query80	823	420	436	420
query81	509	236	236	236
query82	637	116	113	113
query83	153	140	138	138
query84	275	70	71	70
query85	837	293	303	293
query86	328	300	299	299
query87	4746	4686	4738	4686
query88	3442	2184	2136	2136
query89	412	292	285	285
query90	1917	189	184	184
query91	140	97	102	97
query92	63	48	49	48
query93	1232	536	535	535
query94	729	288	294	288
query95	349	247	252	247
query96	606	276	287	276
query97	2889	2695	2664	2664
query98	209	199	198	198
query99	1604	1308	1284	1284
Total cold run time: 315680 ms
Total hot run time: 196066 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.25 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c3ab6a0e4437e6220bd93a34caf4915fc8ad4f70, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.06	0.06
query4	1.65	0.10	0.09
query5	0.42	0.40	0.40
query6	1.15	0.65	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.56	0.50	0.49
query10	0.55	0.55	0.57
query11	0.14	0.11	0.10
query12	0.14	0.11	0.13
query13	0.61	0.59	0.60
query14	2.72	2.70	2.74
query15	0.90	0.82	0.83
query16	0.38	0.37	0.38
query17	1.05	1.03	1.07
query18	0.20	0.19	0.19
query19	1.98	1.89	1.94
query20	0.01	0.01	0.01
query21	15.37	0.60	0.58
query22	2.41	1.73	1.58
query23	16.91	1.14	0.93
query24	2.85	1.90	0.78
query25	0.32	0.22	0.06
query26	0.49	0.14	0.14
query27	0.05	0.05	0.04
query28	10.39	1.10	1.08
query29	12.57	3.20	3.22
query30	0.24	0.06	0.05
query31	2.89	0.40	0.39
query32	3.23	0.47	0.46
query33	2.98	3.00	3.06
query34	16.90	4.51	4.56
query35	4.56	4.54	4.52
query36	0.66	0.48	0.50
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.15	0.12	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.13 s
Total hot run time: 32.25 s

@starocean999 starocean999 marked this pull request as ready for review November 6, 2024 02:02
@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41611 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b13486181bbc66d75808243fcaaee6c17d32f0b9, data reload: false

------ Round 1 ----------------------------------
q1	17557	7476	7291	7291
q2	2071	186	185	185
q3	10588	1134	1139	1134
q4	10312	836	782	782
q5	7789	3092	3116	3092
q6	235	147	145	145
q7	1031	605	618	605
q8	9382	1959	2064	1959
q9	6644	6454	6444	6444
q10	7086	2403	2417	2403
q11	469	263	263	263
q12	414	209	207	207
q13	17791	3001	3011	3001
q14	239	203	221	203
q15	571	529	511	511
q16	662	592	591	591
q17	983	563	561	561
q18	7518	6754	6813	6754
q19	1335	1055	1046	1046
q20	462	185	182	182
q21	4226	3264	3253	3253
q22	1131	999	1013	999
Total cold run time: 108496 ms
Total hot run time: 41611 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7293	7238	7245	7238
q2	350	254	246	246
q3	2912	2799	2870	2799
q4	1956	1689	1684	1684
q5	5470	5488	5554	5488
q6	215	141	137	137
q7	2133	1737	1728	1728
q8	3291	3432	3461	3432
q9	8600	8545	8635	8545
q10	3524	3477	3440	3440
q11	599	487	506	487
q12	786	584	577	577
q13	10093	3011	3048	3011
q14	295	269	270	269
q15	594	544	532	532
q16	674	645	626	626
q17	1808	1580	1571	1571
q18	7828	7662	7460	7460
q19	1683	1517	1542	1517
q20	2056	1834	1803	1803
q21	5428	5297	5330	5297
q22	1117	1036	990	990
Total cold run time: 68705 ms
Total hot run time: 58877 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192479 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b13486181bbc66d75808243fcaaee6c17d32f0b9, data reload: false

query1	967	370	367	367
query2	6138	2003	2028	2003
query3	6485	220	217	217
query4	33843	23784	23641	23641
query5	4584	473	430	430
query6	260	178	178	178
query7	4516	295	291	291
query8	274	224	224	224
query9	9579	2648	2618	2618
query10	475	258	252	252
query11	18282	15490	15178	15178
query12	151	104	101	101
query13	1661	430	420	420
query14	9153	6632	7105	6632
query15	224	187	181	181
query16	6823	473	454	454
query17	1420	576	556	556
query18	2298	567	626	567
query19	299	181	171	171
query20	115	109	110	109
query21	206	104	105	104
query22	4825	4443	4441	4441
query23	36964	35474	34385	34385
query24	11669	3313	3282	3282
query25	553	395	410	395
query26	1157	179	175	175
query27	2721	279	273	273
query28	7892	2431	2436	2431
query29	676	433	428	428
query30	468	318	324	318
query31	1053	789	804	789
query32	80	59	60	59
query33	733	286	276	276
query34	916	518	520	518
query35	906	747	742	742
query36	1133	956	929	929
query37	207	75	73	73
query38	4479	4205	4311	4205
query39	1511	1438	1454	1438
query40	282	100	102	100
query41	49	48	46	46
query42	111	98	98	98
query43	529	483	470	470
query44	1259	806	808	806
query45	184	172	171	171
query46	1145	685	669	669
query47	1933	1851	1841	1841
query48	433	327	347	327
query49	1120	400	397	397
query50	797	404	387	387
query51	7288	7272	7051	7051
query52	99	89	92	89
query53	253	182	180	180
query54	981	413	405	405
query55	80	75	80	75
query56	268	245	243	243
query57	1299	1181	1220	1181
query58	215	227	202	202
query59	3308	2858	2956	2858
query60	269	254	246	246
query61	115	108	106	106
query62	827	669	704	669
query63	216	185	181	181
query64	3389	669	620	620
query65	3306	3198	3218	3198
query66	933	310	310	310
query67	16231	15813	15896	15813
query68	4798	578	570	570
query69	445	258	255	255
query70	1188	1167	1040	1040
query71	354	243	265	243
query72	5964	4020	4206	4020
query73	776	356	359	356
query74	10283	8971	9022	8971
query75	3414	2634	2653	2634
query76	1718	1013	1053	1013
query77	425	279	285	279
query78	10318	9403	9366	9366
query79	1121	593	602	593
query80	774	436	417	417
query81	521	239	233	233
query82	1145	120	116	116
query83	253	165	159	159
query84	234	71	72	71
query85	1032	304	294	294
query86	321	298	310	298
query87	4795	4716	4665	4665
query88	3426	2217	2160	2160
query89	392	292	297	292
query90	1992	186	185	185
query91	140	101	109	101
query92	55	51	49	49
query93	1060	537	536	536
query94	731	294	288	288
query95	335	246	240	240
query96	603	276	282	276
query97	2889	2683	2665	2665
query98	205	194	190	190
query99	1578	1321	1314	1314
Total cold run time: 295900 ms
Total hot run time: 192479 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.9 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b13486181bbc66d75808243fcaaee6c17d32f0b9, data reload: false

query1	0.03	0.04	0.03
query2	0.07	0.03	0.03
query3	0.23	0.06	0.06
query4	1.66	0.11	0.10
query5	0.42	0.40	0.40
query6	1.14	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.04	0.03
query9	0.57	0.50	0.50
query10	0.56	0.56	0.57
query11	0.14	0.10	0.11
query12	0.14	0.11	0.11
query13	0.60	0.60	0.60
query14	2.71	2.83	2.74
query15	0.90	0.84	0.83
query16	0.40	0.38	0.36
query17	0.98	1.08	0.96
query18	0.19	0.20	0.19
query19	1.92	1.76	1.83
query20	0.02	0.01	0.01
query21	15.36	0.57	0.57
query22	2.55	2.71	2.14
query23	17.00	0.92	0.69
query24	3.25	1.27	1.44
query25	0.33	0.13	0.16
query26	0.51	0.14	0.14
query27	0.04	0.05	0.04
query28	10.45	1.08	1.07
query29	12.52	3.24	3.19
query30	0.24	0.06	0.06
query31	2.88	0.39	0.38
query32	3.28	0.47	0.45
query33	2.96	3.06	3.02
query34	17.10	4.45	4.49
query35	4.59	4.46	4.48
query36	0.66	0.48	0.48
query37	0.08	0.07	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.12
query41	0.07	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.93 s
Total hot run time: 32.9 s

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 41668 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d205f141e03fcff62d3270ead4ddf68998129fe8, data reload: false

------ Round 1 ----------------------------------
q1	17597	7640	7334	7334
q2	2060	200	181	181
q3	10676	1187	1188	1187
q4	10577	846	786	786
q5	7744	3170	3121	3121
q6	238	148	148	148
q7	1041	628	623	623
q8	9385	1994	2081	1994
q9	6694	6480	6513	6480
q10	7069	2441	2453	2441
q11	467	264	272	264
q12	398	209	207	207
q13	17787	3004	3038	3004
q14	239	217	211	211
q15	571	536	520	520
q16	644	581	612	581
q17	982	566	515	515
q18	7455	6834	6739	6739
q19	1330	1053	1078	1053
q20	477	192	189	189
q21	4077	3311	3085	3085
q22	1129	1012	1005	1005
Total cold run time: 108637 ms
Total hot run time: 41668 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7363	7333	7289	7289
q2	348	257	255	255
q3	2983	2827	2798	2798
q4	1966	1736	1726	1726
q5	5476	5489	5562	5489
q6	217	137	136	136
q7	2164	1719	1725	1719
q8	3282	3463	3465	3463
q9	8634	8583	8649	8583
q10	3522	3512	3433	3433
q11	609	509	518	509
q12	811	591	569	569
q13	8537	3015	3000	3000
q14	281	263	260	260
q15	603	536	544	536
q16	682	639	656	639
q17	1815	1585	1564	1564
q18	7931	7678	7569	7569
q19	1674	1482	1591	1482
q20	2102	1821	1849	1821
q21	5389	5236	5160	5160
q22	1114	1029	999	999
Total cold run time: 67503 ms
Total hot run time: 58999 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194163 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d205f141e03fcff62d3270ead4ddf68998129fe8, data reload: false

query1	962	374	361	361
query2	6524	2128	2094	2094
query3	6793	219	223	219
query4	33900	23511	23476	23476
query5	4357	470	432	432
query6	271	179	174	174
query7	4604	299	296	296
query8	286	259	241	241
query9	9675	2709	2686	2686
query10	490	264	243	243
query11	18106	15136	15354	15136
query12	156	101	99	99
query13	1653	411	429	411
query14	9913	6957	7129	6957
query15	256	180	174	174
query16	8096	472	466	466
query17	1646	572	564	564
query18	2445	610	612	610
query19	415	179	183	179
query20	118	109	110	109
query21	205	103	101	101
query22	4758	4461	4453	4453
query23	35325	35186	35147	35147
query24	12284	3406	3369	3369
query25	564	403	409	403
query26	1252	184	177	177
query27	2641	283	288	283
query28	8012	2424	2426	2424
query29	690	427	430	427
query30	466	312	322	312
query31	1036	798	818	798
query32	96	58	59	58
query33	798	285	282	282
query34	961	508	525	508
query35	870	740	734	734
query36	1100	964	977	964
query37	200	77	78	77
query38	4369	4334	4251	4251
query39	1491	1445	1418	1418
query40	285	104	102	102
query41	52	48	53	48
query42	110	100	98	98
query43	537	475	487	475
query44	1303	821	812	812
query45	185	171	173	171
query46	1155	704	678	678
query47	1965	1867	1885	1867
query48	406	326	337	326
query49	1236	410	396	396
query50	817	382	412	382
query51	7344	7118	7110	7110
query52	99	88	91	88
query53	251	181	183	181
query54	1093	420	406	406
query55	80	77	76	76
query56	265	254	256	254
query57	1285	1183	1171	1171
query58	223	210	208	208
query59	3268	3079	2923	2923
query60	285	262	269	262
query61	163	109	109	109
query62	828	693	690	690
query63	211	186	183	183
query64	5389	645	628	628
query65	3335	3214	3206	3206
query66	1041	311	307	307
query67	16205	15848	15779	15779
query68	5448	577	566	566
query69	421	252	253	252
query70	1188	1129	1096	1096
query71	387	245	248	245
query72	6372	3978	4054	3978
query73	764	352	362	352
query74	10312	9112	9098	9098
query75	3433	2679	2648	2648
query76	3376	977	1054	977
query77	548	267	271	267
query78	10444	9444	9476	9444
query79	1693	592	608	592
query80	1036	435	421	421
query81	538	245	236	236
query82	955	115	115	115
query83	228	157	160	157
query84	237	72	71	71
query85	1154	305	295	295
query86	349	294	296	294
query87	4984	4708	4754	4708
query88	3220	2209	2149	2149
query89	401	296	296	296
query90	1941	183	187	183
query91	138	102	104	102
query92	59	46	51	46
query93	1092	551	536	536
query94	751	306	293	293
query95	351	248	247	247
query96	606	278	283	278
query97	2896	2654	2721	2654
query98	210	202	200	200
query99	1635	1318	1326	1318
Total cold run time: 304367 ms
Total hot run time: 194163 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.53 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d205f141e03fcff62d3270ead4ddf68998129fe8, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.02	0.03
query3	0.23	0.06	0.06
query4	1.67	0.10	0.10
query5	0.42	0.38	0.41
query6	1.14	0.65	0.64
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.56	0.49	0.49
query10	0.56	0.55	0.59
query11	0.13	0.10	0.11
query12	0.13	0.10	0.11
query13	0.61	0.60	0.60
query14	2.74	2.73	2.73
query15	0.91	0.82	0.82
query16	0.38	0.38	0.38
query17	1.06	1.08	1.06
query18	0.20	0.20	0.20
query19	1.87	1.94	1.81
query20	0.02	0.01	0.01
query21	15.36	0.58	0.60
query22	2.23	2.04	2.78
query23	17.00	0.89	0.88
query24	2.55	1.89	1.75
query25	0.34	0.13	0.19
query26	0.33	0.15	0.13
query27	0.04	0.03	0.06
query28	10.00	1.09	1.07
query29	12.52	3.22	3.23
query30	0.25	0.06	0.06
query31	2.88	0.39	0.38
query32	3.29	0.45	0.45
query33	2.94	2.99	2.98
query34	17.14	4.46	4.49
query35	4.47	4.48	4.50
query36	0.65	0.47	0.48
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.03
query40	0.16	0.12	0.13
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.26 s
Total hot run time: 33.53 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 7, 2024
Copy link
Contributor

github-actions bot commented Nov 7, 2024

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Nov 7, 2024

PR approved by anyone and no changes requested.

@starocean999 starocean999 merged commit 854512f into apache:master Nov 8, 2024
26 of 28 checks passed
morrySnow pushed a commit that referenced this pull request Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.8-merged reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants