Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feature](nereids)support show view command in nereids #44699

Merged
merged 3 commits into from
Dec 2, 2024

Conversation

starocean999
Copy link
Contributor

pick part code of #43271 from master

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40274 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8086e149b2903fb6dc3dff7830bbf8471c98d20a, data reload: false

------ Round 1 ----------------------------------
q1	17563	7372	7229	7229
q2	2049	162	158	158
q3	10818	1067	1145	1067
q4	10548	711	697	697
q5	7777	2803	2806	2803
q6	238	146	147	146
q7	975	616	609	609
q8	9581	1933	1995	1933
q9	8071	6372	6395	6372
q10	6978	2247	2265	2247
q11	449	265	259	259
q12	409	211	206	206
q13	17779	2953	2983	2953
q14	239	218	204	204
q15	574	500	523	500
q16	687	598	595	595
q17	969	541	548	541
q18	7184	6591	6511	6511
q19	1376	1019	1081	1019
q20	479	214	198	198
q21	4043	3257	3061	3061
q22	1089	1016	966	966
Total cold run time: 109875 ms
Total hot run time: 40274 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7306	7218	7167	7167
q2	320	224	218	218
q3	2884	2872	2866	2866
q4	1962	1787	1730	1730
q5	5670	5679	5710	5679
q6	243	140	146	140
q7	2194	1787	1781	1781
q8	3308	3548	3453	3453
q9	8767	8938	8795	8795
q10	3533	3496	3479	3479
q11	594	517	485	485
q12	772	592	621	592
q13	16474	3121	3111	3111
q14	300	278	282	278
q15	557	524	511	511
q16	698	676	660	660
q17	1816	1629	1568	1568
q18	8108	7774	7498	7498
q19	5728	1538	1581	1538
q20	2092	1882	1822	1822
q21	5251	5118	5261	5118
q22	1101	1013	1019	1013
Total cold run time: 79678 ms
Total hot run time: 59502 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194327 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8086e149b2903fb6dc3dff7830bbf8471c98d20a, data reload: false

query1	1258	916	897	897
query2	6227	2026	1949	1949
query3	10747	3753	3787	3753
query4	70288	29829	23581	23581
query5	5555	438	447	438
query6	456	179	173	173
query7	6165	313	312	312
query8	325	227	222	222
query9	9633	2662	2646	2646
query10	498	263	255	255
query11	18048	15622	15703	15622
query12	163	100	100	100
query13	1678	420	411	411
query14	11227	6342	6964	6342
query15	210	171	196	171
query16	7280	481	488	481
query17	1101	574	581	574
query18	1948	329	292	292
query19	189	150	136	136
query20	120	104	103	103
query21	213	100	94	94
query22	4640	4434	4473	4434
query23	34206	34015	33810	33810
query24	6276	2915	2872	2872
query25	499	390	383	383
query26	676	163	162	162
query27	1815	293	289	289
query28	4338	2591	2552	2552
query29	701	457	425	425
query30	239	165	165	165
query31	1001	823	811	811
query32	62	53	52	52
query33	491	277	264	264
query34	915	499	495	495
query35	850	729	722	722
query36	1079	966	958	958
query37	114	72	71	71
query38	4134	4052	3869	3869
query39	1544	1452	1452	1452
query40	204	93	92	92
query41	46	46	46	46
query42	109	103	98	98
query43	521	494	505	494
query44	1146	789	794	789
query45	181	179	174	174
query46	1138	728	722	722
query47	2011	1858	1930	1858
query48	488	374	392	374
query49	748	421	409	409
query50	833	411	411	411
query51	7058	7322	7077	7077
query52	97	89	90	89
query53	251	185	187	185
query54	562	452	451	451
query55	75	74	76	74
query56	257	248	260	248
query57	1235	1074	1093	1074
query58	220	202	203	202
query59	3137	3073	2931	2931
query60	286	256	258	256
query61	129	126	130	126
query62	788	675	673	673
query63	203	179	193	179
query64	1849	645	616	616
query65	3208	3193	3142	3142
query66	715	297	306	297
query67	15797	15220	15333	15220
query68	4605	538	549	538
query69	418	248	248	248
query70	1153	1097	1101	1097
query71	408	244	244	244
query72	6425	3922	3861	3861
query73	750	341	339	339
query74	10175	9009	8779	8779
query75	3356	2579	2607	2579
query76	2266	1010	1053	1010
query77	510	263	256	256
query78	10712	9724	9508	9508
query79	8341	575	568	568
query80	1801	423	409	409
query81	545	241	239	239
query82	1373	109	110	109
query83	258	137	140	137
query84	284	77	81	77
query85	1783	297	320	297
query86	465	301	284	284
query87	4552	4161	4162	4161
query88	5742	2378	2416	2378
query89	548	273	296	273
query90	2144	182	178	178
query91	172	137	137	137
query92	62	47	44	44
query93	6853	543	545	543
query94	904	282	276	276
query95	346	252	245	245
query96	621	279	283	279
query97	3348	3144	3130	3130
query98	213	197	200	197
query99	1678	1262	1280	1262
Total cold run time: 343012 ms
Total hot run time: 194327 ms

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40376 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6e72edd2195e6d936ac8fa3c0ca689fef8d62717, data reload: false

------ Round 1 ----------------------------------
q1	17573	7332	7219	7219
q2	2064	159	152	152
q3	10740	1131	1177	1131
q4	10556	742	772	742
q5	7708	2836	2713	2713
q6	230	142	144	142
q7	955	607	591	591
q8	9566	1949	1955	1949
q9	8339	6377	6369	6369
q10	6957	2279	2280	2279
q11	455	272	267	267
q12	396	219	215	215
q13	17806	2996	2956	2956
q14	234	212	200	200
q15	560	511	515	511
q16	672	608	602	602
q17	948	579	568	568
q18	7128	6599	6576	6576
q19	2511	1003	982	982
q20	482	200	206	200
q21	3870	3221	3050	3050
q22	1078	989	962	962
Total cold run time: 110828 ms
Total hot run time: 40376 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7341	7194	7123	7123
q2	329	226	222	222
q3	2980	2841	2858	2841
q4	2017	1790	1690	1690
q5	5655	5650	5702	5650
q6	222	138	144	138
q7	2138	1779	1762	1762
q8	3279	3520	3377	3377
q9	8801	8691	8798	8691
q10	3545	3496	3489	3489
q11	590	492	517	492
q12	810	584	620	584
q13	16406	3120	3117	3117
q14	303	288	272	272
q15	560	502	524	502
q16	729	660	665	660
q17	1819	1616	1601	1601
q18	8174	7729	7611	7611
q19	1726	1564	1582	1564
q20	2059	1837	1827	1827
q21	9396	5250	5150	5150
q22	1080	1037	1023	1023
Total cold run time: 79959 ms
Total hot run time: 59386 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195055 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6e72edd2195e6d936ac8fa3c0ca689fef8d62717, data reload: false

query1	1238	903	882	882
query2	6225	2123	2033	2033
query3	10751	3765	3735	3735
query4	68926	29669	23464	23464
query5	5394	451	442	442
query6	411	175	170	170
query7	5647	306	305	305
query8	296	226	241	226
query9	9162	2655	2650	2650
query10	516	277	260	260
query11	17800	15286	15587	15286
query12	162	100	101	100
query13	1519	432	418	418
query14	11198	6584	7615	6584
query15	224	184	181	181
query16	7295	521	516	516
query17	1282	577	579	577
query18	1878	315	309	309
query19	204	159	154	154
query20	119	106	123	106
query21	211	103	103	103
query22	4599	4490	4466	4466
query23	34635	33998	34056	33998
query24	6081	2883	2932	2883
query25	519	387	396	387
query26	671	164	158	158
query27	1960	293	303	293
query28	4649	2579	2546	2546
query29	681	435	438	435
query30	253	163	161	161
query31	1007	820	828	820
query32	65	52	54	52
query33	491	266	270	266
query34	901	508	504	504
query35	845	763	730	730
query36	1070	973	958	958
query37	116	70	72	70
query38	4105	3996	4002	3996
query39	1497	1470	1471	1470
query40	199	96	95	95
query41	47	45	47	45
query42	113	95	94	94
query43	541	496	497	496
query44	1182	775	802	775
query45	192	169	168	168
query46	1154	720	725	720
query47	1955	1894	1908	1894
query48	456	383	365	365
query49	747	388	362	362
query50	847	419	417	417
query51	7350	7195	7093	7093
query52	94	90	91	90
query53	250	194	186	186
query54	577	471	459	459
query55	77	75	78	75
query56	261	229	248	229
query57	1171	1094	1082	1082
query58	214	221	211	211
query59	3114	3037	2837	2837
query60	286	253	249	249
query61	119	109	110	109
query62	767	656	653	653
query63	205	197	190	190
query64	1757	648	621	621
query65	3249	3177	3150	3150
query66	704	300	293	293
query67	15831	15330	15490	15330
query68	4506	547	547	547
query69	408	251	255	251
query70	1187	1101	1123	1101
query71	343	247	254	247
query72	6520	3942	4035	3942
query73	746	335	329	329
query74	10348	8869	8955	8869
query75	3354	2660	2618	2618
query76	2066	1037	1053	1037
query77	486	265	269	265
query78	10586	9611	9401	9401
query79	7545	582	580	580
query80	1847	414	446	414
query81	552	251	245	245
query82	1662	117	121	117
query83	289	135	138	135
query84	287	80	74	74
query85	1163	302	288	288
query86	432	299	269	269
query87	4578	4324	4321	4321
query88	5807	2579	2405	2405
query89	537	288	286	286
query90	2175	180	185	180
query91	175	143	138	138
query92	65	45	50	45
query93	6369	556	543	543
query94	913	284	288	284
query95	344	257	258	257
query96	623	282	277	277
query97	3335	3131	3120	3120
query98	214	194	198	194
query99	1709	1294	1297	1294
Total cold run time: 339233 ms
Total hot run time: 195055 ms

@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40537 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bc121365bff4ac027fbeb1a338b252582b83931c, data reload: false

------ Round 1 ----------------------------------
q1	17785	7400	7311	7311
q2	2039	168	178	168
q3	10618	1111	1181	1111
q4	10230	765	746	746
q5	7750	2985	2734	2734
q6	233	144	149	144
q7	964	613	608	608
q8	9355	1911	1977	1911
q9	6797	6427	6448	6427
q10	7054	2276	2288	2276
q11	480	266	265	265
q12	465	210	205	205
q13	17769	2946	2937	2937
q14	226	207	203	203
q15	569	512	509	509
q16	705	589	592	589
q17	969	528	600	528
q18	7447	6639	6605	6605
q19	1705	1048	988	988
q20	470	201	194	194
q21	3906	3121	3090	3090
q22	1112	988	990	988
Total cold run time: 108648 ms
Total hot run time: 40537 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7292	7194	7191	7191
q2	314	221	218	218
q3	2875	2715	2718	2715
q4	1906	1644	1656	1644
q5	5366	5439	5423	5423
q6	215	134	136	134
q7	2064	1643	1644	1643
q8	3195	3338	3381	3338
q9	8464	8438	8428	8428
q10	3470	3423	3397	3397
q11	602	488	498	488
q12	767	575	574	574
q13	16898	2939	2949	2939
q14	281	263	255	255
q15	551	507	519	507
q16	691	645	632	632
q17	1832	1567	1575	1567
q18	7683	7509	7276	7276
q19	1637	1519	1509	1509
q20	1967	1791	1791	1791
q21	5178	4915	4979	4915
q22	1093	1000	985	985
Total cold run time: 74341 ms
Total hot run time: 57569 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189232 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bc121365bff4ac027fbeb1a338b252582b83931c, data reload: false

query1	987	389	366	366
query2	6501	2048	1985	1985
query3	6706	207	206	206
query4	33857	23412	23299	23299
query5	4292	435	416	416
query6	258	177	182	177
query7	4617	305	303	303
query8	276	214	208	208
query9	9594	2666	2657	2657
query10	476	261	254	254
query11	19774	15259	15173	15173
query12	156	99	103	99
query13	1648	429	399	399
query14	8637	6257	6566	6257
query15	209	171	173	171
query16	7729	505	446	446
query17	1448	555	571	555
query18	1969	305	297	297
query19	202	153	146	146
query20	116	108	110	108
query21	202	102	100	100
query22	4819	4582	4523	4523
query23	34529	33763	33702	33702
query24	12557	2861	2883	2861
query25	725	407	416	407
query26	1892	164	163	163
query27	3059	302	294	294
query28	8315	2511	2474	2474
query29	1147	457	436	436
query30	324	155	157	155
query31	1042	817	806	806
query32	94	56	55	55
query33	770	284	276	276
query34	1016	494	497	494
query35	838	713	707	707
query36	1107	939	918	918
query37	279	73	71	71
query38	3911	3837	3807	3807
query39	1631	1413	1407	1407
query40	285	99	100	99
query41	51	50	48	48
query42	107	102	98	98
query43	534	485	484	484
query44	1232	781	800	781
query45	180	162	174	162
query46	1125	709	746	709
query47	1930	1810	1808	1808
query48	457	375	363	363
query49	1308	388	387	387
query50	792	410	409	409
query51	6991	7165	7024	7024
query52	97	99	91	91
query53	254	183	185	183
query54	1188	464	454	454
query55	76	77	79	77
query56	264	252	245	245
query57	1216	1097	1129	1097
query58	243	205	213	205
query59	3090	2833	3026	2833
query60	292	251	252	251
query61	142	102	102	102
query62	890	669	662	662
query63	210	180	181	180
query64	5237	652	610	610
query65	3259	3170	3182	3170
query66	1424	331	295	295
query67	15952	15391	15465	15391
query68	4684	544	547	544
query69	428	252	252	252
query70	1168	1128	1129	1128
query71	425	251	254	251
query72	6652	3901	3857	3857
query73	738	342	344	342
query74	10184	8890	8983	8890
query75	3446	2610	2624	2610
query76	3142	1026	928	928
query77	440	258	257	257
query78	10709	9769	9489	9489
query79	9423	582	592	582
query80	2126	417	405	405
query81	568	234	238	234
query82	1350	111	112	111
query83	273	133	137	133
query84	289	75	84	75
query85	2341	320	286	286
query86	490	296	306	296
query87	4369	4217	4205	4205
query88	5956	2385	2409	2385
query89	555	286	287	286
query90	2118	176	180	176
query91	173	140	142	140
query92	58	48	49	48
query93	7571	553	542	542
query94	897	273	286	273
query95	339	242	243	242
query96	617	278	274	274
query97	3313	3219	3113	3113
query98	207	199	195	195
query99	1644	1312	1287	1287
Total cold run time: 323228 ms
Total hot run time: 189232 ms

@starocean999 starocean999 marked this pull request as ready for review November 28, 2024 14:29
@starocean999
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40463 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit efd471206677c67747445afecd5f805f6f1f9691, data reload: false

------ Round 1 ----------------------------------
q1	17608	7404	7283	7283
q2	2059	156	152	152
q3	10578	1109	1117	1109
q4	10215	768	701	701
q5	7717	2769	2743	2743
q6	238	146	145	145
q7	972	605	612	605
q8	9347	1896	1979	1896
q9	6639	6354	6353	6353
q10	6977	2280	2306	2280
q11	465	264	269	264
q12	414	215	214	214
q13	17777	2963	2953	2953
q14	243	208	211	208
q15	553	518	524	518
q16	672	605	601	601
q17	965	597	533	533
q18	7296	6605	6646	6605
q19	1399	996	1071	996
q20	479	196	196	196
q21	4048	3133	3172	3133
q22	1087	975	982	975
Total cold run time: 107748 ms
Total hot run time: 40463 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7292	7246	7201	7201
q2	322	233	222	222
q3	2856	2812	2894	2812
q4	1975	1771	1692	1692
q5	5419	5718	5723	5718
q6	222	140	139	139
q7	2140	1769	1795	1769
q8	3352	3466	3495	3466
q9	8824	8732	8813	8732
q10	3525	3526	3469	3469
q11	611	509	501	501
q12	802	571	649	571
q13	16942	3199	3134	3134
q14	307	284	292	284
q15	557	513	503	503
q16	707	655	648	648
q17	1808	1590	1573	1573
q18	8011	7733	7624	7624
q19	1692	1465	1612	1465
q20	2064	1847	1846	1846
q21	5338	5225	5327	5225
q22	1093	1032	1035	1032
Total cold run time: 75859 ms
Total hot run time: 59626 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190663 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit efd471206677c67747445afecd5f805f6f1f9691, data reload: false

query1	964	369	358	358
query2	6509	2041	2055	2041
query3	6647	211	214	211
query4	33683	23367	23426	23367
query5	4250	443	420	420
query6	265	174	181	174
query7	4615	311	311	311
query8	300	220	222	220
query9	9493	2675	2682	2675
query10	477	260	272	260
query11	18052	15237	15112	15112
query12	150	103	102	102
query13	1634	442	411	411
query14	9920	7412	7457	7412
query15	235	162	174	162
query16	8024	459	461	459
query17	1438	569	563	563
query18	2128	314	312	312
query19	229	171	156	156
query20	128	121	112	112
query21	199	107	99	99
query22	4865	4661	4420	4420
query23	35267	34172	34297	34172
query24	11701	2964	2888	2888
query25	610	394	399	394
query26	727	163	162	162
query27	2162	291	287	287
query28	6614	2503	2493	2493
query29	775	463	437	437
query30	318	157	147	147
query31	1055	805	822	805
query32	94	73	50	50
query33	753	267	263	263
query34	967	488	494	488
query35	836	709	722	709
query36	1105	950	901	901
query37	113	72	68	68
query38	4056	3766	3816	3766
query39	1484	1405	1439	1405
query40	202	97	90	90
query41	46	45	43	43
query42	104	97	94	94
query43	521	490	471	471
query44	1252	776	785	776
query45	185	159	162	159
query46	1155	731	717	717
query47	1872	1810	1805	1805
query48	466	354	353	353
query49	1037	363	357	357
query50	802	409	410	409
query51	7209	6906	6897	6897
query52	102	88	89	88
query53	260	178	176	176
query54	1200	450	444	444
query55	76	75	75	75
query56	260	248	228	228
query57	1207	1099	1112	1099
query58	228	194	195	194
query59	3087	2845	2807	2807
query60	269	266	245	245
query61	100	97	101	97
query62	868	655	648	648
query63	205	180	183	180
query64	3972	643	607	607
query65	3261	3152	3190	3152
query66	836	306	286	286
query67	15799	15569	15192	15192
query68	4521	561	547	547
query69	427	255	249	249
query70	1153	1148	1126	1126
query71	328	255	252	252
query72	6467	3945	3905	3905
query73	752	335	344	335
query74	10273	8754	8976	8754
query75	3334	2638	2642	2638
query76	2874	1095	1161	1095
query77	404	261	277	261
query78	10594	9634	9856	9634
query79	6638	595	585	585
query80	2082	420	417	417
query81	589	239	238	238
query82	1054	121	119	119
query83	258	134	137	134
query84	293	79	72	72
query85	2171	315	291	291
query86	479	292	304	292
query87	4364	4189	4321	4189
query88	5335	2400	2415	2400
query89	433	285	295	285
query90	2006	178	180	178
query91	172	139	139	139
query92	64	47	49	47
query93	5302	565	545	545
query94	890	277	287	277
query95	348	251	251	251
query96	651	277	289	277
query97	3333	3207	3151	3151
query98	219	197	196	196
query99	1879	1438	1303	1303
Total cold run time: 309110 ms
Total hot run time: 190663 ms

@morrySnow morrySnow merged commit 8e2c581 into apache:branch-3.0 Dec 2, 2024
18 of 20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants