Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-2.0: [fix](create table) fix create table fail msg #45623 #45653

Merged

Conversation

yujun777
Copy link
Collaborator

cherry pick from #45623

@yujun777
Copy link
Collaborator Author

run buildall

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yujun777 yujun777 changed the title [fix](create table) fix create table fail msg #45623 branch-2.0: [fix](create table) fix create table fail msg #45623 Dec 19, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49550 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 6dc1ba0b7a667bfcf328d494fc65992c15f94d7c, data reload: false

------ Round 1 ----------------------------------
q1	17671	4420	4352	4352
q2	2061	160	144	144
q3	10500	1925	1899	1899
q4	10357	1323	1361	1323
q5	8490	3862	3988	3862
q6	231	126	124	124
q7	2022	1604	1614	1604
q8	9328	2734	2733	2733
q9	10634	10011	10259	10011
q10	8656	3553	3542	3542
q11	428	259	260	259
q12	483	293	303	293
q13	18371	4041	4074	4041
q14	369	333	333	333
q15	515	463	447	447
q16	555	444	449	444
q17	1137	949	935	935
q18	7247	6917	6952	6917
q19	1704	1533	1488	1488
q20	526	318	294	294
q21	4406	4218	4103	4103
q22	496	402	411	402
Total cold run time: 116187 ms
Total hot run time: 49550 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4416	4290	4312	4290
q2	330	223	225	223
q3	4190	4175	4172	4172
q4	2774	2759	2741	2741
q5	7180	7148	7109	7109
q6	241	118	120	118
q7	3199	2815	2868	2815
q8	4383	4541	4488	4488
q9	14278	13946	13890	13890
q10	4225	4288	4261	4261
q11	741	684	691	684
q12	1043	855	841	841
q13	6334	3775	3772	3772
q14	456	438	435	435
q15	505	453	454	453
q16	638	602	589	589
q17	3862	3838	3864	3838
q18	8741	8781	8686	8686
q19	1731	1701	1618	1618
q20	2357	2090	2118	2090
q21	8540	8448	8379	8379
q22	1073	909	925	909
Total cold run time: 81237 ms
Total hot run time: 76401 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212921 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 6dc1ba0b7a667bfcf328d494fc65992c15f94d7c, data reload: false

query1	943	428	387	387
query2	6550	2275	2062	2062
query3	6918	202	205	202
query4	23141	21454	21757	21454
query5	19743	6515	6544	6515
query6	298	212	234	212
query7	4348	300	315	300
query8	256	274	241	241
query9	3061	2656	2576	2576
query10	465	321	299	299
query11	15608	15222	15090	15090
query12	120	77	78	77
query13	1019	445	446	445
query14	17295	13503	13239	13239
query15	391	228	223	223
query16	6458	291	271	271
query17	1737	962	857	857
query18	904	321	310	310
query19	219	158	148	148
query20	103	98	106	98
query21	196	106	98	98
query22	5300	5117	5097	5097
query23	34470	33660	33398	33398
query24	7707	6350	6289	6289
query25	537	420	441	420
query26	1279	161	164	161
query27	2340	302	289	289
query28	6055	2284	2262	2262
query29	2902	2709	2738	2709
query30	241	167	169	167
query31	949	781	775	775
query32	71	62	61	61
query33	451	275	264	264
query34	854	463	468	463
query35	1158	976	976	976
query36	1414	1441	1220	1220
query37	169	65	60	60
query38	3103	2941	2922	2922
query39	1360	1332	1317	1317
query40	310	95	98	95
query41	41	38	38	38
query42	96	92	92	92
query43	570	577	580	577
query44	1219	718	718	718
query45	243	235	233	233
query46	1259	956	970	956
query47	1929	1811	1906	1811
query48	520	415	431	415
query49	657	388	387	387
query50	850	660	606	606
query51	4755	4625	4656	4625
query52	92	81	81	81
query53	227	184	184	184
query54	2663	2487	2466	2466
query55	91	89	80	80
query56	229	198	215	198
query57	1387	1279	1133	1133
query58	214	217	197	197
query59	3761	3553	3354	3354
query60	218	221	203	203
query61	99	94	97	94
query62	864	534	457	457
query63	197	177	176	176
query64	3594	1604	1520	1520
query65	3616	3581	3548	3548
query66	779	400	449	400
query67	15705	17057	15283	15283
query68	9519	650	643	643
query69	507	285	266	266
query70	1556	1279	1594	1279
query71	402	296	305	296
query72	6863	4906	4839	4839
query73	763	317	325	317
query74	6368	5859	5843	5843
query75	5066	3646	3742	3646
query76	5147	1138	1148	1138
query77	905	257	259	257
query78	13003	12687	11857	11857
query79	10791	651	654	651
query80	776	395	392	392
query81	492	236	240	236
query82	696	95	94	94
query83	182	130	135	130
query84	257	71	69	69
query85	888	325	332	325
query86	318	285	328	285
query87	3348	3084	3051	3051
query88	4710	2295	2300	2295
query89	425	293	304	293
query90	2642	209	216	209
query91	160	128	128	128
query92	58	52	54	52
query93	6065	557	533	533
query94	927	213	206	206
query95	2076	2054	2044	2044
query96	657	328	325	325
query97	6495	6498	6263	6263
query98	240	205	206	205
query99	3098	1029	873	873
Total cold run time: 321718 ms
Total hot run time: 212921 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.8 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 6dc1ba0b7a667bfcf328d494fc65992c15f94d7c, data reload: false

query1	0.02	0.02	0.02
query2	0.07	0.03	0.03
query3	0.25	0.05	0.04
query4	1.78	0.06	0.05
query5	0.54	0.53	0.52
query6	1.24	0.63	0.63
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.49
query10	0.54	0.55	0.53
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.61	0.62	0.60
query14	0.78	0.79	0.79
query15	0.78	0.76	0.77
query16	0.38	0.37	0.36
query17	1.02	1.03	0.99
query18	0.19	0.29	0.25
query19	1.96	1.85	1.83
query20	0.01	0.02	0.01
query21	15.44	0.55	0.57
query22	2.05	2.24	1.61
query23	17.27	1.13	0.98
query24	4.98	1.79	0.93
query25	0.36	0.13	0.04
query26	0.61	0.16	0.15
query27	0.05	0.04	0.03
query28	7.53	0.73	0.73
query29	12.60	2.30	2.33
query30	0.63	0.60	0.53
query31	2.81	0.40	0.37
query32	3.36	0.50	0.49
query33	3.04	3.05	3.08
query34	15.29	4.83	4.81
query35	4.89	4.86	4.88
query36	1.07	1.02	1.02
query37	0.06	0.05	0.04
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.17	0.14	0.14
query41	0.07	0.02	0.01
query42	0.03	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 103.36 s
Total hot run time: 30.8 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 6dc1ba0b7a667bfcf328d494fc65992c15f94d7c with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.3 seconds inserted 10000000 Rows, about 469K ops/s

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49043 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 77f94ad87d0ca8e0e0321588aa4c26f57e7cfbca, data reload: false

------ Round 1 ----------------------------------
q1	18105	4363	4382	4363
q2	2047	151	150	150
q3	10440	1892	1922	1892
q4	10326	1265	1328	1265
q5	8811	3874	3936	3874
q6	228	146	134	134
q7	2030	1598	1575	1575
q8	9314	2724	2701	2701
q9	10480	9943	9816	9816
q10	8592	3524	3530	3524
q11	432	243	251	243
q12	460	304	300	300
q13	18377	3966	4043	3966
q14	369	320	334	320
q15	507	460	463	460
q16	545	454	457	454
q17	1144	973	959	959
q18	7255	6808	6931	6808
q19	1679	1544	1561	1544
q20	538	300	314	300
q21	4394	4171	4015	4015
q22	504	391	380	380
Total cold run time: 116577 ms
Total hot run time: 49043 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4367	4269	4315	4269
q2	321	226	221	221
q3	4153	4116	4082	4082
q4	2733	2727	2729	2727
q5	7165	7173	7130	7130
q6	240	121	121	121
q7	3205	2793	2824	2793
q8	4368	4431	4512	4431
q9	14182	13894	13941	13894
q10	4240	4303	4254	4254
q11	759	674	711	674
q12	1031	821	854	821
q13	7003	3771	3746	3746
q14	450	435	424	424
q15	499	458	464	458
q16	621	582	623	582
q17	3815	3794	3820	3794
q18	8817	8573	8804	8573
q19	1728	1646	1675	1646
q20	2348	2108	2124	2108
q21	8485	8487	8375	8375
q22	1006	946	925	925
Total cold run time: 81536 ms
Total hot run time: 76048 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 213319 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 77f94ad87d0ca8e0e0321588aa4c26f57e7cfbca, data reload: false

query1	963	392	377	377
query2	6560	2209	2327	2209
query3	6918	197	205	197
query4	23461	21362	21590	21362
query5	19734	6545	6528	6528
query6	292	223	245	223
query7	4334	297	308	297
query8	259	251	281	251
query9	3053	2637	2567	2567
query10	465	304	298	298
query11	15616	14860	15158	14860
query12	124	75	73	73
query13	1048	462	449	449
query14	18359	13685	13591	13591
query15	392	221	231	221
query16	6479	286	269	269
query17	1929	957	897	897
query18	896	319	317	317
query19	218	153	147	147
query20	100	97	95	95
query21	191	99	97	97
query22	5228	5011	4983	4983
query23	34199	33458	33397	33397
query24	7806	6324	6343	6324
query25	519	447	425	425
query26	1262	164	158	158
query27	2435	298	296	296
query28	6059	2289	2262	2262
query29	2930	2692	2700	2692
query30	243	167	162	162
query31	954	719	751	719
query32	69	66	60	60
query33	467	253	269	253
query34	881	483	477	477
query35	1133	960	908	908
query36	1318	1218	1225	1218
query37	175	62	63	62
query38	3060	2902	2892	2892
query39	1379	1319	1335	1319
query40	306	93	93	93
query41	41	40	37	37
query42	89	96	85	85
query43	608	557	613	557
query44	1182	712	726	712
query45	249	228	234	228
query46	1231	950	948	948
query47	1945	1841	1775	1775
query48	509	426	417	417
query49	666	384	395	384
query50	854	611	605	605
query51	4770	4707	4680	4680
query52	88	73	85	73
query53	227	184	200	184
query54	2639	2458	2483	2458
query55	99	79	88	79
query56	236	224	206	206
query57	1269	1138	1134	1134
query58	225	212	221	212
query59	3561	3447	3253	3253
query60	223	213	208	208
query61	99	96	99	96
query62	882	494	498	494
query63	210	176	174	174
query64	3509	1602	1517	1517
query65	3637	3542	3560	3542
query66	775	422	402	402
query67	15487	14965	15548	14965
query68	10145	666	655	655
query69	497	299	254	254
query70	1697	1341	1438	1341
query71	416	317	310	310
query72	6830	4952	4931	4931
query73	769	330	324	324
query74	6303	5776	5777	5776
query75	5275	3673	3752	3673
query76	5840	1128	1207	1128
query77	991	256	260	256
query78	12704	12925	12401	12401
query79	11216	663	652	652
query80	778	416	392	392
query81	494	241	237	237
query82	471	103	101	101
query83	185	137	134	134
query84	257	70	70	70
query85	867	333	322	322
query86	336	301	311	301
query87	3328	3024	3024	3024
query88	4859	2316	2313	2313
query89	379	283	303	283
query90	2634	211	214	211
query91	163	135	129	129
query92	63	51	51	51
query93	4494	560	578	560
query94	1232	215	212	212
query95	2044	2019	2039	2019
query96	653	325	326	325
query97	6542	6466	6454	6454
query98	229	205	214	205
query99	2982	888	825	825
Total cold run time: 322797 ms
Total hot run time: 213319 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 77f94ad87d0ca8e0e0321588aa4c26f57e7cfbca, data reload: false

query1	0.02	0.02	0.03
query2	0.07	0.02	0.02
query3	0.25	0.05	0.04
query4	1.77	0.05	0.06
query5	0.53	0.52	0.52
query6	1.23	0.64	0.62
query7	0.02	0.01	0.01
query8	0.04	0.02	0.03
query9	0.52	0.49	0.48
query10	0.52	0.53	0.54
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.62	0.60	0.60
query14	0.79	0.77	0.78
query15	0.78	0.75	0.76
query16	0.37	0.37	0.38
query17	1.02	0.99	1.01
query18	0.22	0.27	0.22
query19	1.96	1.86	1.83
query20	0.02	0.01	0.01
query21	15.45	0.57	0.58
query22	2.28	2.04	1.53
query23	17.18	1.10	0.96
query24	6.79	0.67	0.82
query25	0.37	0.09	0.06
query26	0.70	0.15	0.16
query27	0.05	0.04	0.03
query28	6.94	0.75	0.72
query29	12.68	2.35	2.35
query30	0.62	0.54	0.53
query31	2.81	0.39	0.39
query32	3.35	0.50	0.49
query33	3.05	3.08	3.07
query34	15.27	4.81	4.81
query35	4.87	4.92	4.88
query36	1.07	1.01	1.00
query37	0.06	0.05	0.04
query38	0.04	0.02	0.03
query39	0.02	0.01	0.01
query40	0.16	0.14	0.15
query41	0.07	0.02	0.01
query42	0.02	0.01	0.02
query43	0.03	0.02	0.02
Total cold run time: 104.87 s
Total hot run time: 30.49 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 77f94ad87d0ca8e0e0321588aa4c26f57e7cfbca with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.6 seconds inserted 10000000 Rows, about 462K ops/s

@yiguolei yiguolei merged commit fdff4a6 into apache:branch-2.0 Dec 20, 2024
21 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants