Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[enhance](nerieds) date_format, to_monday, last_day, to_date, year implement Monotonic #44789

Merged
merged 8 commits into from
Dec 26, 2024
Merged

[enhance](nerieds) date_format, to_monday, last_day, to_date, year implement Monotonic #44789

merged 8 commits into from
Dec 26, 2024

Conversation

feiniaofeiafei
Copy link
Contributor

@feiniaofeiafei feiniaofeiafei commented Nov 29, 2024 •
edited
Loading

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:
This pr implement Monotonic for date_format, to_monday, last_day, to_date, year, which will allow partition pruning on partition column with there functions.

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason

  • Behavior changed:

    • No.
    • Yes.

  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40062 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4f5a5fc6f6674f2bc4111ec4f338a35462659932, data reload: false

------ Round 1 ----------------------------------
q1	17597	8155	7295	7295
q2	2044	202	167	167
q3	10578	1088	1241	1088
q4	10540	734	743	734
q5	7600	2739	2737	2737
q6	239	153	144	144
q7	998	626	600	600
q8	9246	1910	1945	1910
q9	6574	6429	6434	6429
q10	6977	2299	2340	2299
q11	465	268	272	268
q12	434	225	224	224
q13	17780	3010	3038	3010
q14	263	209	210	209
q15	573	527	516	516
q16	667	592	582	582
q17	971	523	530	523
q18	7429	6759	6844	6759
q19	1346	970	1036	970
q20	483	184	179	179
q21	3975	3111	3254	3111
q22	390	315	308	308
Total cold run time: 107169 ms
Total hot run time: 40062 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7271	7211	7225	7211
q2	326	235	231	231
q3	2909	2814	2880	2814
q4	2116	1800	1820	1800
q5	5694	5681	5696	5681
q6	220	138	139	138
q7	2259	1830	1883	1830
q8	3414	3574	3502	3502
q9	9120	9137	9090	9090
q10	3590	3581	3556	3556
q11	607	501	498	498
q12	788	621	604	604
q13	11259	3236	3185	3185
q14	313	291	278	278
q15	578	528	532	528
q16	685	658	627	627
q17	1873	1658	1629	1629
q18	8264	7899	7666	7666
q19	1752	1601	1583	1583
q20	2128	1899	1866	1866
q21	5786	5485	5492	5485
q22	727	592	576	576
Total cold run time: 71679 ms
Total hot run time: 60378 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196683 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4f5a5fc6f6674f2bc4111ec4f338a35462659932, data reload: false

query1	1245	971	936	936
query2	6223	2026	2019	2019
query3	10991	4396	4294	4294
query4	66318	28776	23657	23657
query5	5219	460	439	439
query6	449	210	182	182
query7	5738	326	288	288
query8	300	212	226	212
query9	9464	2724	2693	2693
query10	460	238	238	238
query11	17442	15293	15965	15293
query12	171	108	104	104
query13	1550	420	429	420
query14	10575	7514	6551	6551
query15	219	192	181	181
query16	7038	501	509	501
query17	1090	587	584	584
query18	1827	318	304	304
query19	213	168	157	157
query20	123	113	110	110
query21	212	107	104	104
query22	4576	4708	4653	4653
query23	34723	34515	34492	34492
query24	5752	2482	2428	2428
query25	493	384	379	379
query26	639	149	149	149
query27	1960	291	298	291
query28	4091	2505	2480	2480
query29	692	424	400	400
query30	210	163	151	151
query31	1006	829	817	817
query32	70	56	57	56
query33	405	280	293	280
query34	922	530	504	504
query35	909	767	760	760
query36	1079	966	973	966
query37	123	74	78	74
query38	4561	4416	4390	4390
query39	1538	1475	1463	1463
query40	196	102	128	102
query41	48	46	45	45
query42	116	100	94	94
query43	530	500	495	495
query44	1167	838	845	838
query45	190	181	170	170
query46	1184	740	728	728
query47	2005	1955	1927	1927
query48	450	343	338	338
query49	718	398	369	369
query50	853	389	390	389
query51	7442	7200	7187	7187
query52	94	92	86	86
query53	248	174	171	171
query54	498	413	394	394
query55	78	76	75	75
query56	250	238	230	230
query57	1228	1138	1093	1093
query58	211	201	198	198
query59	3230	3074	2964	2964
query60	260	240	242	240
query61	110	103	121	103
query62	758	674	667	667
query63	207	186	178	178
query64	1365	682	628	628
query65	3312	3260	3245	3245
query66	638	302	304	302
query67	15948	15577	15665	15577
query68	4273	580	544	544
query69	409	248	250	248
query70	1195	1127	1139	1127
query71	348	249	252	249
query72	6466	4051	4097	4051
query73	758	367	363	363
query74	10090	9052	9043	9043
query75	3396	2686	2665	2665
query76	1876	1014	1073	1014
query77	492	271	265	265
query78	10469	9323	9465	9323
query79	2228	582	600	582
query80	879	417	421	417
query81	512	237	228	228
query82	316	116	114	114
query83	227	149	144	144
query84	266	72	70	70
query85	1078	298	305	298
query86	450	295	301	295
query87	4648	4519	4537	4519
query88	4238	2208	2173	2173
query89	419	306	286	286
query90	1959	191	185	185
query91	136	103	100	100
query92	64	50	60	50
query93	2314	544	527	527
query94	771	292	292	292
query95	355	246	243	243
query96	624	278	275	275
query97	2841	2668	2678	2668
query98	222	194	202	194
query99	1609	1306	1298	1298
Total cold run time: 319878 ms
Total hot run time: 196683 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.11 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4f5a5fc6f6674f2bc4111ec4f338a35462659932, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.08	0.07
query4	1.61	0.10	0.11
query5	0.42	0.39	0.42
query6	1.16	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.57	0.52	0.51
query10	0.54	0.56	0.55
query11	0.14	0.10	0.10
query12	0.14	0.11	0.12
query13	0.62	0.61	0.60
query14	2.70	2.71	2.70
query15	0.90	0.83	0.82
query16	0.37	0.37	0.37
query17	1.04	1.01	1.01
query18	0.24	0.20	0.20
query19	1.90	1.82	1.87
query20	0.02	0.01	0.01
query21	15.36	0.58	0.58
query22	2.54	2.20	3.05
query23	17.31	0.94	0.82
query24	2.82	1.16	1.19
query25	0.16	0.15	0.04
query26	0.59	0.14	0.13
query27	0.05	0.04	0.05
query28	10.65	1.10	1.09
query29	12.53	3.30	3.29
query30	0.24	0.06	0.06
query31	2.86	0.38	0.38
query32	3.29	0.46	0.47
query33	2.96	3.04	3.06
query34	17.01	4.49	4.46
query35	4.51	4.47	4.55
query36	0.66	0.49	0.48
query37	0.09	0.06	0.05
query38	0.05	0.03	0.03
query39	0.04	0.02	0.03
query40	0.17	0.13	0.14
query41	0.09	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.82 s
Total hot run time: 33.11 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@feiniaofeiafei feiniaofeiafei changed the title [enhance](nerieds) data_format, to_monday, last_day, to_date, year implement Monotonic [enhance](nerieds) date_format, to_monday, last_day, to_date, year implement Monotonic Dec 19, 2024
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39863 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 29e6ca9e1fb09f56396cbfe4ddbc6e313322b31a, data reload: false

------ Round 1 ----------------------------------
q1	17605	7493	7310	7310
q2	2054	184	166	166
q3	10603	1143	1133	1133
q4	10225	765	802	765
q5	7613	2679	2622	2622
q6	236	147	151	147
q7	978	613	611	611
q8	9247	1849	1929	1849
q9	6586	6413	6394	6394
q10	7016	2318	2303	2303
q11	484	271	263	263
q12	446	229	222	222
q13	17786	2960	2940	2940
q14	251	209	217	209
q15	541	505	497	497
q16	657	578	576	576
q17	970	590	495	495
q18	7324	6789	6734	6734
q19	1327	995	1010	995
q20	494	187	183	183
q21	3969	3149	3268	3149
q22	376	300	312	300
Total cold run time: 106788 ms
Total hot run time: 39863 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7224	7247	7215	7215
q2	332	236	242	236
q3	2889	2731	2973	2731
q4	2188	1892	1833	1833
q5	5523	5649	5617	5617
q6	254	143	138	138
q7	2202	1803	1782	1782
q8	3318	3520	3471	3471
q9	8955	8888	8920	8888
q10	3619	3558	3545	3545
q11	605	523	504	504
q12	809	605	629	605
q13	12199	3219	3279	3219
q14	322	283	285	283
q15	560	514	513	513
q16	699	653	653	653
q17	1893	1590	1570	1570
q18	7926	7409	7315	7315
q19	1690	1439	1457	1439
q20	2059	1795	1887	1795
q21	5434	5128	5373	5128
q22	643	567	569	567
Total cold run time: 71343 ms
Total hot run time: 59047 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 189310 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 29e6ca9e1fb09f56396cbfe4ddbc6e313322b31a, data reload: false

query1	979	387	386	386
query2	6538	2341	2245	2245
query3	6706	222	218	218
query4	34264	23786	23400	23400
query5	4371	468	452	452
query6	284	197	188	188
query7	4638	306	304	304
query8	318	239	240	239
query9	9875	2700	2716	2700
query10	455	253	258	253
query11	17986	15375	15004	15004
query12	152	102	102	102
query13	1660	398	405	398
query14	10663	6754	7056	6754
query15	260	173	186	173
query16	7836	428	421	421
query17	1577	557	569	557
query18	2070	288	295	288
query19	335	156	147	147
query20	118	110	114	110
query21	214	101	101	101
query22	4457	4067	4163	4067
query23	34426	33598	33243	33243
query24	11550	2505	2439	2439
query25	670	409	413	409
query26	1870	168	160	160
query27	2916	340	330	330
query28	8159	2401	2389	2389
query29	996	393	427	393
query30	301	145	154	145
query31	1052	831	820	820
query32	131	59	60	59
query33	778	317	289	289
query34	961	506	522	506
query35	875	741	744	741
query36	1092	945	946	945
query37	255	79	70	70
query38	4262	4151	4125	4125
query39	1519	1613	1436	1436
query40	296	102	102	102
query41	54	44	50	44
query42	120	102	100	100
query43	532	501	492	492
query44	1270	822	815	815
query45	193	162	165	162
query46	1169	720	700	700
query47	1950	1847	1851	1847
query48	408	326	317	317
query49	1288	391	411	391
query50	796	380	395	380
query51	7292	7180	7081	7081
query52	101	94	89	89
query53	260	185	185	185
query54	1076	407	412	407
query55	81	79	82	79
query56	254	253	240	240
query57	1244	1132	1134	1132
query58	239	219	235	219
query59	3157	3140	2946	2946
query60	271	257	252	252
query61	111	104	107	104
query62	892	685	687	685
query63	220	194	197	194
query64	5216	647	649	647
query65	3304	3213	3275	3213
query66	1427	307	314	307
query67	15734	15542	15475	15475
query68	4920	546	554	546
query69	442	269	254	254
query70	1156	1158	1114	1114
query71	344	250	260	250
query72	6458	4344	4012	4012
query73	790	359	357	357
query74	10425	8777	8845	8777
query75	3412	2616	2652	2616
query76	3010	1139	1011	1011
query77	512	277	282	277
query78	10226	9469	9519	9469
query79	1353	598	602	598
query80	1046	528	417	417
query81	514	231	227	227
query82	981	121	128	121
query83	248	154	148	148
query84	234	67	72	67
query85	1318	301	302	301
query86	368	310	311	310
query87	4523	4428	4449	4428
query88	3505	2241	2198	2198
query89	415	294	305	294
query90	2053	196	192	192
query91	135	106	106	106
query92	62	54	54	54
query93	1108	533	528	528
query94	1117	296	287	287
query95	367	255	263	255
query96	621	275	279	275
query97	2889	2678	2683	2678
query98	224	192	205	192
query99	1582	1345	1340	1340
Total cold run time: 302882 ms
Total hot run time: 189310 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.2 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 29e6ca9e1fb09f56396cbfe4ddbc6e313322b31a, data reload: false

query1	0.03	0.03	0.05
query2	0.07	0.03	0.03
query3	0.23	0.06	0.07
query4	1.61	0.11	0.10
query5	0.41	0.41	0.43
query6	1.15	0.65	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.58	0.52	0.49
query10	0.55	0.59	0.56
query11	0.15	0.11	0.10
query12	0.15	0.12	0.11
query13	0.60	0.61	0.60
query14	2.84	2.88	2.72
query15	0.89	0.82	0.81
query16	0.39	0.40	0.37
query17	1.07	0.98	1.00
query18	0.23	0.21	0.21
query19	1.97	1.75	1.97
query20	0.01	0.02	0.01
query21	15.36	0.60	0.57
query22	2.70	2.15	2.99
query23	16.94	0.96	0.90
query24	3.69	1.29	1.28
query25	0.20	0.11	0.11
query26	0.46	0.14	0.14
query27	0.04	0.05	0.04
query28	9.90	1.12	1.09
query29	12.58	3.28	3.21
query30	0.24	0.06	0.06
query31	2.87	0.39	0.38
query32	3.25	0.47	0.45
query33	3.12	3.33	3.10
query34	17.13	4.45	4.55
query35	4.53	4.47	4.50
query36	0.68	0.48	0.49
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.18 s
Total hot run time: 33.2 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 39622 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8c84c5473b0a4e3f389bbb116292e874187bb636, data reload: false

------ Round 1 ----------------------------------
q1	17567	7412	7251	7251
q2	2054	190	179	179
q3	10570	1073	1134	1073
q4	10548	713	736	713
q5	7585	2663	2689	2663
q6	239	150	149	149
q7	1006	634	608	608
q8	9249	1794	1866	1794
q9	6583	6390	6401	6390
q10	7016	2304	2261	2261
q11	470	265	270	265
q12	431	231	220	220
q13	17792	2988	2965	2965
q14	251	213	220	213
q15	554	494	493	493
q16	647	582	580	580
q17	966	594	510	510
q18	7219	6731	6730	6730
q19	1370	1017	899	899
q20	470	187	188	187
q21	4072	3352	3167	3167
q22	386	312	340	312
Total cold run time: 107045 ms
Total hot run time: 39622 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7172	7188	7182	7182
q2	325	233	227	227
q3	2894	2776	2896	2776
q4	2114	1856	1828	1828
q5	5660	5619	5620	5619
q6	217	139	148	139
q7	2225	1859	1804	1804
q8	3332	3512	3469	3469
q9	8983	9045	9017	9017
q10	3582	3555	3525	3525
q11	595	501	513	501
q12	842	597	591	591
q13	12716	3119	3145	3119
q14	310	269	281	269
q15	550	503	499	499
q16	697	661	639	639
q17	1855	1643	1647	1643
q18	8267	7805	7617	7617
q19	1672	1405	1468	1405
q20	2047	1837	1854	1837
q21	5680	5428	5551	5428
q22	664	590	573	573
Total cold run time: 72399 ms
Total hot run time: 59707 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196395 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8c84c5473b0a4e3f389bbb116292e874187bb636, data reload: false

query1	1333	942	915	915
query2	6263	2255	2389	2255
query3	11120	4583	4807	4583
query4	33374	23786	23392	23392
query5	5072	484	452	452
query6	294	222	202	202
query7	4007	303	310	303
query8	312	278	256	256
query9	9654	2726	2720	2720
query10	506	260	266	260
query11	17974	15220	15126	15126
query12	164	106	108	106
query13	1768	443	416	416
query14	10899	6621	7237	6621
query15	268	196	198	196
query16	8135	455	502	455
query17	1605	605	614	605
query18	2182	300	310	300
query19	368	162	161	161
query20	119	116	119	116
query21	217	115	111	111
query22	4574	4524	4426	4426
query23	34685	33804	33680	33680
query24	10868	2551	2630	2551
query25	639	401	414	401
query26	1281	160	156	156
query27	2798	336	347	336
query28	7118	2468	2438	2438
query29	873	433	418	418
query30	239	151	156	151
query31	1043	855	847	847
query32	102	61	85	61
query33	783	326	300	300
query34	1136	531	523	523
query35	902	761	755	755
query36	1183	975	974	974
query37	153	77	77	77
query38	4416	4247	4253	4247
query39	1669	1480	1484	1480
query40	212	111	105	105
query41	45	45	45	45
query42	129	107	105	105
query43	557	508	500	500
query44	1279	823	839	823
query45	195	172	187	172
query46	1262	750	786	750
query47	2055	1928	1919	1919
query48	432	329	352	329
query49	978	415	417	415
query50	911	417	412	412
query51	7377	7124	7186	7124
query52	106	106	98	98
query53	289	201	199	199
query54	1042	439	430	430
query55	81	85	84	84
query56	264	247	268	247
query57	1313	1134	1145	1134
query58	237	226	229	226
query59	3263	3200	2985	2985
query60	296	260	266	260
query61	113	109	104	104
query62	893	703	679	679
query63	225	214	209	209
query64	4073	673	660	660
query65	3382	3271	3281	3271
query66	819	310	315	310
query67	16286	15472	15441	15441
query68	5970	549	554	549
query69	502	256	244	244
query70	1258	1149	1138	1138
query71	483	252	254	252
query72	6558	4291	4290	4290
query73	844	362	364	362
query74	10377	8779	8802	8779
query75	3721	2666	2654	2654
query76	3840	1161	1223	1161
query77	586	276	286	276
query78	10391	9922	9492	9492
query79	1384	618	593	593
query80	823	437	453	437
query81	525	236	235	235
query82	497	126	126	126
query83	194	146	152	146
query84	290	71	74	71
query85	1244	306	305	305
query86	410	276	312	276
query87	4730	4584	4271	4271
query88	3404	2225	2185	2185
query89	432	295	299	295
query90	2057	191	190	190
query91	141	107	103	103
query92	64	51	64	51
query93	1953	543	532	532
query94	796	301	281	281
query95	350	261	267	261
query96	676	285	295	285
query97	2872	2671	2700	2671
query98	222	204	190	190
query99	1615	1360	1286	1286
Total cold run time: 307419 ms
Total hot run time: 196395 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.28 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8c84c5473b0a4e3f389bbb116292e874187bb636, data reload: false

query1	0.04	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.06
query4	1.61	0.11	0.10
query5	0.41	0.41	0.39
query6	1.14	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.04
query9	0.57	0.50	0.50
query10	0.56	0.58	0.57
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.72	2.76	2.80
query15	0.89	0.82	0.82
query16	0.38	0.38	0.37
query17	0.97	1.04	1.00
query18	0.23	0.21	0.21
query19	1.95	1.88	1.97
query20	0.01	0.01	0.02
query21	15.36	0.63	0.57
query22	2.43	1.99	1.63
query23	17.00	0.94	0.90
query24	2.73	0.63	1.27
query25	0.20	0.19	0.09
query26	0.44	0.13	0.14
query27	0.04	0.04	0.05
query28	10.99	1.09	1.08
query29	12.62	3.28	3.23
query30	0.25	0.06	0.06
query31	2.87	0.38	0.39
query32	3.25	0.47	0.45
query33	3.10	3.23	3.12
query34	16.78	4.45	4.54
query35	4.51	4.54	4.51
query36	0.68	0.48	0.50
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.03	0.03
query40	0.17	0.13	0.11
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.47 s
Total hot run time: 32.28 s

@feiniaofeiafei
Copy link
Contributor Author

run buildall

1 similar comment
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39642 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1475058f29e80ca15a412523a1c25c82bdaf8b8f, data reload: false

------ Round 1 ----------------------------------
q1	17580	7469	7272	7272
q2	2045	180	178	178
q3	10546	1133	1167	1133
q4	10228	690	697	690
q5	7586	2705	2708	2705
q6	239	149	146	146
q7	971	621	599	599
q8	9225	1855	1925	1855
q9	6743	6466	6376	6376
q10	6960	2278	2293	2278
q11	455	267	270	267
q12	413	223	218	218
q13	17764	2918	2962	2918
q14	249	212	214	212
q15	558	504	487	487
q16	657	585	599	585
q17	972	534	586	534
q18	7491	6647	6794	6647
q19	1374	975	888	888
q20	463	185	184	184
q21	4313	3171	3156	3156
q22	376	314	320	314
Total cold run time: 107208 ms
Total hot run time: 39642 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7224	7202	7201	7201
q2	323	235	231	231
q3	2899	2788	2915	2788
q4	2111	1883	1803	1803
q5	5579	5584	5640	5584
q6	229	139	141	139
q7	2178	1750	1796	1750
q8	3369	3514	3508	3508
q9	8901	8947	8865	8865
q10	3618	3589	3521	3521
q11	627	503	491	491
q12	796	601	594	594
q13	11590	3069	3040	3040
q14	314	271	291	271
q15	561	498	509	498
q16	694	624	627	624
q17	1803	1583	1584	1583
q18	7934	7425	7439	7425
q19	1675	1491	1527	1491
q20	2067	1822	1792	1792
q21	5379	5261	5172	5172
q22	627	538	604	538
Total cold run time: 70498 ms
Total hot run time: 58909 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190537 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1475058f29e80ca15a412523a1c25c82bdaf8b8f, data reload: false

query1	1008	366	381	366
query2	6544	2389	2339	2339
query3	6714	206	211	206
query4	34173	23390	23379	23379
query5	4348	473	501	473
query6	294	205	184	184
query7	4631	311	320	311
query8	309	240	241	240
query9	9615	2746	2747	2746
query10	482	243	253	243
query11	18063	15141	15104	15104
query12	157	103	111	103
query13	1691	475	444	444
query14	9762	6996	7324	6996
query15	308	180	182	180
query16	8254	445	403	403
query17	1811	621	582	582
query18	2176	291	297	291
query19	367	150	156	150
query20	120	109	106	106
query21	230	103	108	103
query22	4467	4284	4295	4284
query23	34437	36579	33378	33378
query24	11435	2409	2567	2409
query25	547	388	389	388
query26	1094	151	152	151
query27	2841	328	339	328
query28	7824	2477	2467	2467
query29	663	430	422	422
query30	301	144	156	144
query31	1081	814	806	806
query32	104	61	57	57
query33	778	300	288	288
query34	967	523	542	523
query35	881	731	742	731
query36	1107	969	959	959
query37	198	73	75	73
query38	4431	4092	4179	4092
query39	1473	1387	1419	1387
query40	284	105	109	105
query41	47	45	47	45
query42	114	104	102	102
query43	545	495	484	484
query44	1305	801	794	794
query45	184	170	157	157
query46	1155	722	706	706
query47	1949	1857	1878	1857
query48	420	327	317	317
query49	1285	419	407	407
query50	828	382	404	382
query51	7199	7050	7107	7050
query52	101	93	94	93
query53	264	186	190	186
query54	1192	402	402	402
query55	80	79	87	79
query56	260	235	250	235
query57	1277	1121	1128	1121
query58	243	226	222	222
query59	3399	2989	3074	2989
query60	280	252	250	250
query61	110	111	114	111
query62	914	678	676	676
query63	212	194	213	194
query64	4946	676	647	647
query65	3277	3191	3242	3191
query66	1281	315	302	302
query67	15964	15629	15558	15558
query68	5798	566	565	565
query69	448	248	251	248
query70	1145	1115	1093	1093
query71	412	255	243	243
query72	6067	4216	4096	4096
query73	787	371	373	371
query74	10308	8853	9020	8853
query75	3457	2663	2682	2663
query76	3562	1130	1090	1090
query77	537	269	288	269
query78	11208	10121	9618	9618
query79	2171	609	631	609
query80	761	424	429	424
query81	540	244	237	237
query82	576	117	126	117
query83	273	152	150	150
query84	242	72	69	69
query85	774	309	297	297
query86	478	311	286	286
query87	4485	4368	4373	4368
query88	3967	2234	2247	2234
query89	411	287	289	287
query90	2259	190	189	189
query91	141	105	105	105
query92	67	52	53	52
query93	1434	551	559	551
query94	919	287	296	287
query95	363	249	251	249
query96	613	273	280	273
query97	2818	2702	2627	2627
query98	220	213	196	196
query99	1545	1327	1323	1323
Total cold run time: 303587 ms
Total hot run time: 190537 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.71 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1475058f29e80ca15a412523a1c25c82bdaf8b8f, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.24	0.07	0.07
query4	1.60	0.10	0.10
query5	0.41	0.40	0.41
query6	1.17	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.03	0.04
query9	0.58	0.53	0.52
query10	0.54	0.60	0.56
query11	0.14	0.10	0.10
query12	0.13	0.10	0.12
query13	0.60	0.61	0.59
query14	2.72	2.81	2.73
query15	0.91	0.82	0.82
query16	0.37	0.38	0.37
query17	0.99	1.02	1.06
query18	0.23	0.20	0.20
query19	1.98	1.88	1.99
query20	0.01	0.01	0.01
query21	15.37	0.58	0.58
query22	3.23	2.17	2.05
query23	16.80	0.94	0.75
query24	2.74	1.79	2.00
query25	0.29	0.17	0.12
query26	0.39	0.13	0.14
query27	0.04	0.04	0.06
query28	9.80	1.11	1.07
query29	12.63	3.22	3.21
query30	0.25	0.06	0.06
query31	2.87	0.39	0.37
query32	3.24	0.48	0.46
query33	3.08	3.15	3.10
query34	16.93	4.46	4.51
query35	4.52	4.50	4.51
query36	0.70	0.48	0.48
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.18	0.13	0.13
query41	0.09	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.04	0.03
Total cold run time: 106.19 s
Total hot run time: 33.71 s

@feiniaofeiafei
Copy link
Contributor Author

run p0

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32618 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fb992316040dec6bd0fb37a0560ff8cb00c5afd1, data reload: false

------ Round 1 ----------------------------------
q1	17569	6114	6024	6024
q2	2049	308	180	180
q3	10414	1218	738	738
q4	10189	854	421	421
q5	7519	2182	1983	1983
q6	213	183	147	147
q7	903	745	606	606
q8	9240	1343	1163	1163
q9	5285	4920	4940	4920
q10	6768	2320	1864	1864
q11	493	276	268	268
q12	346	361	238	238
q13	17793	3683	3107	3107
q14	242	243	216	216
q15	569	500	511	500
q16	639	640	596	596
q17	579	862	328	328
q18	6879	6475	6343	6343
q19	1798	956	552	552
q20	304	303	184	184
q21	2776	2220	1937	1937
q22	359	334	303	303
Total cold run time: 102926 ms
Total hot run time: 32618 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6241	6152	6145	6145
q2	228	321	232	232
q3	2239	2662	2329	2329
q4	1374	1786	1321	1321
q5	4303	4777	4683	4683
q6	179	175	142	142
q7	2057	1932	1839	1839
q8	2580	2862	2680	2680
q9	7346	7159	7264	7159
q10	3087	3345	2860	2860
q11	591	524	494	494
q12	647	749	589	589
q13	3316	3751	3120	3120
q14	274	309	283	283
q15	569	533	523	523
q16	640	704	650	650
q17	1198	1738	1276	1276
q18	7624	7473	7509	7473
q19	791	1103	1075	1075
q20	1988	2019	1957	1957
q21	5690	5385	4930	4930
q22	577	614	585	585
Total cold run time: 53539 ms
Total hot run time: 52345 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197031 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fb992316040dec6bd0fb37a0560ff8cb00c5afd1, data reload: false

query1	1332	1006	901	901
query2	6387	2326	2271	2271
query3	10997	4812	4632	4632
query4	32926	23734	23390	23390
query5	4373	609	455	455
query6	288	206	210	206
query7	3990	487	311	311
query8	315	247	242	242
query9	9459	2751	2732	2732
query10	470	308	255	255
query11	17963	15612	15353	15353
query12	165	108	105	105
query13	1580	545	420	420
query14	10456	7552	7732	7552
query15	269	210	184	184
query16	7273	599	452	452
query17	1509	775	570	570
query18	1320	375	314	314
query19	214	180	176	176
query20	119	118	115	115
query21	203	123	113	113
query22	4697	4867	4636	4636
query23	34506	33452	33669	33452
query24	6446	2288	2399	2288
query25	479	491	394	394
query26	728	283	150	150
query27	2417	483	327	327
query28	5298	2509	2469	2469
query29	524	564	437	437
query30	209	185	161	161
query31	965	949	857	857
query32	76	60	57	57
query33	467	385	291	291
query34	760	886	521	521
query35	798	828	772	772
query36	1051	1071	1008	1008
query37	121	94	75	75
query38	4447	4172	4203	4172
query39	1548	1471	1471	1471
query40	202	117	106	106
query41	74	46	43	43
query42	113	105	109	105
query43	515	536	489	489
query44	1320	839	837	837
query45	180	177	173	173
query46	882	1077	670	670
query47	1985	2003	1930	1930
query48	387	404	318	318
query49	717	476	408	408
query50	646	661	387	387
query51	7257	7360	7238	7238
query52	107	108	92	92
query53	226	258	190	190
query54	481	518	413	413
query55	82	78	82	78
query56	255	252	244	244
query57	1212	1260	1152	1152
query58	227	221	219	219
query59	3223	3363	3328	3328
query60	269	263	260	260
query61	117	111	108	108
query62	871	822	745	745
query63	229	194	192	192
query64	3561	1044	668	668
query65	3339	3271	3227	3227
query66	791	404	308	308
query67	16413	15853	15518	15518
query68	9203	761	522	522
query69	494	288	265	265
query70	1215	1151	1168	1151
query71	436	278	255	255
query72	6247	3798	3931	3798
query73	648	759	366	366
query74	10364	9329	8705	8705
query75	4468	3169	2654	2654
query76	4916	1206	767	767
query77	850	393	276	276
query78	10069	10245	9486	9486
query79	3010	921	581	581
query80	748	609	425	425
query81	481	273	229	229
query82	636	162	123	123
query83	192	163	145	145
query84	293	97	71	71
query85	790	378	311	311
query86	357	313	297	297
query87	4477	4517	4380	4380
query88	4551	2203	2225	2203
query89	421	339	290	290
query90	1838	199	186	186
query91	132	135	105	105
query92	67	54	51	51
query93	1904	887	535	535
query94	644	394	283	283
query95	329	262	255	255
query96	494	613	281	281
query97	2736	2829	2667	2667
query98	222	205	202	202
query99	1644	1527	1433	1433
Total cold run time: 297702 ms
Total hot run time: 197031 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.06 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fb992316040dec6bd0fb37a0560ff8cb00c5afd1, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.61	0.11	0.10
query5	0.43	0.42	0.42
query6	1.16	0.66	0.65
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.51	0.53
query10	0.55	0.59	0.57
query11	0.14	0.10	0.10
query12	0.15	0.10	0.11
query13	0.60	0.60	0.58
query14	2.72	2.82	2.74
query15	0.90	0.82	0.82
query16	0.38	0.40	0.39
query17	1.03	1.01	1.04
query18	0.23	0.22	0.20
query19	1.99	1.83	2.04
query20	0.01	0.01	0.02
query21	15.37	0.97	0.58
query22	0.75	0.82	0.93
query23	14.99	1.46	0.53
query24	3.03	1.43	0.60
query25	0.17	0.11	0.17
query26	0.26	0.16	0.14
query27	0.04	0.07	0.05
query28	13.25	1.53	1.05
query29	12.65	3.95	3.23
query30	0.24	0.09	0.06
query31	2.81	0.60	0.40
query32	3.23	0.56	0.47
query33	3.03	3.08	3.13
query34	16.70	5.08	4.48
query35	4.51	4.45	4.46
query36	0.66	0.48	0.48
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.03	0.03
query40	0.17	0.14	0.13
query41	0.08	0.02	0.02
query42	0.04	0.03	0.02
query43	0.04	0.02	0.02
Total cold run time: 105.11 s
Total hot run time: 31.06 s

@feiniaofeiafei feiniaofeiafei force-pushed the add_date_format branch 2 times, most recently from 9ada9e4 to 3ce9cf6 Compare December 24, 2024 14:28
@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32955 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 3ce9cf6533c26f44962487d799878369cbe7228a, data reload: false

------ Round 1 ----------------------------------
q1	17805	6301	6124	6124
q2	2044	308	163	163
q3	10624	1207	743	743
q4	10874	858	444	444
q5	7511	2194	1967	1967
q6	207	178	148	148
q7	905	762	608	608
q8	9486	1415	1211	1211
q9	5632	5076	5023	5023
q10	7009	2323	1950	1950
q11	511	287	266	266
q12	364	368	248	248
q13	19653	3667	3036	3036
q14	250	235	211	211
q15	570	514	494	494
q16	717	623	587	587
q17	745	866	319	319
q18	7946	6559	6381	6381
q19	3487	980	558	558
q20	299	310	184	184
q21	2807	2212	1982	1982
q22	350	341	308	308
Total cold run time: 109796 ms
Total hot run time: 32955 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6435	6173	6155	6155
q2	234	323	237	237
q3	2330	2763	2482	2482
q4	1421	1855	1350	1350
q5	4398	4997	4933	4933
q6	176	174	141	141
q7	2100	1954	1765	1765
q8	2632	2793	2668	2668
q9	7298	7323	7236	7236
q10	2975	3272	2836	2836
q11	589	514	483	483
q12	685	783	581	581
q13	3452	3748	3109	3109
q14	278	318	278	278
q15	545	527	514	514
q16	660	682	664	664
q17	1233	1738	1264	1264
q18	7715	7383	7429	7383
q19	887	1236	1122	1122
q20	1969	2029	1846	1846
q21	5707	5076	5117	5076
q22	642	639	612	612
Total cold run time: 54361 ms
Total hot run time: 52735 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197100 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 3ce9cf6533c26f44962487d799878369cbe7228a, data reload: false

query1	1309	951	952	951
query2	6383	2371	2304	2304
query3	10990	4806	4806	4806
query4	33353	23703	23391	23391
query5	4758	607	480	480
query6	279	209	201	201
query7	3994	490	307	307
query8	319	247	251	247
query9	9627	2729	2721	2721
query10	483	310	245	245
query11	18463	15391	15391	15391
query12	155	103	100	100
query13	1565	539	398	398
query14	10362	7224	7454	7224
query15	234	201	195	195
query16	8003	663	437	437
query17	1498	745	575	575
query18	2163	402	330	330
query19	240	191	156	156
query20	122	113	125	113
query21	210	130	113	113
query22	4364	4695	4334	4334
query23	34426	33926	33628	33628
query24	6610	2386	2346	2346
query25	522	497	427	427
query26	1183	289	157	157
query27	2180	488	342	342
query28	5628	2495	2471	2471
query29	747	588	442	442
query30	212	183	147	147
query31	994	922	849	849
query32	87	63	59	59
query33	507	363	312	312
query34	792	853	533	533
query35	827	821	818	818
query36	1007	1049	983	983
query37	116	102	78	78
query38	4360	4182	4380	4182
query39	1520	1488	1497	1488
query40	216	123	103	103
query41	46	45	45	45
query42	119	107	102	102
query43	567	518	489	489
query44	1466	817	835	817
query45	183	179	175	175
query46	890	1054	665	665
query47	2020	1987	1899	1899
query48	426	436	328	328
query49	770	473	392	392
query50	662	684	393	393
query51	7161	7228	7136	7136
query52	99	106	108	106
query53	232	257	187	187
query54	481	511	439	439
query55	85	80	86	80
query56	252	253	244	244
query57	1251	1240	1180	1180
query58	231	216	224	216
query59	3167	3164	3045	3045
query60	280	280	257	257
query61	114	111	108	108
query62	888	817	782	782
query63	240	196	194	194
query64	4400	1052	663	663
query65	3340	3285	3290	3285
query66	1129	429	312	312
query67	16576	15638	15475	15475
query68	9421	761	516	516
query69	444	295	241	241
query70	1201	1102	1136	1102
query71	419	282	262	262
query72	6114	3834	3857	3834
query73	655	795	365	365
query74	10202	9291	8928	8928
query75	4383	3151	2665	2665
query76	4700	1197	795	795
query77	926	360	293	293
query78	10225	10129	9391	9391
query79	4405	896	593	593
query80	731	520	420	420
query81	488	260	231	231
query82	531	153	118	118
query83	210	165	142	142
query84	279	99	71	71
query85	764	348	312	312
query86	357	318	300	300
query87	4394	4579	4543	4543
query88	3428	2324	2235	2235
query89	447	345	291	291
query90	2074	187	186	186
query91	136	131	115	115
query92	70	60	51	51
query93	2262	898	526	526
query94	676	385	287	287
query95	326	259	249	249
query96	489	612	279	279
query97	2716	2836	2693	2693
query98	213	205	198	198
query99	1655	1560	1470	1470
Total cold run time: 303224 ms
Total hot run time: 197100 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 3ce9cf6533c26f44962487d799878369cbe7228a, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.11	0.11
query5	0.43	0.42	0.41
query6	1.15	0.65	0.64
query7	0.02	0.01	0.02
query8	0.04	0.04	0.03
query9	0.58	0.50	0.51
query10	0.54	0.55	0.55
query11	0.16	0.11	0.10
query12	0.14	0.11	0.11
query13	0.60	0.61	0.60
query14	2.71	2.76	2.90
query15	0.89	0.82	0.83
query16	0.39	0.39	0.40
query17	1.04	1.05	1.01
query18	0.23	0.21	0.21
query19	1.90	1.73	1.99
query20	0.01	0.02	0.01
query21	15.38	0.97	0.59
query22	0.75	0.94	0.99
query23	14.91	1.38	0.57
query24	2.60	1.46	1.55
query25	0.24	0.19	0.19
query26	0.22	0.14	0.14
query27	0.07	0.05	0.05
query28	14.35	1.47	1.04
query29	12.62	3.95	3.29
query30	0.25	0.08	0.06
query31	2.82	0.62	0.37
query32	3.23	0.54	0.46
query33	3.04	3.08	3.04
query34	16.69	5.12	4.48
query35	4.55	4.46	4.46
query36	0.65	0.48	0.47
query37	0.10	0.06	0.06
query38	0.04	0.04	0.04
query39	0.04	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 105.66 s
Total hot run time: 32.04 s

morrySnow
morrySnow reviewed Dec 25, 2024
View reviewed changes
...re/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DateFormat.java Outdated
Comment on lines 57 to 59
private static final Set<String> monoFormat = ImmutableSet.of("yyyyMMdd", "yyyy-MM-dd", "yyyy-MM-ddHH:mm:ss",
"%Y", "%Y-%m", "%Y-%m-%d", "%Y-%m-%d%H", "%Y-%m-%d%H:%i", "%Y-%m-%d%H:%i:%s", "%Y-%m-%d%H:%i:%S",
"%Y-%m-%d%T", "%Y%m%d", "%Y%m");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add case that the original format is illegal, such as yyy yM Md d

@feiniaofeiafei
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32628 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 342c1f328b32116ddae30f09896df0b33a662d87, data reload: false

------ Round 1 ----------------------------------
q1	17590	6220	6061	6061
q2	2050	308	166	166
q3	10558	1239	748	748
q4	10202	849	427	427
q5	7489	2158	1982	1982
q6	209	183	151	151
q7	904	742	601	601
q8	9226	1346	1182	1182
q9	5395	4927	4981	4927
q10	6814	2339	1876	1876
q11	491	272	263	263
q12	354	366	222	222
q13	17759	3678	2964	2964
q14	241	248	217	217
q15	559	508	498	498
q16	634	618	594	594
q17	562	860	331	331
q18	6959	6363	6415	6363
q19	2444	974	548	548
q20	308	318	188	188
q21	2914	2190	1988	1988
q22	358	354	331	331
Total cold run time: 104020 ms
Total hot run time: 32628 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6348	6232	6202	6202
q2	243	340	235	235
q3	2355	2746	2464	2464
q4	1478	1878	1361	1361
q5	4467	4976	5066	4976
q6	191	187	148	148
q7	2113	2176	1992	1992
q8	2718	2882	2785	2785
q9	7857	7509	7454	7454
q10	3107	3376	2771	2771
q11	570	518	496	496
q12	688	833	656	656
q13	3406	3811	3175	3175
q14	283	334	271	271
q15	587	529	499	499
q16	663	717	663	663
q17	1190	1743	1267	1267
q18	7649	7598	7485	7485
q19	848	1188	1084	1084
q20	2018	2091	1911	1911
q21	5688	5165	5003	5003
q22	623	626	586	586
Total cold run time: 55090 ms
Total hot run time: 53484 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196976 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 342c1f328b32116ddae30f09896df0b33a662d87, data reload: false

query1	1292	951	931	931
query2	6518	2293	2262	2262
query3	10925	4639	4804	4639
query4	32829	23853	23374	23374
query5	3791	613	472	472
query6	264	194	211	194
query7	4011	476	303	303
query8	285	233	226	226
query9	9390	2734	2712	2712
query10	462	289	236	236
query11	18362	15401	15377	15377
query12	158	103	104	103
query13	1565	516	406	406
query14	10373	6783	6873	6783
query15	254	217	200	200
query16	7843	621	455	455
query17	1531	747	588	588
query18	2144	422	326	326
query19	211	189	168	168
query20	128	115	118	115
query21	206	130	111	111
query22	4595	4703	4578	4578
query23	35612	34776	34126	34126
query24	6671	2268	2301	2268
query25	456	435	373	373
query26	1193	242	147	147
query27	2578	454	325	325
query28	5782	2496	2464	2464
query29	548	525	436	436
query30	209	185	156	156
query31	987	1015	866	866
query32	81	58	55	55
query33	501	363	293	293
query34	783	864	527	527
query35	813	835	787	787
query36	1040	1063	978	978
query37	121	99	79	79
query38	4279	4333	4148	4148
query39	1505	1498	1436	1436
query40	210	115	98	98
query41	48	43	49	43
query42	119	102	101	101
query43	507	533	503	503
query44	1323	823	825	823
query45	196	178	175	175
query46	884	1065	657	657
query47	2031	2061	1925	1925
query48	381	422	338	338
query49	758	473	382	382
query50	628	695	393	393
query51	7182	7360	7195	7195
query52	104	101	94	94
query53	248	260	182	182
query54	478	478	404	404
query55	79	87	77	77
query56	258	252	235	235
query57	1248	1244	1157	1157
query58	238	231	223	223
query59	3255	3377	3107	3107
query60	274	281	251	251
query61	106	123	110	110
query62	844	868	775	775
query63	241	194	198	194
query64	4340	1059	669	669
query65	3385	3221	3254	3221
query66	950	420	306	306
query67	16424	15888	15436	15436
query68	10021	751	516	516
query69	497	283	250	250
query70	1197	1105	1117	1105
query71	439	286	250	250
query72	6154	3868	3775	3775
query73	1354	751	355	355
query74	10393	9365	8994	8994
query75	4454	3141	2635	2635
query76	5655	1182	743	743
query77	1022	367	300	300
query78	9925	10315	9801	9801
query79	3231	893	596	596
query80	690	498	424	424
query81	473	274	235	235
query82	271	145	123	123
query83	194	168	145	145
query84	274	87	73	73
query85	832	376	305	305
query86	344	313	307	307
query87	4573	4723	4397	4397
query88	3445	2238	2197	2197
query89	425	328	295	295
query90	2117	185	184	184
query91	127	128	102	102
query92	68	54	52	52
query93	1863	897	531	531
query94	684	414	291	291
query95	334	263	246	246
query96	491	609	280	280
query97	2753	2837	2662	2662
query98	227	202	199	199
query99	1662	1578	1511	1511
Total cold run time: 303224 ms
Total hot run time: 196976 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.04 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 342c1f328b32116ddae30f09896df0b33a662d87, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.05	0.03
query3	0.24	0.07	0.07
query4	1.61	0.10	0.11
query5	0.43	0.43	0.42
query6	1.18	0.66	0.67
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.58	0.50	0.50
query10	0.56	0.57	0.54
query11	0.15	0.11	0.11
query12	0.14	0.11	0.12
query13	0.62	0.60	0.60
query14	2.82	2.73	2.77
query15	0.89	0.83	0.84
query16	0.39	0.38	0.38
query17	1.04	1.07	1.07
query18	0.21	0.21	0.21
query19	1.99	1.84	2.00
query20	0.02	0.01	0.02
query21	15.36	0.95	0.58
query22	0.75	0.79	0.60
query23	15.39	1.44	0.64
query24	3.07	1.10	0.79
query25	0.19	0.12	0.06
query26	0.38	0.16	0.14
query27	0.06	0.05	0.05
query28	13.34	1.52	1.04
query29	12.58	3.84	3.22
query30	0.24	0.09	0.06
query31	2.83	0.60	0.38
query32	3.22	0.54	0.46
query33	3.11	3.07	3.13
query34	16.65	5.08	4.44
query35	4.60	4.49	4.46
query36	0.65	0.52	0.47
query37	0.10	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.17	0.13	0.12
query41	0.08	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.04	0.02
Total cold run time: 105.94 s
Total hot run time: 31.04 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Dec 26, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@morrySnow morrySnow merged commit 7a33251 into apache:master Dec 26, 2024
23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@xzj7019 xzj7019 xzj7019 approved these changes

@morrySnow morrySnow morrySnow approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@feiniaofeiafei @doris-robot @morrySnow @xzj7019