Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [test](nereids) add test simplify comparison predicate #44886 #45803

Merged

Conversation

yujun777
Copy link
Collaborator

cherry pick from #44886

@yujun777
Copy link
Collaborator Author

run buildall

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@yujun777 yujun777 changed the title [test](nereids) add test simplify comparison predicate #44886 branch-3.0: [test](nereids) add test simplify comparison predicate #44886 Dec 23, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 40513 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dec8ad4bc438b82f894d79e9cc6c6a60b7a2372b, data reload: false

------ Round 1 ----------------------------------
q1	17887	7476	7307	7307
q2	2074	162	154	154
q3	10645	1104	1145	1104
q4	10421	726	675	675
q5	7737	2769	2829	2769
q6	238	150	146	146
q7	959	605	601	601
q8	9353	1937	1974	1937
q9	6726	6397	6370	6370
q10	7063	2282	2314	2282
q11	460	271	258	258
q12	445	215	207	207
q13	17808	2947	2969	2947
q14	233	219	219	219
q15	556	521	522	521
q16	670	599	599	599
q17	979	588	537	537
q18	7318	6699	6561	6561
q19	3721	1036	1060	1036
q20	483	198	191	191
q21	4076	3180	3107	3107
q22	1044	985	993	985
Total cold run time: 110896 ms
Total hot run time: 40513 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7386	7259	7256	7256
q2	335	238	226	226
q3	2882	2719	2686	2686
q4	1884	1657	1698	1657
q5	5410	5406	5437	5406
q6	211	140	139	139
q7	2060	1674	1694	1674
q8	3208	3349	3391	3349
q9	8552	8489	8489	8489
q10	3441	3360	3414	3360
q11	592	496	506	496
q12	734	529	599	529
q13	16904	2990	2979	2979
q14	285	264	280	264
q15	553	512	508	508
q16	707	648	650	648
q17	1779	1594	1542	1542
q18	7776	7314	7351	7314
q19	1665	1564	1622	1564
q20	1985	1796	1795	1795
q21	5341	5087	5071	5071
q22	1084	966	998	966
Total cold run time: 74774 ms
Total hot run time: 57918 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188534 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dec8ad4bc438b82f894d79e9cc6c6a60b7a2372b, data reload: false

query1	995	369	371	369
query2	6508	2040	2011	2011
query3	6704	226	228	226
query4	34022	23636	23302	23302
query5	4376	445	439	439
query6	267	171	179	171
query7	4633	305	315	305
query8	290	219	211	211
query9	9714	2681	2672	2672
query10	494	278	250	250
query11	17976	15000	15082	15000
query12	150	109	99	99
query13	1645	426	394	394
query14	9340	6545	6271	6271
query15	207	176	177	176
query16	7798	510	468	468
query17	1635	570	542	542
query18	1982	312	316	312
query19	210	156	154	154
query20	115	109	109	109
query21	61	53	49	49
query22	4547	4202	4010	4010
query23	34451	33790	33719	33719
query24	12330	2799	2872	2799
query25	745	404	398	398
query26	1913	169	171	169
query27	3014	303	296	296
query28	8422	2473	2433	2433
query29	1219	455	430	430
query30	332	162	157	157
query31	1026	792	808	792
query32	101	61	60	60
query33	800	284	290	284
query34	994	489	504	489
query35	847	710	718	710
query36	1092	906	938	906
query37	283	73	80	73
query38	3950	3783	3790	3783
query39	1465	1422	1447	1422
query40	228	87	89	87
query41	55	51	48	48
query42	108	102	99	99
query43	540	494	498	494
query44	1279	772	776	772
query45	184	169	166	166
query46	1131	707	713	707
query47	1969	1828	1836	1828
query48	458	367	367	367
query49	1297	386	383	383
query50	796	425	413	413
query51	7060	7268	6940	6940
query52	98	90	88	88
query53	263	186	183	183
query54	1213	462	455	455
query55	78	78	81	78
query56	266	240	246	240
query57	1236	1114	1088	1088
query58	231	209	218	209
query59	3119	3005	2946	2946
query60	291	289	277	277
query61	109	102	105	102
query62	883	680	660	660
query63	206	192	186	186
query64	5307	660	598	598
query65	3253	3143	3155	3143
query66	1415	317	306	306
query67	15826	15359	15262	15262
query68	5515	560	546	546
query69	448	262	254	254
query70	1164	1118	1144	1118
query71	432	251	266	251
query72	6780	3853	3971	3853
query73	740	358	348	348
query74	10253	8885	8942	8885
query75	3356	2600	2602	2600
query76	3536	1009	966	966
query77	432	288	283	283
query78	10774	9859	9537	9537
query79	6778	580	586	580
query80	1701	425	409	409
query81	562	247	234	234
query82	1034	119	118	118
query83	267	143	143	143
query84	287	80	82	80
query85	2300	295	284	284
query86	496	301	305	301
query87	4400	4317	4231	4231
query88	5259	2354	2344	2344
query89	423	289	305	289
query90	2242	183	186	183
query91	179	142	143	142
query92	67	51	51	51
query93	5439	540	519	519
query94	1037	284	293	284
query95	347	246	244	244
query96	629	279	275	275
query97	3337	3099	3137	3099
query98	220	201	200	200
query99	1921	1298	1309	1298
Total cold run time: 317907 ms
Total hot run time: 188534 ms

@yujun777
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40254 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e5d5b35a39387a6b732fc374e10d2c941d5967da, data reload: false

------ Round 1 ----------------------------------
q1	17576	7354	7225	7225
q2	2055	171	162	162
q3	10566	1100	1156	1100
q4	10229	736	744	736
q5	7720	2803	2777	2777
q6	233	148	142	142
q7	955	612	599	599
q8	9344	1903	1956	1903
q9	6595	6363	6347	6347
q10	6939	2258	2320	2258
q11	454	260	270	260
q12	405	212	204	204
q13	17778	2963	2981	2963
q14	228	209	215	209
q15	559	518	509	509
q16	657	595	602	595
q17	959	516	537	516
q18	7361	6721	6593	6593
q19	1372	1030	1024	1024
q20	484	195	201	195
q21	3886	3138	2945	2945
q22	1060	992	1000	992
Total cold run time: 107415 ms
Total hot run time: 40254 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7282	7147	7232	7147
q2	336	232	226	226
q3	2832	2740	2878	2740
q4	2006	1720	1692	1692
q5	5720	5743	5606	5606
q6	223	139	138	138
q7	2155	1695	1789	1695
q8	3332	3502	3432	3432
q9	8814	8859	8797	8797
q10	3554	3476	3502	3476
q11	592	501	481	481
q12	763	625	594	594
q13	16958	3111	3070	3070
q14	308	262	257	257
q15	573	521	512	512
q16	681	642	646	642
q17	1785	1670	1532	1532
q18	7847	7562	7194	7194
q19	7911	1545	1511	1511
q20	1988	1764	1794	1764
q21	5089	4842	4990	4842
q22	1104	956	980	956
Total cold run time: 81853 ms
Total hot run time: 58304 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190224 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e5d5b35a39387a6b732fc374e10d2c941d5967da, data reload: false

query1	969	365	367	365
query2	6512	2090	2092	2090
query3	6710	213	223	213
query4	33708	23302	23492	23302
query5	4318	448	448	448
query6	273	178	170	170
query7	4629	308	321	308
query8	291	229	225	225
query9	9564	2690	2669	2669
query10	494	261	264	261
query11	17909	14981	15051	14981
query12	146	102	103	102
query13	1636	426	410	410
query14	9290	7390	6909	6909
query15	225	185	172	172
query16	7912	489	510	489
query17	1620	576	553	553
query18	2036	309	320	309
query19	219	156	157	156
query20	115	108	110	108
query21	61	47	45	45
query22	4570	4327	4403	4327
query23	34420	33737	33745	33737
query24	12349	2872	2900	2872
query25	716	413	402	402
query26	1847	173	169	169
query27	2981	301	303	301
query28	8314	2452	2428	2428
query29	1109	458	436	436
query30	341	172	165	165
query31	1089	792	809	792
query32	98	58	57	57
query33	778	288	297	288
query34	981	491	519	491
query35	853	711	720	711
query36	1090	932	959	932
query37	271	73	76	73
query38	3982	3856	3850	3850
query39	1587	1416	1428	1416
query40	229	85	84	84
query41	55	53	50	50
query42	112	99	100	99
query43	539	499	494	494
query44	1282	792	787	787
query45	186	170	171	170
query46	1150	722	715	715
query47	1869	1808	1823	1808
query48	454	384	361	361
query49	1297	401	399	399
query50	795	422	412	412
query51	7104	7049	6984	6984
query52	101	97	95	95
query53	274	199	188	188
query54	1272	467	458	458
query55	75	79	75	75
query56	272	268	258	258
query57	1181	1104	1103	1103
query58	245	216	235	216
query59	3186	3000	3098	3000
query60	299	248	247	247
query61	109	105	107	105
query62	867	654	684	654
query63	212	185	182	182
query64	5352	636	630	630
query65	3291	3179	3161	3161
query66	1428	302	326	302
query67	15876	15400	15449	15400
query68	5604	582	552	552
query69	425	268	256	256
query70	1170	1123	1133	1123
query71	346	258	250	250
query72	6560	3898	3933	3898
query73	762	343	336	336
query74	10272	8880	8885	8880
query75	3348	2656	2601	2601
query76	3502	1066	1135	1066
query77	407	275	270	270
query78	10660	9794	9473	9473
query79	8915	584	582	582
query80	2178	423	414	414
query81	564	231	233	231
query82	1404	117	115	115
query83	258	141	142	141
query84	303	77	78	77
query85	2302	298	293	293
query86	500	306	299	299
query87	4518	4324	4189	4189
query88	5919	2369	2387	2369
query89	560	300	293	293
query90	2291	188	182	182
query91	175	141	142	141
query92	68	48	48	48
query93	6745	555	528	528
query94	1071	298	269	269
query95	349	249	251	249
query96	625	278	278	278
query97	3323	3170	3174	3170
query98	217	201	193	193
query99	1599	1326	1289	1289
Total cold run time: 322065 ms
Total hot run time: 190224 ms

@yujun777
Copy link
Collaborator Author

run p0

@yiguolei yiguolei merged commit fc2f65d into apache:branch-3.0 Dec 24, 2024
18 of 20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants