Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](nereids) flatten compound predicates #44803

Closed
wants to merge 5 commits into from
Closed

Conversation

englefly
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@englefly englefly marked this pull request as draft November 29, 2024 15:30
@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40530 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dfa39da617d9e799d71165e288c0394c1f81eac0, data reload: false

------ Round 1 ----------------------------------
q1	17591	7534	7384	7384
q2	2061	182	172	172
q3	10837	1151	1201	1151
q4	10537	705	795	705
q5	7615	2744	2737	2737
q6	236	154	146	146
q7	996	641	618	618
q8	9245	1918	1876	1876
q9	6776	6534	6447	6447
q10	7027	2414	2364	2364
q11	474	270	256	256
q12	434	234	226	226
q13	17768	3031	3047	3031
q14	236	216	206	206
q15	570	522	517	517
q16	663	603	581	581
q17	982	571	565	565
q18	7269	6816	6786	6786
q19	1443	1040	1007	1007
q20	461	184	186	184
q21	4208	3425	3254	3254
q22	378	335	317	317
Total cold run time: 107807 ms
Total hot run time: 40530 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7282	7230	7246	7230
q2	324	232	230	230
q3	2986	2943	2978	2943
q4	2134	1950	1920	1920
q5	5663	5673	5706	5673
q6	224	142	140	140
q7	2263	1805	1786	1786
q8	3370	3538	3561	3538
q9	8912	9048	9075	9048
q10	3617	3589	3566	3566
q11	639	506	496	496
q12	814	646	618	618
q13	11535	3280	3225	3225
q14	296	270	279	270
q15	585	533	516	516
q16	704	661	644	644
q17	1878	1654	1627	1627
q18	8283	7801	7604	7604
q19	1710	1660	1507	1507
q20	2117	1883	1884	1883
q21	5557	5603	5459	5459
q22	661	603	570	570
Total cold run time: 71554 ms
Total hot run time: 60493 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197551 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dfa39da617d9e799d71165e288c0394c1f81eac0, data reload: false

query1	1248	954	987	954
query2	6248	2084	2096	2084
query3	10971	4555	4452	4452
query4	67328	28598	23492	23492
query5	4914	464	463	463
query6	401	197	169	169
query7	5462	309	300	300
query8	332	240	242	240
query9	8511	2756	2736	2736
query10	436	243	248	243
query11	16977	15273	16098	15273
query12	160	104	103	103
query13	1450	423	399	399
query14	10777	6988	7715	6988
query15	217	203	198	198
query16	6967	467	495	467
query17	1285	578	561	561
query18	1790	302	299	299
query19	200	161	156	156
query20	112	112	109	109
query21	198	107	107	107
query22	4521	4583	4502	4502
query23	34936	34434	34576	34434
query24	5678	2567	2460	2460
query25	509	384	387	384
query26	634	157	149	149
query27	1682	294	294	294
query28	4496	2459	2488	2459
query29	711	417	423	417
query30	209	151	154	151
query31	985	847	864	847
query32	64	57	52	52
query33	455	283	282	282
query34	951	517	546	517
query35	869	769	758	758
query36	1089	945	984	945
query37	123	79	68	68
query38	4608	4538	4447	4447
query39	1517	1489	1473	1473
query40	204	109	108	108
query41	47	52	50	50
query42	110	102	104	102
query43	544	505	501	501
query44	1199	840	838	838
query45	200	176	176	176
query46	1190	760	738	738
query47	2032	1917	1938	1917
query48	441	340	325	325
query49	783	420	417	417
query50	827	418	407	407
query51	7287	7173	7207	7173
query52	99	85	95	85
query53	258	177	182	177
query54	504	402	395	395
query55	79	71	74	71
query56	265	234	238	234
query57	1226	1108	1125	1108
query58	215	224	215	215
query59	3189	2991	3001	2991
query60	274	235	241	235
query61	106	104	102	102
query62	787	684	672	672
query63	209	188	198	188
query64	1346	675	686	675
query65	3280	3215	3195	3195
query66	718	296	307	296
query67	15906	15686	15646	15646
query68	4032	579	559	559
query69	433	253	256	253
query70	1098	1140	1122	1122
query71	361	250	249	249
query72	6383	4049	3988	3988
query73	757	368	360	360
query74	9475	9188	9054	9054
query75	3410	2700	2637	2637
query76	1944	1102	1097	1097
query77	473	278	283	278
query78	10494	9464	9403	9403
query79	1694	598	600	598
query80	1145	454	493	454
query81	506	239	240	239
query82	1255	118	122	118
query83	248	139	198	139
query84	274	69	65	65
query85	896	306	313	306
query86	375	301	303	301
query87	4629	4541	4581	4541
query88	3712	2219	2182	2182
query89	425	299	292	292
query90	1972	190	195	190
query91	137	103	104	103
query92	67	51	49	49
query93	2005	530	548	530
query94	835	296	301	296
query95	356	253	257	253
query96	607	279	274	274
query97	2854	2659	2655	2655
query98	223	193	203	193
query99	1636	1313	1304	1304
Total cold run time: 318057 ms
Total hot run time: 197551 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit dfa39da617d9e799d71165e288c0394c1f81eac0, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.07	0.07
query4	1.63	0.10	0.11
query5	0.44	0.42	0.41
query6	1.15	0.65	0.65
query7	0.02	0.02	0.01
query8	0.05	0.03	0.03
query9	0.57	0.52	0.50
query10	0.54	0.55	0.57
query11	0.14	0.10	0.10
query12	0.14	0.12	0.10
query13	0.61	0.60	0.61
query14	2.84	2.78	2.90
query15	0.90	0.83	0.82
query16	0.38	0.39	0.39
query17	1.05	0.99	1.08
query18	0.21	0.20	0.21
query19	1.99	1.87	1.98
query20	0.01	0.01	0.01
query21	15.37	0.60	0.57
query22	3.01	1.70	2.38
query23	16.98	0.88	0.90
query24	3.22	0.77	0.50
query25	0.26	0.20	0.15
query26	0.25	0.13	0.13
query27	0.04	0.04	0.04
query28	11.27	1.09	1.07
query29	12.61	3.25	3.21
query30	0.24	0.06	0.06
query31	2.88	0.38	0.38
query32	3.28	0.46	0.48
query33	2.98	3.01	3.01
query34	17.02	4.43	4.46
query35	4.47	4.47	4.49
query36	0.65	0.48	0.49
query37	0.08	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 108 s
Total hot run time: 32.08 s

@englefly englefly closed this Nov 30, 2024
@englefly englefly deleted the huge-binary-v5 branch November 30, 2024 03:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants