Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [fix](nereids) support one phase DeferMaterializeTopN #45693 #45714

Closed
wants to merge 1 commit into from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #45693

### What problem does this PR solve?
make DeferMaterializeTopN support one phase sort.
@Thearas
Copy link
Contributor

Thearas commented Dec 20, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 20, 2024
@Thearas
Copy link
Contributor

Thearas commented Dec 20, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40620 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4eb2be3a7d9ff885694408deb0bc662e2ed1b553, data reload: false

------ Round 1 ----------------------------------
q1	17594	7459	7240	7240
q2	2055	169	161	161
q3	10744	1072	1189	1072
q4	10545	766	750	750
q5	7775	2852	2765	2765
q6	236	150	151	150
q7	970	618	605	605
q8	9575	1889	2009	1889
q9	8042	6407	6363	6363
q10	6994	2302	2299	2299
q11	480	262	265	262
q12	398	215	209	209
q13	17764	2947	2982	2947
q14	232	213	215	213
q15	560	524	518	518
q16	687	617	611	611
q17	973	594	589	589
q18	7120	6612	6613	6612
q19	2193	1076	1053	1053
q20	479	194	199	194
q21	3954	3218	3155	3155
q22	1090	963	967	963
Total cold run time: 110460 ms
Total hot run time: 40620 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7350	7191	7213	7191
q2	318	241	225	225
q3	2965	2874	2864	2864
q4	2060	1760	1752	1752
q5	5656	5719	5755	5719
q6	217	146	147	146
q7	2204	1750	1749	1749
q8	3329	3531	3402	3402
q9	8864	8844	8807	8807
q10	3547	3516	3487	3487
q11	587	511	495	495
q12	802	599	618	599
q13	16455	3152	3149	3149
q14	317	276	275	275
q15	552	527	526	526
q16	712	671	658	658
q17	1845	1604	1600	1600
q18	8162	7757	7490	7490
q19	1664	1562	1606	1562
q20	2036	1886	1864	1864
q21	5332	5297	5273	5273
q22	1114	1020	1023	1020
Total cold run time: 76088 ms
Total hot run time: 59853 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 194800 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4eb2be3a7d9ff885694408deb0bc662e2ed1b553, data reload: false

query1	1245	923	944	923
query2	6217	2120	2144	2120
query3	10971	4113	4152	4113
query4	65741	28654	23355	23355
query5	5225	460	455	455
query6	457	186	179	179
query7	5687	318	307	307
query8	320	228	234	228
query9	9226	2684	2665	2665
query10	497	269	257	257
query11	17827	15120	15820	15120
query12	147	94	98	94
query13	1586	461	424	424
query14	10444	6728	6466	6466
query15	215	173	179	173
query16	7224	531	501	501
query17	1099	572	589	572
query18	1895	336	327	327
query19	232	153	155	153
query20	118	108	115	108
query21	69	43	44	43
query22	4659	4738	4434	4434
query23	34519	33961	33974	33961
query24	6320	2977	2838	2838
query25	512	391	402	391
query26	670	167	156	156
query27	1864	297	295	295
query28	4320	2535	2509	2509
query29	682	440	437	437
query30	247	163	160	160
query31	1039	818	823	818
query32	65	53	58	53
query33	424	279	274	274
query34	901	498	514	498
query35	804	738	713	713
query36	1090	960	961	960
query37	116	69	68	68
query38	4060	3934	3999	3934
query39	1553	1438	1452	1438
query40	148	81	82	81
query41	48	45	44	44
query42	113	94	100	94
query43	540	511	515	511
query44	1162	793	809	793
query45	197	176	167	167
query46	1140	733	712	712
query47	1946	1866	1902	1866
query48	458	376	363	363
query49	728	376	376	376
query50	804	415	410	410
query51	7178	7218	7151	7151
query52	98	87	90	87
query53	252	181	182	181
query54	545	438	457	438
query55	79	76	73	73
query56	258	225	229	225
query57	1155	1123	1109	1109
query58	200	193	199	193
query59	3175	2936	3143	2936
query60	275	249	234	234
query61	105	107	104	104
query62	784	647	654	647
query63	213	188	195	188
query64	1686	667	623	623
query65	3221	3125	3184	3125
query66	727	295	300	295
query67	15683	15314	15253	15253
query68	4637	546	547	546
query69	439	248	252	248
query70	1161	1129	1055	1055
query71	336	251	254	251
query72	6452	3978	3887	3887
query73	745	341	343	341
query74	10231	8876	9000	8876
query75	3327	2618	2630	2618
query76	1885	1166	1072	1072
query77	507	259	274	259
query78	10651	9671	9565	9565
query79	7558	586	589	586
query80	1960	420	421	420
query81	550	245	240	240
query82	1268	116	115	115
query83	296	141	140	140
query84	281	85	75	75
query85	1569	297	293	293
query86	479	305	291	291
query87	4407	4161	4181	4161
query88	5797	2382	2475	2382
query89	418	284	285	284
query90	2010	183	181	181
query91	177	139	143	139
query92	69	45	49	45
query93	6518	518	521	518
query94	908	301	276	276
query95	350	245	252	245
query96	620	272	281	272
query97	3283	3130	3136	3130
query98	204	206	202	202
query99	1585	1288	1304	1288
Total cold run time: 333883 ms
Total hot run time: 194800 ms

@morrySnow morrySnow closed this Dec 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants