Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](nereids) support one phase DeferMaterializeTopN #45693 branch-3.0 #45848

Merged
merged 1 commit into from
Dec 25, 2024

Conversation

englefly
Copy link
Contributor

What problem does this PR solve?

pick #45693
Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@englefly
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40419 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a35db2e4e9a774cf04eaa9ac01ece81cdc7a9679, data reload: false

------ Round 1 ----------------------------------
q1	17570	7375	7296	7296
q2	2057	169	165	165
q3	10555	1100	1174	1100
q4	10221	763	732	732
q5	7756	2797	2762	2762
q6	237	149	143	143
q7	974	616	606	606
q8	9348	1873	1951	1873
q9	6730	6442	6403	6403
q10	6951	2290	2335	2290
q11	454	263	252	252
q12	398	209	205	205
q13	17794	2967	2964	2964
q14	232	208	209	208
q15	558	528	524	524
q16	673	603	602	602
q17	990	550	523	523
q18	7369	6593	6611	6593
q19	2858	1083	1023	1023
q20	460	206	191	191
q21	3916	3074	2976	2976
q22	1067	988	998	988
Total cold run time: 109168 ms
Total hot run time: 40419 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7411	7350	7200	7200
q2	326	230	227	227
q3	2844	2961	2847	2847
q4	2045	1755	1763	1755
q5	5688	5642	5676	5642
q6	220	139	134	134
q7	2116	1754	1799	1754
q8	3341	3522	3469	3469
q9	8779	8809	8977	8809
q10	3588	3522	3463	3463
q11	594	497	503	497
q12	792	604	631	604
q13	17173	3069	3116	3069
q14	306	267	272	267
q15	548	514	508	508
q16	720	630	652	630
q17	1833	1588	1569	1569
q18	7740	7448	7386	7386
q19	3280	1584	1412	1412
q20	2024	1811	1776	1776
q21	9985	4975	4987	4975
q22	1096	1001	976	976
Total cold run time: 82449 ms
Total hot run time: 58969 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190841 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a35db2e4e9a774cf04eaa9ac01ece81cdc7a9679, data reload: false

query1	986	369	358	358
query2	6694	2127	2021	2021
query3	6698	213	225	213
query4	33985	23752	23462	23462
query5	4301	463	442	442
query6	263	171	178	171
query7	4624	304	305	304
query8	286	225	211	211
query9	9646	2716	2686	2686
query10	491	260	258	258
query11	17977	15161	15372	15161
query12	155	102	98	98
query13	1632	422	405	405
query14	9531	6994	7454	6994
query15	233	173	174	173
query16	7823	463	476	463
query17	1634	572	558	558
query18	2034	317	317	317
query19	238	156	164	156
query20	114	106	110	106
query21	64	45	44	44
query22	4631	4216	4365	4216
query23	34114	33611	33735	33611
query24	12293	2927	2914	2914
query25	698	377	408	377
query26	1873	166	171	166
query27	2944	292	292	292
query28	8315	2465	2451	2451
query29	1130	434	433	433
query30	328	160	164	160
query31	992	762	787	762
query32	96	60	59	59
query33	772	278	276	276
query34	1013	504	519	504
query35	871	729	721	721
query36	1107	933	933	933
query37	270	71	74	71
query38	3991	3836	3946	3836
query39	1475	1408	1435	1408
query40	221	81	82	81
query41	51	55	48	48
query42	109	96	98	96
query43	539	497	501	497
query44	1297	786	784	784
query45	180	170	164	164
query46	1135	713	737	713
query47	1892	1782	1800	1782
query48	467	358	368	358
query49	1274	375	373	373
query50	800	424	412	412
query51	7244	7154	7044	7044
query52	101	93	90	90
query53	260	186	191	186
query54	1219	473	445	445
query55	80	73	74	73
query56	249	241	266	241
query57	1189	1089	1075	1075
query58	232	219	215	215
query59	3199	3115	3043	3043
query60	295	256	258	256
query61	132	126	110	110
query62	842	662	656	656
query63	216	185	183	183
query64	5366	656	625	625
query65	3262	3194	3188	3188
query66	1437	320	306	306
query67	15641	15281	15284	15281
query68	3533	547	555	547
query69	391	262	269	262
query70	1218	1112	1119	1112
query71	329	259	248	248
query72	6177	4194	4149	4149
query73	747	350	360	350
query74	10001	8943	8877	8877
query75	3368	2638	2595	2595
query76	2557	1092	1084	1084
query77	440	314	275	275
query78	10466	9701	9670	9670
query79	2976	598	587	587
query80	2110	448	449	448
query81	579	246	243	243
query82	780	127	121	121
query83	266	153	158	153
query84	293	90	84	84
query85	2166	374	355	355
query86	499	280	305	280
query87	4348	4407	4307	4307
query88	4862	2381	2366	2366
query89	415	284	302	284
query90	2111	186	191	186
query91	195	159	158	158
query92	62	85	49	49
query93	4717	541	544	541
query94	964	307	285	285
query95	364	256	252	252
query96	623	285	276	276
query97	3269	3116	3191	3116
query98	212	198	195	195
query99	1651	1270	1287	1270
Total cold run time: 307940 ms
Total hot run time: 190841 ms

@morrySnow morrySnow merged commit 93f86ce into apache:branch-3.0 Dec 25, 2024
19 of 21 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants