Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Enhancement] (nereids)implement alterWorkloadPolicyCommand in nereids #44501

Merged
merged 3 commits into from
Nov 27, 2024

Conversation

Vallishp
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #42794

Related PR: #xxx

Problem Summary:
implement alterWorkloadPolicyCommand in nereids

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Vallishp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39488 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit b9bae44436a1d8d34210380f34bba005455002a8, data reload: false

------ Round 1 ----------------------------------
q1	17585	7408	7215	7215
q2	2043	170	184	170
q3	10545	1074	1202	1074
q4	10578	707	682	682
q5	7605	2705	2788	2705
q6	236	148	146	146
q7	977	639	598	598
q8	9239	1840	1904	1840
q9	6469	6405	6395	6395
q10	7009	2341	2322	2322
q11	467	252	255	252
q12	416	219	211	211
q13	17766	2999	3014	2999
q14	263	208	224	208
q15	574	527	512	512
q16	670	578	599	578
q17	971	474	531	474
q18	7181	6671	6620	6620
q19	1364	912	957	912
q20	445	176	179	176
q21	4040	3300	3089	3089
q22	383	310	311	310
Total cold run time: 106826 ms
Total hot run time: 39488 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7210	7236	7222	7222
q2	317	230	230	230
q3	2918	2802	2892	2802
q4	1984	1800	1778	1778
q5	5677	5716	5701	5701
q6	233	142	144	142
q7	2307	1821	1842	1821
q8	3411	3574	3497	3497
q9	8816	8893	8911	8893
q10	3592	3532	3556	3532
q11	588	521	507	507
q12	806	641	626	626
q13	12741	3258	3234	3234
q14	303	285	266	266
q15	558	521	509	509
q16	704	656	640	640
q17	1854	1615	1621	1615
q18	8287	7770	7705	7705
q19	1671	1624	1500	1500
q20	2102	1906	1873	1873
q21	5653	5365	5295	5295
q22	626	577	561	561
Total cold run time: 72358 ms
Total hot run time: 59949 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196658 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit b9bae44436a1d8d34210380f34bba005455002a8, data reload: false

query1	1256	940	919	919
query2	6238	2016	2066	2016
query3	10798	3974	3892	3892
query4	67279	28825	23620	23620
query5	4973	473	444	444
query6	403	184	177	177
query7	5512	295	283	283
query8	315	234	226	226
query9	8804	2711	2703	2703
query10	427	252	259	252
query11	16870	15143	15930	15143
query12	162	104	109	104
query13	1458	450	439	439
query14	10563	7724	7745	7724
query15	208	196	196	196
query16	7145	452	456	452
query17	1244	590	588	588
query18	1545	327	295	295
query19	193	145	149	145
query20	116	113	111	111
query21	224	100	99	99
query22	4663	4703	4431	4431
query23	34724	34448	34580	34448
query24	5413	2382	2456	2382
query25	478	403	386	386
query26	662	145	153	145
query27	2154	282	303	282
query28	4360	2511	2487	2487
query29	676	427	419	419
query30	221	151	151	151
query31	1042	816	869	816
query32	64	54	52	52
query33	440	290	264	264
query34	963	492	513	492
query35	832	745	722	722
query36	1086	976	1001	976
query37	121	72	79	72
query38	4436	4332	4427	4332
query39	1520	1471	1460	1460
query40	207	98	95	95
query41	46	42	42	42
query42	106	95	96	95
query43	550	488	492	488
query44	1193	840	838	838
query45	188	170	165	165
query46	1148	688	698	688
query47	2012	1901	1935	1901
query48	430	311	336	311
query49	728	407	388	388
query50	841	392	392	392
query51	7343	7354	7084	7084
query52	95	82	89	82
query53	253	174	176	174
query54	505	389	388	388
query55	78	76	73	73
query56	242	248	231	231
query57	1282	1170	1159	1159
query58	218	207	201	201
query59	3272	3096	3238	3096
query60	268	239	243	239
query61	103	106	104	104
query62	794	667	675	667
query63	210	207	196	196
query64	1402	682	639	639
query65	3254	3207	3196	3196
query66	696	298	297	297
query67	16009	15547	15606	15547
query68	3893	558	555	555
query69	412	244	257	244
query70	1195	1093	1125	1093
query71	356	250	249	249
query72	6385	4125	4093	4093
query73	778	353	361	353
query74	10126	9049	8913	8913
query75	3363	2677	2676	2676
query76	1805	1095	1153	1095
query77	502	264	277	264
query78	10531	9392	9284	9284
query79	2172	583	601	583
query80	1478	423	422	422
query81	522	233	232	232
query82	1287	117	115	115
query83	274	137	138	137
query84	276	69	74	69
query85	1047	301	294	294
query86	392	297	293	293
query87	4823	4583	4497	4497
query88	3607	2216	2200	2200
query89	420	288	306	288
query90	1965	190	180	180
query91	135	100	97	97
query92	62	47	52	47
query93	2843	522	520	520
query94	834	293	282	282
query95	348	250	244	244
query96	626	276	275	275
query97	2838	2685	2667	2667
query98	213	198	194	194
query99	1586	1282	1287	1282
Total cold run time: 320155 ms
Total hot run time: 196658 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.79 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit b9bae44436a1d8d34210380f34bba005455002a8, data reload: false

query1	0.03	0.03	0.03
query2	0.09	0.03	0.04
query3	0.23	0.07	0.07
query4	1.62	0.10	0.11
query5	0.41	0.40	0.41
query6	1.16	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.03	0.03
query9	0.58	0.53	0.51
query10	0.56	0.58	0.56
query11	0.15	0.11	0.11
query12	0.13	0.11	0.12
query13	0.59	0.61	0.60
query14	2.83	2.84	2.70
query15	0.91	0.83	0.81
query16	0.38	0.38	0.36
query17	1.04	1.04	1.02
query18	0.22	0.21	0.21
query19	1.95	1.78	1.99
query20	0.01	0.01	0.01
query21	15.36	0.59	0.58
query22	2.43	2.74	1.32
query23	16.98	0.84	0.91
query24	2.99	1.59	0.79
query25	0.31	0.08	0.12
query26	0.53	0.14	0.14
query27	0.04	0.04	0.04
query28	10.34	1.09	1.07
query29	12.57	3.26	3.27
query30	0.26	0.06	0.07
query31	2.88	0.38	0.38
query32	3.27	0.46	0.46
query33	2.99	3.01	3.03
query34	16.97	4.46	4.48
query35	4.47	4.46	4.44
query36	0.64	0.50	0.47
query37	0.09	0.06	0.06
query38	0.05	0.03	0.04
query39	0.03	0.02	0.02
query40	0.15	0.12	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 106.44 s
Total hot run time: 31.79 s

starocean999
starocean999 previously approved these changes Nov 25, 2024
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 25, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@LiBinfeng-01
Copy link
Collaborator

run p0

@Vallishp Vallishp force-pushed the alter_workload_policy branch from b9bae44 to 260497e Compare November 26, 2024 08:26
@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Nov 26, 2024
@Vallishp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39927 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 260497e38a8dfed9c88f39e86d4fdb3a8d749002, data reload: false

------ Round 1 ----------------------------------
q1	17582	7549	7272	7272
q2	2039	174	161	161
q3	10595	1072	1145	1072
q4	10596	714	717	714
q5	7623	2728	2649	2649
q6	246	145	146	145
q7	997	627	593	593
q8	9242	1840	1916	1840
q9	6611	6420	6415	6415
q10	7020	2300	2335	2300
q11	463	254	251	251
q12	423	217	212	212
q13	17785	3061	3036	3036
q14	257	209	213	209
q15	575	526	517	517
q16	643	593	599	593
q17	978	515	565	515
q18	7277	6774	6718	6718
q19	1340	1038	922	922
q20	483	179	186	179
q21	4110	3340	3300	3300
q22	383	314	320	314
Total cold run time: 107268 ms
Total hot run time: 39927 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7296	7218	7231	7218
q2	324	227	225	225
q3	2922	2832	2924	2832
q4	2054	1849	1798	1798
q5	5698	5676	5605	5605
q6	227	141	141	141
q7	2262	1831	1831	1831
q8	3420	3586	3517	3517
q9	8869	9000	8892	8892
q10	3603	3532	3565	3532
q11	617	513	524	513
q12	843	600	604	600
q13	11590	3340	3243	3243
q14	309	269	284	269
q15	575	522	527	522
q16	682	650	659	650
q17	1872	1649	1618	1618
q18	8301	7820	7905	7820
q19	1723	1635	1562	1562
q20	2146	1872	1878	1872
q21	5627	5366	5520	5366
q22	677	571	584	571
Total cold run time: 71637 ms
Total hot run time: 60197 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195932 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 260497e38a8dfed9c88f39e86d4fdb3a8d749002, data reload: false

query1	1295	956	909	909
query2	6377	2066	2056	2056
query3	10798	3892	3900	3892
query4	67609	28899	23641	23641
query5	4923	464	449	449
query6	425	181	185	181
query7	5534	292	286	286
query8	321	227	224	224
query9	8442	2643	2642	2642
query10	433	249	244	244
query11	17451	15169	15770	15169
query12	158	96	101	96
query13	1519	420	433	420
query14	10397	7974	6824	6824
query15	217	183	194	183
query16	7103	489	466	466
query17	1101	560	574	560
query18	1816	305	303	303
query19	193	171	148	148
query20	129	113	115	113
query21	209	106	102	102
query22	4747	4570	4520	4520
query23	34690	34136	34431	34136
query24	5429	2538	2557	2538
query25	486	377	391	377
query26	657	146	147	146
query27	1995	272	286	272
query28	4645	2462	2466	2462
query29	693	418	416	416
query30	222	149	152	149
query31	1019	822	844	822
query32	70	61	62	61
query33	413	302	291	291
query34	944	515	525	515
query35	871	743	746	743
query36	1123	947	977	947
query37	124	75	74	74
query38	4515	4369	4361	4361
query39	1544	1488	1462	1462
query40	211	97	104	97
query41	47	41	43	41
query42	107	95	114	95
query43	558	495	495	495
query44	1182	817	820	817
query45	187	162	166	162
query46	1157	712	720	712
query47	2047	1969	1924	1924
query48	423	309	319	309
query49	722	382	384	382
query50	843	384	414	384
query51	7437	7351	7239	7239
query52	100	91	84	84
query53	258	179	172	172
query54	500	398	381	381
query55	77	76	76	76
query56	248	234	241	234
query57	1285	1175	1133	1133
query58	221	217	216	216
query59	3087	2887	2815	2815
query60	263	240	256	240
query61	140	131	136	131
query62	772	693	652	652
query63	220	190	192	190
query64	1463	777	639	639
query65	3288	3221	3247	3221
query66	637	300	312	300
query67	16015	15721	15624	15624
query68	4014	580	538	538
query69	439	247	249	247
query70	1182	1146	1143	1143
query71	325	252	248	248
query72	6459	4044	4044	4044
query73	762	346	352	346
query74	10252	9131	9094	9094
query75	3529	2671	2661	2661
query76	1779	1042	1182	1042
query77	464	284	337	284
query78	10455	9422	9409	9409
query79	2118	581	628	581
query80	1374	417	446	417
query81	531	241	234	234
query82	1260	115	116	115
query83	271	151	156	151
query84	283	76	70	70
query85	1007	290	296	290
query86	420	301	298	298
query87	4786	4544	4497	4497
query88	3606	2187	2153	2153
query89	405	295	307	295
query90	1953	188	186	186
query91	140	105	113	105
query92	66	50	50	50
query93	2871	530	540	530
query94	841	301	296	296
query95	351	247	245	245
query96	634	280	272	272
query97	2846	2646	2691	2646
query98	209	189	199	189
query99	1848	1291	1328	1291
Total cold run time: 321612 ms
Total hot run time: 195932 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.11 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 260497e38a8dfed9c88f39e86d4fdb3a8d749002, data reload: false

query1	0.03	0.04	0.02
query2	0.07	0.06	0.03
query3	0.23	0.08	0.07
query4	1.63	0.10	0.11
query5	0.40	0.44	0.40
query6	1.18	0.66	0.65
query7	0.02	0.01	0.02
query8	0.03	0.03	0.03
query9	0.59	0.51	0.50
query10	0.56	0.56	0.56
query11	0.13	0.11	0.11
query12	0.14	0.11	0.12
query13	0.61	0.60	0.60
query14	2.70	2.72	2.74
query15	0.91	0.82	0.83
query16	0.39	0.38	0.38
query17	1.07	1.08	1.02
query18	0.21	0.20	0.21
query19	1.93	1.86	2.03
query20	0.01	0.01	0.01
query21	15.36	0.56	0.58
query22	3.00	1.72	2.06
query23	17.02	1.02	0.83
query24	3.18	1.60	0.67
query25	0.29	0.07	0.19
query26	0.47	0.15	0.13
query27	0.04	0.04	0.04
query28	10.50	1.10	1.07
query29	12.57	3.22	3.20
query30	0.24	0.06	0.07
query31	2.84	0.37	0.36
query32	3.30	0.46	0.46
query33	3.01	3.11	3.02
query34	17.19	4.49	4.52
query35	4.51	4.43	4.50
query36	0.67	0.48	0.48
query37	0.09	0.07	0.06
query38	0.04	0.04	0.04
query39	0.04	0.02	0.03
query40	0.16	0.13	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.5 s
Total hot run time: 32.11 s

@Vallishp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39940 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit db772d6f85d866231eb2a6a1a72744b4651ea56a, data reload: false

------ Round 1 ----------------------------------
q1	17635	7437	7311	7311
q2	2055	178	173	173
q3	10587	1063	1182	1063
q4	10563	703	697	697
q5	7597	2728	2613	2613
q6	236	146	146	146
q7	971	625	589	589
q8	9248	1850	1898	1850
q9	6528	6376	6370	6370
q10	7032	2302	2302	2302
q11	457	255	251	251
q12	420	227	226	226
q13	17774	3039	3028	3028
q14	233	208	216	208
q15	575	526	534	526
q16	664	586	577	577
q17	970	574	548	548
q18	7160	6718	6741	6718
q19	1335	1006	1079	1006
q20	472	188	185	185
q21	4129	3237	3279	3237
q22	379	318	316	316
Total cold run time: 107020 ms
Total hot run time: 39940 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7216	7301	7231	7231
q2	328	225	235	225
q3	2890	2818	2920	2818
q4	2011	1765	1739	1739
q5	5695	5633	5602	5602
q6	225	141	143	141
q7	2283	1827	1808	1808
q8	3381	3527	3457	3457
q9	8788	8872	8840	8840
q10	3604	3517	3523	3517
q11	614	527	530	527
q12	816	638	585	585
q13	11073	3225	3240	3225
q14	301	275	276	275
q15	577	514	525	514
q16	670	640	644	640
q17	1818	1659	1574	1574
q18	8201	7811	7645	7645
q19	3709	1606	1613	1606
q20	2195	1921	1949	1921
q21	5659	5209	5432	5209
q22	646	568	565	565
Total cold run time: 72700 ms
Total hot run time: 59664 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196031 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit db772d6f85d866231eb2a6a1a72744b4651ea56a, data reload: false

query1	1259	961	916	916
query2	6212	2020	1992	1992
query3	10794	3952	3865	3865
query4	67348	28865	23561	23561
query5	4881	463	439	439
query6	396	163	166	163
query7	5469	294	282	282
query8	296	212	208	208
query9	8521	2630	2619	2619
query10	429	247	242	242
query11	17203	15255	16059	15255
query12	146	103	104	103
query13	1487	434	444	434
query14	10535	7463	6593	6593
query15	221	197	172	172
query16	7207	494	474	474
query17	1062	592	550	550
query18	1856	299	318	299
query19	220	156	152	152
query20	121	125	110	110
query21	214	105	103	103
query22	4801	4433	4627	4433
query23	35666	34795	34472	34472
query24	5474	2510	2592	2510
query25	478	391	392	391
query26	649	152	151	151
query27	1924	281	282	281
query28	4632	2486	2463	2463
query29	671	414	421	414
query30	211	158	147	147
query31	1067	883	864	864
query32	67	52	54	52
query33	475	302	317	302
query34	939	523	514	514
query35	851	730	745	730
query36	1091	962	957	957
query37	126	77	72	72
query38	4454	4409	4386	4386
query39	1516	1478	1442	1442
query40	200	99	101	99
query41	48	44	43	43
query42	120	101	102	101
query43	537	487	516	487
query44	1182	856	826	826
query45	181	169	170	169
query46	1155	708	695	695
query47	2075	1975	1959	1959
query48	421	316	328	316
query49	757	397	385	385
query50	838	398	400	398
query51	7280	7281	7075	7075
query52	96	84	88	84
query53	260	177	187	177
query54	505	387	384	384
query55	75	75	73	73
query56	272	222	269	222
query57	1265	1175	1167	1167
query58	227	207	207	207
query59	3336	3012	2825	2825
query60	305	251	266	251
query61	134	126	126	126
query62	805	667	674	667
query63	219	187	195	187
query64	1414	664	620	620
query65	3268	3229	3226	3226
query66	691	300	301	300
query67	16531	15910	15828	15828
query68	3554	591	559	559
query69	416	254	261	254
query70	1230	1122	1177	1122
query71	387	246	244	244
query72	6100	4121	3943	3943
query73	777	355	349	349
query74	10128	8970	8927	8927
query75	3387	2695	2690	2690
query76	1989	1197	1235	1197
query77	545	288	274	274
query78	10620	9502	9467	9467
query79	1597	590	595	590
query80	854	416	428	416
query81	518	232	229	229
query82	1349	115	120	115
query83	265	150	154	150
query84	285	69	69	69
query85	902	300	290	290
query86	351	298	302	298
query87	4678	4552	4568	4552
query88	3483	2177	2149	2149
query89	415	294	298	294
query90	2018	187	226	187
query91	136	108	107	107
query92	62	47	48	47
query93	1909	545	541	541
query94	758	295	279	279
query95	343	248	247	247
query96	622	276	280	276
query97	2903	2711	2663	2663
query98	214	195	195	195
query99	1693	1301	1312	1301
Total cold run time: 319654 ms
Total hot run time: 196031 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.16 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit db772d6f85d866231eb2a6a1a72744b4651ea56a, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.04	0.03
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.44	0.40	0.41
query6	1.19	0.65	0.65
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.56	0.53	0.50
query10	0.58	0.54	0.56
query11	0.15	0.10	0.10
query12	0.14	0.11	0.12
query13	0.61	0.58	0.60
query14	2.71	2.71	2.72
query15	0.89	0.84	0.83
query16	0.39	0.37	0.38
query17	1.03	1.05	1.08
query18	0.22	0.22	0.21
query19	1.85	1.80	2.00
query20	0.02	0.01	0.02
query21	15.62	0.61	0.59
query22	2.40	2.67	1.39
query23	17.02	0.86	0.70
query24	2.90	1.29	1.27
query25	0.19	0.09	0.13
query26	0.67	0.13	0.14
query27	0.04	0.04	0.04
query28	10.46	1.09	1.08
query29	12.52	3.24	3.19
query30	0.25	0.06	0.06
query31	2.88	0.38	0.37
query32	3.27	0.47	0.47
query33	2.99	3.00	3.12
query34	17.04	4.43	4.48
query35	4.54	4.47	4.43
query36	0.67	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.03	0.03	0.02
query40	0.16	0.13	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.02	0.03
Total cold run time: 106.73 s
Total hot run time: 32.16 s

@Vallishp
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39865 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ea12224caa44be3ea37cd3b441e5fa14f2f66c78, data reload: false

------ Round 1 ----------------------------------
q1	17596	7556	7273	7273
q2	2051	176	170	170
q3	10585	1103	1231	1103
q4	10430	737	704	704
q5	7612	2746	2639	2639
q6	251	149	145	145
q7	988	617	604	604
q8	9238	1848	1984	1848
q9	6561	6428	6403	6403
q10	6992	2302	2317	2302
q11	489	260	279	260
q12	423	212	220	212
q13	17769	3021	3025	3021
q14	248	219	218	218
q15	580	533	523	523
q16	643	589	584	584
q17	984	553	550	550
q18	7248	6662	6728	6662
q19	1336	1051	975	975
q20	494	181	186	181
q21	3991	3168	3169	3168
q22	382	320	322	320
Total cold run time: 106891 ms
Total hot run time: 39865 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7322	7246	7262	7246
q2	323	233	235	233
q3	2952	2794	2975	2794
q4	2038	1755	1773	1755
q5	5676	5705	5666	5666
q6	228	142	141	141
q7	2286	1858	1830	1830
q8	3373	3593	3502	3502
q9	8898	8988	8943	8943
q10	3574	3542	3541	3541
q11	608	487	513	487
q12	829	621	595	595
q13	12302	3325	3277	3277
q14	320	273	270	270
q15	574	519	510	510
q16	686	654	648	648
q17	1861	1653	1611	1611
q18	8323	7683	7767	7683
q19	1682	1590	1556	1556
q20	2153	1850	1886	1850
q21	5545	5394	5481	5394
q22	629	574	550	550
Total cold run time: 72182 ms
Total hot run time: 60082 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197180 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ea12224caa44be3ea37cd3b441e5fa14f2f66c78, data reload: false

query1	1306	942	934	934
query2	6232	2130	1994	1994
query3	10999	4015	3935	3935
query4	67388	29077	23527	23527
query5	4899	459	452	452
query6	421	202	187	187
query7	5525	307	291	291
query8	315	241	230	230
query9	8754	2796	2759	2759
query10	447	252	284	252
query11	17104	15410	15946	15410
query12	161	111	111	111
query13	1489	419	399	399
query14	10849	7614	7263	7263
query15	199	185	191	185
query16	7119	460	479	460
query17	1124	566	560	560
query18	1890	297	302	297
query19	201	145	150	145
query20	120	115	108	108
query21	215	104	98	98
query22	5017	4672	4904	4672
query23	35150	34318	34465	34318
query24	5399	2504	2581	2504
query25	502	383	393	383
query26	637	154	151	151
query27	1808	290	293	290
query28	4630	2542	2500	2500
query29	659	414	438	414
query30	223	150	152	150
query31	1030	843	844	843
query32	70	59	62	59
query33	464	300	299	299
query34	949	509	514	509
query35	847	728	717	717
query36	1103	967	991	967
query37	126	74	81	74
query38	4537	4509	4380	4380
query39	1508	1453	1460	1453
query40	205	103	100	100
query41	44	44	44	44
query42	107	95	95	95
query43	533	500	492	492
query44	1178	844	826	826
query45	180	179	171	171
query46	1149	720	747	720
query47	2055	1933	1976	1933
query48	417	319	321	319
query49	730	399	387	387
query50	853	391	393	391
query51	7440	7114	7151	7114
query52	96	88	83	83
query53	252	185	179	179
query54	509	404	385	385
query55	75	73	76	73
query56	270	249	249	249
query57	1315	1194	1204	1194
query58	218	212	212	212
query59	3314	3061	2973	2973
query60	264	254	273	254
query61	133	133	136	133
query62	785	679	670	670
query63	211	188	205	188
query64	1503	800	641	641
query65	3264	3170	3179	3170
query66	714	293	297	293
query67	16157	15678	15769	15678
query68	4035	563	580	563
query69	433	253	290	253
query70	1213	1108	1125	1108
query71	326	258	247	247
query72	6174	4051	3993	3993
query73	761	360	365	360
query74	10227	9013	8954	8954
query75	3383	2651	2641	2641
query76	2170	1129	1193	1129
query77	491	268	275	268
query78	10548	9463	9454	9454
query79	2121	601	617	601
query80	1407	467	429	429
query81	521	229	229	229
query82	1321	116	123	116
query83	266	150	149	149
query84	283	69	68	68
query85	1093	310	303	303
query86	430	287	304	287
query87	4846	4464	4562	4464
query88	3842	2252	2198	2198
query89	420	290	292	290
query90	1937	185	182	182
query91	136	108	106	106
query92	62	49	50	49
query93	3086	544	537	537
query94	816	288	297	288
query95	342	248	247	247
query96	625	283	275	275
query97	2911	2678	2739	2678
query98	214	189	198	189
query99	2026	1289	1278	1278
Total cold run time: 323853 ms
Total hot run time: 197180 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ea12224caa44be3ea37cd3b441e5fa14f2f66c78, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.04	0.03
query3	0.23	0.07	0.07
query4	1.61	0.10	0.11
query5	0.41	0.44	0.42
query6	1.14	0.66	0.66
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.59	0.51	0.50
query10	0.55	0.54	0.55
query11	0.14	0.11	0.11
query12	0.14	0.11	0.11
query13	0.62	0.59	0.61
query14	2.82	2.74	2.73
query15	0.89	0.82	0.84
query16	0.39	0.39	0.41
query17	1.08	1.08	1.08
query18	0.23	0.22	0.20
query19	1.97	1.77	1.96
query20	0.01	0.01	0.01
query21	15.36	0.60	0.58
query22	2.97	1.86	2.54
query23	17.07	0.91	0.97
query24	3.35	0.78	1.68
query25	0.23	0.27	0.11
query26	0.43	0.14	0.13
query27	0.04	0.04	0.05
query28	10.56	1.10	1.08
query29	12.54	3.23	3.22
query30	0.25	0.07	0.06
query31	2.86	0.39	0.37
query32	3.28	0.46	0.49
query33	2.97	2.99	3.06
query34	17.07	4.45	4.45
query35	4.49	4.46	4.46
query36	0.68	0.52	0.48
query37	0.10	0.06	0.06
query38	0.05	0.04	0.03
query39	0.04	0.02	0.02
query40	0.17	0.13	0.13
query41	0.09	0.03	0.02
query42	0.04	0.03	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.66 s
Total hot run time: 32.49 s

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Nov 27, 2024
@starocean999 starocean999 merged commit bf67d44 into apache:master Nov 27, 2024
22 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Enhancement] (nereids)implement alterWorkloadPolicyCommand in nereids
4 participants