Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test perf #44223

Closed
wants to merge 3 commits into from
Closed

Test perf #44223

wants to merge 3 commits into from

Conversation

Gabriel39
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@Gabriel39 Gabriel39 marked this pull request as draft November 19, 2024 01:50
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@Gabriel39
Copy link
Contributor Author

run buildall

@Gabriel39
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 40186 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8622f259623d674b54f23d16de6340cfe0c0b3b8, data reload: false

------ Round 1 ----------------------------------
q1	17618	7442	7305	7305
q2	2064	188	164	164
q3	10875	1044	1120	1044
q4	10538	778	658	658
q5	7734	2823	2760	2760
q6	233	145	145	145
q7	989	608	595	595
q8	9580	1906	2037	1906
q9	7831	6432	6420	6420
q10	6982	2254	2309	2254
q11	457	260	266	260
q12	397	208	209	208
q13	17768	2999	2990	2990
q14	231	213	205	205
q15	563	525	516	516
q16	681	619	600	600
q17	971	516	534	516
q18	7193	6570	6367	6367
q19	2644	1048	1024	1024
q20	470	189	190	189
q21	4227	3092	3094	3092
q22	1071	978	968	968
Total cold run time: 111117 ms
Total hot run time: 40186 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7339	7205	7224	7205
q2	349	250	246	246
q3	2966	2859	2850	2850
q4	2027	1753	1715	1715
q5	5646	5701	5818	5701
q6	218	137	137	137
q7	2188	1811	1726	1726
q8	3366	3538	3387	3387
q9	8847	8901	8782	8782
q10	3553	3492	3500	3492
q11	586	487	490	487
q12	826	621	552	552
q13	16399	3157	3131	3131
q14	305	258	273	258
q15	601	546	534	534
q16	729	682	665	665
q17	1806	1619	1573	1573
q18	8190	7809	7326	7326
q19	3868	1540	1566	1540
q20	2045	1855	1866	1855
q21	5320	5451	5284	5284
q22	1137	1028	989	989
Total cold run time: 78311 ms
Total hot run time: 59435 ms

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@@ -994,20 +994,20 @@ void IRuntimeFilter::insert_batch(const vectorized::ColumnPtr column, size_t sta
Status IRuntimeFilter::publish(bool publish_local) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function 'publish' has cognitive complexity of 82 (threshold 50) [readability-function-cognitive-complexity]

Status IRuntimeFilter::publish(bool publish_local) {
                       ^
Additional context

be/src/exprs/runtime_filter.cpp:996: nesting level increased to 1

    auto send_to_remote_targets = [&](IRuntimeFilter* filter, uint64_t local_merge_time) {
                                  ^

be/src/exprs/runtime_filter.cpp:999: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(_state->global_runtime_filter_mgr()->get_merge_addr(&addr));
        ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:999: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(_state->global_runtime_filter_mgr()->get_merge_addr(&addr));
        ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1002: nesting level increased to 1

    auto send_to_local_targets = [&](std::shared_ptr<RuntimePredicateWrapper> wrapper, bool global,
                                 ^

be/src/exprs/runtime_filter.cpp:1014: nesting level increased to 1

    auto do_merge = [&]() {
                    ^

be/src/exprs/runtime_filter.cpp:1015: +2, including nesting penalty of 1, nesting level increased to 2

        if (!_state->global_runtime_filter_mgr()->get_consume_filters(_filter_id).empty()) {
        ^

be/src/exprs/runtime_filter.cpp:1017: +3, including nesting penalty of 2, nesting level increased to 3

            RETURN_IF_ERROR(_state->global_runtime_filter_mgr()->get_local_merge_producer_filters(
            ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1017: +4, including nesting penalty of 3, nesting level increased to 4

            RETURN_IF_ERROR(_state->global_runtime_filter_mgr()->get_local_merge_producer_filters(
            ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1021: +3, including nesting penalty of 2, nesting level increased to 3

            RETURN_IF_ERROR(local_merge_filters->filters[0]->merge_from(_wrapper.get()));
            ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1021: +4, including nesting penalty of 3, nesting level increased to 4

            RETURN_IF_ERROR(local_merge_filters->filters[0]->merge_from(_wrapper.get()));
            ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1024: +3, including nesting penalty of 2, nesting level increased to 3

            if (local_merge_filters->merge_time == 0) {
            ^

be/src/exprs/runtime_filter.cpp:1025: +4, including nesting penalty of 3, nesting level increased to 4

                if (_has_local_target) {
                ^

be/src/exprs/runtime_filter.cpp:1026: +5, including nesting penalty of 4, nesting level increased to 5

                    RETURN_IF_ERROR(send_to_local_targets(
                    ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1026: +6, including nesting penalty of 5, nesting level increased to 6

                    RETURN_IF_ERROR(send_to_local_targets(
                    ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1029: +1, nesting level increased to 4

                } else {
                  ^

be/src/exprs/runtime_filter.cpp:1030: +5, including nesting penalty of 4, nesting level increased to 5

                    RETURN_IF_ERROR(send_to_remote_targets(
                    ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1030: +6, including nesting penalty of 5, nesting level increased to 6

                    RETURN_IF_ERROR(send_to_remote_targets(
                    ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1039: +1, including nesting penalty of 0, nesting level increased to 1

    if (_has_local_target) {
    ^

be/src/exprs/runtime_filter.cpp:1042: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(do_merge());
        ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1042: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(do_merge());
        ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1043: +2, including nesting penalty of 1, nesting level increased to 2

        RETURN_IF_ERROR(send_to_local_targets(_wrapper, false));
        ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1043: +3, including nesting penalty of 2, nesting level increased to 3

        RETURN_IF_ERROR(send_to_local_targets(_wrapper, false));
        ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1044: +1, nesting level increased to 1

    } else if (!publish_local) {
           ^

be/src/exprs/runtime_filter.cpp:1045: +2, including nesting penalty of 1, nesting level increased to 2

        if (_is_broadcast_join || _state->get_query_ctx()->be_exec_version() < USE_NEW_SERDE) {
        ^

be/src/exprs/runtime_filter.cpp:1045: +1

        if (_is_broadcast_join || _state->get_query_ctx()->be_exec_version() < USE_NEW_SERDE) {
                               ^

be/src/exprs/runtime_filter.cpp:1046: +3, including nesting penalty of 2, nesting level increased to 3

            RETURN_IF_ERROR(send_to_remote_targets(this, 0));
            ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1046: +4, including nesting penalty of 3, nesting level increased to 4

            RETURN_IF_ERROR(send_to_remote_targets(this, 0));
            ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1047: +1, nesting level increased to 2

        } else {
          ^

be/src/exprs/runtime_filter.cpp:1048: +3, including nesting penalty of 2, nesting level increased to 3

            RETURN_IF_ERROR(do_merge());
            ^

be/src/common/status.h:631: expanded from macro 'RETURN_IF_ERROR'

    do {                                \
    ^

be/src/exprs/runtime_filter.cpp:1048: +4, including nesting penalty of 3, nesting level increased to 4

            RETURN_IF_ERROR(do_merge());
            ^

be/src/common/status.h:633: expanded from macro 'RETURN_IF_ERROR'

        if (UNLIKELY(!_status_.ok())) { \
        ^

be/src/exprs/runtime_filter.cpp:1050: +1, nesting level increased to 1

    } else {
      ^

@Gabriel39
Copy link
Contributor Author

run buildall

1 similar comment
@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40628 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 55ebcb37e0c782f7cabb79ec14322eb47d40bcbf, data reload: false

------ Round 1 ----------------------------------
q1	17959	7570	7253	7253
q2	2087	171	165	165
q3	10898	1077	1153	1077
q4	10553	771	721	721
q5	7752	2779	2738	2738
q6	234	145	148	145
q7	986	612	619	612
q8	9379	1908	2003	1908
q9	6583	6390	6407	6390
q10	6997	2306	2297	2297
q11	449	268	261	261
q12	409	210	212	210
q13	17778	2953	2994	2953
q14	243	204	216	204
q15	560	521	531	521
q16	662	619	613	613
q17	968	554	574	554
q18	7295	6631	6581	6581
q19	3367	1041	1071	1041
q20	478	200	201	200
q21	3881	3260	3186	3186
q22	1061	998	1004	998
Total cold run time: 110579 ms
Total hot run time: 40628 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7379	7207	7193	7193
q2	338	248	243	243
q3	2977	2907	2814	2814
q4	2080	1806	1768	1768
q5	5640	5710	5723	5710
q6	224	145	142	142
q7	2219	1786	1756	1756
q8	3356	3535	3388	3388
q9	8924	8861	8838	8838
q10	3516	3482	3472	3472
q11	592	510	491	491
q12	792	629	628	628
q13	16534	3166	3173	3166
q14	315	267	287	267
q15	578	551	535	535
q16	709	682	666	666
q17	1851	1615	1622	1615
q18	8109	7847	7419	7419
q19	2280	1528	1637	1528
q20	2087	1861	1833	1833
q21	5446	5222	5241	5222
q22	1127	1007	981	981
Total cold run time: 77073 ms
Total hot run time: 59675 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193045 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 55ebcb37e0c782f7cabb79ec14322eb47d40bcbf, data reload: false

query1	2527	2240	2224	2224
query2	6221	2177	2096	2096
query3	15158	10546	236	236
query4	33013	23449	23529	23449
query5	3837	448	434	434
query6	286	171	177	171
query7	3980	304	310	304
query8	283	224	241	224
query9	9208	2684	2649	2649
query10	462	261	251	251
query11	17928	15076	15235	15076
query12	155	100	102	100
query13	1544	414	410	410
query14	8951	6439	7600	6439
query15	268	177	181	177
query16	8044	457	520	457
query17	1472	595	595	595
query18	2369	631	613	613
query19	255	186	205	186
query20	131	122	119	119
query21	203	107	104	104
query22	4511	4512	4345	4345
query23	35043	34021	33952	33952
query24	11635	3406	3261	3261
query25	611	406	417	406
query26	927	179	176	176
query27	2264	297	306	297
query28	6767	2549	2523	2523
query29	815	461	460	460
query30	400	310	300	300
query31	1056	826	832	826
query32	92	58	55	55
query33	783	293	272	272
query34	1044	515	517	515
query35	855	719	727	719
query36	1142	978	991	978
query37	118	74	68	68
query38	4056	3963	4054	3963
query39	1546	1452	1457	1452
query40	206	106	104	104
query41	50	48	47	47
query42	110	96	103	96
query43	521	501	489	489
query44	1236	806	813	806
query45	186	170	174	170
query46	1179	751	730	730
query47	1983	1911	1847	1847
query48	458	374	382	374
query49	917	383	388	383
query50	833	413	407	407
query51	7818	7170	7321	7170
query52	101	88	89	88
query53	256	182	183	182
query54	1147	453	439	439
query55	78	71	72	71
query56	250	239	226	226
query57	1176	1111	1092	1092
query58	217	207	192	192
query59	3147	2893	2790	2790
query60	274	260	255	255
query61	106	103	116	103
query62	872	654	659	654
query63	220	192	186	186
query64	4369	636	602	602
query65	3237	3166	3177	3166
query66	833	294	302	294
query67	15734	15443	15295	15295
query68	4488	560	574	560
query69	463	256	248	248
query70	1156	1133	1137	1133
query71	390	252	244	244
query72	6494	3711	3970	3711
query73	758	338	337	337
query74	10068	9026	8839	8839
query75	3377	2607	2588	2588
query76	2858	1010	1058	1010
query77	569	263	261	261
query78	10514	9719	9555	9555
query79	8849	584	597	584
query80	2220	417	423	417
query81	601	243	243	243
query82	1125	120	108	108
query83	290	159	155	155
query84	286	72	72	72
query85	1894	302	288	288
query86	467	286	311	286
query87	4484	4337	4276	4276
query88	5697	2376	2363	2363
query89	548	295	288	288
query90	2062	185	185	185
query91	176	149	144	144
query92	65	48	48	48
query93	7775	532	539	532
query94	918	281	274	274
query95	350	250	250	250
query96	640	281	287	281
query97	3361	3147	3138	3138
query98	226	203	194	194
query99	1616	1293	1293	1293
Total cold run time: 322259 ms
Total hot run time: 193045 ms

@Gabriel39
Copy link
Contributor Author

run buildall

1 similar comment
@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40558 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit bda18736d82de7d109fd7d19e8e87b53d166c4a5, data reload: false

------ Round 1 ----------------------------------
q1	17952	7414	7649	7414
q2	2037	157	159	157
q3	10659	1095	1183	1095
q4	10377	720	764	720
q5	7805	2859	2805	2805
q6	235	145	149	145
q7	966	601	612	601
q8	9351	1897	1950	1897
q9	6650	6417	6414	6414
q10	7052	2303	2289	2289
q11	465	263	261	261
q12	407	219	220	219
q13	17801	2981	2932	2932
q14	244	198	210	198
q15	568	531	522	522
q16	681	608	605	605
q17	963	608	548	548
q18	7398	6608	6627	6608
q19	1798	1067	975	975
q20	460	194	212	194
q21	3935	3045	2993	2993
q22	1079	966	1004	966
Total cold run time: 108883 ms
Total hot run time: 40558 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7328	7242	7185	7185
q2	314	216	212	212
q3	2865	2935	2890	2890
q4	2019	1749	1733	1733
q5	5708	5623	5717	5623
q6	216	136	139	136
q7	2125	1753	1764	1753
q8	3240	3447	3453	3447
q9	8807	8796	8828	8796
q10	3546	3535	3764	3535
q11	597	509	490	490
q12	807	606	629	606
q13	17049	3092	3094	3092
q14	305	288	278	278
q15	560	511	498	498
q16	703	659	649	649
q17	1795	1567	1557	1557
q18	7697	7363	7196	7196
q19	1702	1461	1465	1461
q20	1979	1795	1771	1771
q21	5127	5055	4979	4979
q22	1081	958	978	958
Total cold run time: 75570 ms
Total hot run time: 58845 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 188817 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit bda18736d82de7d109fd7d19e8e87b53d166c4a5, data reload: false

query1	957	371	384	371
query2	6511	2130	1985	1985
query3	6703	215	223	215
query4	33818	23428	23362	23362
query5	4305	445	423	423
query6	266	180	172	172
query7	4623	325	306	306
query8	299	222	229	222
query9	9484	2706	2687	2687
query10	480	265	252	252
query11	18211	15196	15174	15174
query12	151	103	102	102
query13	1653	414	399	399
query14	9348	7076	7084	7076
query15	256	167	173	167
query16	8103	476	450	450
query17	1616	562	537	537
query18	2054	242	243	242
query19	245	149	150	149
query20	111	109	106	106
query21	207	105	103	103
query22	4389	4534	4186	4186
query23	34561	33724	33521	33521
query24	11522	1749	1726	1726
query25	726	409	404	404
query26	1778	168	168	168
query27	2911	296	303	296
query28	8223	2497	2513	2497
query29	1084	447	429	429
query30	279	103	101	101
query31	1031	786	796	786
query32	94	56	56	56
query33	781	275	286	275
query34	1005	499	505	499
query35	846	697	706	697
query36	1088	952	914	914
query37	279	73	79	73
query38	3987	3832	3943	3832
query39	1502	1421	1413	1413
query40	290	98	105	98
query41	53	52	53	52
query42	110	98	97	97
query43	534	489	490	489
query44	1236	778	790	778
query45	182	169	169	169
query46	1149	719	719	719
query47	1917	1850	1838	1838
query48	446	365	363	363
query49	1299	403	385	385
query50	796	398	409	398
query51	7229	7119	7169	7119
query52	106	92	88	88
query53	266	195	189	189
query54	570	336	327	327
query55	80	76	75	75
query56	259	270	231	231
query57	1213	1154	1119	1119
query58	229	197	198	197
query59	3210	3074	2894	2894
query60	280	247	260	247
query61	110	111	108	108
query62	882	664	673	664
query63	210	186	179	179
query64	5170	617	607	607
query65	3241	3183	3163	3163
query66	1421	309	304	304
query67	15774	15658	15389	15389
query68	5163	552	535	535
query69	437	252	252	252
query70	1165	1145	1162	1145
query71	435	250	248	248
query72	6330	3914	3932	3914
query73	756	339	343	339
query74	10450	8754	8908	8754
query75	3459	2626	2600	2600
query76	3187	1094	1015	1015
query77	381	266	263	263
query78	10642	9856	9668	9668
query79	8223	584	594	584
query80	1634	426	412	412
query81	559	237	239	237
query82	1350	118	117	117
query83	257	135	150	135
query84	291	82	75	75
query85	2230	304	296	296
query86	497	269	313	269
query87	4450	4353	4314	4314
query88	5691	2357	2362	2357
query89	436	303	289	289
query90	2025	177	182	177
query91	174	139	141	139
query92	68	49	52	49
query93	6128	536	536	536
query94	897	295	293	293
query95	351	245	250	245
query96	623	282	284	282
query97	3317	3124	3184	3124
query98	218	202	193	193
query99	1938	1302	1311	1302
Total cold run time: 317511 ms
Total hot run time: 188817 ms

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40700 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 793f96d121a01ef34ac468b259aa324094fc9bd6, data reload: false

------ Round 1 ----------------------------------
q1	17830	8386	7330	7330
q2	2083	170	161	161
q3	10708	1118	1217	1118
q4	10572	728	758	728
q5	7743	2842	2788	2788
q6	239	149	149	149
q7	968	604	597	597
q8	9581	1967	1998	1967
q9	8147	6367	6429	6367
q10	7011	2320	2313	2313
q11	454	258	264	258
q12	396	211	212	211
q13	17772	2965	2975	2965
q14	241	218	208	208
q15	584	523	519	519
q16	693	592	612	592
q17	994	583	567	567
q18	7176	6573	6563	6563
q19	2513	1012	1031	1012
q20	473	191	198	191
q21	3923	3162	3112	3112
q22	1086	984	1023	984
Total cold run time: 111187 ms
Total hot run time: 40700 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7395	7293	7904	7293
q2	350	245	242	242
q3	3055	2923	2940	2923
q4	2028	1771	1794	1771
q5	5696	5734	5818	5734
q6	219	147	139	139
q7	2194	1808	1804	1804
q8	3321	3455	3522	3455
q9	8908	8870	8825	8825
q10	3551	3481	3529	3481
q11	599	520	487	487
q12	831	592	591	591
q13	16797	3134	3222	3134
q14	300	266	272	266
q15	580	513	533	513
q16	702	676	660	660
q17	1854	1604	1619	1604
q18	8106	7848	7595	7595
q19	1737	1636	1644	1636
q20	2036	1830	1868	1830
q21	5352	5339	5330	5330
q22	1104	1049	1008	1008
Total cold run time: 76715 ms
Total hot run time: 60321 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 195640 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 793f96d121a01ef34ac468b259aa324094fc9bd6, data reload: false

query1	1241	919	925	919
query2	6238	2121	2047	2047
query3	10831	3995	4105	3995
query4	65856	29171	23430	23430
query5	5842	450	433	433
query6	490	176	172	172
query7	6099	311	304	304
query8	326	221	231	221
query9	9584	2670	2670	2670
query10	551	277	256	256
query11	18305	15522	15701	15522
query12	169	109	104	104
query13	1605	425	421	421
query14	11246	6354	7952	6354
query15	213	185	177	177
query16	7672	519	502	502
query17	1101	550	545	545
query18	2095	311	302	302
query19	221	152	145	145
query20	121	112	115	112
query21	218	104	100	100
query22	4656	4571	4591	4571
query23	34839	34010	33849	33849
query24	5861	2914	2916	2914
query25	525	400	385	385
query26	712	165	165	165
query27	1974	294	297	294
query28	4362	2566	2532	2532
query29	679	450	461	450
query30	241	166	165	165
query31	1005	821	812	812
query32	67	57	55	55
query33	434	297	296	296
query34	909	502	508	502
query35	853	780	724	724
query36	1091	937	952	937
query37	117	71	78	71
query38	4051	4103	3992	3992
query39	1534	1510	1470	1470
query40	203	105	111	105
query41	55	51	50	50
query42	113	100	106	100
query43	537	497	505	497
query44	1175	819	806	806
query45	185	171	176	171
query46	1193	759	730	730
query47	1978	1929	1851	1851
query48	465	385	370	370
query49	781	398	396	396
query50	835	426	414	414
query51	7359	7231	7087	7087
query52	95	90	85	85
query53	258	186	188	186
query54	565	454	478	454
query55	73	75	74	74
query56	272	256	253	253
query57	1166	1104	1102	1102
query58	220	208	210	208
query59	3253	3128	3017	3017
query60	302	263	254	254
query61	115	110	105	105
query62	759	666	664	664
query63	209	195	190	190
query64	1811	638	616	616
query65	3229	3181	3168	3168
query66	698	287	296	287
query67	16013	15336	15479	15336
query68	4565	549	550	549
query69	417	256	250	250
query70	1109	1099	1147	1099
query71	362	253	260	253
query72	6492	3900	3906	3900
query73	751	335	338	335
query74	9433	8948	8896	8896
query75	3340	2607	2691	2607
query76	2699	1156	1084	1084
query77	473	255	269	255
query78	10778	9844	9512	9512
query79	8361	575	581	575
query80	2025	440	419	419
query81	557	240	238	238
query82	1365	112	116	112
query83	253	141	138	138
query84	290	84	78	78
query85	1809	306	296	296
query86	486	303	287	287
query87	4530	4286	4326	4286
query88	5848	2368	2363	2363
query89	565	289	295	289
query90	2137	179	182	179
query91	192	143	147	143
query92	59	47	49	47
query93	6671	543	539	539
query94	965	304	287	287
query95	347	247	252	247
query96	635	278	273	273
query97	3340	3112	3155	3112
query98	224	193	192	192
query99	1606	1314	1309	1309
Total cold run time: 340535 ms
Total hot run time: 195640 ms

@Gabriel39
Copy link
Contributor Author

run buildall

1 similar comment
@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40256 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8d54cb63bb105be86f32a450415a15d4329f4c64, data reload: false

------ Round 1 ----------------------------------
q1	17601	7355	7237	7237
q2	2032	165	172	165
q3	10583	1090	1119	1090
q4	10230	732	671	671
q5	7719	2796	2682	2682
q6	236	148	162	148
q7	960	611	593	593
q8	9344	1896	1989	1896
q9	6620	6339	6358	6339
q10	7030	2330	2300	2300
q11	456	261	264	261
q12	391	214	220	214
q13	17803	2957	2985	2957
q14	233	216	206	206
q15	570	514	523	514
q16	676	598	605	598
q17	953	568	536	536
q18	7354	6541	6687	6541
q19	2305	1007	951	951
q20	490	193	198	193
q21	4090	3190	3198	3190
q22	1087	996	974	974
Total cold run time: 108763 ms
Total hot run time: 40256 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7313	7208	7217	7208
q2	331	228	222	222
q3	2832	2720	2738	2720
q4	1891	1632	1684	1632
q5	5343	5405	5388	5388
q6	219	139	142	139
q7	2074	1671	1666	1666
q8	3199	3374	3357	3357
q9	8534	8496	8473	8473
q10	3442	3378	3396	3378
q11	603	480	504	480
q12	763	592	599	592
q13	16922	3049	2957	2957
q14	279	258	259	258
q15	562	510	498	498
q16	693	658	649	649
q17	1811	1572	1537	1537
q18	7712	7485	7358	7358
q19	1620	1526	1473	1473
q20	1977	1789	1765	1765
q21	5193	5149	5068	5068
q22	1077	977	982	977
Total cold run time: 74390 ms
Total hot run time: 57795 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190009 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8d54cb63bb105be86f32a450415a15d4329f4c64, data reload: false

query1	995	371	362	362
query2	6531	2084	2099	2084
query3	6701	216	221	216
query4	33838	23549	23522	23522
query5	4340	443	443	443
query6	278	168	162	162
query7	4623	312	295	295
query8	276	213	220	213
query9	9678	2667	2649	2649
query10	482	264	267	264
query11	17856	15300	15175	15175
query12	148	103	99	99
query13	1622	432	393	393
query14	9389	7193	6867	6867
query15	228	173	173	173
query16	7904	474	483	474
query17	1619	564	546	546
query18	2035	303	309	303
query19	205	165	159	159
query20	119	109	107	107
query21	207	103	101	101
query22	4440	4297	4136	4136
query23	34251	33929	33712	33712
query24	11909	2836	2835	2835
query25	705	401	392	392
query26	1865	175	167	167
query27	2939	294	293	293
query28	8442	2490	2496	2490
query29	1135	444	425	425
query30	332	169	166	166
query31	1021	794	807	794
query32	97	56	60	56
query33	778	287	279	279
query34	1008	498	489	489
query35	845	732	727	727
query36	1091	952	892	892
query37	269	75	77	75
query38	3975	3871	3882	3871
query39	1467	1411	1440	1411
query40	292	106	99	99
query41	53	50	49	49
query42	112	102	99	99
query43	514	492	487	487
query44	1247	799	773	773
query45	189	171	171	171
query46	1130	706	704	704
query47	1897	1810	1785	1785
query48	461	372	362	362
query49	1292	392	385	385
query50	802	397	398	397
query51	7167	7172	7371	7172
query52	100	95	90	90
query53	256	181	185	181
query54	1150	467	448	448
query55	77	78	80	78
query56	268	248	244	244
query57	1188	1080	1102	1080
query58	241	199	215	199
query59	3131	3057	3021	3021
query60	298	253	264	253
query61	109	105	106	105
query62	870	659	656	656
query63	211	187	185	185
query64	5253	635	604	604
query65	3330	3172	3179	3172
query66	1418	322	320	320
query67	15733	15167	15281	15167
query68	4746	546	550	546
query69	423	255	252	252
query70	1161	1113	1135	1113
query71	405	252	278	252
query72	6412	3942	3876	3876
query73	760	348	334	334
query74	10338	8885	8930	8885
query75	3320	2633	2637	2633
query76	3091	1185	986	986
query77	403	277	255	255
query78	10600	9555	9431	9431
query79	9795	576	576	576
query80	2123	420	405	405
query81	556	245	236	236
query82	1439	116	114	114
query83	256	138	137	137
query84	294	78	80	78
query85	2278	303	292	292
query86	489	301	298	298
query87	4412	4217	4288	4217
query88	5700	2382	2371	2371
query89	558	291	289	289
query90	2111	182	182	182
query91	181	145	143	143
query92	59	50	48	48
query93	7487	550	554	550
query94	940	285	286	285
query95	349	252	252	252
query96	643	277	274	274
query97	3340	3139	3154	3139
query98	217	196	200	196
query99	1984	1261	1300	1261
Total cold run time: 321302 ms
Total hot run time: 190009 ms

@Gabriel39
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40265 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 2ccadddddb766470e9bcfc19cdab4a4ccd6a01d9, data reload: false

------ Round 1 ----------------------------------
q1	18012	7451	7351	7351
q2	2774	161	164	161
q3	10562	1089	1138	1089
q4	10215	787	742	742
q5	7721	2821	2741	2741
q6	235	146	147	146
q7	958	601	590	590
q8	9341	1876	1924	1876
q9	6635	6337	6354	6337
q10	6983	2356	2311	2311
q11	452	263	263	263
q12	406	205	208	205
q13	17780	2961	2965	2961
q14	233	205	215	205
q15	567	514	510	510
q16	666	598	600	598
q17	954	539	549	539
q18	7312	6467	6543	6467
q19	2364	1025	1020	1020
q20	469	194	187	187
q21	3805	3148	3022	3022
q22	1051	944	966	944
Total cold run time: 109495 ms
Total hot run time: 40265 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7355	7277	7180	7180
q2	328	232	228	228
q3	2828	3054	2963	2963
q4	1985	1743	1714	1714
q5	5682	5627	5593	5593
q6	217	141	143	141
q7	2165	1762	1737	1737
q8	3285	3495	3484	3484
q9	8866	8768	8767	8767
q10	3556	3519	3472	3472
q11	593	501	510	501
q12	783	612	592	592
q13	16985	3117	3075	3075
q14	285	253	260	253
q15	547	514	558	514
q16	692	647	657	647
q17	1774	1583	1542	1542
q18	7758	7320	7341	7320
q19	1662	1507	1426	1426
q20	1965	1790	1761	1761
q21	5056	5144	5084	5084
q22	1061	997	996	996
Total cold run time: 75428 ms
Total hot run time: 58990 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190466 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 2ccadddddb766470e9bcfc19cdab4a4ccd6a01d9, data reload: false

query1	972	378	360	360
query2	6551	2096	2003	2003
query3	6704	210	217	210
query4	33752	23396	23406	23396
query5	4364	433	442	433
query6	263	186	162	162
query7	4633	312	294	294
query8	279	213	214	213
query9	9441	2659	2653	2653
query10	466	265	262	262
query11	18220	15066	15064	15064
query12	148	99	97	97
query13	1642	409	386	386
query14	9418	7338	7270	7270
query15	241	175	176	175
query16	8100	462	452	452
query17	1623	565	551	551
query18	2115	299	316	299
query19	228	152	148	148
query20	114	112	110	110
query21	203	107	101	101
query22	4611	4258	4493	4258
query23	35115	33893	33938	33893
query24	12088	2802	2853	2802
query25	704	401	419	401
query26	1789	163	166	163
query27	3004	292	291	291
query28	8384	2497	2456	2456
query29	1048	446	408	408
query30	332	163	160	160
query31	1121	765	784	765
query32	100	61	60	60
query33	768	274	273	273
query34	1054	501	498	498
query35	805	742	717	717
query36	1090	925	935	925
query37	285	73	75	73
query38	3920	3846	3866	3846
query39	1507	1403	1398	1398
query40	289	98	97	97
query41	53	48	46	46
query42	106	99	93	93
query43	533	463	467	463
query44	1236	770	769	769
query45	186	168	162	162
query46	1130	711	689	689
query47	1904	1817	1827	1817
query48	460	366	368	366
query49	1246	356	382	356
query50	780	393	398	393
query51	7213	7028	7042	7028
query52	102	83	86	83
query53	256	180	183	180
query54	1129	453	465	453
query55	75	70	76	70
query56	247	240	231	231
query57	1185	1130	1108	1108
query58	228	196	206	196
query59	3008	2826	2954	2826
query60	267	239	251	239
query61	110	106	115	106
query62	840	676	662	662
query63	209	178	180	178
query64	5199	646	614	614
query65	3277	3154	3177	3154
query66	1232	318	333	318
query67	15772	15561	15577	15561
query68	4559	557	554	554
query69	401	253	249	249
query70	1140	1032	1117	1032
query71	336	260	256	256
query72	6362	4160	4193	4160
query73	749	337	332	332
query74	9977	8915	8938	8915
query75	3359	2630	2627	2627
query76	2775	1141	1040	1040
query77	397	276	269	269
query78	10643	9709	9400	9400
query79	8004	587	599	587
query80	2065	447	450	447
query81	564	239	237	237
query82	1040	125	119	119
query83	316	150	147	147
query84	291	82	83	82
query85	1877	308	286	286
query86	487	287	273	273
query87	4408	4178	4291	4178
query88	5599	2397	2402	2397
query89	445	285	288	285
query90	2093	176	179	176
query91	177	165	143	143
query92	67	48	50	48
query93	6118	558	548	548
query94	1134	282	271	271
query95	349	252	260	252
query96	645	284	282	282
query97	3321	3129	3165	3129
query98	222	201	200	200
query99	1746	1317	1261	1261
Total cold run time: 317140 ms
Total hot run time: 190466 ms

@Gabriel39 Gabriel39 closed this Nov 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants