Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[feat](test) add bloomfilter ut case #44351

Merged
merged 9 commits into from
Dec 2, 2024
Merged

Conversation

airborne12
Copy link
Member

@airborne12 airborne12 commented Nov 20, 2024

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

@@ -295,5 +296,203 @@ TEST_F(BloomFilterIndexReaderWriterTest, test_decimal) {
delete[] val;
}

TEST_F(BloomFilterIndexReaderWriterTest, test_datev2) {
size_t num = 1024 * 3 - 1;
uint32_t* val = new uint32_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
uint32_t* val = new uint32_t[num];
auto* val = new uint32_t[num];


TEST_F(BloomFilterIndexReaderWriterTest, test_datetimev2) {
size_t num = 1024 * 3 - 1;
uint64_t* val = new uint64_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
uint64_t* val = new uint64_t[num];
auto* val = new uint64_t[num];


TEST_F(BloomFilterIndexReaderWriterTest, test_decimal32) {
size_t num = 1024 * 3 - 1;
int32_t* val = new int32_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
int32_t* val = new int32_t[num];
auto* val = new int32_t[num];

delete[] val;
}

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function 'test_ngram_bloom_filter_index_reader_writer' exceeds recommended size/complexity thresholds [readability-function-size]

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^
Additional context

be/test/olap/rowset/segment_v2/bloom_filter_index_reader_writer_test.cpp:340: 95 lines including whitespace and comments (threshold 80)

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^

@airborne12
Copy link
Member Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

TEST_F(BloomFilterIndexReaderWriterTest, test_decimal64) {
size_t num = 1024 * 3 - 1;
;
int64_t* val = new int64_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
int64_t* val = new int64_t[num];
auto* val = new int64_t[num];


TEST_F(BloomFilterIndexReaderWriterTest, test_ipv4) {
size_t num = 1024 * 3 - 1;
uint32_t* val = new uint32_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
uint32_t* val = new uint32_t[num];
auto* val = new uint32_t[num];


TEST_F(BloomFilterIndexReaderWriterTest, test_decimal128i) {
size_t num = 1024 * 3 - 1;
int128_t* val = new int128_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
int128_t* val = new int128_t[num];
auto* val = new int128_t[num];

}

std::string file_name = "bloom_filter_decimal128i";
int128_t not_exist_value = int128_t(9999999999999999999ULL);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with a cast to avoid duplicating the type name [modernize-use-auto]

Suggested change
int128_t not_exist_value = int128_t(9999999999999999999ULL);
auto not_exist_value = int128_t(9999999999999999999ULL);


TEST_F(BloomFilterIndexReaderWriterTest, test_ipv6) {
size_t num = 1024 * 3 - 1;
uint128_t* val = new uint128_t[num];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: use auto when initializing with new to avoid duplicating the type name [modernize-use-auto]

Suggested change
uint128_t* val = new uint128_t[num];
auto* val = new uint128_t[num];

delete[] val;
}

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function 'test_ngram_bloom_filter_index_reader_writer' exceeds recommended size/complexity thresholds [readability-function-size]

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^
Additional context

be/test/olap/rowset/segment_v2/bloom_filter_index_reader_writer_test.cpp:428: 95 lines including whitespace and comments (threshold 80)

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^

@doris-robot
Copy link

TPC-H: Total hot run time: 39852 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5, data reload: false

------ Round 1 ----------------------------------
q1	17704	7476	7280	7280
q2	2038	168	164	164
q3	10821	1099	1152	1099
q4	10563	765	741	741
q5	7608	2717	2682	2682
q6	237	147	143	143
q7	956	614	607	607
q8	9223	1882	1947	1882
q9	6528	6379	6369	6369
q10	6979	2319	2324	2319
q11	475	262	255	255
q12	430	221	210	210
q13	17764	3011	3059	3011
q14	239	212	218	212
q15	583	532	509	509
q16	668	587	575	575
q17	970	483	521	483
q18	7225	6696	6783	6696
q19	1349	1065	1003	1003
q20	466	182	181	181
q21	3986	3193	3118	3118
q22	368	313	320	313
Total cold run time: 107180 ms
Total hot run time: 39852 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7239	7219	7191	7191
q2	320	232	222	222
q3	2935	2814	2949	2814
q4	2044	1828	1780	1780
q5	5693	5682	5661	5661
q6	222	141	139	139
q7	2249	1866	1827	1827
q8	3445	3543	3491	3491
q9	8848	8876	8892	8876
q10	3584	3547	3556	3547
q11	599	506	503	503
q12	838	627	615	615
q13	10641	3313	3203	3203
q14	316	273	289	273
q15	590	541	525	525
q16	686	654	639	639
q17	1841	1640	1586	1586
q18	8270	7800	7564	7564
q19	1696	1587	1592	1587
q20	2098	1878	1859	1859
q21	5582	5361	5474	5361
q22	718	583	593	583
Total cold run time: 70454 ms
Total hot run time: 59846 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196097 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5, data reload: false

query1	1241	939	956	939
query2	6247	2161	2150	2150
query3	10799	4155	4067	4067
query4	67525	29004	23643	23643
query5	4952	441	452	441
query6	413	187	194	187
query7	5502	302	296	296
query8	320	226	230	226
query9	8535	2672	2673	2672
query10	447	252	255	252
query11	17330	15186	15870	15186
query12	149	103	109	103
query13	1510	416	422	416
query14	10544	7508	7076	7076
query15	208	194	207	194
query16	7070	429	478	429
query17	989	560	548	548
query18	1813	292	280	280
query19	200	161	146	146
query20	113	119	111	111
query21	205	97	109	97
query22	4687	4433	4365	4365
query23	34638	34179	33930	33930
query24	5315	2472	2447	2447
query25	464	390	385	385
query26	641	154	152	152
query27	1683	294	290	290
query28	4041	2466	2422	2422
query29	691	438	447	438
query30	213	151	146	146
query31	1015	832	817	817
query32	66	59	61	59
query33	396	293	290	290
query34	936	514	525	514
query35	841	705	713	705
query36	1083	941	962	941
query37	116	74	81	74
query38	4337	4367	4254	4254
query39	1552	1429	1562	1429
query40	199	100	100	100
query41	90	47	42	42
query42	103	94	101	94
query43	539	506	518	506
query44	1175	820	820	820
query45	181	162	165	162
query46	1135	681	676	676
query47	1947	1863	1832	1832
query48	411	321	322	321
query49	715	385	386	385
query50	805	380	417	380
query51	7224	7174	7102	7102
query52	100	90	95	90
query53	253	176	182	176
query54	518	400	389	389
query55	82	75	80	75
query56	256	231	249	231
query57	1327	1190	1149	1149
query58	226	217	223	217
query59	3343	3206	3322	3206
query60	288	248	245	245
query61	141	109	107	107
query62	787	675	659	659
query63	211	190	196	190
query64	1399	683	648	648
query65	3335	3184	3223	3184
query66	719	319	316	316
query67	15987	15787	15713	15713
query68	3974	573	544	544
query69	431	256	256	256
query70	1144	1168	1146	1146
query71	359	250	255	250
query72	6413	4073	3946	3946
query73	767	355	366	355
query74	10238	8950	8976	8950
query75	3405	2695	2671	2671
query76	1804	1025	996	996
query77	499	278	288	278
query78	10627	9584	9429	9429
query79	1994	611	603	603
query80	1400	425	429	425
query81	526	235	229	229
query82	578	116	115	115
query83	190	155	159	155
query84	278	71	74	71
query85	985	309	296	296
query86	418	312	306	306
query87	4706	4661	4569	4569
query88	3760	2226	2192	2192
query89	433	297	294	294
query90	2032	188	191	188
query91	131	101	101	101
query92	66	50	54	50
query93	2812	552	546	546
query94	916	291	290	290
query95	356	248	247	247
query96	638	286	294	286
query97	2941	2688	2717	2688
query98	216	202	196	196
query99	1583	1306	1297	1297
Total cold run time: 318943 ms
Total hot run time: 196097 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.61 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.04	0.03
query3	0.24	0.08	0.07
query4	1.59	0.11	0.10
query5	0.44	0.43	0.41
query6	1.17	0.65	0.66
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.59	0.50	0.50
query10	0.56	0.55	0.56
query11	0.14	0.10	0.10
query12	0.14	0.11	0.11
query13	0.61	0.60	0.59
query14	2.74	2.77	2.83
query15	0.90	0.83	0.81
query16	0.39	0.40	0.37
query17	1.06	1.05	1.04
query18	0.20	0.20	0.19
query19	1.96	1.88	2.01
query20	0.01	0.01	0.01
query21	15.38	0.61	0.60
query22	2.72	2.78	1.67
query23	17.08	0.96	0.86
query24	3.36	1.18	1.40
query25	0.44	0.09	0.08
query26	0.36	0.13	0.14
query27	0.06	0.04	0.04
query28	9.98	1.10	1.07
query29	12.52	3.20	3.17
query30	0.25	0.07	0.06
query31	2.86	0.39	0.37
query32	3.27	0.47	0.46
query33	2.98	3.01	3.04
query34	17.27	4.45	4.43
query35	4.49	4.44	4.48
query36	0.66	0.49	0.48
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.03	0.02
query40	0.17	0.12	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.06 s
Total hot run time: 32.61 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.07% (9913/26039)
Line Coverage: 29.25% (82939/283545)
Region Coverage: 28.39% (42604/150083)
Branch Coverage: 24.94% (21594/86590)
Coverage Report: http://coverage.selectdb-in.cc/coverage/d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5_d4ed7c81cb4ffbb4f21141eb129c02f6e1f850c5/report/index.html

@airborne12
Copy link
Member Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

delete[] val;
}

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function 'test_ngram_bloom_filter_index_reader_writer' exceeds recommended size/complexity thresholds [readability-function-size]

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^
Additional context

be/test/olap/rowset/segment_v2/bloom_filter_index_reader_writer_test.cpp:477: 95 lines including whitespace and comments (threshold 80)

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^

@doris-robot
Copy link

TPC-H: Total hot run time: 40294 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ca998c7c1bebba900a1c0d09740aa17ee570fa1a, data reload: false

------ Round 1 ----------------------------------
q1	17658	7635	7361	7361
q2	2052	182	185	182
q3	10631	1116	1183	1116
q4	10315	751	779	751
q5	7606	2764	2702	2702
q6	241	148	148	148
q7	995	622	596	596
q8	9227	1933	1951	1933
q9	6592	6455	6511	6455
q10	7067	2302	2316	2302
q11	475	264	261	261
q12	419	219	218	218
q13	17780	2990	3032	2990
q14	256	230	226	226
q15	590	531	525	525
q16	673	582	596	582
q17	998	573	562	562
q18	7437	6624	6772	6624
q19	1378	1036	1050	1036
q20	482	182	190	182
q21	3984	3314	3228	3228
q22	371	318	314	314
Total cold run time: 107227 ms
Total hot run time: 40294 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7253	7252	7279	7252
q2	329	226	231	226
q3	2926	2839	2964	2839
q4	2024	1822	1833	1822
q5	5758	5675	5664	5664
q6	224	146	148	146
q7	2244	1843	1818	1818
q8	3438	3611	3565	3565
q9	8861	8940	8907	8907
q10	3633	3540	3594	3540
q11	604	500	502	500
q12	850	595	599	595
q13	10717	3254	3231	3231
q14	302	286	269	269
q15	556	528	543	528
q16	688	647	623	623
q17	1899	1637	1626	1626
q18	8417	7798	7585	7585
q19	1722	1590	1681	1590
q20	2112	1921	1878	1878
q21	5603	5492	5423	5423
q22	646	578	583	578
Total cold run time: 70806 ms
Total hot run time: 60205 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197316 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ca998c7c1bebba900a1c0d09740aa17ee570fa1a, data reload: false

query1	1247	938	965	938
query2	6246	2114	2044	2044
query3	10868	3940	4006	3940
query4	68264	28011	23551	23551
query5	4876	465	459	459
query6	421	192	179	179
query7	5551	310	288	288
query8	308	228	222	222
query9	8779	2685	2687	2685
query10	440	259	239	239
query11	17153	15420	16032	15420
query12	165	105	106	105
query13	1509	447	444	444
query14	9997	7608	7480	7480
query15	211	186	215	186
query16	7149	478	456	456
query17	1290	586	580	580
query18	1815	343	300	300
query19	194	162	157	157
query20	119	110	112	110
query21	209	105	101	101
query22	4893	4810	4769	4769
query23	35132	34490	34264	34264
query24	5711	2492	2480	2480
query25	487	380	386	380
query26	648	147	141	141
query27	1901	279	292	279
query28	4302	2493	2465	2465
query29	700	437	406	406
query30	217	146	146	146
query31	970	824	836	824
query32	70	56	56	56
query33	423	287	276	276
query34	926	517	560	517
query35	867	751	723	723
query36	1080	966	962	962
query37	124	75	74	74
query38	4560	4413	4434	4413
query39	1522	1499	1473	1473
query40	204	96	96	96
query41	49	41	47	41
query42	109	97	99	97
query43	547	498	507	498
query44	1192	850	835	835
query45	195	165	163	163
query46	1172	714	704	704
query47	2059	1929	1953	1929
query48	414	336	320	320
query49	713	380	380	380
query50	844	428	408	408
query51	7376	7192	7128	7128
query52	98	86	87	86
query53	253	176	170	170
query54	499	391	393	391
query55	82	73	72	72
query56	249	229	232	229
query57	1288	1154	1172	1154
query58	217	206	215	206
query59	3229	3206	3062	3062
query60	267	248	243	243
query61	108	109	109	109
query62	798	670	656	656
query63	219	178	180	178
query64	1376	641	625	625
query65	3295	3180	3218	3180
query66	704	300	309	300
query67	15907	15660	15737	15660
query68	4041	556	560	556
query69	443	245	252	245
query70	1193	1127	1166	1127
query71	366	246	250	246
query72	6212	4127	3993	3993
query73	778	354	356	354
query74	10180	8987	8951	8951
query75	3392	2708	2655	2655
query76	1876	1064	1029	1029
query77	492	267	282	267
query78	10484	9485	9365	9365
query79	2156	678	611	611
query80	1410	425	425	425
query81	524	231	229	229
query82	1263	118	114	114
query83	253	142	147	142
query84	274	83	66	66
query85	984	294	293	293
query86	414	304	303	303
query87	4720	4526	4532	4526
query88	3779	2229	2215	2215
query89	422	297	305	297
query90	1930	186	182	182
query91	134	103	149	103
query92	64	47	49	47
query93	3011	547	539	539
query94	828	297	289	289
query95	357	245	252	245
query96	638	287	282	282
query97	2861	2696	2706	2696
query98	211	198	202	198
query99	1614	1274	1297	1274
Total cold run time: 322111 ms
Total hot run time: 197316 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.49 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ca998c7c1bebba900a1c0d09740aa17ee570fa1a, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.07	0.07
query4	1.61	0.11	0.11
query5	0.43	0.40	0.42
query6	1.16	0.67	0.64
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.58	0.51	0.51
query10	0.55	0.53	0.55
query11	0.14	0.10	0.10
query12	0.14	0.12	0.12
query13	0.62	0.59	0.60
query14	2.72	2.80	2.77
query15	0.89	0.81	0.82
query16	0.37	0.37	0.38
query17	1.05	1.05	1.06
query18	0.23	0.21	0.20
query19	1.95	1.83	1.97
query20	0.02	0.01	0.01
query21	15.36	0.61	0.56
query22	2.57	1.98	2.49
query23	16.89	1.03	0.87
query24	2.99	0.78	1.28
query25	0.30	0.13	0.05
query26	0.53	0.14	0.14
query27	0.05	0.04	0.04
query28	11.01	1.10	1.05
query29	12.54	3.36	3.36
query30	0.24	0.07	0.05
query31	2.88	0.38	0.37
query32	3.27	0.46	0.47
query33	2.93	2.97	3.03
query34	16.90	4.38	4.42
query35	4.52	4.44	4.54
query36	0.67	0.48	0.47
query37	0.09	0.06	0.06
query38	0.04	0.04	0.03
query39	0.03	0.02	0.02
query40	0.16	0.13	0.12
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.97 s
Total hot run time: 32.49 s

@airborne12
Copy link
Member Author

run buildall

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

delete[] val;
}

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: function 'test_ngram_bloom_filter_index_reader_writer' exceeds recommended size/complexity thresholds [readability-function-size]

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^
Additional context

be/test/olap/rowset/segment_v2/bloom_filter_index_reader_writer_test.cpp:485: 95 lines including whitespace and comments (threshold 80)

void test_ngram_bloom_filter_index_reader_writer(const std::string& file_name, Slice* values,
     ^

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.36% (9992/26051)
Line Coverage: 29.47% (83648/283840)
Region Coverage: 28.63% (43048/150362)
Branch Coverage: 25.21% (21866/86746)
Coverage Report: http://coverage.selectdb-in.cc/coverage/78008e1741a804b680b5eca0b837990a6eda0402_78008e1741a804b680b5eca0b837990a6eda0402/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 39573 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 78008e1741a804b680b5eca0b837990a6eda0402, data reload: false

------ Round 1 ----------------------------------
q1	17597	7538	7239	7239
q2	2043	176	171	171
q3	10619	1116	1189	1116
q4	10467	800	721	721
q5	7612	2686	2586	2586
q6	242	147	148	147
q7	970	638	616	616
q8	9246	1860	1928	1860
q9	6601	6371	6349	6349
q10	7037	2281	2279	2279
q11	461	255	250	250
q12	434	232	210	210
q13	17784	3031	3012	3012
q14	239	201	211	201
q15	585	520	520	520
q16	645	589	585	585
q17	981	538	513	513
q18	7202	6507	6684	6507
q19	1348	1051	1099	1051
q20	484	187	179	179
q21	4005	3216	3147	3147
q22	378	316	314	314
Total cold run time: 106980 ms
Total hot run time: 39573 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7237	7193	7199	7193
q2	332	231	232	231
q3	2910	2813	2980	2813
q4	2029	1794	1801	1794
q5	5662	5673	5646	5646
q6	234	142	143	142
q7	2249	1877	1805	1805
q8	3419	3555	3535	3535
q9	8781	8884	8885	8884
q10	3608	3536	3561	3536
q11	595	509	496	496
q12	830	611	622	611
q13	11979	3354	3303	3303
q14	325	265	271	265
q15	570	511	511	511
q16	698	642	639	639
q17	1847	1637	1647	1637
q18	8294	7723	7669	7669
q19	1681	1549	1600	1549
q20	2132	1867	1865	1865
q21	5576	5447	5439	5439
q22	666	586	606	586
Total cold run time: 71654 ms
Total hot run time: 60149 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196775 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 78008e1741a804b680b5eca0b837990a6eda0402, data reload: false

query1	1235	940	974	940
query2	6296	2155	2042	2042
query3	10900	4198	3907	3907
query4	67260	31743	23862	23862
query5	4984	468	444	444
query6	317	182	195	182
query7	4889	296	284	284
query8	278	222	215	215
query9	6461	2659	2629	2629
query10	405	245	251	245
query11	15770	15114	15951	15114
query12	164	104	102	102
query13	1055	453	428	428
query14	10931	7002	7607	7002
query15	210	192	184	184
query16	6958	483	495	483
query17	1093	594	588	588
query18	1780	322	314	314
query19	217	165	163	163
query20	129	114	110	110
query21	206	118	105	105
query22	4749	4537	4608	4537
query23	34935	34327	34270	34270
query24	5476	2585	2562	2562
query25	494	396	391	391
query26	653	148	154	148
query27	1834	283	285	283
query28	4344	2464	2460	2460
query29	698	428	418	418
query30	221	159	169	159
query31	997	832	858	832
query32	67	52	60	52
query33	436	279	280	279
query34	947	523	525	523
query35	875	761	729	729
query36	1075	972	978	972
query37	120	74	77	74
query38	4450	4344	4348	4344
query39	1520	1478	1477	1477
query40	206	97	100	97
query41	44	43	43	43
query42	121	102	102	102
query43	550	503	508	503
query44	1187	852	841	841
query45	192	172	170	170
query46	1181	706	708	706
query47	2035	1923	1927	1923
query48	422	307	316	307
query49	725	393	391	391
query50	853	412	401	401
query51	7462	7283	7220	7220
query52	98	88	87	87
query53	252	177	180	177
query54	529	408	390	390
query55	76	84	79	79
query56	261	238	242	238
query57	1288	1181	1174	1174
query58	223	213	214	213
query59	3203	3097	2966	2966
query60	260	241	248	241
query61	111	105	105	105
query62	792	684	672	672
query63	206	188	189	188
query64	1413	640	670	640
query65	3267	3187	3269	3187
query66	704	302	313	302
query67	15962	15709	15607	15607
query68	3605	569	570	569
query69	440	253	248	248
query70	1181	1112	1152	1112
query71	359	245	246	245
query72	6477	3942	3995	3942
query73	778	353	353	353
query74	10137	8980	9089	8980
query75	3402	2686	2661	2661
query76	1505	1143	1136	1136
query77	491	280	288	280
query78	10567	9528	9399	9399
query79	1792	602	596	596
query80	854	428	426	426
query81	533	229	237	229
query82	1323	115	116	115
query83	265	152	148	148
query84	285	76	66	66
query85	1010	298	290	290
query86	345	300	305	300
query87	4655	4644	4558	4558
query88	3618	2204	2195	2195
query89	426	294	299	294
query90	2028	187	190	187
query91	137	102	104	102
query92	73	51	51	51
query93	2235	539	533	533
query94	800	294	302	294
query95	350	245	258	245
query96	631	281	286	281
query97	2897	2701	2629	2629
query98	215	198	207	198
query99	2026	1327	1290	1290
Total cold run time: 314492 ms
Total hot run time: 196775 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 33.74 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 78008e1741a804b680b5eca0b837990a6eda0402, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.23	0.08	0.07
query4	1.62	0.10	0.10
query5	0.41	0.43	0.39
query6	1.14	0.66	0.65
query7	0.02	0.02	0.01
query8	0.04	0.04	0.03
query9	0.58	0.50	0.52
query10	0.53	0.55	0.56
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.60	0.61	0.60
query14	2.71	2.86	2.85
query15	0.91	0.84	0.82
query16	0.38	0.38	0.39
query17	1.09	1.08	1.07
query18	0.22	0.21	0.20
query19	1.90	1.87	2.03
query20	0.01	0.01	0.00
query21	15.72	0.59	0.56
query22	2.83	2.21	1.92
query23	17.05	0.85	0.88
query24	2.78	1.66	1.79
query25	0.33	0.15	0.16
query26	0.41	0.15	0.13
query27	0.05	0.05	0.05
query28	10.43	1.11	1.08
query29	12.61	3.20	3.17
query30	0.24	0.06	0.05
query31	2.86	0.38	0.39
query32	3.28	0.47	0.47
query33	3.08	3.06	3.09
query34	17.16	4.51	4.56
query35	4.57	4.56	4.53
query36	0.67	0.49	0.49
query37	0.09	0.06	0.07
query38	0.04	0.04	0.03
query39	0.03	0.02	0.03
query40	0.17	0.13	0.14
query41	0.08	0.03	0.02
query42	0.03	0.02	0.02
query43	0.03	0.03	0.03
Total cold run time: 107.33 s
Total hot run time: 33.74 s

@airborne12
Copy link
Member Author

run buildall

1 similar comment
@airborne12
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39691 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8b27f170a819666620bc33a21e24cb7a3d764003, data reload: false

------ Round 1 ----------------------------------
q1	17599	7386	7290	7290
q2	2033	168	158	158
q3	10636	1102	1193	1102
q4	10574	744	765	744
q5	7605	2694	2728	2694
q6	237	146	147	146
q7	982	618	607	607
q8	9443	1782	1893	1782
q9	6531	6322	6378	6322
q10	6954	2275	2332	2275
q11	468	262	275	262
q12	420	223	215	215
q13	17777	2992	2999	2992
q14	245	215	215	215
q15	575	522	518	518
q16	653	589	574	574
q17	957	548	521	521
q18	7217	6686	6679	6679
q19	1343	1059	1028	1028
q20	472	181	178	178
q21	3966	3245	3085	3085
q22	379	315	304	304
Total cold run time: 107066 ms
Total hot run time: 39691 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7219	7198	7190	7190
q2	318	226	228	226
q3	2904	2783	2888	2783
q4	1989	1801	1749	1749
q5	5682	5667	5628	5628
q6	221	139	138	138
q7	2263	1839	1796	1796
q8	3395	3560	3497	3497
q9	8835	8851	8819	8819
q10	3591	3543	3542	3542
q11	586	501	514	501
q12	851	598	604	598
q13	12469	3185	3252	3185
q14	327	262	277	262
q15	560	531	527	527
q16	692	643	641	641
q17	1836	1651	1575	1575
q18	8242	7828	7769	7769
q19	1667	1590	1459	1459
q20	2127	1849	1884	1849
q21	5454	5373	5461	5373
q22	676	590	552	552
Total cold run time: 71904 ms
Total hot run time: 59659 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 196754 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8b27f170a819666620bc33a21e24cb7a3d764003, data reload: false

query1	1294	951	941	941
query2	6231	2061	2024	2024
query3	10768	4007	3912	3912
query4	67465	28767	23742	23742
query5	4948	456	435	435
query6	424	188	191	188
query7	5540	333	304	304
query8	330	223	223	223
query9	8849	2653	2647	2647
query10	452	283	236	236
query11	17137	15441	15727	15441
query12	158	98	103	98
query13	1479	413	428	413
query14	10402	7195	7550	7195
query15	207	176	184	176
query16	7047	480	489	480
query17	1076	566	576	566
query18	1928	302	317	302
query19	207	157	150	150
query20	117	117	120	117
query21	210	106	99	99
query22	4907	4817	4681	4681
query23	34530	34136	34178	34136
query24	5594	2513	2562	2513
query25	503	386	397	386
query26	638	153	155	153
query27	2049	291	282	282
query28	4441	2475	2431	2431
query29	689	413	427	413
query30	219	148	149	148
query31	1032	838	851	838
query32	69	56	60	56
query33	459	279	286	279
query34	948	506	502	502
query35	859	728	720	720
query36	1091	981	972	972
query37	124	77	71	71
query38	4458	4342	4289	4289
query39	1513	1452	1496	1452
query40	224	100	143	100
query41	46	45	44	44
query42	107	97	99	97
query43	536	493	483	483
query44	1165	823	824	823
query45	186	167	168	167
query46	1164	725	714	714
query47	2036	1928	1933	1928
query48	413	310	318	310
query49	736	405	381	381
query50	850	423	390	390
query51	7410	7310	7146	7146
query52	96	86	85	85
query53	247	185	175	175
query54	514	390	398	390
query55	87	75	77	75
query56	252	259	252	252
query57	1319	1187	1186	1186
query58	232	222	223	222
query59	3257	3197	2947	2947
query60	288	261	264	261
query61	127	165	103	103
query62	796	660	666	660
query63	217	189	189	189
query64	1390	667	626	626
query65	3264	3189	3215	3189
query66	699	300	303	300
query67	15957	15935	15523	15523
query68	3959	568	564	564
query69	409	259	257	257
query70	1172	1099	1107	1099
query71	352	263	248	248
query72	6362	4025	4124	4025
query73	752	350	354	350
query74	10171	8938	9027	8938
query75	3419	2689	2660	2660
query76	1830	1113	1138	1113
query77	459	272	269	269
query78	10471	9461	9377	9377
query79	1727	592	594	592
query80	878	507	436	436
query81	505	238	224	224
query82	1299	118	121	118
query83	186	147	145	145
query84	282	75	69	69
query85	894	299	313	299
query86	333	298	300	298
query87	4886	4696	4580	4580
query88	3492	2198	2166	2166
query89	423	288	300	288
query90	2017	187	188	187
query91	135	101	105	101
query92	69	51	51	51
query93	1967	555	548	548
query94	829	294	289	289
query95	347	251	253	251
query96	627	272	274	272
query97	2840	2705	2674	2674
query98	218	199	191	191
query99	1844	1298	1302	1298
Total cold run time: 319161 ms
Total hot run time: 196754 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.73 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8b27f170a819666620bc33a21e24cb7a3d764003, data reload: false

query1	0.03	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.08	0.07
query4	1.61	0.10	0.10
query5	0.44	0.41	0.41
query6	1.14	0.66	0.65
query7	0.02	0.01	0.02
query8	0.04	0.03	0.02
query9	0.56	0.51	0.51
query10	0.55	0.55	0.57
query11	0.14	0.10	0.10
query12	0.13	0.11	0.11
query13	0.61	0.62	0.60
query14	2.84	2.76	2.73
query15	0.91	0.84	0.82
query16	0.39	0.39	0.38
query17	1.06	1.05	1.06
query18	0.22	0.22	0.21
query19	1.92	1.88	2.00
query20	0.01	0.00	0.01
query21	15.36	0.59	0.57
query22	2.19	2.18	2.02
query23	17.04	1.04	0.79
query24	2.85	0.92	1.96
query25	0.17	0.18	0.14
query26	0.55	0.15	0.14
query27	0.05	0.04	0.04
query28	10.03	1.11	1.07
query29	12.56	3.24	3.23
query30	0.25	0.06	0.06
query31	2.88	0.39	0.38
query32	3.26	0.46	0.46
query33	3.01	2.98	3.04
query34	17.02	4.43	4.48
query35	4.48	4.46	4.52
query36	0.66	0.49	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.03	0.04	0.03
Total cold run time: 105.75 s
Total hot run time: 32.73 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.34% (9960/25978)
Line Coverage: 29.47% (83500/283351)
Region Coverage: 28.61% (42975/150190)
Branch Coverage: 25.22% (21834/86584)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8b27f170a819666620bc33a21e24cb7a3d764003_8b27f170a819666620bc33a21e24cb7a3d764003/report/index.html

@airborne12
Copy link
Member Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.33% (9959/25981)
Line Coverage: 29.45% (83476/283481)
Region Coverage: 28.60% (42983/150265)
Branch Coverage: 25.21% (21841/86636)
Coverage Report: http://coverage.selectdb-in.cc/coverage/dfa29d0bad301668e7944caa225c441a0d919d8e_dfa29d0bad301668e7944caa225c441a0d919d8e/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 40063 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit dfa29d0bad301668e7944caa225c441a0d919d8e, data reload: false

------ Round 1 ----------------------------------
q1	17597	7392	7239	7239
q2	2055	172	165	165
q3	10674	1090	1232	1090
q4	10550	731	703	703
q5	7602	2697	2752	2697
q6	244	152	147	147
q7	1018	632	619	619
q8	9964	1877	1901	1877
q9	6624	6363	6411	6363
q10	7043	2315	2318	2315
q11	457	271	271	271
q12	425	219	215	215
q13	17764	3054	3027	3027
q14	242	209	217	209
q15	587	540	523	523
q16	682	581	596	581
q17	988	517	613	517
q18	7285	6766	6767	6766
q19	1352	1049	1098	1049
q20	469	176	186	176
q21	4000	3185	3262	3185
q22	393	346	329	329
Total cold run time: 108015 ms
Total hot run time: 40063 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7338	7352	7270	7270
q2	337	234	236	234
q3	3074	3052	3056	3052
q4	2145	1892	1895	1892
q5	5823	5782	5744	5744
q6	216	139	142	139
q7	2251	1806	1762	1762
q8	3398	3562	3523	3523
q9	8881	8885	8861	8861
q10	3581	3553	3577	3553
q11	611	519	511	511
q12	829	610	618	610
q13	16638	3164	3237	3164
q14	299	285	268	268
q15	582	523	526	523
q16	693	652	671	652
q17	1853	1646	1577	1577
q18	8372	7802	7625	7625
q19	1685	1474	1492	1474
q20	2164	1859	1851	1851
q21	5555	5345	5243	5243
q22	654	590	566	566
Total cold run time: 76979 ms
Total hot run time: 60094 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197297 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit dfa29d0bad301668e7944caa225c441a0d919d8e, data reload: false

query1	1267	987	993	987
query2	6240	2119	2113	2113
query3	10921	4177	4095	4095
query4	67967	29590	23637	23637
query5	4979	452	450	450
query6	430	187	183	183
query7	5596	298	294	294
query8	315	231	232	231
query9	8952	2701	2715	2701
query10	448	248	248	248
query11	17372	15255	16016	15255
query12	159	105	105	105
query13	1489	416	433	416
query14	10948	7163	7543	7163
query15	221	182	190	182
query16	7617	483	459	459
query17	1046	561	582	561
query18	1904	317	315	315
query19	201	157	154	154
query20	117	114	109	109
query21	208	107	104	104
query22	4813	4615	4491	4491
query23	34972	34242	34606	34242
query24	5454	2479	2492	2479
query25	495	395	385	385
query26	646	174	148	148
query27	1714	273	284	273
query28	4194	2458	2492	2458
query29	702	422	416	416
query30	213	151	150	150
query31	1062	849	875	849
query32	73	56	55	55
query33	415	291	294	291
query34	929	525	519	519
query35	879	786	767	767
query36	1108	978	972	972
query37	123	77	73	73
query38	4489	4506	4474	4474
query39	1551	1483	1452	1452
query40	201	103	100	100
query41	45	40	42	40
query42	118	105	101	101
query43	544	502	509	502
query44	1190	820	807	807
query45	180	166	171	166
query46	1153	762	699	699
query47	2035	1931	1925	1925
query48	427	317	332	317
query49	720	408	395	395
query50	846	407	402	402
query51	7359	7221	7122	7122
query52	97	85	87	85
query53	254	175	175	175
query54	497	401	383	383
query55	76	73	77	73
query56	233	247	236	236
query57	1318	1182	1163	1163
query58	212	222	232	222
query59	3362	3127	3075	3075
query60	273	248	240	240
query61	135	107	113	107
query62	807	668	671	668
query63	210	192	183	183
query64	1396	681	637	637
query65	3314	3179	3203	3179
query66	689	299	298	298
query67	15916	15698	15559	15559
query68	3894	566	543	543
query69	438	254	258	254
query70	1204	1151	1119	1119
query71	352	255	246	246
query72	6479	4221	4043	4043
query73	763	360	355	355
query74	10377	9110	9089	9089
query75	3423	2686	2654	2654
query76	1993	1054	1066	1054
query77	490	268	273	268
query78	10384	9407	9393	9393
query79	2091	596	599	596
query80	1426	507	418	418
query81	530	236	230	230
query82	1300	117	117	117
query83	268	149	150	149
query84	289	71	68	68
query85	1039	292	300	292
query86	414	302	304	302
query87	4778	4678	4653	4653
query88	3759	2217	2180	2180
query89	422	298	291	291
query90	2012	182	188	182
query91	138	104	99	99
query92	64	50	50	50
query93	2926	533	538	533
query94	812	300	290	290
query95	347	249	249	249
query96	628	278	271	271
query97	2809	2682	2686	2682
query98	218	190	209	190
query99	1617	1322	1330	1322
Total cold run time: 323520 ms
Total hot run time: 197297 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 198536 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9d2ba0ce3ed4edafc304aef6ea607b11bc1f04f5, data reload: false

query1	1270	980	950	950
query2	6241	2121	2039	2039
query3	11057	4221	4224	4221
query4	68102	29490	23800	23800
query5	4939	465	477	465
query6	454	179	167	167
query7	5604	307	290	290
query8	303	229	219	219
query9	8909	2721	2718	2718
query10	453	281	277	277
query11	17447	15405	16015	15405
query12	166	111	108	108
query13	1546	435	437	435
query14	10669	7700	7854	7700
query15	215	191	205	191
query16	7622	515	515	515
query17	1098	604	593	593
query18	1915	312	308	308
query19	201	163	159	159
query20	126	116	119	116
query21	206	108	107	107
query22	4784	4530	4551	4530
query23	35882	34602	34483	34483
query24	5691	2547	2515	2515
query25	507	403	414	403
query26	653	161	160	160
query27	1928	287	298	287
query28	3982	2472	2469	2469
query29	679	419	442	419
query30	207	146	152	146
query31	1016	837	836	836
query32	67	55	58	55
query33	428	294	288	288
query34	957	522	542	522
query35	876	780	745	745
query36	1085	945	966	945
query37	121	74	76	74
query38	4538	4519	4480	4480
query39	1527	1489	1487	1487
query40	201	103	128	103
query41	46	46	43	43
query42	106	104	100	100
query43	541	504	496	496
query44	1193	835	824	824
query45	192	166	170	166
query46	1155	764	725	725
query47	2039	1924	1914	1914
query48	429	331	331	331
query49	729	390	404	390
query50	860	398	423	398
query51	7400	7198	7005	7005
query52	97	88	90	88
query53	252	182	190	182
query54	516	412	412	412
query55	77	75	74	74
query56	251	241	239	239
query57	1282	1169	1155	1155
query58	224	210	227	210
query59	3229	2936	3048	2936
query60	268	266	248	248
query61	109	116	116	116
query62	767	680	676	676
query63	224	188	206	188
query64	1388	681	730	681
query65	3321	3182	3202	3182
query66	644	298	314	298
query67	16055	15809	15624	15624
query68	4263	557	548	548
query69	423	257	265	257
query70	1131	1149	1118	1118
query71	343	258	256	256
query72	6189	4061	3995	3995
query73	782	360	364	360
query74	10255	9084	8997	8997
query75	3408	2680	2635	2635
query76	1831	1178	1071	1071
query77	484	280	275	275
query78	10540	9516	9452	9452
query79	2271	597	618	597
query80	969	439	443	439
query81	525	246	230	230
query82	217	124	119	119
query83	179	210	151	151
query84	297	72	73	72
query85	1021	307	314	307
query86	414	310	302	302
query87	4792	4622	4618	4618
query88	4202	2230	2197	2197
query89	422	299	295	295
query90	2041	192	189	189
query91	147	101	105	101
query92	70	51	50	50
query93	2149	549	538	538
query94	788	280	268	268
query95	355	252	247	247
query96	631	271	280	271
query97	2923	2692	2663	2663
query98	224	196	192	192
query99	1601	1304	1295	1295
Total cold run time: 322953 ms
Total hot run time: 198536 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.95 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9d2ba0ce3ed4edafc304aef6ea607b11bc1f04f5, data reload: false

query1	0.03	0.02	0.03
query2	0.07	0.03	0.03
query3	0.24	0.06	0.07
query4	1.63	0.11	0.12
query5	0.44	0.41	0.41
query6	1.16	0.66	0.65
query7	0.01	0.02	0.01
query8	0.04	0.03	0.03
query9	0.56	0.49	0.51
query10	0.55	0.55	0.56
query11	0.15	0.11	0.11
query12	0.14	0.11	0.11
query13	0.61	0.59	0.60
query14	2.85	2.86	2.76
query15	0.90	0.84	0.84
query16	0.37	0.39	0.37
query17	1.03	1.06	1.05
query18	0.22	0.21	0.22
query19	1.96	1.88	1.99
query20	0.01	0.01	0.01
query21	15.36	0.57	0.58
query22	2.22	2.77	1.81
query23	16.98	0.85	0.81
query24	3.06	1.18	1.14
query25	0.19	0.06	0.10
query26	0.63	0.13	0.14
query27	0.04	0.04	0.04
query28	10.54	1.10	1.07
query29	12.54	3.26	3.22
query30	0.25	0.08	0.06
query31	2.84	0.39	0.37
query32	3.30	0.47	0.47
query33	3.01	3.09	3.05
query34	16.96	4.55	4.59
query35	4.51	4.51	4.53
query36	0.66	0.50	0.48
query37	0.09	0.06	0.07
query38	0.05	0.04	0.04
query39	0.03	0.02	0.02
query40	0.16	0.13	0.13
query41	0.07	0.02	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 106.54 s
Total hot run time: 32.95 s

@airborne12
Copy link
Member Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40303 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit ebae1c113c98f8feac0c4fa142d04976fcf5d107, data reload: false

------ Round 1 ----------------------------------
q1	17648	7567	7275	7275
q2	2043	174	181	174
q3	10681	1172	1204	1172
q4	10425	821	764	764
q5	7612	3614	2769	2769
q6	238	145	147	145
q7	992	633	614	614
q8	9248	1939	1974	1939
q9	6850	6571	6487	6487
q10	6988	2347	2318	2318
q11	461	268	259	259
q12	426	227	220	220
q13	17842	3020	3029	3020
q14	234	209	208	208
q15	568	522	542	522
q16	663	573	586	573
q17	974	522	554	522
q18	7613	6704	6720	6704
q19	1340	1025	944	944
q20	486	191	183	183
q21	3974	3240	3172	3172
q22	401	322	319	319
Total cold run time: 107707 ms
Total hot run time: 40303 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7256	7246	7226	7226
q2	330	227	231	227
q3	2912	2797	2783	2783
q4	1974	1662	1674	1662
q5	5390	5434	5482	5434
q6	221	137	139	137
q7	2131	1702	1735	1702
q8	3275	3440	3429	3429
q9	8676	8721	8689	8689
q10	3503	3463	3449	3449
q11	591	504	505	504
q12	775	563	586	563
q13	10526	3061	2992	2992
q14	295	264	272	264
q15	568	530	502	502
q16	667	627	623	623
q17	1809	1588	1576	1576
q18	7984	7391	7431	7391
q19	1676	1525	1530	1525
q20	2070	1810	1857	1810
q21	5307	5222	5258	5222
q22	660	590	564	564
Total cold run time: 68596 ms
Total hot run time: 58274 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190828 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit ebae1c113c98f8feac0c4fa142d04976fcf5d107, data reload: false

query1	993	396	388	388
query2	6542	2070	2023	2023
query3	6697	210	216	210
query4	34151	23570	23577	23570
query5	4326	468	457	457
query6	283	192	174	174
query7	4618	305	305	305
query8	291	232	235	232
query9	9364	2711	2704	2704
query10	476	257	258	257
query11	18202	15249	15302	15249
query12	156	104	103	103
query13	1666	418	410	410
query14	10654	6703	6504	6504
query15	266	176	183	176
query16	8123	481	469	469
query17	1632	582	579	579
query18	2140	304	302	302
query19	378	199	146	146
query20	117	110	111	110
query21	201	103	103	103
query22	4653	4442	4493	4442
query23	35004	33884	34206	33884
query24	11473	2464	2526	2464
query25	667	380	372	372
query26	1793	164	154	154
query27	2857	280	280	280
query28	8234	2411	2434	2411
query29	1019	408	397	397
query30	295	143	154	143
query31	1020	793	846	793
query32	98	58	57	57
query33	759	290	284	284
query34	988	501	513	501
query35	905	750	754	750
query36	1089	946	958	946
query37	280	77	81	77
query38	4422	4335	4357	4335
query39	1510	1431	1395	1395
query40	284	106	99	99
query41	46	44	43	43
query42	111	99	99	99
query43	537	490	473	473
query44	1259	810	802	802
query45	188	164	168	164
query46	1173	706	714	706
query47	1978	1819	1859	1819
query48	416	310	321	310
query49	1291	391	387	387
query50	789	399	395	395
query51	7302	7064	7227	7064
query52	95	93	86	86
query53	261	176	177	176
query54	1199	398	412	398
query55	84	77	75	75
query56	257	230	255	230
query57	1310	1183	1168	1168
query58	230	235	217	217
query59	3271	3206	2883	2883
query60	270	244	247	244
query61	122	106	107	106
query62	908	675	690	675
query63	216	190	190	190
query64	5112	651	631	631
query65	3317	3245	3216	3216
query66	1441	313	319	313
query67	16061	15727	15525	15525
query68	5188	549	549	549
query69	408	258	249	249
query70	1208	1130	1213	1130
query71	353	268	259	259
query72	6347	4112	4113	4112
query73	760	355	354	354
query74	10532	9027	9149	9027
query75	3461	2655	2652	2652
query76	3076	1114	990	990
query77	516	293	324	293
query78	10462	9427	9410	9410
query79	1897	589	602	589
query80	1203	431	456	431
query81	533	238	233	233
query82	909	116	114	114
query83	240	146	147	146
query84	229	71	68	68
query85	1409	301	304	301
query86	440	274	306	274
query87	4723	4573	4670	4573
query88	3638	2236	2195	2195
query89	410	297	301	297
query90	2120	192	189	189
query91	134	142	102	102
query92	68	56	55	55
query93	1609	537	546	537
query94	1142	322	298	298
query95	354	247	261	247
query96	606	278	283	278
query97	2859	2708	2692	2692
query98	231	205	207	205
query99	1534	1333	1329	1329
Total cold run time: 306469 ms
Total hot run time: 190828 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.74 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit ebae1c113c98f8feac0c4fa142d04976fcf5d107, data reload: false

query1	0.02	0.03	0.03
query2	0.06	0.04	0.04
query3	0.23	0.07	0.07
query4	1.63	0.10	0.10
query5	0.42	0.40	0.43
query6	1.16	0.66	0.64
query7	0.02	0.01	0.02
query8	0.04	0.03	0.03
query9	0.56	0.53	0.52
query10	0.56	0.57	0.56
query11	0.14	0.11	0.11
query12	0.14	0.11	0.12
query13	0.62	0.59	0.61
query14	2.71	2.85	2.88
query15	0.91	0.82	0.82
query16	0.40	0.39	0.39
query17	1.08	1.08	1.04
query18	0.23	0.21	0.21
query19	1.88	1.87	2.04
query20	0.01	0.01	0.01
query21	15.38	0.58	0.56
query22	2.48	1.96	1.52
query23	17.02	0.88	0.88
query24	2.83	1.23	2.26
query25	0.24	0.30	0.07
query26	0.48	0.15	0.13
query27	0.04	0.04	0.04
query28	9.34	1.12	1.08
query29	12.54	3.24	3.18
query30	0.25	0.06	0.06
query31	2.88	0.37	0.38
query32	3.29	0.46	0.48
query33	2.98	3.09	3.04
query34	16.94	4.45	4.46
query35	4.53	4.50	4.55
query36	0.67	0.48	0.47
query37	0.09	0.06	0.06
query38	0.04	0.03	0.04
query39	0.04	0.02	0.03
query40	0.17	0.13	0.12
query41	0.08	0.02	0.03
query42	0.04	0.02	0.02
query43	0.03	0.03	0.04
Total cold run time: 105.2 s
Total hot run time: 32.74 s

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.31% (9958/25990)
Line Coverage: 29.44% (83510/283629)
Region Coverage: 28.59% (42989/150343)
Branch Coverage: 25.21% (21837/86634)
Coverage Report: http://coverage.selectdb-in.cc/coverage/ebae1c113c98f8feac0c4fa142d04976fcf5d107_ebae1c113c98f8feac0c4fa142d04976fcf5d107/report/index.html

Copy link
Contributor

@qidaye qidaye left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 29, 2024
Copy link
Contributor

PR approved by anyone and no changes requested.

@airborne12
Copy link
Member Author

run buildall

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.36% (9966/25979)
Line Coverage: 29.44% (83579/283848)
Region Coverage: 28.57% (43009/150528)
Branch Coverage: 25.18% (21848/86756)
Coverage Report: http://coverage.selectdb-in.cc/coverage/259f6bb53e7fda06bfe530fd0c9a19889c343a32_259f6bb53e7fda06bfe530fd0c9a19889c343a32/report/index.html

@doris-robot
Copy link

TPC-H: Total hot run time: 40064 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 259f6bb53e7fda06bfe530fd0c9a19889c343a32, data reload: false

------ Round 1 ----------------------------------
q1	17612	8246	7298	7298
q2	2047	182	166	166
q3	10593	1167	1226	1167
q4	10579	733	714	714
q5	7602	2757	2730	2730
q6	245	152	149	149
q7	998	626	609	609
q8	9241	1885	1926	1885
q9	6705	6520	6526	6520
q10	7006	2281	2301	2281
q11	457	263	263	263
q12	428	224	228	224
q13	17765	3052	3001	3001
q14	246	216	212	212
q15	590	542	522	522
q16	665	579	605	579
q17	987	589	520	520
q18	7308	6693	6719	6693
q19	1347	967	991	967
q20	484	178	175	175
q21	4301	3072	3236	3072
q22	388	320	317	317
Total cold run time: 107594 ms
Total hot run time: 40064 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7259	7325	7279	7279
q2	327	233	234	233
q3	2885	2897	2979	2897
q4	2125	1818	1930	1818
q5	5655	5715	5730	5715
q6	222	144	146	144
q7	2291	1816	1769	1769
q8	3451	3526	3558	3526
q9	9070	9027	9022	9022
q10	3629	3575	3564	3564
q11	599	506	505	505
q12	850	597	617	597
q13	10831	3214	3185	3185
q14	296	274	280	274
q15	586	540	529	529
q16	707	640	627	627
q17	1861	1652	1639	1639
q18	8327	7733	7542	7542
q19	1714	1563	1517	1517
q20	2133	1872	1898	1872
q21	5692	5537	5596	5537
q22	672	571	603	571
Total cold run time: 71182 ms
Total hot run time: 60362 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197607 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 259f6bb53e7fda06bfe530fd0c9a19889c343a32, data reload: false

query1	1262	981	938	938
query2	6253	2185	2093	2093
query3	10997	4489	4544	4489
query4	67705	28636	23669	23669
query5	4986	475	476	475
query6	402	192	183	183
query7	5460	302	299	299
query8	315	228	231	228
query9	8605	2729	2723	2723
query10	438	249	256	249
query11	17214	15307	15924	15307
query12	161	106	105	105
query13	1442	414	420	414
query14	11146	6870	6760	6760
query15	220	182	197	182
query16	7139	482	453	453
query17	1170	575	600	575
query18	1826	341	319	319
query19	215	161	153	153
query20	120	121	121	121
query21	213	116	101	101
query22	4505	4706	4543	4543
query23	34992	34840	34328	34328
query24	5419	2514	2573	2514
query25	488	391	387	387
query26	655	155	153	153
query27	1939	287	283	283
query28	4273	2497	2470	2470
query29	673	464	455	455
query30	210	152	153	152
query31	1043	806	835	806
query32	67	55	59	55
query33	395	303	308	303
query34	942	527	522	522
query35	891	790	795	790
query36	1093	967	986	967
query37	126	79	73	73
query38	4449	4361	4302	4302
query39	1535	1467	1520	1467
query40	204	106	110	106
query41	47	44	43	43
query42	110	101	100	100
query43	556	527	518	518
query44	1201	829	818	818
query45	198	177	175	175
query46	1214	760	748	748
query47	2012	1947	1924	1924
query48	432	314	308	308
query49	796	413	392	392
query50	848	392	414	392
query51	7452	7203	7223	7203
query52	100	93	89	89
query53	278	179	179	179
query54	523	404	398	398
query55	79	75	77	75
query56	258	228	234	228
query57	1267	1126	1114	1114
query58	213	220	222	220
query59	3239	3061	3104	3061
query60	261	241	248	241
query61	106	108	106	106
query62	804	673	685	673
query63	216	194	188	188
query64	1390	671	640	640
query65	3289	3229	3237	3229
query66	649	313	307	307
query67	16254	15491	15455	15455
query68	3876	557	557	557
query69	449	253	247	247
query70	1203	1135	1114	1114
query71	335	252	246	246
query72	6461	4174	4125	4125
query73	775	356	364	356
query74	9334	9109	9039	9039
query75	3371	2685	2711	2685
query76	1906	1121	1134	1121
query77	501	279	279	279
query78	10573	9495	9426	9426
query79	1647	596	600	596
query80	1137	444	437	437
query81	505	231	223	223
query82	1287	121	118	118
query83	254	140	143	140
query84	284	73	70	70
query85	951	300	298	298
query86	440	281	309	281
query87	4772	4596	4533	4533
query88	3787	2212	2223	2212
query89	430	300	292	292
query90	1913	190	191	190
query91	139	104	101	101
query92	62	49	49	49
query93	2033	538	542	538
query94	762	287	281	281
query95	357	250	259	250
query96	635	283	278	278
query97	2845	2662	2711	2662
query98	220	191	201	191
query99	1659	1339	1336	1336
Total cold run time: 319883 ms
Total hot run time: 197607 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.43 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 259f6bb53e7fda06bfe530fd0c9a19889c343a32, data reload: false

query1	0.04	0.03	0.03
query2	0.06	0.03	0.03
query3	0.23	0.08	0.07
query4	1.58	0.11	0.11
query5	0.42	0.39	0.41
query6	1.14	0.66	0.65
query7	0.03	0.02	0.01
query8	0.04	0.03	0.03
query9	0.59	0.53	0.50
query10	0.56	0.56	0.56
query11	0.13	0.10	0.10
query12	0.14	0.12	0.11
query13	0.61	0.60	0.61
query14	2.75	2.82	2.72
query15	0.91	0.83	0.81
query16	0.40	0.38	0.36
query17	1.06	1.01	1.02
query18	0.23	0.22	0.21
query19	1.94	1.90	2.05
query20	0.02	0.01	0.01
query21	15.37	0.61	0.58
query22	2.46	2.36	1.97
query23	17.00	0.81	0.72
query24	2.91	1.06	0.82
query25	0.35	0.11	0.06
query26	0.36	0.15	0.14
query27	0.05	0.04	0.04
query28	11.10	1.11	1.08
query29	12.59	3.22	3.17
query30	0.26	0.06	0.06
query31	2.86	0.38	0.38
query32	3.28	0.47	0.47
query33	2.98	3.02	3.01
query34	17.04	4.50	4.48
query35	4.49	4.47	4.49
query36	0.67	0.51	0.48
query37	0.09	0.06	0.06
query38	0.05	0.04	0.03
query39	0.03	0.02	0.03
query40	0.18	0.13	0.12
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.02
Total cold run time: 107.16 s
Total hot run time: 32.43 s

Copy link
Member

@eldenmoon eldenmoon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@airborne12 airborne12 merged commit b2b0ac7 into apache:master Dec 2, 2024
21 of 23 checks passed
@airborne12 airborne12 deleted the add-bf-ut branch December 2, 2024 06:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants