Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[test](load) add docker test for #44344 #44373

Closed
wants to merge 1 commit into from

Conversation

kaijchen
Copy link
Contributor

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaijchen
Copy link
Contributor Author

run buildall

Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39856 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit caf4e297a4fb18cb97e9173482fbeadcfe4bff2f, data reload: false

------ Round 1 ----------------------------------
q1	17591	7401	7236	7236
q2	2043	173	168	168
q3	10597	1122	1206	1122
q4	10533	718	682	682
q5	7609	2701	2680	2680
q6	240	149	145	145
q7	976	658	611	611
q8	9228	1877	1912	1877
q9	6574	6394	6401	6394
q10	6991	2289	2310	2289
q11	462	269	259	259
q12	425	215	214	214
q13	17802	3020	3025	3020
q14	240	209	226	209
q15	578	535	522	522
q16	652	593	591	591
q17	973	534	523	523
q18	7171	6689	6729	6689
q19	1362	1014	955	955
q20	489	189	183	183
q21	4197	3232	3169	3169
q22	379	318	326	318
Total cold run time: 107112 ms
Total hot run time: 39856 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7247	7244	7192	7192
q2	332	230	232	230
q3	2854	2820	2992	2820
q4	2030	1779	1797	1779
q5	5711	5693	5638	5638
q6	224	139	138	138
q7	2309	1829	1828	1828
q8	3454	3571	3470	3470
q9	8932	8998	8937	8937
q10	3622	3586	3532	3532
q11	614	514	520	514
q12	831	598	624	598
q13	12437	3267	3205	3205
q14	330	279	274	274
q15	569	513	511	511
q16	723	635	641	635
q17	1874	1703	1610	1610
q18	8303	7741	7692	7692
q19	1682	1502	1491	1491
q20	2135	1927	1884	1884
q21	5679	5443	5368	5368
q22	649	568	566	566
Total cold run time: 72541 ms
Total hot run time: 59912 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 38.03% (9902/26035)
Line Coverage: 29.21% (82813/283523)
Region Coverage: 28.34% (42540/150088)
Branch Coverage: 24.90% (21564/86596)
Coverage Report: http://coverage.selectdb-in.cc/coverage/caf4e297a4fb18cb97e9173482fbeadcfe4bff2f_caf4e297a4fb18cb97e9173482fbeadcfe4bff2f/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 197938 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit caf4e297a4fb18cb97e9173482fbeadcfe4bff2f, data reload: false

query1	1274	957	914	914
query2	6216	2246	2187	2187
query3	10901	4065	4055	4055
query4	68397	29117	23538	23538
query5	4976	468	445	445
query6	408	183	195	183
query7	5463	305	298	298
query8	304	213	215	213
query9	8549	2672	2675	2672
query10	430	241	240	240
query11	17194	15307	15892	15307
query12	168	109	105	105
query13	1460	443	440	440
query14	13140	7721	7626	7626
query15	207	188	185	185
query16	7467	480	489	480
query17	1080	593	606	593
query18	1273	304	302	302
query19	199	192	148	148
query20	113	109	111	109
query21	222	102	104	102
query22	4918	4775	4887	4775
query23	34717	34595	34315	34315
query24	5528	2486	2452	2452
query25	486	409	392	392
query26	642	146	146	146
query27	1910	282	290	282
query28	4796	2491	2474	2474
query29	657	430	427	427
query30	235	146	150	146
query31	1038	844	844	844
query32	66	53	53	53
query33	411	279	290	279
query34	952	511	546	511
query35	843	740	730	730
query36	1088	972	975	972
query37	121	70	71	70
query38	4490	4435	4352	4352
query39	1523	1511	1526	1511
query40	200	99	95	95
query41	45	41	42	41
query42	115	105	101	101
query43	560	521	512	512
query44	1246	843	834	834
query45	180	164	168	164
query46	1143	745	733	733
query47	2045	1948	1972	1948
query48	418	326	336	326
query49	723	381	399	381
query50	841	396	382	382
query51	7430	7258	7032	7032
query52	97	87	90	87
query53	257	179	175	175
query54	524	399	412	399
query55	81	72	78	72
query56	250	230	236	230
query57	1329	1175	1139	1139
query58	224	221	210	210
query59	3321	3138	3265	3138
query60	262	247	238	238
query61	117	113	172	113
query62	774	672	669	669
query63	211	195	175	175
query64	1463	652	648	648
query65	3322	3165	3214	3165
query66	629	307	300	300
query67	16134	15811	15782	15782
query68	3967	571	616	571
query69	437	248	251	248
query70	1215	1130	1165	1130
query71	355	248	247	247
query72	6398	4053	4114	4053
query73	756	374	365	365
query74	10323	9098	9046	9046
query75	3393	2687	2662	2662
query76	1850	1063	1044	1044
query77	461	264	283	264
query78	10548	9551	9408	9408
query79	1433	593	578	578
query80	856	478	438	438
query81	504	223	223	223
query82	1283	121	127	121
query83	173	153	143	143
query84	276	72	70	70
query85	886	316	319	316
query86	326	305	274	274
query87	4700	4639	4461	4461
query88	3428	2245	2200	2200
query89	423	296	300	296
query90	1997	183	184	183
query91	139	106	101	101
query92	62	46	50	46
query93	1983	556	546	546
query94	754	276	286	276
query95	343	244	244	244
query96	621	274	285	274
query97	2859	2719	2654	2654
query98	213	199	208	199
query99	1659	1295	1310	1295
Total cold run time: 322424 ms
Total hot run time: 197938 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.36 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit caf4e297a4fb18cb97e9173482fbeadcfe4bff2f, data reload: false

query1	0.03	0.03	0.04
query2	0.07	0.04	0.03
query3	0.24	0.07	0.07
query4	1.63	0.10	0.11
query5	0.43	0.39	0.43
query6	1.18	0.66	0.65
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.58	0.50	0.51
query10	0.55	0.56	0.56
query11	0.14	0.10	0.10
query12	0.14	0.10	0.12
query13	0.60	0.61	0.60
query14	2.82	2.85	2.74
query15	0.90	0.82	0.82
query16	0.39	0.39	0.38
query17	0.96	1.07	0.99
query18	0.23	0.21	0.21
query19	1.95	1.86	2.02
query20	0.01	0.01	0.01
query21	15.36	0.60	0.60
query22	2.70	2.65	1.86
query23	17.16	0.88	0.83
query24	2.74	0.99	0.67
query25	0.14	0.10	0.11
query26	0.52	0.14	0.14
query27	0.05	0.04	0.04
query28	11.27	1.08	1.08
query29	12.56	3.17	3.20
query30	0.24	0.06	0.07
query31	2.86	0.38	0.38
query32	3.29	0.47	0.47
query33	2.99	3.00	3.08
query34	17.00	4.50	4.51
query35	4.56	4.54	4.49
query36	0.68	0.48	0.49
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.15	0.12	0.13
query41	0.08	0.03	0.02
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 107.51 s
Total hot run time: 32.36 s

@kaijchen kaijchen marked this pull request as ready for review November 22, 2024 07:02
@kaijchen
Copy link
Contributor Author

run buildall

@kaijchen kaijchen closed this Nov 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants