Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[opt](file cache) Remove prefetch when align_size and add more UT #46427

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

gavinchou
Copy link
Contributor

What problem does this PR solve?

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@gavinchou
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 32826 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit c53cc865b08415436a7b4744b8ab7f6dadec2eb2, data reload: false

------ Round 1 ----------------------------------
q1	17598	6083	6040	6040
q2	2038	287	166	166
q3	10572	1240	758	758
q4	10221	856	434	434
q5	7855	2218	2016	2016
q6	205	183	152	152
q7	914	772	612	612
q8	9282	1412	1193	1193
q9	5435	4963	4979	4963
q10	6827	2291	1859	1859
q11	487	281	262	262
q12	351	370	238	238
q13	17760	3746	3104	3104
q14	232	245	213	213
q15	560	510	494	494
q16	623	620	587	587
q17	580	851	334	334
q18	6820	6502	6328	6328
q19	2092	957	549	549
q20	309	316	194	194
q21	2967	2403	2018	2018
q22	365	336	312	312
Total cold run time: 104093 ms
Total hot run time: 32826 ms

----- Round 2, with runtime_filter_mode=off -----
q1	6311	6219	6227	6219
q2	233	330	232	232
q3	2244	2640	2305	2305
q4	1440	1831	1377	1377
q5	4325	4778	4905	4778
q6	185	177	145	145
q7	2111	1973	1792	1792
q8	2640	2856	2711	2711
q9	7285	7238	7323	7238
q10	3069	3334	2828	2828
q11	578	511	496	496
q12	676	747	636	636
q13	3560	3865	3331	3331
q14	301	319	289	289
q15	582	519	496	496
q16	674	688	657	657
q17	1211	1735	1276	1276
q18	7628	7416	7379	7379
q19	953	1169	1156	1156
q20	2039	2061	1906	1906
q21	5708	5265	4926	4926
q22	620	587	565	565
Total cold run time: 54373 ms
Total hot run time: 52738 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 197440 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit c53cc865b08415436a7b4744b8ab7f6dadec2eb2, data reload: false

query1	1270	948	903	903
query2	6495	2363	2321	2321
query3	10961	4697	4764	4697
query4	33055	23577	23997	23577
query5	4260	607	461	461
query6	300	196	188	188
query7	3992	492	302	302
query8	308	251	253	251
query9	9213	2623	2620	2620
query10	471	307	260	260
query11	18097	15537	15303	15303
query12	162	108	106	106
query13	1577	545	399	399
query14	10600	7689	7494	7494
query15	256	217	206	206
query16	8119	623	447	447
query17	1532	781	600	600
query18	2140	433	342	342
query19	247	183	172	172
query20	130	112	116	112
query21	206	128	107	107
query22	4561	4622	4392	4392
query23	35080	33685	34566	33685
query24	6702	2357	2315	2315
query25	448	450	388	388
query26	1125	270	158	158
query27	2099	476	340	340
query28	5435	2448	2426	2426
query29	531	561	428	428
query30	222	192	146	146
query31	1009	905	859	859
query32	85	62	58	58
query33	483	345	318	318
query34	793	835	541	541
query35	818	834	759	759
query36	1040	1045	996	996
query37	116	102	77	77
query38	4111	4307	4485	4307
query39	1551	1499	1462	1462
query40	208	121	104	104
query41	45	46	44	44
query42	125	104	118	104
query43	532	529	511	511
query44	1344	815	827	815
query45	180	170	167	167
query46	888	1069	682	682
query47	2009	1950	1928	1928
query48	394	429	319	319
query49	740	493	410	410
query50	646	681	417	417
query51	7398	7261	7260	7260
query52	105	106	89	89
query53	236	260	195	195
query54	482	516	412	412
query55	81	81	82	81
query56	265	294	253	253
query57	1203	1239	1127	1127
query58	237	249	219	219
query59	3217	3361	3097	3097
query60	278	268	256	256
query61	109	108	107	107
query62	871	819	766	766
query63	237	207	206	206
query64	4332	1032	623	623
query65	3360	3319	3312	3312
query66	755	425	351	351
query67	16514	15824	15444	15444
query68	9266	691	518	518
query69	470	286	241	241
query70	1209	1151	1157	1151
query71	441	290	254	254
query72	6422	3826	3879	3826
query73	660	755	366	366
query74	10356	9015	8982	8982
query75	4554	3156	2697	2697
query76	4520	1162	784	784
query77	780	350	273	273
query78	10224	10170	9325	9325
query79	2598	798	588	588
query80	622	507	429	429
query81	471	272	221	221
query82	621	154	120	120
query83	161	157	142	142
query84	238	95	79	79
query85	787	368	314	314
query86	354	303	313	303
query87	4449	4416	4334	4334
query88	3147	2220	2229	2220
query89	429	330	285	285
query90	1859	182	186	182
query91	124	134	102	102
query92	66	55	55	55
query93	1017	857	529	529
query94	648	393	283	283
query95	327	262	245	245
query96	490	610	282	282
query97	2928	2996	2835	2835
query98	210	204	193	193
query99	1655	1555	1460	1460
Total cold run time: 298494 ms
Total hot run time: 197440 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.08 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit c53cc865b08415436a7b4744b8ab7f6dadec2eb2, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.03	0.03
query3	0.24	0.07	0.07
query4	1.62	0.10	0.10
query5	0.45	0.39	0.41
query6	1.16	0.69	0.69
query7	0.02	0.02	0.02
query8	0.04	0.03	0.03
query9	0.57	0.49	0.50
query10	0.55	0.57	0.55
query11	0.15	0.11	0.11
query12	0.15	0.11	0.11
query13	0.61	0.62	0.60
query14	2.70	2.87	2.74
query15	0.93	0.86	0.85
query16	0.40	0.38	0.40
query17	1.00	1.02	1.04
query18	0.22	0.21	0.21
query19	1.97	2.02	1.90
query20	0.02	0.01	0.01
query21	15.35	0.94	0.58
query22	0.75	0.77	0.60
query23	15.35	1.46	0.55
query24	2.86	1.37	0.55
query25	0.16	0.22	0.09
query26	0.40	0.15	0.13
query27	0.05	0.06	0.04
query28	13.36	1.57	1.06
query29	12.60	4.06	3.30
query30	0.25	0.10	0.07
query31	2.85	0.60	0.39
query32	3.22	0.56	0.48
query33	3.20	3.16	3.09
query34	16.53	5.25	4.50
query35	4.59	4.49	4.50
query36	0.65	0.51	0.50
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.03	0.02	0.03
query40	0.17	0.13	0.13
query41	0.08	0.03	0.03
query42	0.04	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 105.57 s
Total hot run time: 31.08 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants