Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-3.0: [case](cloud) add case that partial update fail to update tmp rowset after it write new segment in publish phase #45795 #45961

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

Cherry-picked from #45795

…after it write new segment in publish phase (#45795)

add a case that partial update fail to update tmp rowset after it write
a new segment in publish phase. The inverted checker is expected to fail
because of this case before #45626
is merged.
@Thearas
Copy link
Contributor

Thearas commented Dec 25, 2024

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@dataroaring dataroaring reopened this Dec 25, 2024
@Thearas
Copy link
Contributor

Thearas commented Dec 25, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40915 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a70df99ab583541ae0207499aace2fe6d00382a3, data reload: false

------ Round 1 ----------------------------------
q1	17571	7473	7279	7279
q2	2059	175	162	162
q3	10558	1158	1149	1149
q4	10217	766	747	747
q5	7750	2765	2725	2725
q6	240	149	146	146
q7	968	619	603	603
q8	9357	1934	1982	1934
q9	6604	6435	6391	6391
q10	6998	2312	2293	2293
q11	457	271	263	263
q12	400	213	211	211
q13	17776	2997	2994	2994
q14	247	216	209	209
q15	555	523	530	523
q16	670	623	621	621
q17	962	602	528	528
q18	7316	6810	6736	6736
q19	1384	1057	1010	1010
q20	488	212	200	200
q21	3980	3199	3271	3199
q22	1128	992	992	992
Total cold run time: 107685 ms
Total hot run time: 40915 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7341	7250	7285	7250
q2	328	230	222	222
q3	2887	2759	2786	2759
q4	1900	1688	1679	1679
q5	5441	5523	5413	5413
q6	218	138	139	138
q7	2099	1739	1710	1710
q8	3244	3355	3416	3355
q9	8462	8500	8516	8500
q10	3484	3413	3442	3413
q11	601	481	514	481
q12	796	592	600	592
q13	13581	2988	3014	2988
q14	299	258	262	258
q15	559	519	514	514
q16	710	668	670	668
q17	1788	1595	1561	1561
q18	7757	7318	7436	7318
q19	1661	1622	1591	1591
q20	2057	1804	1823	1804
q21	5358	5230	5256	5230
q22	1113	1035	1001	1001
Total cold run time: 71684 ms
Total hot run time: 58445 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 191229 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a70df99ab583541ae0207499aace2fe6d00382a3, data reload: false

query1	986	380	356	356
query2	6512	2109	2052	2052
query3	6712	218	223	218
query4	33842	23593	23551	23551
query5	4317	466	440	440
query6	268	175	182	175
query7	4623	322	319	319
query8	282	223	230	223
query9	9678	2687	2682	2682
query10	479	265	256	256
query11	18020	15247	15247	15247
query12	158	99	102	99
query13	1637	444	421	421
query14	9845	7093	6386	6386
query15	253	174	182	174
query16	8092	462	474	462
query17	1616	575	564	564
query18	2152	321	323	321
query19	297	153	156	153
query20	119	111	107	107
query21	66	49	47	47
query22	4517	4443	4360	4360
query23	34677	33961	34209	33961
query24	11274	2806	2834	2806
query25	692	424	404	404
query26	1608	170	171	170
query27	2857	302	306	302
query28	8130	2492	2458	2458
query29	988	452	434	434
query30	330	171	164	164
query31	1140	798	820	798
query32	95	60	58	58
query33	783	294	306	294
query34	932	484	509	484
query35	870	716	716	716
query36	1101	930	979	930
query37	138	75	76	75
query38	3945	3827	3838	3827
query39	1513	1456	1437	1437
query40	229	88	97	88
query41	53	52	51	51
query42	112	101	99	99
query43	531	496	486	486
query44	1347	815	816	815
query45	185	169	170	169
query46	1148	713	729	713
query47	1930	1842	1868	1842
query48	476	401	371	371
query49	1289	423	395	395
query50	804	408	413	408
query51	7245	7032	7212	7032
query52	104	91	90	90
query53	259	185	188	185
query54	1218	474	465	465
query55	80	79	78	78
query56	279	260	242	242
query57	1249	1125	1100	1100
query58	240	205	221	205
query59	3271	3002	2863	2863
query60	317	260	262	260
query61	112	116	116	116
query62	893	685	666	666
query63	218	186	180	180
query64	5382	670	635	635
query65	3333	3208	3160	3160
query66	1430	324	299	299
query67	16226	15708	15696	15696
query68	4710	578	571	571
query69	455	271	300	271
query70	1219	1149	1097	1097
query71	408	250	249	249
query72	6545	4162	4032	4032
query73	752	349	365	349
query74	10375	9042	8969	8969
query75	3406	2617	2668	2617
query76	2911	1062	1057	1057
query77	457	277	279	277
query78	10568	9640	9611	9611
query79	1540	590	605	590
query80	1089	443	419	419
query81	541	241	238	238
query82	885	117	121	117
query83	231	168	147	147
query84	241	79	79	79
query85	1287	316	289	289
query86	354	281	308	281
query87	4335	4470	4272	4272
query88	3503	2398	2351	2351
query89	402	282	297	282
query90	1932	186	188	186
query91	185	147	148	147
query92	59	52	52	52
query93	1076	571	553	553
query94	891	307	286	286
query95	365	260	260	260
query96	607	281	288	281
query97	3325	3270	3155	3155
query98	221	209	204	204
query99	1546	1300	1341	1300
Total cold run time: 301925 ms
Total hot run time: 191229 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.23 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a70df99ab583541ae0207499aace2fe6d00382a3, data reload: false

query1	0.04	0.04	0.03
query2	0.06	0.03	0.03
query3	0.24	0.06	0.06
query4	1.62	0.11	0.11
query5	0.54	0.53	0.53
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.04	0.04	0.03
query9	0.56	0.48	0.52
query10	0.56	0.55	0.60
query11	0.15	0.11	0.10
query12	0.14	0.11	0.13
query13	0.61	0.59	0.59
query14	2.99	2.90	3.07
query15	0.89	0.83	0.81
query16	0.40	0.39	0.37
query17	1.07	1.07	1.06
query18	0.23	0.22	0.22
query19	1.98	1.92	1.82
query20	0.01	0.01	0.01
query21	15.36	0.59	0.60
query22	3.16	2.03	1.53
query23	17.21	0.89	0.91
query24	3.42	0.54	1.97
query25	0.24	0.07	0.14
query26	0.57	0.13	0.13
query27	0.05	0.04	0.04
query28	10.22	1.10	1.08
query29	12.88	3.25	3.25
query30	0.25	0.06	0.06
query31	2.86	0.38	0.37
query32	3.26	0.46	0.47
query33	2.97	3.03	3.02
query34	16.77	4.45	4.46
query35	4.52	4.42	4.50
query36	0.68	0.50	0.47
query37	0.09	0.06	0.06
query38	0.05	0.04	0.04
query39	0.04	0.02	0.02
query40	0.17	0.12	0.12
query41	0.08	0.02	0.03
query42	0.03	0.02	0.02
query43	0.04	0.03	0.03
Total cold run time: 108.2 s
Total hot run time: 32.23 s

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants