[branch-2.0](routine-load) fix be core when partial table load failed

[sollhui]

Proposed changes

#34712

[doris-robot]

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

[sollhui]

run buildall

[doris-robot]

TPC-H: Total hot run time: 49561 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 834a2ae1689078ee79eed08425f87e0900be77de, data reload: false

------ Round 1 ----------------------------------
q1	17999	4406	4328	4328
q2	2057	194	147	147
q3	10346	1876	1901	1876
q4	10360	1214	1324	1214
q5	8672	3875	3877	3875
q6	234	127	125	125
q7	2100	1615	1583	1583
q8	9316	2726	2703	2703
q9	10622	10321	10220	10220
q10	8661	3538	3518	3518
q11	416	233	251	233
q12	461	300	299	299
q13	18335	3966	3973	3966
q14	357	339	331	331
q15	514	450	470	450
q16	687	577	574	574
q17	1121	946	957	946
q18	7370	6978	6897	6897
q19	1709	1568	1504	1504
q20	563	310	314	310
q21	4406	4084	4078	4078
q22	480	384	406	384
Total cold run time: 116786 ms
Total hot run time: 49561 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4303	4275	4316	4275
q2	317	224	228	224
q3	4185	4155	4117	4117
q4	2734	2736	2734	2734
q5	7138	7068	7093	7068
q6	234	119	117	117
q7	3182	2828	2874	2828
q8	4361	4474	4508	4474
q9	16939	16783	16683	16683
q10	4239	4228	4257	4228
q11	770	692	733	692
q12	1023	863	874	863
q13	7101	3748	3741	3741
q14	450	427	431	427
q15	494	461	453	453
q16	741	680	690	680
q17	3786	3834	3802	3802
q18	8864	8816	8838	8816
q19	1707	1699	1660	1660
q20	2371	2097	2118	2097
q21	8443	8547	8448	8448
q22	1024	971	935	935
Total cold run time: 84406 ms
Total hot run time: 79362 ms

[doris-robot]

TeamCity be ut coverage result:
Function Coverage: 37.81% (8099/21420)
Line Coverage: 29.47% (66137/224435)
Region Coverage: 28.95% (34089/117733)
Branch Coverage: 24.81% (17495/70528)
Coverage Report: http://coverage.selectdb-in.cc/coverage/834a2ae1689078ee79eed08425f87e0900be77de_834a2ae1689078ee79eed08425f87e0900be77de/report/index.html

[doris-robot]

TPC-DS: Total hot run time: 203272 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 834a2ae1689078ee79eed08425f87e0900be77de, data reload: false

query1	933	389	377	377
query2	6585	2903	2589	2589
query3	6920	214	203	203
query4	20500	17812	17907	17812
query5	19739	6498	6469	6469
query6	293	219	230	219
query7	4163	295	308	295
query8	252	284	255	255
query9	3120	2696	2641	2641
query10	416	302	282	282
query11	11284	10730	10735	10730
query12	124	75	72	72
query13	5591	668	674	668
query14	17378	13686	13510	13510
query15	378	229	235	229
query16	6673	301	268	268
query17	1806	1440	888	888
query18	2309	409	410	409
query19	207	151	150	150
query20	73	81	83	81
query21	191	99	104	99
query22	5162	4994	5024	4994
query23	32427	32024	31878	31878
query24	7004	6547	6508	6508
query25	525	429	427	427
query26	526	163	161	161
query27	1817	298	296	296
query28	6199	2335	2323	2323
query29	2959	2798	2728	2728
query30	247	170	169	169
query31	915	745	749	745
query32	73	63	61	61
query33	408	259	257	257
query34	868	479	472	472
query35	1113	918	926	918
query36	1373	1284	1192	1192
query37	96	62	63	62
query38	3056	2953	2908	2908
query39	1379	1336	1320	1320
query40	209	96	97	96
query41	47	38	37	37
query42	81	82	83	82
query43	665	715	767	715
query44	1145	716	714	714
query45	247	237	228	228
query46	1236	967	976	967
query47	1898	1718	1714	1714
query48	991	710	696	696
query49	624	382	376	376
query50	850	593	609	593
query51	4760	4643	4675	4643
query52	88	91	82	82
query53	441	316	312	312
query54	2664	2437	2432	2432
query55	93	91	84	84
query56	244	209	217	209
query57	1144	1167	1099	1099
query58	225	213	198	198
query59	4326	4020	3986	3986
query60	209	210	203	203
query61	99	96	98	96
query62	834	460	466	460
query63	499	342	337	337
query64	2519	1584	1516	1516
query65	3623	3555	3526	3526
query66	771	376	388	376
query67	16157	16819	14929	14929
query68	9209	642	682	642
query69	580	354	358	354
query70	1853	1429	1561	1429
query71	425	302	329	302
query72	6608	3551	3510	3510
query73	742	327	322	322
query74	6304	5828	5827	5827
query75	5470	3719	3730	3719
query76	5679	1128	1234	1128
query77	977	272	271	271
query78	12429	11623	11936	11623
query79	8394	667	658	658
query80	1383	414	411	411
query81	501	237	249	237
query82	1442	97	99	97
query83	178	132	134	132
query84	255	69	75	69
query85	874	323	316	316
query86	330	297	290	290
query87	3266	2960	3059	2960
query88	4904	2344	2347	2344
query89	367	290	274	274
query90	1976	229	204	204
query91	176	136	139	136
query92	60	56	57	56
query93	6115	623	620	620
query94	707	217	210	210
query95	1126	1058	1057	1057
query96	657	330	329	329
query97	6535	6333	6348	6333
query98	184	175	180	175
query99	3028	886	866	866
Total cold run time: 314505 ms
Total hot run time: 203272 ms

[doris-robot]

ClickBench: Total hot run time: 30.48 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 834a2ae1689078ee79eed08425f87e0900be77de, data reload: false

query1	0.02	0.03	0.02
query2	0.08	0.02	0.02
query3	0.24	0.05	0.05
query4	1.79	0.06	0.07
query5	0.54	0.52	0.54
query6	1.22	0.62	0.61
query7	0.02	0.01	0.01
query8	0.03	0.02	0.02
query9	0.52	0.49	0.47
query10	0.54	0.54	0.53
query11	0.13	0.09	0.09
query12	0.12	0.08	0.08
query13	0.62	0.61	0.60
query14	0.78	0.78	0.79
query15	0.79	0.76	0.76
query16	0.35	0.37	0.37
query17	1.00	1.02	1.00
query18	0.22	0.26	0.24
query19	1.92	1.85	1.85
query20	0.02	0.01	0.02
query21	15.47	0.55	0.57
query22	2.24	2.44	1.65
query23	16.84	1.14	0.82
query24	7.56	1.08	0.72
query25	0.40	0.12	0.06
query26	0.73	0.19	0.16
query27	0.04	0.04	0.03
query28	5.77	0.77	0.71
query29	12.60	2.33	2.33
query30	0.63	0.53	0.53
query31	2.82	0.39	0.37
query32	3.34	0.49	0.50
query33	3.07	3.10	3.09
query34	15.26	4.79	4.81
query35	4.83	4.86	4.84
query36	1.05	1.00	1.01
query37	0.05	0.04	0.05
query38	0.03	0.02	0.02
query39	0.02	0.01	0.01
query40	0.16	0.14	0.14
query41	0.06	0.02	0.01
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 103.96 s
Total hot run time: 30.48 s

[doris-robot]

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 834a2ae1689078ee79eed08425f87e0900be77de with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.4 seconds inserted 10000000 Rows, about 467K ops/s