Doris 实时同步程序运行一段时间,就会遇到E-230的错误,请各路大神帮帮忙!!! #38447
Answered
by
Panlibin2015
Panlibin2015
asked this question in
Q&A
-
目前集群是1个FE,2个BE,BE是16核32G内存 |
Beta Was this translation helpful? Give feedback.
Answered by
Panlibin2015
Jul 29, 2024
Replies: 1 comment
-
Doris社区的Darren给到我两个关键的建议:
改完后,数据同步快了很多,这个问题目前看是得到解决了 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
Panlibin2015
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Doris社区的Darren给到我两个关键的建议:
写入Doris操作,流写入改为批写入
批写入参数设置为 batchSize 20w,写入时间间隔(指定时间内没有达到batchSize触发)改为30s
Be参数修改:
max_base_compaction_threads = 8
max_cumu_compaction_threads = 2
compaction_task_num_per_disk = 8
compaction_task_num_per_fast_disk = 12
改完后,数据同步快了很多,这个问题目前看是得到解决了