Skip to content

Doris 实时同步程序运行一段时间,就会遇到E-230的错误,请各路大神帮帮忙!!! #38447

Answered by Panlibin2015
Panlibin2015 asked this question in Q&A
Discussion options

You must be logged in to vote

Doris社区的Darren给到我两个关键的建议:

  1. 写入Doris操作,流写入改为批写入

  2. 批写入参数设置为 batchSize 20w,写入时间间隔(指定时间内没有达到batchSize触发)改为30s

  3. Be参数修改:
    max_base_compaction_threads = 8
    max_cumu_compaction_threads = 2
    compaction_task_num_per_disk = 8
    compaction_task_num_per_fast_disk = 12

改完后,数据同步快了很多,这个问题目前看是得到解决了

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by Panlibin2015
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
1 participant