Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refresh materialized view failed: corrupted partition meta #55366

Open
LiShuMing opened this issue Jan 23, 2025 · 0 comments · May be fixed by #55372
Open

Refresh materialized view failed: corrupted partition meta #55366

LiShuMing opened this issue Jan 23, 2025 · 0 comments · May be fixed by #55372
Labels
type/bug Something isn't working

Comments

@LiShuMing
Copy link
Contributor

Steps to reproduce the behavior (Required)

  • Create MV with jdbc catalog and orcale/tidb server, refresh mv fail as below:
2025-01-14 11:02:37.073+08:00 INFO (starrocks-taskrun-pool-0|267) [PartitionBasedMvRefreshProcessor.syncAndCheckPartitions():267] Sync and check materialized view mv_oracle01 partition changing after 1 times: true, costs: 121 ms
2025-01-14 11:02:37.079+08:00 WARN (starrocks-taskrun-pool-0|267) [PartitionBasedMvRefreshProcessor.doRefreshMaterializedViewWithRetry():377] Refresh materialized view mv_oracle01 failed at 1th time: java.lang.IllegalStateException: corrupted partition meta
	at com.google.common.base.Preconditions.checkState(Preconditions.java:512)
	at com.starrocks.connector.partitiontraits.DefaultTraits.getPartitionNameWithPartitionInfo(DefaultTraits.java:117)
	at com.starrocks.connector.partitiontraits.DefaultTraits.getUpdatedPartitionNames(DefaultTraits.java:134)
	at com.starrocks.catalog.MaterializedView.getUpdatedPartitionNamesOfExternalTable(MaterializedView.java:828)
	at com.starrocks.catalog.MvRefreshArbiter.needsToRefreshTable(MvRefreshArbiter.java:145)
	at com.starrocks.catalog.MvRefreshArbiter.needsToRefreshTable(MvRefreshArbiter.java:47)
	at com.starrocks.scheduler.mv.MVPCTRefreshPartitioner.isNonPartitionedMVNeedToRefresh(MVPCTRefreshPartitioner.java:246)
	at com.starrocks.scheduler.mv.MVPCTRefreshNonPartitioner.getMVPartitionsToRefresh(MVPCTRefreshNonPartitioner.java:66)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.getPartitionsToRefreshForMaterializedView(PartitionBasedMvRefreshProcessor.java:972)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.getPartitionsToRefreshForMaterializedView(PartitionBasedMvRefreshProcessor.java:930)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.checkMvToRefreshedPartitions(PartitionBasedMvRefreshProcessor.java:289)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.doRefreshMaterializedView(PartitionBasedMvRefreshProcessor.java:439)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.doRefreshMaterializedViewWithRetry(PartitionBasedMvRefreshProcessor.java:368)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.doMvRefresh(PartitionBasedMvRefreshProcessor.java:327)
	at com.starrocks.scheduler.PartitionBasedMvRefreshProcessor.processTaskRun(PartitionBasedMvRefreshProcessor.java:199)
	at com.starrocks.scheduler.TaskRun.executeTaskRun(TaskRun.java:270)
	at com.starrocks.scheduler.TaskRunExecutor.lambda$executeTaskRun$0(TaskRunExecutor.java:59)
	at java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:842)
2025-01-14 11:02:38.084+08:00 INFO (starrocks-taskrun-pool-0|267) [PartitionBasedMvRefreshProcessor.processTaskRun():219] Refresh mv mv_oracle01 trace logs:    0ms|-- MVRefreshPrepare[1] 7ms
   8ms|-- MVRefreshDoWholeRefresh[1] 1s195ms
  21ms|    -- MVRefreshComputeCandidatePartitions[1] 54ms
  75ms|    -- MVRefreshSyncAndCheckPartitions[1] 121ms
  75ms|        -- MVRefreshExternalTable[1] 58ms
 134ms|        -- MVRefreshCheckBaseTableChange[1] 62ms
 197ms|    -- MVRefreshCheckMVToRefreshPartitions[1] 3ms
Tracer Cost: 156us

Expected behavior (Required)

Real behavior (Required)

StarRocks version (Required)

3.3.9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
type/bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[BugFix] Fix refresh mv with some external table bug LiShuMing/starrocks
1 participant
@LiShuMing