Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broker forgets to delete uploaded segment when restarted #13

Open
ivanyu opened this issue Apr 13, 2023 · 0 comments
Open

Broker forgets to delete uploaded segment when restarted #13

ivanyu opened this issue Apr 13, 2023 · 0 comments
Labels
bug Stale tiered storage Issues related to Tiered Storage

Comments

@ivanyu
Copy link
Member

ivanyu commented Apr 13, 2023

If a broker uploaded a segment to the remote, but didn't delete it locally and was restarted, it will not delete the local segment after restart until the next segment is uploaded. Most likely, because this remains -1 until the next segment upload (in this log).

Possible fix: update highestOffsetWithRemoteIndex on start for the leader.

@ivanyu ivanyu added the tiered storage Issues related to Tiered Storage label Apr 13, 2023
@mdedetrich mdedetrich added the bug label Apr 21, 2023
@github-actions github-actions bot added the Stale label Jul 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Stale tiered storage Issues related to Tiered Storage
Projects
None yet
Development

No branches or pull requests

2 participants