Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

compactor: concurrently get deletion marks for blocks #9881

Merged
merged 4 commits into from
Nov 12, 2024
Merged

compactor: concurrently get deletion marks for blocks #9881

merged 4 commits into from
Nov 12, 2024
+99 −74

Commits on Nov 12, 2024

  1. compactor: concurrently get deletion marks for blocks 

    With a lot of blocks churn (for example a lot of OOO blocks) getting the deletion marks for newly discovered blocks can take a long time (13 minutes).

This PR introduces changes the bucket index updater to request 16 deletions marks concurrently (same as the number of block deleted in parallel).

Signed-off-by: Dimitar Dimitrov <[email protected]>
    @dimitarvdimitrov
    dimitarvdimitrov committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    cdb5c12 View commit details
    Browse the repository at this point in the history

  2. Add CHANGELOG.md entry 

    Signed-off-by: Dimitar Dimitrov <[email protected]>
    @dimitarvdimitrov
    dimitarvdimitrov committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    92e745b View commit details
    Browse the repository at this point in the history

  3. Restore error handling 

    Signed-off-by: Dimitar Dimitrov <[email protected]>
    @dimitarvdimitrov
    dimitarvdimitrov committed Nov 12, 2024
    Configuration menu
    Copy the full SHA
    fbdbd25 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into dimitar/compactor/request-deletion-marks-con… 

    …currently
    @codesome
    codesome authored Nov 12, 2024
    Configuration menu
    Copy the full SHA
    ff7147b View commit details
    Browse the repository at this point in the history