Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Delete Stale Keys from Disk AND RBM #13

Merged
merged 22 commits into from
Dec 19, 2023
Merged

Delete Stale Keys from Disk AND RBM #13

merged 22 commits into from
Dec 19, 2023

Commits on Nov 28, 2023

  1. Update IndicesRequestCache.java 

    to delete stale keys from diskcache
    @kiranprakash154
    kiranprakash154 committed Nov 28, 2023
    3 Configuration menu
    Copy the full SHA
    52b9dfd View commit details
    Browse the repository at this point in the history

  2. More updates to disk cache cleanup

    @kiranprakash154
    kiranprakash154 committed Nov 28, 2023
    7 Configuration menu
    Copy the full SHA
    5bab65d View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2023

  1. register INDICES_REQUEST_CACHE_DISK_CLEAN_THRESHOLD_SETTING in cluste… 

    …rsettings.java
    @kiranprakash154
    kiranprakash154 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    4500090 View commit details
    Browse the repository at this point in the history

  2. make INDICES_REQUEST_CACHE_DISK_CLEAN_INTERVAL_SETTING dynamic property

    @kiranprakash154
    kiranprakash154 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    4199bc2 View commit details
    Browse the repository at this point in the history

  3. minor changes

    @kiranprakash154
    kiranprakash154 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    6e05b9d View commit details
    Browse the repository at this point in the history

  4. change the way we calculate disk key staleness

    @kiranprakash154
    kiranprakash154 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    aa3c39c View commit details
    Browse the repository at this point in the history

  5. fix breaking tests

    @kiranprakash154
    kiranprakash154 committed Nov 29, 2023
    Configuration menu
    Copy the full SHA
    83d70f7 View commit details
    Browse the repository at this point in the history

Commits on Nov 30, 2023

  1. Fix test to include IndexShard

    @kiranprakash154
    kiranprakash154 committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    caae291 View commit details
    Browse the repository at this point in the history

  2. UT for testing invalidate of DiskTier is called

    @kiranprakash154
    kiranprakash154 committed Nov 30, 2023
    Configuration menu
    Copy the full SHA
    9d0eab1 View commit details
    Browse the repository at this point in the history

Commits on Dec 5, 2023

  1. Introduce CleanupStatus to keysToClean

    @kiranprakash154
    kiranprakash154 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    5c472ae View commit details
    Browse the repository at this point in the history

  2. use that cleanupStatus and logic to update staleKeyEntries

    @kiranprakash154
    kiranprakash154 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    be10a16 View commit details
    Browse the repository at this point in the history

  3. register INDICES_REQUEST_CACHE_DISK_CLEAN_INTERVAL_SETTING to cluster… 

    … settings
    @kiranprakash154
    kiranprakash154 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    4c8b240 View commit details
    Browse the repository at this point in the history

  4. Add removal listener to update eh cache stats

    @kiranprakash154
    kiranprakash154 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    eeb973e View commit details
    Browse the repository at this point in the history

  5. re-organize imports

    @kiranprakash154
    kiranprakash154 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    f22cdaf View commit details
    Browse the repository at this point in the history

  6. Add IT tests

    @kiranprakash154
    kiranprakash154 committed Dec 5, 2023
    Configuration menu
    Copy the full SHA
    280cb07 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'feature/tiered-caching' into kp/delete-stale-keys 

    Signed-off-by: Kiran Prakash <[email protected]>
    @kiranprakash154
    kiranprakash154 authored Dec 5, 2023
    Configuration menu
    Copy the full SHA
    27f122b View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2023

  1. refactor cleanCache & cleanDiskCache to share methods

    @kiranprakash154
    kiranprakash154 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    8f0b5bc View commit details
    Browse the repository at this point in the history

  2. null checks for indexShard

    @kiranprakash154
    kiranprakash154 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    8c996b3 View commit details
    Browse the repository at this point in the history

  3. some bugs i found

    @kiranprakash154
    kiranprakash154 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    4bd1503 View commit details
    Browse the repository at this point in the history

  4. use assertNumCacheEntries

    @kiranprakash154
    kiranprakash154 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    1911fa6 View commit details
    Browse the repository at this point in the history

  5. update print statement

    @kiranprakash154
    kiranprakash154 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    ae0b471 View commit details
    Browse the repository at this point in the history

  6. edit sleep time

    @kiranprakash154
    kiranprakash154 committed Dec 15, 2023
    Configuration menu
    Copy the full SHA
    fce110d View commit details
    Browse the repository at this point in the history