I want to delete unimportant kv based on the cumulative attention score

[coolling]

Hello, I want to delete unimportant kv based on the cumulative attention score

I have some confusion

1. I have never understood how the deletion of cells corresponds to the deletion of kv cache
2. When kv exceeds the capacity, the program will report an error. Is there any solution here?

Sorry, I translated it through a translation software, so it may be a little strange