Skip to content

[V1] Simplify prefix caching logic by removing num_evictable_computed_blocks#11310

Merged
comaniac merged 4 commits intovllm-project:mainfrom heheda12345:v1-prefix-cache-fixDec 19, 2024

Commits

Commits on Dec 18, 2024

Commits on Dec 19, 2024