Skip to content

[V1][Prefix Cache] Move the logic of full cache hit and num_computed_tokens into KVCacheManager #33102

[V1][Prefix Cache] Move the logic of full cache hit and num_computed_tokens into KVCacheManager

[V1][Prefix Cache] Move the logic of full cache hit and num_computed_tokens into KVCacheManager #33102

Annotations

1 warning

yapf (3.12)

succeeded Jan 13, 2025 in 1m 54s