Skip to content

Recompute KV cache for Phi3 when switching from short to long factor#1161

Merged
ajindal1 merged 7 commits intomainfrom abjindal/phi3_reset_compute_cacheJan 8, 2025

Commits

Commits on Dec 20, 2024

Commits on Jan 3, 2025

Commits on Jan 6, 2025

Commits on Jan 7, 2025

Commits on Jan 8, 2025