[Benchmark] Add benchmark script for CPU offloading #11533

Merged

comaniac merged 3 commits intovllm-project:mainfrom ApostaC:local-dev/cpu-offloading-benchmark

Jan 1, 2025

+184

Commits on Dec 26, 2024

[Add] benchmark script for CPU offloading (long document QA use case)

ApostaC
and
KuntaiDu
committed

Commits on Dec 31, 2024