Skip to content

Commit

Permalink
Make suggested title change
Browse files Browse the repository at this point in the history
Signed-off-by: Harry Mellor <[email protected]>
  • Loading branch information
hmellor committed Jan 13, 2025
1 parent 1740d65 commit 7b150a4
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/getting_started/installation/cpu/index.md
Original file line number Diff line number Diff line change
Expand Up @@ -211,7 +211,7 @@ $ python examples/offline_inference/basic.py

- If using vLLM CPU backend on a multi-socket machine with NUMA, be aware to set CPU cores using `VLLM_CPU_OMP_THREADS_BIND` to avoid cross NUMA node memory access.

## CPU Backend Considerations
## Other considerations

- The CPU backend significantly differs from the GPU backend since the vLLM architecture was originally optimized for GPU use. A number of optimizations are needed to enhance its performance.

Expand Down

0 comments on commit 7b150a4

Please sign in to comment.