Skip to content

Pull requests: vllm-project/vllm

New pull request New
423 Open 4,878 Closed
423 Open 4,878 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Misc] Use registry-based initialization for KV cache transfer connector.
#11481 opened Dec 25, 2024 by KuntaiDu Loading…
2
[Misc] Allow initializing KV cache transfer agent when using third-party library for disaggregated prefill
#11480 opened Dec 25, 2024 by KuntaiDu Loading…
1
Update amd-installation.md ci/build documentation Improvements or additions to documentation
#11470 opened Dec 24, 2024 by johnnynunez Loading…
3
Update deploying_with_k8s.md with AMD ROCm GPU example documentation Improvements or additions to documentation
#11465 opened Dec 24, 2024 by AlexHe99 Loading…
1
[Misc] Update disaggregation benchmark scripts and test logs ready ONLY add when PR is ready to merge/full CI is needed
#11456 opened Dec 24, 2024 by Jeffwan Loading…
1
2
[Frontend] improve hermes_tool_parser.py ci/build frontend
#11453 opened Dec 24, 2024 by paulcx Loading…
1
[Platform] More consistent entrypoints across different platforms ci/build
#11448 opened Dec 24, 2024 by terrytangyuan Loading…
3
[Model] Support for fairseq2 Llama
#11442 opened Dec 24, 2024 by MartinGleize • Draft
1
[Model][LoRA]LoRA support added for MolmoForCausalLM ci/build documentation Improvements or additions to documentation frontend needs-rebase
#11439 opened Dec 23, 2024 by ayylemao Loading…
1
7
fix: add missing bos_token to example templates ci/build
#11432 opened Dec 23, 2024 by toslunar Loading…
5
Add TTFT to offline_inference_with_prefix.py
#11428 opened Dec 23, 2024 by xu-song Loading…
5
[WIP][VLM] Implement merged multimodal processor for Mllama
#11427 opened Dec 23, 2024 by Isotr0py • Draft
1
Zhn/fish e2e merge ci/build
#11426 opened Dec 23, 2024 by niuzheng168 • Draft
1
Bump helm/kind-action from 1.10.0 to 1.11.0 ci/build dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#11424 opened Dec 23, 2024 by dependabot bot Loading…
1
[V1] add error handling
#11420 opened Dec 22, 2024 by Ajay-Satish-01 Loading…
1
1
[WIP][Doc]Add documentation for using EAGLE in vLLM documentation Improvements or additions to documentation
#11417 opened Dec 22, 2024 by sroy745 • Draft
1
[Model][BugFix] Mamba/Jamba exceed mamba cache slots
#11414 opened Dec 22, 2024 by mzusman Loading…
1
[V1] Support Pixtral-HF on V1
#11409 opened Dec 22, 2024 by ywang96 • Draft
2
[V1] Optimize block table transfer from CPU to GPU ci/build
#11401 opened Dec 22, 2024 by WoosukKwon • Draft
5
[VLM] Support caching in merged multi-modal processor ci/build documentation Improvements or additions to documentation
#11396 opened Dec 21, 2024 by DarkLight1337 Loading…
3
[Bugfix] Fix available_kv_cache_memory
#11395 opened Dec 21, 2024 by wubai Loading…
1
[V1] Use FlashInfer Sampling Kernel for Top-P & Top-K Sampling
#11394 opened Dec 21, 2024 by WoosukKwon • Draft
1
Update Dockerfile.rocm ci/build
#11387 opened Dec 20, 2024 by yx-lamini Loading…
2
[Core] Support global prefix caching
#11385 opened Dec 20, 2024 by lyppg Loading…
1
[Misc] Adding API Key to the benchmark
#11384 opened Dec 20, 2024 by bjb19 Loading…
3
ProTip! Add no:assignee to see everything that’s not assigned.