Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upstream merge 25 1 6 #350

Merged
merged 202 commits into from
Jan 8, 2025
Merged

Upstream merge 25 1 6 #350

merged 202 commits into from
Jan 8, 2025

Conversation

gshtras
Copy link
Collaborator

@gshtras gshtras commented Jan 6, 2025

2025/1/6 merge

@varun-sundar-rabindranath
[misc] Layerwise profile updates (vllm-project#10242)
efbce85 
Signed-off-by: Varun Sundar Rabindranath <[email protected]>
Co-authored-by: Varun Sundar Rabindranath <[email protected]>
@youkaichao
[core] overhaul memory profiling and fix backward compatibility (vllm…
551603f 
…-project#10511)

Signed-off-by: youkaichao <[email protected]>
@bk-TurbaAI @mgoin
[Docs] hint to enable use of GPU performance counters in profiling to…
35ffa68 
…ols for multi-node distributed serving (vllm-project#11235)

Co-authored-by: Michael Goin <[email protected]>
@youkaichao
[ci][tests] add gh200 tests (vllm-project#11244)
c301616 
Signed-off-by: youkaichao <[email protected]>
@youkaichao @tlrmchlsmth
[torch.compile] fast inductor (vllm-project#11108)
88a412e 
Signed-off-by: youkaichao <[email protected]>
Co-authored-by: Tyler Michael Smith <[email protected]>
@youkaichao
fix gh200 tests on main (vllm-project#11246)
35bae11 
Signed-off-by: youkaichao <[email protected]>
@mgoin
[CI] Add test case with JSON schema using references + use xgrammar b…
0064f69 
…y default with OpenAI parse (vllm-project#10935)

Signed-off-by: mgoin <[email protected]>
@kylehh @DarkLight1337
[Frontend] Add OpenAI API support for input_audio (vllm-project#11027)
66d4b16 
Signed-off-by: DarkLight1337 <[email protected]>
Co-authored-by: DarkLight1337 <[email protected]>
@ywang96
[V1][VLM] Proper memory profiling for image language models (vllm-pro…
59c9b6e 
…ject#11210)

Signed-off-by: Roger Wang <[email protected]>
Co-authored-by: ywang96 <[email protected]>
@wangxiyuan
[Platform] platform agnostic for EngineArgs initialization (vllm-proj…
e88db68 
…ect#11225)

Signed-off-by: wangxiyuan <[email protected]>
@tlrmchlsmth
[V1][Core] Use weakref.finalize instead of atexit (vllm-project#11242)
2bfdbf2 
Signed-off-by: Tyler Michael Smith <[email protected]>
@ywang96 @BBuf
[Misc] Kernel Benchmark for RMSNorm (vllm-project#11241)
02222a0 
Signed-off-by: Roger Wang <[email protected]>
Co-authored-by: Xiaoyu Zhang <[email protected]>
@Isotr0py
[Misc] Allow passing logits_soft_cap for xformers backend (vllm-proje…
f9ecbb1 
…ct#11252)

Signed-off-by: Isotr0py <[email protected]>
@joerunde
[Bugfix] Fix request cancellation without polling (vllm-project#11190)
2d1b9ba
@mgoin
[Bugfix] Set temperature=0.7 in test_guided_choice_chat (vllm-project…
c77eb8a 
…#11264)
@comaniac
[V1] Prefix caching for vision language models (vllm-project#11187)
bf8717e 
Signed-off-by: Cody Yu <[email protected]>
@kzawora-intel
[Bugfix] Restore support for larger block sizes (vllm-project#11259)
866fa45 
Signed-off-by: Konrad Zawora <[email protected]>
@wallashss
[Bugfix] Fix guided decoding with tokenizer mode mistral (vllm-projec…
8b79f9e 
…t#11046)
@yma11
[MISC][XPU]update ipex link for CI fix (vllm-project#11278)
f04e407
@dsikka @Faraz9877
@ilmarkov @rahul-tuli @robertgshaw2-redhat
[Kernel]: Cutlass 2:4 Sparsity + FP8/Int8 Quant Support (vllm-project…
60508ff 
…#10995)

Co-authored-by: Faraz Shahsavan <[email protected]>
Co-authored-by: ilmarkov <[email protected]>
Co-authored-by: Rahul Tuli <[email protected]>
Co-authored-by: [email protected] <[email protected]>
@Isotr0py
[Bugfix] Fix broken phi3-v mm_processor_kwargs tests (vllm-project#11263
996aa70 
)

Signed-off-by: Isotr0py <[email protected]>
@simon-mo
[CI][Misc] Remove Github Action Release Workflow (vllm-project#11274)
362cff1
@jikunshang
[FIX] update openai version (vllm-project#11287)
f954fe0 
Signed-off-by: Kunshang Ji <[email protected]>
@joerunde
[Bugfix] fix minicpmv test (vllm-project#11304)
ca5f54a 
Signed-off-by: Joe Runde <[email protected]>
@alexm-redhat
[V1] VLM - enable processor cache by default (vllm-project#11305)
fdea8ec 
Signed-off-by: Alexander Matveev <[email protected]>
@tlrmchlsmth
[Bugfix][Build/CI] Fix sparse CUTLASS compilation on CUDA [12.0, 12.2) (
5a9da2e 
vllm-project#11311)

Signed-off-by: Tyler Michael Smith <[email protected]>
@tjohnson31415
[Model] IBM Granite 3.1 (vllm-project#11307)
17ca964 
Signed-off-by: Travis Johnson <[email protected]>
@mgoin
[CI] Expand test_guided_generate to test all backends (vllm-project#1…
a30482f 
…1313)

Signed-off-by: mgoin <[email protected]>
@heheda12345
[V1] Simplify prefix caching logic by removing `num_evictable_compute…
c6b0a7d 
…d_blocks` (vllm-project#11310)
@DarkLight1337
[VLM] Merged multimodal processor for Qwen2-Audio (vllm-project#11303)
6142ef0 
Signed-off-by: DarkLight1337 <[email protected]>
bet0x and others added 26 commits January 4, 2025 06:29
@bet0x
Update bnb.md with example for OpenAI (vllm-project#11718)
d1d4939
@jikunshang
[V1] Add RayExecutor support for AsyncLLM (api server) (vllm-proj…
fbf2564 
…ect#11712)
@xcnick
[V1] Add kv cache utils tests. (vllm-project#11513)
d91457d 
Signed-off-by: xcnick <[email protected]>
@yanburman
[Core][Bugfix] Use correct device to initialize GPU data during CUDA-…
300acb8 
…graph-capture (vllm-project#11233)

Signed-off-by: Yan Burman <[email protected]>
Signed-off-by: Ido Asraff <[email protected]>
@DarkLight1337
[VLM] Merged multi-modal processors for LLaVA-NeXT-Video and LLaVA-On…
eed11eb 
…eVision (vllm-project#11717)

Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Bugfix] Fix precision error in LLaVA-NeXT (vllm-project#11735)
ba214df 
Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337 @Isotr0py
[Model] Remove unnecessary weight initialization logic (vllm-project#…
65c0892 
…11736)

Signed-off-by: DarkLight1337 <[email protected]>
Signed-off-by: Isotr0py <[email protected]>
Co-authored-by: Isotr0py <[email protected]>
@jeejeelee
[Bugfix][V1] Fix test_kv_cache_utils.py (vllm-project#11738)
4783143 
Signed-off-by: Jee Jee Li <[email protected]>
@houseroad
[MISC] Replace c10::optional with std::optional (vllm-project#11730)
4068f4b 
Signed-off-by: Lu Fang <[email protected]>
@cennn
[distributed] remove pynccl's redundant stream (vllm-project#11744)
635b897
@RuixiangMa
fix: [doc] fix typo (vllm-project#11751)
eba1717 
Co-authored-by: Lancer <[email protected]>
@robertgshaw2-redhat
[Frontend] Improve StreamingResponse Exception Handling (vllm-proje…
33fc1e2 
…ct#11752)
@cennn
[distributed] remove pynccl's redundant change_state (vllm-project#11749
9e764e7 
)
@DarkLight1337
[Doc] [1/N] Reorganize Getting Started section (vllm-project#11645)
402d378 
Signed-off-by: DarkLight1337 <[email protected]>
@comaniac
[Bugfix] Remove block size constraint (vllm-project#11723)
408e560
@WoosukKwon
[V1] Add BlockTable class (vllm-project#11693)
06bfb51 
Signed-off-by: Woosuk Kwon <[email protected]>
@ruisearch42
[Misc] Fix typo for valid_tool_parses (vllm-project#11753)
f8fcca1 
Signed-off-by: Rui Qiao <[email protected]>
@ruisearch42
[V1] Refactor get_executor_cls (vllm-project#11754)
022c5c6
@lucas-tucker
[mypy] Forward pass function type hints in lora (vllm-project#11740)
9c74971 
Signed-off-by: lucast2021 <[email protected]>
Co-authored-by: lucast2021 <[email protected]>
@surajssd
k8s-config: Update the secret to use stringData (vllm-project#11679)
2a622d7 
Signed-off-by: Suraj Deshmukh <[email protected]>
@DarkLight1337
[VLM] Separate out profiling-related logic (vllm-project#11746)
996357e 
Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Doc][2/N] Reorganize Models and Usage sections (vllm-project#11755)
ee77fdb 
Signed-off-by: DarkLight1337 <[email protected]>
@ywang96
[Bugfix] Fix max image size for LLaVA-Onevision (vllm-project#11769)
9279b9f 
Signed-off-by: Roger Wang <[email protected]>
@youkaichao
[doc] explain how to add interleaving sliding window support (vllm-pr…
4ca5d40 
…oject#11771)

Signed-off-by: youkaichao <[email protected]>
@gshtras
Merge remote-tracking branch 'upstream/main'
4773c29
@gshtras
format
267c1a1
@gshtras gshtras merged commit 88e020d into main Jan 8, 2025
10 of 11 checks passed
@gshtras gshtras deleted the upstream_merge_25_1_6 branch January 8, 2025 15:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@shajrawi shajrawi shajrawi approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.