Skip to content

Pull requests: openvinotoolkit/openvino.genai

New pull request New
45 Open 1,471 Closed
45 Open 1,471 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

LLM: release plugin once pipeline is removed category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) no-match-files
#1627 opened Jan 24, 2025 by ilya-lavrenov • Draft 2025.1
@Wovchena @sammysun0711
Don't silence a error if a file can't be opened category: tokenizers Tokenizer class or submodule update
#1620 opened Jan 22, 2025 by Wovchena Loading… 2025.1
@pavel-esir
2
Add Phi-3.5-vision-instruct and Phi-3-vision-128k-instruct category: visual language Visual language pipeline no-match-files
#1619 opened Jan 22, 2025 by Wovchena Loading… 2025.0
@yatarkan
Increase priority for rt info to fix Phi-3.5-vision-instruct and Phi-3-vision-128k-instruct category: tokenizers Tokenizer class or submodule update no-match-files
#1618 opened Jan 22, 2025 by Wovchena Loading… 2025.0
@pavel-esir
2
[ Speculative decoding ] Support different tokenizers for draft and main models category: GHA CI based on Github actions category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1617 opened Jan 22, 2025 by iefode Loading…
1
[VLM] Set stop token ids from default generation config in VLM pipeline category: visual language Visual language pipeline
#1612 opened Jan 21, 2025 by yatarkan Loading… 2025.1
@ilya-lavrenov
8
Change npu to gpu in sample category: samples GenAI samples
#1608 opened Jan 20, 2025 by DimaPastushenkov Loading… 2025.1
@ilya-lavrenov
1
Samples build instructions no-match-files
#1604 opened Jan 20, 2025 by DimaPastushenkov Loading… 2025.1
@ilya-lavrenov @olpipi
2
[WA] Add API to release memory by unload plugin category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) do_not_merge no-match-files
#1600 opened Jan 20, 2025 by sammysun0711 • Draft
@ilya-lavrenov
2
[CB] Update Block manager assert category: continuous batching Continuous batching
#1569 opened Jan 16, 2025 by iefode • Draft 2025.1
@ilya-lavrenov
2
Update to the latest tokenizers with StringPack/Unpack from opset category: tokenizers Tokenizer class or submodule update
#1562 opened Jan 16, 2025 by pavel-esir Loading… 2025.0
@ilya-lavrenov
1
Pass pad_token_id as model compilation parameters category: LLM LLM pipeline (stateful, static)
#1556 opened Jan 15, 2025 by AsyaPronina Loading…
Cb by default int8 respect ir category: continuous batching Continuous batching category: LLM LLM pipeline (stateful, static) category: speculative decoding Speculative decoding do_not_merge no-match-files
#1552 opened Jan 15, 2025 by ilya-lavrenov Loading… 2025.0
@andrei-kochin
Debug qwen category: LLM LLM pipeline (stateful, static) category: NPU category: samples GenAI samples do_not_review
#1537 opened Jan 13, 2025 by AsyaPronina • Draft
Automatically apply chat template in non-chat scenarios category: cmake / build Cmake scripts category: GenAI C++ API Changes in GenAI C++ public headers category: GHA CI based on Github actions category: llm_bench Label for tool/llm_bench folder category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: tokenizers Tokenizer class or submodule update category: visual language Visual language pipeline category: WWB PR changes WWB no-match-files
#1533 opened Jan 13, 2025 by sbalandi Loading… 2025.1
@ilya-lavrenov @Wovchena
17
[Tokenizers] add max_lengh parametrisation to encode category: GenAI C++ API Changes in GenAI C++ public headers category: Python API Python API for GenAI category: tokenizers Tokenizer class or submodule update enhancement New feature or request
#1518 opened Jan 9, 2025 by pavel-esir • Draft 2025.1
3
Add MSVC Support For UTF-8 in Chat Sample category: samples GenAI samples
#1483 opened Jan 6, 2025 by sammysun0711 Loading…
Add a choice of how to end streaming from callback: STOP or CANCEL category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: LLM LLM pipeline (stateful, static) category: prompt lookup category: Python API Python API for GenAI category: samples GenAI samples category: speculative decoding Speculative decoding category: visual language Visual language pipeline category: whisper Whisper pipeline no-match-files
#1476 opened Jan 3, 2025 by sbalandi Loading… 2025.1
@ilya-lavrenov
23
Concurrency in stable-diffusion image generation category: cmake / build Cmake scripts category: GenAI C++ API Changes in GenAI C++ public headers category: samples GenAI samples category: text to image Text 2 image pipeline no-match-files
#1475 opened Jan 3, 2025 by dtrawins • Draft
@ilya-lavrenov
5
[LLM] Enabled CB by default category: LLM LLM pipeline (stateful, static) Code Freeze
#1455 opened Dec 30, 2024 by ilya-lavrenov Loading… 2025.0
@andrei-kochin
Add code quality checks to GitHub Actions category: cmake / build Cmake scripts category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: GHA CI based on Github actions category: llm_bench Label for tool/llm_bench folder category: LLM LLM pipeline (stateful, static) category: LoRA Low rank adapters category: prompt lookup category: Python API Python API for GenAI category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding category: text to image Text 2 image pipeline category: tokenizers Tokenizer class or submodule update category: visual language Visual language pipeline category: whisper Whisper pipeline no-match-files
#1453 opened Dec 30, 2024 by Cyber-Var Loading… 2025.1
@ilya-lavrenov
16
Pl bench category: cmake / build Cmake scripts category: continuous batching Continuous batching category: GenAI C++ API Changes in GenAI C++ public headers category: GHA CI based on Github actions category: LLM LLM pipeline (stateful, static) category: Python API Python API for GenAI category: samples GenAI samples category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding no-match-files
#1421 opened Dec 21, 2024 by iefode • Draft
Use get_max_new_tokens() insted of max_new_tokens field when stopping… category: continuous batching Continuous batching category: prompt lookup category: sampling Sampling / Decoding algorithms category: speculative decoding Speculative decoding
#1417 opened Dec 20, 2024 by michalkulakowski Loading…
@ilya-lavrenov @Wovchena @mzegla
7
add performance statistics for image generation category: cmake / build Cmake scripts category: GenAI C++ API Changes in GenAI C++ public headers category: Python API Python API for GenAI category: samples GenAI samples category: text to image Text 2 image pipeline
#1405 opened Dec 18, 2024 by xufang-lisa Loading…
@ilya-lavrenov @likholat
6
Add performance statistics for speculative decoding test category: continuous batching Continuous batching category: prompt lookup category: samples GenAI samples category: speculative decoding Speculative decoding
#1403 opened Dec 18, 2024 by xufang-lisa • Draft
@iefode
ProTip! Filter pull requests by the default branch with base:master.