Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unified pipeline for models & support phi3 model #45

Merged
merged 24 commits into from
Jul 3, 2024
Merged

Unified pipeline for models & support phi3 model #45

merged 24 commits into from
Jul 3, 2024

Commits on Jun 19, 2024

  1. Optional logprobs & fix llama eos/stop token

    @guoqingbao
    guoqingbao committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    b7c2e3d View commit details
    Browse the repository at this point in the history

  2. Cargo fmt

    @guoqingbao
    guoqingbao committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    a449cad View commit details
    Browse the repository at this point in the history

  3. Mention other options for chat completion request

    @guoqingbao
    guoqingbao committed Jun 19, 2024
    Configuration menu
    Copy the full SHA
    f7f1988 View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2024

  1. Merge branch 'EricLBuehler:master' into master

    @guoqingbao
    guoqingbao authored Jun 20, 2024
    Configuration menu
    Copy the full SHA
    61cc400 View commit details
    Browse the repository at this point in the history

  2. Configurable kvcache & fix repeat chat history

    @guoqingbao
    guoqingbao committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    ae7f54c View commit details
    Browse the repository at this point in the history

  3. Improve readability

    @guoqingbao
    guoqingbao committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    78f184c View commit details
    Browse the repository at this point in the history

  4. Merge branch 'master' of github.com:guoqingbao/candle-vllm

    @guoqingbao
    guoqingbao committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    b476402 View commit details
    Browse the repository at this point in the history

  5. Instructions for ChatUI & add demo chat video

    @guoqingbao
    guoqingbao committed Jun 20, 2024
    Configuration menu
    Copy the full SHA
    597aaec View commit details
    Browse the repository at this point in the history

Commits on Jun 24, 2024

  1. Merge branch 'EricLBuehler:master' into master

    @guoqingbao
    guoqingbao authored Jun 24, 2024
    Configuration menu
    Copy the full SHA
    e5b93a0 View commit details
    Browse the repository at this point in the history

  2. Optimization for decoding stage & try to fix blocktable issue

    @guoqingbao
    guoqingbao committed Jun 24, 2024
    Configuration menu
    Copy the full SHA
    efe8c46 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2024

  1. Support stream response for chat completion

    @guoqingbao
    guoqingbao committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    7c13746 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' of github.com:guoqingbao/candle-vllm

    @guoqingbao
    guoqingbao committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    aab3a40 View commit details
    Browse the repository at this point in the history

  3. Update ReadMe & demo video

    @guoqingbao
    guoqingbao committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    e2e8436 View commit details
    Browse the repository at this point in the history

  4. Reduce demo video size

    @guoqingbao
    guoqingbao committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    30d4e99 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Fix stream generation hang in release mode

    @guoqingbao
    guoqingbao committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    0d9fc0b View commit details
    Browse the repository at this point in the history

  2. Reduce the buffer size & update ReadMe

    @guoqingbao
    guoqingbao committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    7a137aa View commit details
    Browse the repository at this point in the history

  3. Fix LLaMa2 prompt instruction (for long conversation)

    @guoqingbao
    guoqingbao committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    37c760a View commit details
    Browse the repository at this point in the history

  4. Cargo fmt

    @guoqingbao
    guoqingbao committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    6d21d9e View commit details
    Browse the repository at this point in the history

  5. Padding to avoid block allocation issue & revision for prompt instruc… 

    …tion
    @guoqingbao
    guoqingbao committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    47ae004 View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2024

  1. Merge branch 'master' of github.com:guoqingbao/candle-vllm

    @guoqingbao
    guoqingbao committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    54667ef View commit details
    Browse the repository at this point in the history

  2. Unfied pipeline for models & support phi3 model

    @guoqingbao
    guoqingbao committed Jul 1, 2024
    Configuration menu
    Copy the full SHA
    df42cb8 View commit details
    Browse the repository at this point in the history

Commits on Jul 2, 2024

  1. Fix padding strategy

    @guoqingbao
    guoqingbao committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    42ab769 View commit details
    Browse the repository at this point in the history

  2. Cargo fmt

    @guoqingbao
    guoqingbao committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    8164981 View commit details
    Browse the repository at this point in the history

  3. Update ReadMe for supported models

    @guoqingbao
    guoqingbao committed Jul 2, 2024
    Configuration menu
    Copy the full SHA
    c93301a View commit details
    Browse the repository at this point in the history