Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scheduler methods #13

Closed
wants to merge 16 commits into from
Closed

Scheduler methods #13

wants to merge 16 commits into from

Commits on Oct 21, 2024

  1. add two new load-balance-method

    @josephydu
    josephydu committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    53b8f0f View commit details
    Browse the repository at this point in the history

  2. change the method name from zmq_raix to pre_radix

    @josephydu
    josephydu committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    13387d3 View commit details
    Browse the repository at this point in the history

  3. Maintain seq_lens_sum to make more FlashInfer operations non-blocking (… 

    …sgl-project#1741)
    @merrymercy
    merrymercy authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    09603c6 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' of https://github.com/sgl-project/sglang into sch… 

    …eduler_methods
    @josephydu
    josephydu committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    e1131c8 View commit details
    Browse the repository at this point in the history

  5. Fix prefill oom (sgl-project#1743)

    @hnyls2002
    hnyls2002 authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    efb099c View commit details
    Browse the repository at this point in the history

  6. Faster overlap mode scheduler (sgl-project#1738)

    @merrymercy
    merrymercy authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    7ce3606 View commit details
    Browse the repository at this point in the history

  7. misc: add CODEOWNERS (sgl-project#1737)

    @zhyncs
    zhyncs authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    e68b9e7 View commit details
    Browse the repository at this point in the history

  8. Fix sliding window attention and gemma-2 unit tests in CI (sgl-projec… 

    …t#1746)
    @merrymercy
    merrymercy authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    0061128 View commit details
    Browse the repository at this point in the history

  9. Llama3.2 vision model support (sgl-project#1551)

    @hnyls2002
    hnyls2002 authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    94cde10 View commit details
    Browse the repository at this point in the history

  10. Update max_req_len and max_req_input_len (sgl-project#1748)

    @hnyls2002
    hnyls2002 authored Oct 21, 2024
    Configuration menu
    Copy the full SHA
    5e1558f View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. Release v0.3.4.post1 (sgl-project#1749)

    @merrymercy
    merrymercy authored Oct 22, 2024
    Configuration menu
    Copy the full SHA
    1f26e8b View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Fix edge case for truncated (sgl-project#1747)

    @ByronHsu
    ByronHsu authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    17536e7 View commit details
    Browse the repository at this point in the history

  2. Fuse more ops & Simplify token mapping (sgl-project#1758)

    @merrymercy
    merrymercy authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    ad4125d View commit details
    Browse the repository at this point in the history

  3. [API] add get memory pool size (sgl-project#1760) 

    Co-authored-by: Byron Hsu <[email protected]>
    @Ying1123 @ByronHsu
    Ying1123 and ByronHsu authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    2fce449 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'upstream/main' into scheduler_methods 

    merge main
    @josephydu
    josephydu committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    c7c1520 View commit details
    Browse the repository at this point in the history

  5. fix bug in comments

    @josephydu
    josephydu committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    f211917 View commit details
    Browse the repository at this point in the history