Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Debug pipeline #1566

Draft
wants to merge 6 commits into
base: main
Choose a base branch
from
Draft

Debug pipeline #1566

wants to merge 6 commits into from

Commits on Jan 26, 2024

  1. warning

    @ProExpertProg
    ProExpertProg committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    9346df5 View commit details
    Browse the repository at this point in the history

  2. [TextGeneration] Split up prep_for_generation operator, handle edge… 

    … cases, handle kv_cache full during prefill (#1562)

* split prep_for_generation operator

* fix logits

* update non-kv cache pipeline and tests

* add tests to address edge cases

* add condition to check of kv_cache full during prompt inference, add test to cover this case, revert debugging changes

* fix typing

* remove commented code

* remove irrelevant condition

* address PR comments
    @dsikka @ProExpertProg
    dsikka authored and ProExpertProg committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    4a4c8d1 View commit details
    Browse the repository at this point in the history

  3. Hacking up a debug pipeline

    @mgoin @ProExpertProg
    mgoin authored and ProExpertProg committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    7a2608d View commit details
    Browse the repository at this point in the history

  4. Layer summary

    @mgoin @ProExpertProg
    mgoin authored and ProExpertProg committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    2c861fb View commit details
    Browse the repository at this point in the history

  5. Save files

    @mgoin @ProExpertProg
    mgoin authored and ProExpertProg committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    f1b5f50 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2024

  1. improved output file names

    @ProExpertProg
    ProExpertProg committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    7a018d9 View commit details
    Browse the repository at this point in the history