Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-43418: Divide AP pipeline into preload and prompt subsets #191

Merged
merged 3 commits into from
Sep 4, 2024

Commits on Aug 30, 2024

  1. Set up ExitStack for next_visit_handler cleanups.

    Using a stack for the cleanups reduces the number of nested blocks that
    need to be added to properly handle various objects, at the cost of one
    block for the stack itself. This lets try blocks be reserved purely for
    exception handling.
    kfindeisen committed Aug 30, 2024
    Configuration menu
    Copy the full SHA
    28ae963 View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Move existing cleanups to ExitStack.

    This fixes a bug where the preprocessing runs would not be cleaned up
    if the service timed out while waiting for raws.
    kfindeisen committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    0ccf07f View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. Split AP pipelines into preload and prompt subsets.

    The two subsets will now be run separately. There is also an
    "afterburner" subset, but it will not be run by Prompt Processing
    at all.
    kfindeisen committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    676520d View commit details
    Browse the repository at this point in the history