Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix GPTQ for inputs with batch size != 1 and with seq len == 1 #3002

Merged
merged 4 commits into from
Oct 24, 2024
Merged

Fix GPTQ for inputs with batch size != 1 and with seq len == 1 #3002

merged 4 commits into from
Oct 24, 2024

Commits on Oct 21, 2024

  1. Fix for inputs with batch size != 1 in data-aware weight compression

    @ljaljushkin
    ljaljushkin committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    1214ce8 View commit details
    Browse the repository at this point in the history

  2. fixed errors with backup_mode

    @ljaljushkin
    ljaljushkin committed Oct 21, 2024
    Configuration menu
    Copy the full SHA
    2dc74db View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. supported corner case with batch and seq len =1

    @ljaljushkin
    ljaljushkin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    dba63e8 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/develop' into nl/3d_activations_… 

    …weight_compression
    @ljaljushkin
    ljaljushkin committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    0465015 View commit details
    Browse the repository at this point in the history