Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support finetuning with LoRA #431

Merged
merged 9 commits into from
Sep 6, 2023
Merged

Support finetuning with LoRA #431

merged 9 commits into from
Sep 6, 2023

Commits on Aug 17, 2023

  1. Add support for LoRA models

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    acf2ed3 View commit details
    Browse the repository at this point in the history

  2. Workaround random bug

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    a5c9ef1 View commit details
    Browse the repository at this point in the history

  3. Pass only trainable params to the optimizer in trainer

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    326984b View commit details
    Browse the repository at this point in the history

  4. Add peft dependency

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    f4b0362 View commit details
    Browse the repository at this point in the history

  5. Fix edge case in peft + pipelines

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    6a443b0 View commit details
    Browse the repository at this point in the history

  6. Fix dropout check

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    98cb02a View commit details
    Browse the repository at this point in the history

  7. Add notebook for Whisper LoRA

    @katalinic-gc
    katalinic-gc committed Aug 17, 2023
    Configuration menu
    Copy the full SHA
    60fa56c View commit details
    Browse the repository at this point in the history

Commits on Sep 1, 2023

  1. Simplify pipelines logic, requiring adapter weights to be merged in

    @katalinic-gc
    katalinic-gc committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    7427191 View commit details
    Browse the repository at this point in the history

  2. Remove notebook for now

    @katalinic-gc
    katalinic-gc committed Sep 1, 2023
    Configuration menu
    Copy the full SHA
    8f2065b View commit details
    Browse the repository at this point in the history