Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix deepseeed crash with Sentence Transformer Trainer #1328

Merged
merged 18 commits into from
Sep 24, 2024
Merged

Fix deepseeed crash with Sentence Transformer Trainer #1328

merged 18 commits into from
Sep 24, 2024

Commits on Sep 12, 2024

  1. Fix deepseeed crash with Sentence Transformer Trainer

    @nngokhale
    nngokhale committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    e9fd825 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2024

  1. add examples for mistral 7b model with deepspeed zero2/3

    @ZhengHongming888
    ZhengHongming888 committed Sep 13, 2024
    Configuration menu
    Copy the full SHA
    b726f9a View commit details
    Browse the repository at this point in the history

Commits on Sep 14, 2024

  1. add the LoRA + gradient_checkpointing example for single card

    @ZhengHongming888
    ZhengHongming888 committed Sep 14, 2024
    Configuration menu
    Copy the full SHA
    a3e9af9 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. Update examples/sentence-transformers-training/nli/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    b0c523a View commit details
    Browse the repository at this point in the history

  2. Update examples/sentence-transformers-training/nli/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c5a8f50 View commit details
    Browse the repository at this point in the history

  3. Update examples/sentence-transformers-training/nli/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    e5674c8 View commit details
    Browse the repository at this point in the history

  4. Update examples/sentence-transformers-training/nli/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a93bc51 View commit details
    Browse the repository at this point in the history

  5. Update examples/sentence-transformers-training/sts/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    17fa098 View commit details
    Browse the repository at this point in the history

  6. Update examples/sentence-transformers-training/sts/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    e6301af View commit details
    Browse the repository at this point in the history

  7. Update examples/sentence-transformers-training/sts/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    a4768e4 View commit details
    Browse the repository at this point in the history

  8. Update examples/sentence-transformers-training/sts/README.md 

    Co-authored-by: Yaser Afshar <[email protected]>
    @ZhengHongming888 @yafshar
    ZhengHongming888 and yafshar authored Sep 16, 2024
    Configuration menu
    Copy the full SHA
    7948a92 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. Rename st_gaudi_transformer_tokenize.py to st_gaudi_transformer.py

    @nngokhale
    nngokhale committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    1a7886f View commit details
    Browse the repository at this point in the history

  2. Add source link of changes

    @nngokhale
    nngokhale committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    e45f3a5 View commit details
    Browse the repository at this point in the history

  3. Add peft LoRA and deepspeed options to training_stsbenchmark

    @nngokhale
    nngokhale committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    cd2bd4a View commit details
    Browse the repository at this point in the history

  4. Add peft LoRA and deepspeed options to training_nli

    @nngokhale
    nngokhale committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    13967df View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Add saving merged model for peft training

    @nngokhale
    nngokhale committed Sep 18, 2024
    Configuration menu
    Copy the full SHA
    dcadfdf View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Make style

    @nngokhale
    nngokhale committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f9ccd14 View commit details
    Browse the repository at this point in the history

  2. Add peft sentence transformer training tests

    @nngokhale
    nngokhale committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    f6569d3 View commit details
    Browse the repository at this point in the history