Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Starcoder2 : KVCache and flash attention (FusedSDPA) enablement #1149

Merged
merged 21 commits into from
Aug 6, 2024
Merged

Starcoder2 : KVCache and flash attention (FusedSDPA) enablement #1149

merged 21 commits into from
Aug 6, 2024

Commits on Jun 26, 2024

  1. fix from Mandy

    @12010486
    12010486 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    6bc11df View commit details
    Browse the repository at this point in the history

  2. Adding KVCache

    @12010486
    12010486 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    53e28cf View commit details
    Browse the repository at this point in the history

  3. Update GaudiStarcoder2ForCausalLM

    @12010486
    12010486 committed Jun 26, 2024
    Configuration menu
    Copy the full SHA
    fd023f3 View commit details
    Browse the repository at this point in the history

  4. Update run_lm_eval.py

    @12010486
    12010486 authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    fe82d14 View commit details
    Browse the repository at this point in the history

  5. Update utils.py

    @12010486
    12010486 authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    f60b32b View commit details
    Browse the repository at this point in the history

  6. Update utils.py

    @12010486
    12010486 authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    43337e3 View commit details
    Browse the repository at this point in the history

  7. Update trainer.py

    @12010486
    12010486 authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    04f1d36 View commit details
    Browse the repository at this point in the history

  8. First fix on Starcoder2Model

    @12010486
    12010486 authored Jun 26, 2024
    Configuration menu
    Copy the full SHA
    b136b1d View commit details
    Browse the repository at this point in the history

Commits on Jun 27, 2024

  1. Wrong alignment fix

    @12010486
    12010486 authored Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6e15483 View commit details
    Browse the repository at this point in the history

  2. Added GaudiStarcoder2Attention function block

    @abhatkal
    abhatkal committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6d0e054 View commit details
    Browse the repository at this point in the history

  3. Complete GaudiStarcoder2Model

    @12010486 @abhatkal
    12010486 authored and abhatkal committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    49c8e50 View commit details
    Browse the repository at this point in the history

  4. Update __init__.py with GaudiStarcoder2Model

    @12010486 @abhatkal
    12010486 authored and abhatkal committed Jun 27, 2024
    Configuration menu
    Copy the full SHA
    6482e41 View commit details
    Browse the repository at this point in the history

Commits on Jul 9, 2024

  1. Added KVCache class and updated the starcoder2 code to call the same

    @abhatkal
    abhatkal committed Jul 9, 2024
    Configuration menu
    Copy the full SHA
    8fb3d03 View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2024

  1. Merge commits from latest main

    @abhatkal
    abhatkal committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    92ac4e4 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' of https://github.com/huggingface/optimum-habana … 

    …into abhatkal/starcoder2
    @abhatkal
    abhatkal committed Jul 22, 2024
    Configuration menu
    Copy the full SHA
    b6091ac View commit details
    Browse the repository at this point in the history

  3. fix q_length

    @abhilash1910
    abhilash1910 authored Jul 22, 2024
    Configuration menu
    Copy the full SHA
    f702e37 View commit details
    Browse the repository at this point in the history

Commits on Jul 26, 2024

  1. Starcoder2 : Cleaned up stale comments

    @abhatkal
    abhatkal committed Jul 26, 2024
    Configuration menu
    Copy the full SHA
    aaa230d View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. Merge branch 'main' into abhatkal/starcoder2

    @abhilash1910
    abhilash1910 authored Aug 2, 2024
    Configuration menu
    Copy the full SHA
    c4fcdd1 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Remove stray comments

    @ssarkar2
    ssarkar2 authored Aug 6, 2024
    Configuration menu
    Copy the full SHA
    0956465 View commit details
    Browse the repository at this point in the history

  2. Update : Starcoder2 : Formatted the code

    @abhatkal
    abhatkal committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    a6b6ff0 View commit details
    Browse the repository at this point in the history

  3. Make style

    @regisss
    regisss committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    35374d9 View commit details
    Browse the repository at this point in the history