Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tensor parallel distributed strategy without using deepspeed #1121

Merged
merged 10 commits into from
Jul 30, 2024
Merged

Tensor parallel distributed strategy without using deepspeed #1121

merged 10 commits into from
Jul 30, 2024

Commits on Jul 30, 2024

  1. TP reference - ibm foundation-model-stack

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    080a6a1 View commit details
    Browse the repository at this point in the history

  2. Code cleanup -removed unused code

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    4feb085 View commit details
    Browse the repository at this point in the history

  3. make style, updated README for distributed_strategy="tp" 

    Added test in tests/test_text_generation_example.py
add a link to the original implementation for the referenced files
    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    a73c6f6 View commit details
    Browse the repository at this point in the history

  4. Updated LlamaConfig with distributed_strategy

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    cca19c2 View commit details
    Browse the repository at this point in the history

  5. Updated README.md and test data-set path

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    dbb316b View commit details
    Browse the repository at this point in the history

  6. distributed_strategy is not JSON serializable

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    182baf5 View commit details
    Browse the repository at this point in the history

  7. Updated README.md 

    make style changes
    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    524d1cc View commit details
    Browse the repository at this point in the history

  8. Renamed the distributed_strategy parameter to parallel_strategy

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    bb19c4e View commit details
    Browse the repository at this point in the history

  9. Updated cache_dir for parallel_strategy = tp

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    6a04a8c View commit details
    Browse the repository at this point in the history

  10. Updated the perf number for test test_text_generation_distributed_tp

    @kalyanjkk
    kalyanjkk committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    3fd17e7 View commit details
    Browse the repository at this point in the history