Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

metal : refactor kernel args into structs #10238

Merged
merged 20 commits into from
Nov 17, 2024
Merged

metal : refactor kernel args into structs #10238

merged 20 commits into from
Nov 17, 2024

Commits on Nov 17, 2024

  1. metal : add kernel arg structs (wip)

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    051ff11 View commit details
    Browse the repository at this point in the history

  2. metal : fattn args 

    ggml-ci
    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    362a3f3 View commit details
    Browse the repository at this point in the history

  3. metal : cont + avoid potential int overflow [no ci]

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    cbae088 View commit details
    Browse the repository at this point in the history

  4. metal : mul mat struct (wip)

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    0d0c54f View commit details
    Browse the repository at this point in the history

  5. cont : mul mat vec

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    07bc761 View commit details
    Browse the repository at this point in the history

  6. cont : pass by reference

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    4af3a87 View commit details
    Browse the repository at this point in the history

  7. cont : args is first argument

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    481b05d View commit details
    Browse the repository at this point in the history

  8. cont : use char ptr

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    d2a0550 View commit details
    Browse the repository at this point in the history

  9. cont : shmem style

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    f759814 View commit details
    Browse the repository at this point in the history

  10. cont : thread counters style

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    cd89d1a View commit details
    Browse the repository at this point in the history

  11. cont : mul mm id 

    ggml-ci
    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    ec18f96 View commit details
    Browse the repository at this point in the history

  12. cont : int safety + register optimizations 

    ggml-ci
    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    1a8f8df View commit details
    Browse the repository at this point in the history

  13. metal : GGML_OP_CONCAT 

    ggml-ci
    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    4c1c721 View commit details
    Browse the repository at this point in the history

  14. metal : GGML_OP_ADD, GGML_OP_SUB, GGML_OP_MUL, GGML_OP_DIV

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    281fa05 View commit details
    Browse the repository at this point in the history

  15. metal : GGML_OP_REPEAT

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    d7488ba View commit details
    Browse the repository at this point in the history

  16. metal : GGML_OP_CPY

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    2b86f84 View commit details
    Browse the repository at this point in the history

  17. metal : GGML_OP_RMS_NORM

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    b438ff7 View commit details
    Browse the repository at this point in the history

  18. metal : GGML_OP_NORM

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    f018669 View commit details
    Browse the repository at this point in the history

  19. metal : add TODOs for rest of ops

    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    1c60302 View commit details
    Browse the repository at this point in the history

  20. ggml : add ggml-metal-impl.h 

    ggml-ci
    @ggerganov
    ggerganov committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    a112eb4 View commit details
    Browse the repository at this point in the history