Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[experimental]backend: add new oneDNN backend #855

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from

Commits on Jun 28, 2024

  1. Add oneDNN(DNNL) backend (new simplified version)

    * Backend logic is based on BLAS backend
    * Implemented support for MUL_MAT operation
    * Implemented MUL_MAT fusing with subsequential ADD as bias-add
    * Implemented weights 'pre-packing'(reordering) for MUL_MAT operation
    
    Notes:
    * This it is the second version of the DNNL-backend based on refactored ggml backend support implemented together with BLAS-backend
    * It is recommended to enable GGML_OPENMP when oneDNN compiled with DNNL_CPU_RUNTIME=OMP(default)
    rfsaliev committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    a5d602d View commit details
    Browse the repository at this point in the history