Add DenseMoELayer and wire it up in Mixtral/Deepseek V2 (#2537)
#1216
Annotations
1 warning
|
The following actions use a deprecated Node.js version and will be forced to run on node20: docker/[email protected], docker/build-push-action@v4. For more info: https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/
|
Loading